adding new tables for ports

This commit is contained in:
Mark Bishop
2018-09-11 19:19:38 -07:00
parent ef0c97eb59
commit 715679d4dc
6 changed files with 516 additions and 23 deletions
@@ -98,7 +98,7 @@ Next, set API permissions for Rancher within Azure.
<br/>
- **Access the directory as the signed-in user**
- **Read directory data**
- **Read all groups**
- **Read all groups**π
- **Read all users' full profiles**
- **Read all users' basic profiles**
- **Sign in and read user profile**
@@ -11,47 +11,61 @@ To operate properly, Rancher requires a number of ports to be open on Rancher no
The following table lists the ports that need to be open to/from nodes that are running the `rancher/rancher` container ([Single Node Install]({{< baseurl >}}/rancher/v2.x/en/installation/single-node-install/)) or `cattle` deployment pods ([High Availability Install]({{< baseurl >}}/rancher/v2.x/en/installation/ha-server-install/)).
| Protocol | Port | Source | Destination | Description |
|:--------:|:-----------------:|----------------------------------------------------------------------------------------------------------|----------------------------------------------------------|--------------------------------------------|
| TCP | 80 | Load balancer/reverse proxy | - | HTTP traffic to Rancher UI/API |
| TCP | 443 | Load balancer/reverse proxy </br> Otherwise IPs of all cluster nodes and other Rancher API/UI clients. | - | HTTPS traffic to Rancher UI/API |
| TCP | 443 | - | 35.160.43.145</br>35.167.242.46</br>52.33.59.17 | Rancher catalog (git.rancher.io) |
| TCP | 22 | - | Any node created using Node Driver | SSH provisioning of node by Node Driver |
| TCP | 2376 | - | Any node created using Node Driver | Docker daemon TLS port used by Node Driver |
| TCP | Provider dependent| - | Port of the Kubernetes API Endpoint in Hosted Clusters | Kubernetes API |
----
{{< ports-rancher-nodes >}}
## Kubernetes Cluster Nodes
The required ports for cluster nodes vary across different methods for creating clusters.
### Hosted/Imported Kubernetes Clusters
>**Tip:**
>
>If security isn't a large concern and you're okay with opening a few additional ports, you can use the table in [Commonly Used Ports](#commonly-used-ports) as your port reference instead of the comprehensive tables below.
The following table depicts the port requirements for [Hosted]({{< baseurl >}}/rancher/v2.x/en/cluster-provisioning/hosted-kubernetes-clusters) and [Imported]({{< baseurl >}}/rancher/v2.x/en/cluster-provisioning/imported-clusters/) clusters.
{{% tabs %}}
![Hosted/Imported Port Requirements]({{< baseurl >}}/img/rancher/port-table-hosted-imported.png)
### Rancher Launched Kubernetes Cluster (Instrastructure Nodes)
{{% tab "IaaS Clusters" %}}
The following table depicts the port requirements for [Rancher Launched Kubernetes]({{< baseurl >}}/rancher/v2.x/en/cluster-provisioning/rke-clusters/) with nodes created in an [Infrastructure Provider]({{< baseurl >}}/rancher/v2.x/en/cluster-provisioning/rke-clusters/node-pools/).
>**Note:**
>The required ports are automatically opened by Rancher during creation of clusters in cloud providers like Amazon EC2 or DigitalOcean.
![RKE Infrastructure Port Requirements]({{< baseurl >}}/img/rancher/port-table-infrastructure-nodes.png)
{{< ports-iaas-nodes >}}
### Rancher Launched Kubernetes Cluster (Custom Nodes)
{{% /tab %}}
{{% tab "Custom Cluster" %}}
The following table depicts the port requirements for [Rancher Launched Kubernetes]({{< baseurl >}}/rancher/v2.x/en/cluster-provisioning/rke-clusters/) with [Custom Nodes]({{< baseurl >}}/rancher/v2.x/en/cluster-provisioning/rke-clusters/custom-nodes/).
![RKE Custom Port Requirements]({{< baseurl >}}/img/rancher/port-table-custom-nodes.png)
{{< ports-custom-nodes >}}
## Annex
{{% /tab %}}
### Port Descriptions
{{% tab "Hosted Clusters" %}}
Description of common ports referenced in the above requirements.
The following table depicts the port requirements for [hosted clusters]({{< baseurl >}}/rancher/v2.x/en/cluster-provisioning/hosted-kubernetes-clusters).
{{< ports-imported-hosted >}}
{{% /tab %}}
{{% tab "Imported Clusters" %}}
The following table depicts the port requirements for [imported clusters]({{< baseurl >}}/rancher/v2.x/en/cluster-provisioning/imported-clusters/).
{{< ports-imported-hosted >}}
{{% /tab %}}
{{% /tabs %}}
## Other Port Considerations
### Commonly Used Ports
These ports are typically opened on your Kubernetes nodes, regardless of what type of cluster it is.
| Protocol | Port | Description |
|:--------: |:----------------: |------------------------------------------------- |
@@ -70,7 +84,14 @@ Description of common ports referenced in the above requirements.
### Local Node Traffic
Ports marked as `local traffic` in the above requirements (e.g. `9099/tcp`) are used for Kubernetes healthchecks (`livenessProbe` and`readinessProbe`).
These healthchecks are executed on the node itself. In most cloud environments, this local traffic is allowed by default. When you have applied strict host firewall policies on the node, or when you are using nodes that have multiple interfaces (multihomed), this traffic may get blocked. In this case, you have to explicitely allow this traffic in your host firewall, or in case of public/private cloud hosted machines (i.e. AWS or OpenStack), in your security group configuration. Keep in mind that when using a security group as Source or Destination in your security group, that this only applies to the private interface of the nodes/instances.
These healthchecks are executed on the node itself. In most cloud environments, this local traffic is allowed by default.
However, this traffic may be blocked when:
- You have applied strict host firewall policies on the node.
- You are using nodes that have multiple interfaces (multihomed).
In these cases, you have to explicitly allow this traffic in your host firewall, or in case of public/private cloud hosted machines (i.e. AWS or OpenStack), in your security group configuration. Keep in mind that when using a security group as source or destination in your security group, explicitly opening ports only applies to the private interface of the nodes/instances.
### Rancher AWS EC2 security group
+181
View File
@@ -0,0 +1,181 @@
<table>
<thead>
<tr>
<th>From / To</th>
<th>Rancher Nodes</th>
<th>etcd Plane Nodes</th>
<th>Control Plane Nodes</th>
<th>Worker Plane Nodes</th>
<th>External Load Balancer</th>
<th>Internet</th>
</tr>
</thead>
<tbody>
<tr>
<td >Rancher Nodes <sup>(1)</sup></td>
<td></td>
<td></td>
<td></td>
<td></td>
<td></td>
<td style="background-color: #3497DA">git.rancher.io <sup>(2)</sup>:<br>35.160.43.145:32<br>35.167.242.46:32<br>52.33.59.17:32</td>
</tr>
<tr>
<td rowspan="5">etcd Plane Nodes</td>
<td rowspan="5" style="background-color: #3497DA">443 TCP <sup>(3)</sup></td>
<td style="background-color: #3497DA">2379 TCP</td>
<td></td>
<td></td>
<td rowspan="5" style="background-color: #3497DA">443 TCP</td>
<td></td>
</tr>
<tr>
<td style="background-color: #3497DA">2380 TCP</td>
<td></td>
<td></td>
<td></td>
</tr>
<tr>
<td></td>
<td style="background-color: #3497DA">6443 TCP</td>
<td></td>
<td></td>
</tr>
<tr>
<td colspan="3" style="background-color: #3497DA">8472 UDP</td>
<td></td>
</tr>
<tr>
<td style="background-color: #3497DA">9099 TCP <sup>(4)</sup></td>
<td></td>
<td></td>
<td></td>
</tr>
<tr>
<td rowspan="7">Control Plane Nodes</td>
<td rowspan="7" style="background-color: #3497DA">443 TCP <sup>(3)</sup></td>
<td style="background-color: #3497DA">2379 TCP</td>
<td></td>
<td></td>
<td rowspan="7" style="background-color: #3497DA">443 TCP</td>
<td></td>
</tr>
<tr>
<td style="background-color: #3497DA">2380 TCP</td>
<td></td>
<td></td>
<td></td>
</tr>
<tr>
<td></td>
<td style="background-color: #3497DA">6443 TCP</td>
<td></td>
<td></td>
</tr>
<tr>
<td colspan="3" style="background-color: #3497DA">8472 UDP</td>
<td></td>
</tr>
<tr>
<td colspan="3" style="background-color: #3497DA">10250 TCP</td>
<td></td>
</tr>
<tr>
<td></td>
<td style="background-color: #3497DA">9099 TCP <sup>(4)</sup></td>
<td></td>
<td></td>
</tr>
<tr>
<td></td>
<td style="background-color: #3497DA">10254 TCP <sup>(4)</sup></td>
<td></td>
<td></td>
</tr>
<tr>
<td rowspan="4">Worker Plane Nodes</td>
<td rowspan="4" style="background-color: #3497DA">443 TCP <sup>(3)</sup></td>
<td></td>
<td style="background-color: #3497DA">6443 TCP</td>
<td></td>
<td rowspan="4" style="background-color: #3497DA">443 TCP</td>
<td></td>
</tr>
<tr>
<td colspan="3" style="background-color: #3497DA">8472 UDP</td>
<td></td>
</tr>
<tr>
<td></td>
<td></td>
<td style="background-color: #3497DA">9099 TCP <sup>(4)</sup></td>
<td></td>
</tr>
<tr>
<td></td>
<td></td>
<td style="background-color: #3497DA">10254 TCP <sup>(4)</sup></td>
<td></td>
</tr>
<tr>
<td rowspan="2">External Load Balancer <sup>(5)</sup></td>
<td style="background-color: #3497DA">80 TCP</td>
<td></td>
<td></td>
<td></td>
<td></td>
<td></td>
</tr>
<tr>
<td style="background-color: #3497DA">443 TCP <sup>(6)</sup></td>
<td></td>
<td></td>
<td></td>
<td></td>
<td></td>
</tr>
<tr>
<td rowspan="2">API / UI Clients</td>
<td style="background-color: #3497DA">80 TCP <sup>(3)</sup></td>
<td></td>
<td></td>
<td></td>
<td style="background-color: #3497DA">80 TCP<br></td>
<td></td>
</tr>
<tr>
<td style="background-color: #3497DA">443 TCP <sup>(3)</sup></td>
<td></td>
<td></td>
<td></td>
<td style="background-color: #3497DA">443 TCP</td>
<td></td>
</tr>
<tr>
<td rowspan="3">Workload Clients</td>
<td></td>
<td></td>
<td></td>
<td style="background-color: #3497DA">30000-32767 TCP/UDP<br>(nodeport)</td>
<td></td>
<td></td>
</tr>
<tr>
<td></td>
<td></td>
<td colspan="2" style="background-color: #3497DA">80 TCP (Ingress)</td>
<td></td>
<td></td>
</tr>
<tr>
<td></td>
<td></td>
<td colspan="2" style="background-color: #3497DA">443 TCP (Ingress)</td>
<td></td>
<td></td>
</tr>
<tr>
<td colspan="7">Notes:<br><br>1. Nodes running standalone server or Rancher HA deployment.<br>2. Required to fetch Rancher chart library.<br>3. Only without external load balancer.<br>4. Local traffic to the node itself (not across nodes).<br>5. Load balancer / proxy that handles tragging to the Rancher UI / API.<br>6. Only if SSL is not terminated at external load balancer.</td>
</tr>
</tbody>
</table>
+184
View File
@@ -0,0 +1,184 @@
<table style="border-style:solid;">
<thead>
<tr>
<th>From / To</th>
<th>Rancher Nodes</th>
<th>etcd Plane Nodes</th>
<th>Control Plane Nodes</th>
<th>Worker Plane Nodes</th>
<th>External Load Balancer</th>
<th>Internet</th>
</tr>
</thead>
<tbody>
<tr>
<td rowspan="2">Rancher Nodes <sup>(1)</sup></td>
<td></td>
<td colspan="3" style="background-color: #3497DA">22 TCP</td>
<td></td>
<td rowspan="2" style="background-color: #3497DA">git.rancher.io <sup>(2)</sup>:<br>35.160.43.145:32<br>35.167.242.46:32<br>52.33.59.17:32</td>
</tr>
<tr>
<td></td>
<td colspan="3" style="background-color: #3497DA">2376 TCP</td>
<td></td>
</tr>
<tr>
<td rowspan="5">etcd Plane Nodes</td>
<td rowspan="5" style="background-color: #3497DA">443 TCP <sup>(3)</sup></td>
<td style="background-color: #3497DA">2379 TCP</td>
<td></td>
<td></td>
<td rowspan="5" style="background-color: #3497DA">443 TCP</td>
<td></td>
</tr>
<tr>
<td style="background-color: #3497DA">2380 TCP</td>
<td></td>
<td></td>
<td></td>
</tr>
<tr>
<td></td>
<td style="background-color: #3497DA">6443 TCP</td>
<td></td>
<td></td>
</tr>
<tr>
<td colspan="3" style="background-color: #3497DA">8472 TCP</td>
<td></td>
</tr>
<tr>
<td style="background-color: #3497DA">9099 TCP <sup>(4)</sup></td>
<td></td>
<td></td>
<td></td>
</tr>
<tr>
<td rowspan="7">Control Plane Nodes</td>
<td rowspan="7" style="background-color: #3497DA">443 TCP <sup>(3)</sup></td>
<td style="background-color: #3497DA">2379 TCP</td>
<td></td>
<td></td>
<td rowspan="7" style="background-color: #3497DA">443 TCP</td>
<td></td>
</tr>
<tr>
<td style="background-color: #3497DA">2380 TCP</td>
<td></td>
<td></td>
<td></td>
</tr>
<tr>
<td></td>
<td style="background-color: #3497DA">6443 TCP</td>
<td></td>
<td></td>
</tr>
<tr>
<td colspan="3" style="background-color: #3497DA">8472 UDP</td>
<td></td>
</tr>
<tr>
<td colspan="3" style="background-color: #3497DA">10250 TCP</td>
<td></td>
</tr>
<tr>
<td></td>
<td style="background-color: #3497DA">9099 TCP <sup>(4)</sup></td>
<td></td>
<td></td>
</tr>
<tr>
<td></td>
<td style="background-color: #3497DA">10254 TCP <sup>(4)</sup></td>
<td></td>
<td></td>
</tr>
<tr>
<td rowspan="4">Worker Plane Nodes</td>
<td rowspan="4" style="background-color: #3497DA">443 TCP <sup>(3)</sup></td>
<td></td>
<td style="background-color: #3497DA">6443 TCP</td>
<td></td>
<td rowspan="4" style="background-color: #3497DA">443 TCP</td>
<td></td>
</tr>
<tr>
<td colspan="3" style="background-color: #3497DA">8472 UDP</td>
<td></td>
</tr>
<tr>
<td></td>
<td></td>
<td style="background-color: #3497DA">9099 TCP <sup>(4)</sup></td>
<td></td>
</tr>
<tr>
<td></td>
<td></td>
<td style="background-color: #3497DA">10254 TCP <sup>(4)</sup></td>
<td></td>
</tr>
<tr>
<td rowspan="2">External Load Balancer <sup>(5)</sup></td>
<td style="background-color: #3497DA">80 TCP</td>
<td></td>
<td></td>
<td></td>
<td></td>
<td></td>
</tr>
<tr>
<td style="background-color: #3497DA">443 TCP <sup>(6)</sup></td>
<td></td>
<td></td>
<td></td>
<td></td>
<td></td>
</tr>
<tr>
<td rowspan="2">API / UI Clients</td>
<td style="background-color: #3497DA">80 TCP <sup>(3)</sup></td>
<td></td>
<td></td>
<td></td>
<td style="background-color: #3497DA">80 TCP<br></td>
<td></td>
</tr>
<tr>
<td style="background-color: #3497DA">443 TCP <sup>(3)</sup></td>
<td></td>
<td></td>
<td></td>
<td style="background-color: #3497DA">443 TCP</td>
<td></td>
</tr>
<tr>
<td rowspan="3">Workload Clients</td>
<td></td>
<td></td>
<td></td>
<td style="background-color: #3497DA">30000-32767 TCP/UDP<br>(nodeport)</td>
<td></td>
<td></td>
</tr>
<tr>
<td></td>
<td></td>
<td colspan="2" style="background-color: #3497DA">80 TCP (Ingress)</td>
<td></td>
<td></td>
</tr>
<tr>
<td></td>
<td></td>
<td colspan="2" style="background-color: #3497DA">443 TCP (Ingress)</td>
<td></td>
<td></td>
</tr>
<tr>
<td colspan="7">Notes:<br><br>1. Nodes running standalone server or Rancher HA deployment.<br>2. Required to fetch Rancher chart library.<br>3. Only without external load balancer.<br>4. Local traffic to the node itself (not across nodes).<br>5. Load balancer / proxy that handles tragging to the Rancher UI / API.<br>6. Only if SSL is not terminated at external load balancer.</td>
</tr>
</tbody>
</table>
@@ -0,0 +1,51 @@
<table>
<thead>
<tr>
<th>From / To</th>
<th>Rancher Nodes</th>
<th>Hosted / Imported Cluster</th>
<th>External Load Balancer</th>
<th>Internet</th>
</tr>
</thead>
<tbody>
<tr>
<td>Rancher Nodes <sup>(1)</sup></td>
<td></td>
<td style="background-color: #3497DA">Kubernetes API <br>Endpoint Port <sup>(2)</sup></td>
<td></td>
<td style="background-color: #3497DA">git.rancher.io <sup>(3)</sup>:<br>35.160.43.145/32<br>35.167.242.46/32<br>52.33.59.17/32</td>
</tr>
<tr>
<td>Hosted / Imported Cluster</td>
<td style="background-color: #3497DA">443 TCP <sup>(4)(5)</sup></td>
<td></td>
<td style="background-color: #3497DA">443 TCP <sup>(5)</sup></td>
<td></td>
</tr>
<tr>
<td>External Load Balancer <sup>(5)</sup></td>
<td style="background-color: #3497DA">80 TCP<br>443 TCP <sup>(6)</sup></td>
<td></td>
<td></td>
<td></td>
</tr>
<tr>
<td>API / UI Clients</td>
<td style="background-color: #3497DA">80 TCP <sup>(4)</sup><br>443 TCP <sup>(4)</sup></td>
<td></td>
<td style="background-color: #3497DA">80 TCP<br>443 TCP</td>
<td></td>
</tr>
<tr>
<td>Workload Client</td>
<td></td>
<td style="background-color: #3497DA">Cluster / Provider Specific <sup>(7)</sup></td>
<td></td>
<td></td>
</tr>
<tr>
<td colspan="5">Notes:<br><br>1. Nodes running standalone server or Rancher HA deployment.<br>2. Only for hosted clusters.<br>3. Required to fetch Rancher chart library.<br>4. Only without external load balancer.<br>5. From worker nodes.<br>6. Only if SSL is not terminated at external load balancer.<br>7. Usually Ingress backed by infrastructure load balancer and/or nodeport.</td>
</tr>
</tbody>
</table>
@@ -0,0 +1,56 @@
<table>
<caption>Port Requirements for Hosted / Imported Clusters</caption>
<thead>
<tr>
<th>Protocol</th>
<th>Port</th>
<th>Source</th>
<th>Destination</th>
<th>Description</th>
</tr>
</thead>
<tbody>
<tr>
<td>TCP</td>
<td>80</td>
<td>Load Balancer / Reverse Proxy</td>
<td></td>
<td>HTTP traffic to Rancher UI / API.</td>
</tr>
<tr>
<td>TCP</td>
<td>443</td>
<td>Load Balancer / Reverse Proxy<br><br>Otherwise IPs of all cluster nodes and other Rancher API / UI clients.</td>
<td></td>
<td>HTTPS traffic to Rancher UI / API.</td>
</tr>
<tr>
<td>TCP</td>
<td>443</td>
<td></td>
<td>35.160.43.145<br>35.167.242.46<br>52.33.59.17</td>
<td>Rancher catalog (git.rancher.io).</td>
</tr>
<tr>
<td>TCP</td>
<td>22</td>
<td></td>
<td>Any node created using node driver.</td>
<td>SSH provisioning of node by node driver.</td>
</tr>
<tr>
<td>TCP</td>
<td>2376</td>
<td></td>
<td>Any node created using node driver.</td>
<td>Docker daemon TLS port used by node driver.</td>
</tr>
<tr>
<td>TCP</td>
<td>Provider Dependent</td>
<td></td>
<td>Port of the Kubernetes API endpoint in hosted clusters.</td>
<td>Kubernetes API.</td>
</tr>
</tbody>
</table>