--- title: '3. Install Kubernetes (Skip for Docker Installs)' --- :::note Skip this section if you are installing Rancher on a single node with Docker. ::: This section describes how to install a Kubernetes cluster according to our [best practices for the Rancher server environment.](../../../../reference-guides/rancher-manager-architecture/architecture-recommendations.md#environment-for-kubernetes-installations) This cluster should be dedicated to run only the Rancher server. Rancher can be installed on any Kubernetes cluster, including hosted Kubernetes providers. The steps to set up an air-gapped Kubernetes cluster on RKE2 or K3s are shown below. In this guide, we are assuming you have created your nodes in your air gapped environment and have a secure Docker private registry on your bastion server. ## Installation Outline 1. [Prepare Images Directory](#1-prepare-images-directory) 2. [Create Registry YAML](#2-create-registry-yaml) 3. [Install K3s](#3-install-k3s) 4. [Save and Start Using the kubeconfig File](#4-save-and-start-using-the-kubeconfig-file) ## 1. Prepare Images Directory Obtain the images tar file for your architecture from the [releases](https://github.com/k3s-io/k3s/releases) page for the version of K3s you will be running. Place the tar file in the `images` directory before starting K3s on each node, for example: ```sh sudo mkdir -p /var/lib/rancher/k3s/agent/images/ sudo cp ./k3s-airgap-images-$ARCH.tar /var/lib/rancher/k3s/agent/images/ ``` ## 2. Create Registry YAML Create the registries.yaml file at `/etc/rancher/k3s/registries.yaml`. This will tell K3s the necessary details to connect to your private registry. The registries.yaml file should look like this before plugging in the necessary information: ```yaml --- mirrors: customreg: endpoint: - "https://ip-to-server:5000" configs: customreg: auth: username: xxxxxx # this is the registry username password: xxxxxx # this is the registry password tls: cert_file: key_file: ca_file: ``` Note, at this time only secure registries are supported with K3s (SSL with custom CA). For more information on private registries configuration file for K3s, refer to the [K3s documentation.](https://rancher.com/docs/k3s/latest/en/installation/private-registry/) ## 3. Install K3s Rancher needs to be installed on a supported Kubernetes version. To find out which versions of Kubernetes are supported for your Rancher version, refer to the [Rancher Support Matrix](https://www.suse.com/suse-rancher/support-matrix/all-supported-versions/). To specify the K3s (Kubernetes) version, use the INSTALL_K3S_VERSION (e.g., `INSTALL_K3S_VERSION="v1.24.10+k3s1"`) environment variable when running the K3s installation script. Obtain the K3s binary from the [releases](https://github.com/k3s-io/k3s/releases) page, matching the same version used to get the airgap images tar. Also obtain the K3s install script at https://get.k3s.io Place the binary in `/usr/local/bin` on each node. Place the install script anywhere on each node, and name it `install.sh`. Install K3s on each server: ``` INSTALL_K3S_SKIP_DOWNLOAD=true INSTALL_K3S_VERSION= ./install.sh ``` Install K3s on each agent: ``` INSTALL_K3S_SKIP_DOWNLOAD=true INSTALL_K3S_VERSION= K3S_URL=https://:6443 K3S_TOKEN= ./install.sh ``` Where `` is the IP or valid DNS of the server and `` is the node-token from the server found at `/var/lib/rancher/k3s/server/node-token`. :::note K3s additionally provides a `--resolv-conf` flag for kubelets, which may help with configuring DNS in air-gapped networks. ::: ## 4. Save and Start Using the kubeconfig File When you installed K3s on each Rancher server node, a `kubeconfig` file was created on the node at `/etc/rancher/k3s/k3s.yaml`. This file contains credentials for full access to the cluster, and you should save this file in a secure location. To use this `kubeconfig` file, 1. Install [kubectl,](https://kubernetes.io/docs/tasks/tools/install-kubectl/#install-kubectl) a Kubernetes command-line tool. 2. Copy the file at `/etc/rancher/k3s/k3s.yaml` and save it to the directory `~/.kube/config` on your local machine. 3. In the kubeconfig file, the `server` directive is defined as localhost. Configure the server as the DNS of your load balancer, referring to port 6443. (The Kubernetes API server will be reached at port 6443, while the Rancher server will be reached at ports 80 and 443.) Here is an example `k3s.yaml`: ```yaml apiVersion: v1 clusters: - cluster: certificate-authority-data: [CERTIFICATE-DATA] server: [LOAD-BALANCER-DNS]:6443 # Edit this line name: default contexts: - context: cluster: default user: default name: default current-context: default kind: Config preferences: {} users: - name: default user: password: [PASSWORD] username: admin ``` **Result:** You can now use `kubectl` to manage your K3s cluster. If you have more than one kubeconfig file, you can specify which one you want to use by passing in the path to the file when using `kubectl`: ``` kubectl --kubeconfig ~/.kube/config/k3s.yaml get pods --all-namespaces ``` For more information about the `kubeconfig` file, refer to the [K3s documentation](https://rancher.com/docs/k3s/latest/en/cluster-access/) or the [official Kubernetes documentation](https://kubernetes.io/docs/concepts/configuration/organize-cluster-access-kubeconfig/) about organizing cluster access using `kubeconfig` files. ## Note on Upgrading Upgrading an air-gap environment can be accomplished in the following manner: 1. Download the new air-gap images (tar file) from the [releases](https://github.com/k3s-io/k3s/releases) page for the version of K3s you will be upgrading to. Place the tar in the `/var/lib/rancher/k3s/agent/images/` directory on each node. Delete the old tar file. 2. Copy and replace the old K3s binary in `/usr/local/bin` on each node. Copy over the install script at https://get.k3s.io (as it is possible it has changed since the last release). Run the script again just as you had done in the past with the same environment variables. 3. Restart the K3s service (if not restarted automatically by installer). In this guide, we are assuming you have created your nodes in your air-gapped environment and have a secure Docker private registry on your bastion server. ## Installation Outline 1. [Create RKE2 configuration](#1-create-rke2-configuration) 2. [Create Registry YAML](#2-create-registry-yaml) 3. [Install RKE2](#3-install-rke2) 4. [Save and Start Using the kubeconfig File](#4-save-and-start-using-the-kubeconfig-file) ## 1. Create RKE2 configuration Create the config.yaml file at `/etc/rancher/rke2/config.yaml`. This will contain all the configuration options necessary to create a highly available RKE2 cluster. On the first server the minimum config is: ``` token: my-shared-secret tls-san: - loadbalancer-dns-domain.com ``` On each other server the config file should contain the same token and tell RKE2 to connect to the existing first server: ``` server: https://ip-of-first-server:9345 token: my-shared-secret tls-san: - loadbalancer-dns-domain.com ``` For more information, refer to the [RKE2 documentation](https://docs.rke2.io/install/ha). :::note RKE2 additionally provides a `resolv-conf` option for kubelets, which may help with configuring DNS in air-gap networks. ::: ## 2. Create Registry YAML Create the registries.yaml file at `/etc/rancher/rke2/registries.yaml`. This will tell RKE2 the necessary details to connect to your private registry. The registries.yaml file should look like this before plugging in the necessary information: ``` --- mirrors: customreg: endpoint: - "https://ip-to-server:5000" configs: customreg: auth: username: xxxxxx # this is the registry username password: xxxxxx # this is the registry password tls: cert_file: key_file: ca_file: ``` For more information on private registries configuration file for RKE2, refer to the [RKE2 documentation.](https://docs.rke2.io/install/private_registry) ## 3. Install RKE2 Rancher needs to be installed on a supported Kubernetes version. To find out which versions of Kubernetes are supported for your Rancher version, refer to the [support maintenance terms.](https://rancher.com/support-maintenance-terms/) Download the install script, rke2, rke2-images, and sha256sum archives from the release and upload them into a directory on each server: ``` mkdir /tmp/rke2-artifacts && cd /tmp/rke2-artifacts/ wget https://github.com/rancher/rke2/releases/download/v1.21.5%2Brke2r2/rke2-images.linux-amd64.tar.zst wget https://github.com/rancher/rke2/releases/download/v1.21.5%2Brke2r2/rke2.linux-amd64.tar.gz wget https://github.com/rancher/rke2/releases/download/v1.21.5%2Brke2r2/sha256sum-amd64.txt curl -sfL https://get.rke2.io --output install.sh ``` Next, run install.sh using the directory on each server, as in the example below: ``` INSTALL_RKE2_ARTIFACT_PATH=/tmp/rke2-artifacts sh install.sh ``` Then enable and start the service on all servers: `` systemctl enable rke2-server.service systemctl start rke2-server.service `` For more information, refer to the [RKE2 documentation](https://docs.rke2.io/install/airgap). ## 4. Save and Start Using the kubeconfig File When you installed RKE2 on each Rancher server node, a `kubeconfig` file was created on the node at `/etc/rancher/rke2/rke2.yaml`. This file contains credentials for full access to the cluster, and you should save this file in a secure location. To use this `kubeconfig` file, 1. Install [kubectl](https://kubernetes.io/docs/tasks/tools/install-kubectl/#install-kubectl), a Kubernetes command-line tool. 2. Copy the file at `/etc/rancher/rke2/rke2.yaml` and save it to the directory `~/.kube/config` on your local machine. 3. In the kubeconfig file, the `server` directive is defined as localhost. Configure the server as the DNS of your load balancer, referring to port 6443. (The Kubernetes API server will be reached at port 6443, while the Rancher server will be reached at ports 80 and 443.) Here is an example `rke2.yaml`: ``` apiVersion: v1 clusters: - cluster: certificate-authority-data: [CERTIFICATE-DATA] server: [LOAD-BALANCER-DNS]:6443 # Edit this line name: default contexts: - context: cluster: default user: default name: default current-context: default kind: Config preferences: {} users: - name: default user: password: [PASSWORD] username: admin ``` **Result:** You can now use `kubectl` to manage your RKE2 cluster. If you have more than one kubeconfig file, you can specify which one you want to use by passing in the path to the file when using `kubectl`: ``` kubectl --kubeconfig ~/.kube/config/rke2.yaml get pods --all-namespaces ``` For more information about the `kubeconfig` file, refer to the [RKE2 documentation](https://docs.rke2.io/cluster_access) or the [official Kubernetes documentation](https://kubernetes.io/docs/concepts/configuration/organize-cluster-access-kubeconfig/) about organizing cluster access using `kubeconfig` files. ## Note on Upgrading Upgrading an air-gap environment can be accomplished in the following manner: 1. Download the new air-gap artifacts and install script from the [releases](https://github.com/rancher/rke2/releases) page for the version of RKE2 you will be upgrading to. 2. Run the script again just as you had done in the past with the same environment variables. 3. Restart the RKE2 service. ## Issues or Errors? See the [Troubleshooting](../../install-upgrade-on-a-kubernetes-cluster/troubleshooting.md) page. ## [Next: Install Rancher](install-rancher-ha.md)