From 48dab2c8403531f2720a75e31529de36da2a2750 Mon Sep 17 00:00:00 2001 From: Nick Gerace Date: Wed, 3 Mar 2021 17:49:46 -0500 Subject: [PATCH] Add cattle-ogging ns recreation troubleshooting --- .../rancher/v2.x/en/logging/v2.5/_index.md | 38 +++++++++++++++++-- 1 file changed, 34 insertions(+), 4 deletions(-) diff --git a/content/rancher/v2.x/en/logging/v2.5/_index.md b/content/rancher/v2.x/en/logging/v2.5/_index.md index 5a839ff1d70..8bf71dc23e3 100644 --- a/content/rancher/v2.x/en/logging/v2.5/_index.md +++ b/content/rancher/v2.x/en/logging/v2.5/_index.md @@ -56,7 +56,7 @@ Rancher logging has two roles, `logging-admin` and `logging-view`. - `logging-admin` gives users full access to namespaced flows and outputs - `logging-view` allows users to *view* namespaced flows and outputs, and cluster flows and outputs -> **Why choose one role over the other?** Edit access to cluster flow and cluster output resources is powerful. Any user with it has edit access for all logs in the cluster. +> **Why choose one role over the other?** Edit access to cluster flow and cluster output resources is powerful. Any user with it has edit access for all logs in the cluster. In Rancher, the cluster administrator role is the only role with full access to all `rancher-logging` resources. Cluster members are not able to edit or read any logging resources. Project owners and members have the following privileges: @@ -116,7 +116,7 @@ metadata: spec: globalOutputRefs: - "example-es" -``` +``` We should now see our configured index with logs in it. @@ -152,7 +152,7 @@ spec: containers: - name: generator image: paynejacob/loggenerator:latest -``` +``` With `coolapp` running, we will follow a similar path as when we created a cluster output. However, unlike cluster outputs, we create our output in our application's namespace. @@ -301,7 +301,7 @@ spec: - key: cattle.io/os operator: "Equal" value: "linux" - effect: NoSchedule + effect: NoSchedule nodeSelector: kubernetes.io/os: linux ``` @@ -334,3 +334,33 @@ However, if you would like to add tolerations for *only* the `fluentbit` contain fluentbit_tolerations: # insert tolerations list for fluentbit containers only... ``` + +# Troubleshooting + +### The `cattle-logging` Namespace Being Recreated + +If your cluster previously deployed logging from the Cluster Manager UI, you may encounter an issue where its `cattle-logging` namespace is continually being recreated. + +The solution is to delete all `clusterloggings.management.cattle.io` and `projectloggings.management.cattle.io` custom resources from the cluster specific namespace in the management cluster. +The existence of these custom resources causes Rancher to create the `cattle-logging` namespace in the downstream cluster if it does not exist. + +The cluster namespace matches the cluster ID, so we need to find the cluster ID for each cluster. + +1. In your web browser, navigate to your cluster(s) in either the Cluster Manager UI or the Cluster Explorer UI. +2. Copy the `` portion from one of the URLs below. The `` portion is the cluster namespace name. + +```bash +# Cluster Management UI +https:///c// + +# Cluster Explorer UI (Dashboard) +https:///dashboard/c// +``` + +Now that we have the `` namespace, we can delete the CRs that cause `cattle-logging` to be continually recreated. +*Warning:* ensure that logging, the version installed from the Cluster Manager UI, is not currently in use. + +```bash +kubectl delete clusterloggings.management.cattle.io -n +kubectl delete projectloggings.management.cattle.io -n +```