Add cattle-ogging ns recreation troubleshooting

This commit is contained in:
Nick Gerace
2021-03-03 17:49:46 -05:00
parent c0e67713ae
commit 48dab2c840
+34 -4
View File
@@ -56,7 +56,7 @@ Rancher logging has two roles, `logging-admin` and `logging-view`.
- `logging-admin` gives users full access to namespaced flows and outputs
- `logging-view` allows users to *view* namespaced flows and outputs, and cluster flows and outputs
> **Why choose one role over the other?** Edit access to cluster flow and cluster output resources is powerful. Any user with it has edit access for all logs in the cluster.
> **Why choose one role over the other?** Edit access to cluster flow and cluster output resources is powerful. Any user with it has edit access for all logs in the cluster.
In Rancher, the cluster administrator role is the only role with full access to all `rancher-logging` resources. Cluster members are not able to edit or read any logging resources. Project owners and members have the following privileges:
@@ -116,7 +116,7 @@ metadata:
spec:
globalOutputRefs:
- "example-es"
```
```
We should now see our configured index with logs in it.
@@ -152,7 +152,7 @@ spec:
containers:
- name: generator
image: paynejacob/loggenerator:latest
```
```
With `coolapp` running, we will follow a similar path as when we created a cluster output. However, unlike cluster outputs, we create our output in our application's namespace.
@@ -301,7 +301,7 @@ spec:
- key: cattle.io/os
operator: "Equal"
value: "linux"
effect: NoSchedule
effect: NoSchedule
nodeSelector:
kubernetes.io/os: linux
```
@@ -334,3 +334,33 @@ However, if you would like to add tolerations for *only* the `fluentbit` contain
fluentbit_tolerations:
# insert tolerations list for fluentbit containers only...
```
# Troubleshooting
### The `cattle-logging` Namespace Being Recreated
If your cluster previously deployed logging from the Cluster Manager UI, you may encounter an issue where its `cattle-logging` namespace is continually being recreated.
The solution is to delete all `clusterloggings.management.cattle.io` and `projectloggings.management.cattle.io` custom resources from the cluster specific namespace in the management cluster.
The existence of these custom resources causes Rancher to create the `cattle-logging` namespace in the downstream cluster if it does not exist.
The cluster namespace matches the cluster ID, so we need to find the cluster ID for each cluster.
1. In your web browser, navigate to your cluster(s) in either the Cluster Manager UI or the Cluster Explorer UI.
2. Copy the `<cluster-id>` portion from one of the URLs below. The `<cluster-id>` portion is the cluster namespace name.
```bash
# Cluster Management UI
https://<your-url>/c/<cluster-id>/
# Cluster Explorer UI (Dashboard)
https://<your-url>/dashboard/c/<cluster-id>/
```
Now that we have the `<cluster-id>` namespace, we can delete the CRs that cause `cattle-logging` to be continually recreated.
*Warning:* ensure that logging, the version installed from the Cluster Manager UI, is not currently in use.
```bash
kubectl delete clusterloggings.management.cattle.io -n <cluster-id>
kubectl delete projectloggings.management.cattle.io -n <cluster-id>
```