made updates based on feedback
This commit is contained in:
@@ -14,11 +14,11 @@ labels:
|
||||
- enterprise
|
||||
- oss
|
||||
menuTitle: Troubleshooting
|
||||
title: Troubleshoot issues with the Prometheus data source
|
||||
title: Troubleshoot Prometheus data source issues
|
||||
weight: 600
|
||||
---
|
||||
|
||||
# Troubleshoot issues with the Prometheus data source
|
||||
# Troubleshoot Prometheus data source issues
|
||||
|
||||
This document provides troubleshooting information for common errors you may encounter when using the Prometheus data source in Grafana.
|
||||
|
||||
@@ -53,6 +53,7 @@ The following errors occur when Grafana cannot establish or maintain a connectio
|
||||
1. Check the network latency between Grafana and Prometheus.
|
||||
1. Verify that Prometheus is not overloaded or experiencing performance issues.
|
||||
1. Increase the **Query timeout** setting in the data source configuration under **Interval behavior**.
|
||||
1. Check the [Grafana server timeout configuration](https://grafana.com/docs/grafana/latest/setup-grafana/configure-grafana#timeout) for server-level timeout settings.
|
||||
1. Reduce the time range or complexity of your query.
|
||||
1. Check if any network devices (load balancers, proxies) are timing out the connection.
|
||||
|
||||
@@ -83,7 +84,7 @@ The following errors occur when there are issues with authentication credentials
|
||||
1. Verify that the username and password are correct if using basic authentication.
|
||||
1. Check that the authentication method selected matches your Prometheus configuration.
|
||||
1. If using a reverse proxy with authentication, verify the credentials are correct.
|
||||
1. For AWS SigV4 authentication, verify the IAM credentials and permissions.
|
||||
1. For AWS SigV4 authentication, verify the IAM credentials and permissions. Alternatively, consider using the [Amazon Managed Service for Prometheus data source](https://grafana.com/grafana/plugins/grafana-amazonprometheus-datasource/) for simplified AWS authentication.
|
||||
|
||||
### Forbidden (403)
|
||||
|
||||
@@ -96,7 +97,7 @@ The following errors occur when there are issues with authentication credentials
|
||||
1. Verify the user has read access to the Prometheus API.
|
||||
1. Check Prometheus security settings and access control configuration.
|
||||
1. If using a reverse proxy, verify the proxy is not blocking the request.
|
||||
1. For AWS Managed Prometheus, verify the IAM policy grants the required permissions.
|
||||
1. For AWS Managed Prometheus, verify the IAM policy grants the required permissions. Alternatively, consider using the [Amazon Managed Service for Prometheus data source](https://grafana.com/grafana/plugins/grafana-amazonprometheus-datasource/) for simplified AWS authentication.
|
||||
|
||||
## Query errors
|
||||
|
||||
@@ -108,6 +109,8 @@ The following errors occur when there are issues with PromQL syntax or query exe
|
||||
|
||||
**Cause:** The PromQL query contains invalid syntax.
|
||||
|
||||
**Alternative cause:** A proxy between Grafana and Prometheus requires authentication. When proxy authentication fails, the proxy redirects the request to an HTML authentication page. Grafana cannot parse the HTML response, which results in a parse error. This appears to be a query issue but is actually a proxy authentication issue.
|
||||
|
||||
**Solution:**
|
||||
|
||||
1. Check your query syntax for typos or invalid characters.
|
||||
@@ -115,18 +118,20 @@ The following errors occur when there are issues with PromQL syntax or query exe
|
||||
1. Ensure string values in label matchers are enclosed in quotes.
|
||||
1. Use the Prometheus expression browser to test your query directly.
|
||||
1. Refer to the [Prometheus querying documentation](https://prometheus.io/docs/prometheus/latest/querying/basics/) for syntax guidance.
|
||||
1. If you have a proxy between Grafana and Prometheus, verify that proxy authentication is correctly configured. Check your proxy logs for authentication failures or redirects.
|
||||
|
||||
### Unknown metric name
|
||||
### Query returns no data for a metric
|
||||
|
||||
**Error message:** "unknown metric name" or query returns no data
|
||||
**Symptom:** The query returns no data and the visualization is empty.
|
||||
|
||||
**Cause:** The specified metric does not exist in Prometheus.
|
||||
**Cause:** The specified metric does not exist in Prometheus, or there is no data for the selected time range.
|
||||
|
||||
**Solution:**
|
||||
|
||||
1. Verify the metric name is spelled correctly.
|
||||
1. Check that the metric is being scraped by Prometheus.
|
||||
1. Use the Prometheus UI to browse available metrics at `/graph` or `/api/v1/label/__name__/values`.
|
||||
1. Use the Prometheus API to browse available metrics at `/api/v1/label/__name__/values`.
|
||||
1. Use the [target metadata API](https://prometheus.io/docs/prometheus/latest/querying/api#querying-target-metadata) to verify which metrics a target exposes.
|
||||
1. Verify the time range includes data for the metric.
|
||||
|
||||
### Query timeout limit exceeded
|
||||
|
||||
Reference in New Issue
Block a user