Resolving Otel Collector Error "Permanent error: empty data points"
TLDR Saad reported an error encountered with otel collector. Srikanth suggested the fix should be on the instrumentation, not sending any empty data points.
Oct 13, 2023 (1 month ago)
Saad
09:28 AMhas anyone encountered this error in the otel collector
Permanent error: empty data points```
2023-10-13T09:27:43.683Z error exporterhelper/queued_retry.go:391 Exporting failed. The error is not retryable. Dropping data. {"kind": "exporter", "data_type": "metrics", "name": "clickhousemetricswrite", "error": "Permanent error: empty data points. db.client.connections.usage is dropped; Permanent error: empty data points. db.client.connections.usage is dropped", "errorCauses": [{"error": "Permanent error: empty data points. db.client.connections.usage is dropped"}, {"error": "Permanent error: empty data points. db.client.connections.usage is dropped"}], "dropped_items": 616}```any idea how I can fix it? 🙏
Prashant
10:33 AMOct 16, 2023 (1 month ago)
Srikanth
03:00 AMFix should be on the instrumentation, do not send any empty data points.
SigNoz Community
Indexed 1023 threads (61% resolved)
Similar Threads
Troubleshooting Clickhouse Exporter Error
ELLIOTTCABLE encountered an error with Clickhouse exporters, likely due to a misconfiguration hinted by Srikanth. This was confirmed when ELLIOTTCABLE realized that Clickhouse's HTTP protocol was not implemented. The user subsequently inquired about HTTP-protocol support or alternative configurations.
Troubleshooting: No Tracing Data Exported from Docker Container
Hassan couldn't export tracing data from the otel-collector, but resolved it by running all containers on the same external network. Olawale experienced a similar issue.
Troubleshooting Signoz Deployment Issues
Juan is having issues running signoz data, only logs are working. The issues were identified by Srikanth as non-working network and harmless table issues in a k8s cluster. However, the issues are not yet resolved.