Monitoring HTTP Endpoints Health in Kubernetes Deployment
TLDR Narasimhamurthi faced issues with monitoring HTTP endpoints health and collector-metrics pod in a Kubernetes deployment. Srikanth provided guidance, and the issue was resolved after correcting the config.
Feb 20, 2023 (7 months ago)
Narasimhamurthi
11:48 AMTo monitor health of the http endpoints ,for signoz deployed in k8s ,is it here https://github.com/SigNoz/charts/blob/main/charts/signoz/values.yaml#L2342 configuration to be update in helm chart as blow doc has for docker install method.
https://signoz.io/docs/monitor-http-endpoints/#steps-to-monitor-the-health-of-the-http-endpoints
Narasimhamurthi
04:01 PMI think this is for docker instal method. That’s y it is failing.can you give us k8s deployment method.
Srikanth
04:03 PM... in the actual config? They are meant to be a placeholder for the rest of the config. You need to add receivers and just then add them to metrics pipelin.Narasimhamurthi
04:21 PMSrikanth
04:21 PMNarasimhamurthi
04:38 PMSrikanth
04:41 PMkubectl describe pod ... run this command and share the output for the podSrikanth
04:42 PMNarasimhamurthi
04:48 PMNarasimhamurthi
04:49 PM
Srikanth
04:51 PMNarasimhamurthi
04:53 PMNarasimhamurthi
04:53 PMSrikanth
04:54 PMNarasimhamurthi
04:57 PMSrikanth
04:57 PMWhich screen and what logs are you referring to?
Narasimhamurthi
04:58 PMNarasimhamurthi
04:59 PM
Srikanth
05:00 PMhttpcheck_status you will see them.Narasimhamurthi
05:08 PM
Srikanth
05:10 PMNarasimhamurthi
05:11 PMSrikanth
05:12 PMNarasimhamurthi
05:14 PMSrikanth
05:16 PMsignoz_ in the metric name and if something shows up matching the text then please share your full config collector-metrics podNarasimhamurthi
05:19 PM
Srikanth
05:20 PMNarasimhamurthi
05:25 PMSrikanth
05:26 PMNarasimhamurthi
05:27 PMNarasimhamurthi
05:29 PM
Srikanth
05:30 PMNarasimhamurthi
05:33 PMSrikanth
05:38 PMSrikanth
05:40 PMNarasimhamurthi
05:40 PM
Narasimhamurthi
05:40 PMNarasimhamurthi
05:41 PMSrikanth
05:41 PM/dev-agent vs /dev-agentsNarasimhamurthi
05:49 PM
Narasimhamurthi
05:58 PM
SigNoz Community
Indexed 825 threads (61% resolved)
Similar Threads
Issues with Monitoring HTTP Endpoints Configuration
Andre faced issues setting up monitoring for HTTP endpoints. Prashant and Srikanth provided guidance and troubleshooting. The issue was resolved after restarting Docker containers and configuring the dashboard panel.
1Headers in Monitoring HTTP Endpoints & Otel-Collector Error
Rohit asks about providing headers in monitoring HTTP endpoints and reports errors in otel-collector logs. Srikanth mentions headers are unsupported and requires more investigation for errors.
SigNoz Not Collecting Pod Logs Issue
Maksym is experiencing issues with SigNoz not collecting pod logs. Prashant suspects it could be an issue with the kubelet stats receiver and not pod logs.
Troubleshooting SigNoz Auto-Instrumentation Configuration
igor is having trouble configuring auto-instrumentation for Java applications using SigNoz, with traces not appearing in the SigNoz UI. Prashant advises to check logs of the otel sidecar, use service name for endpoint, verify supported libraries, and test with telemetrygen. However, the issue still persists.
Troubleshooting Signoz Dashboard Not Showing Traces
prasanth encountered issues with Signoz dashboard not displaying traces. Srikanth recommended configuring the `OTEL_EXPORTER_OTLP_ENDPOINT`, but they are still facing issues with the exporter's connection.