SigNoz Instrumentation Error in GCP/GKE with Python and FastAPI
TLDR Andre faced an error while instrumenting their app service with SigNoz. Srikanth identified the incorrect config and suggested the correct endpoint, resolving the issue.
Apr 28, 2023 (5 months ago)
Andre
03:08 AMI need for support…
We install SigNoz on GCP/GKE via helm, with the following values:
global:
storageClass: gce-resizable
cloud: gcp
clickhouse:
installCustomStorageClass: true
The instrumented pyhon application we are calling this way:
WORKDIR / app
CMD ["bash", "-c", "OTEL_RESOURCE_ATTRIBUTES=service.name=zagpt-python OTEL_EXPORTER_OTLP_ENDPOINT='' opentelemetry-instrument --traces_exporter otlp_proto_http --metrics_exporter otlp_proto_http python webhook.py"]
In the log of the signoz-otel-collector pod, it gives me the error:
api-stg-00042-deployment-65f9c6d996-48wtk app Transient error Bad Gateway encountered while exporting span batch, retrying in 32s.
Does anyone have any idea where the error is for not letting me instrument my app service with python and FastAPI?
Srikanth
04:28 AM>
api-stg-00042-deployment-65f9c6d996-48wtk app Transient error Bad Gateway encountered while exporting span batch, retrying in 32s.
>
This shouldn’t be the signoz-otel-collector pod but rather your application.
>
OTEL_EXPORTER_OTLP_ENDPOINT=''
>
--traces_exporter otlp_proto_http --metrics_exporter otlp_proto_http
This is an incorrect config. You are using the HTTP exporter, but the endpoint configured is the gRPC port. You either have to change the exporter or the endpoint to HTTP, i.e.
4318
.Andre
04:42 AMSigNoz Community
Indexed 825 threads (61% resolved)
Similar Threads
Headers in Monitoring HTTP Endpoints & Otel-Collector Error
Rohit asks about providing headers in monitoring HTTP endpoints and reports errors in otel-collector logs. Srikanth mentions headers are unsupported and requires more investigation for errors.
Troubleshooting Docker File Configuration for Metrics Traces
Vibhav was trying to pass config in a Docker file and encountered issues with metrics traces not getting pushed. Prashant offered reference, and Srikanth identified potential grpc exporter issue.
Troubleshooting SigNoz Auto-Instrumentation Configuration
igor is having trouble configuring auto-instrumentation for Java applications using SigNoz, with traces not appearing in the SigNoz UI. Prashant advises to check logs of the otel sidecar, use service name for endpoint, verify supported libraries, and test with telemetrygen. However, the issue still persists.