#support

Troubleshooting SigNoz Dashboard Visibility Issue

TLDR Naman had an issue with SigNoz not displaying services even though they've enabled it and sent data successfully. Srikanth engaged in investigation and troubleshooting, but the issue remained unresolved.

3mo

Join the chat

Aug 13, 2023 (3 months ago)

Photo of md5-05247fe16b41ccab864b3cca9450a270

Naman

02:20 PM

we have enabled signoz in our env and we want to export logs, metrics and traces of out kubernetes deployment application to signoz
context: we have used signoz side car approach and also tested the troubleshotting guide

the setup of signoz is done correctly
as per below ss by using troubleshooting guide the log is showing that it has sent data successfully to signoz, but in the signoz dashboard we are not able to see any of the services. attached 3rd SS for the same

need urgent help for this as we require to enable signoz in multiple prod account by next week.
cc: Sanket

Image 1 for we have enabled signoz in our env and we want to export logs, metrics and traces of out kubernetes deployment application to signoz
*context:* we have used signoz side car approach and also tested the troubleshotting guide

the setup of signoz is done correctly
as per below ss by using troubleshooting guide the log is showing that it has sent data successfully to signoz, but in the signoz dashboard we are not able to see any of the services. attached 3rd SS for the same

need urgent help for this as we require to enable signoz in multiple prod account by next week.
cc: <@4Kfba0>

Image 2 for we have enabled signoz in our env and we want to export logs, metrics and traces of out kubernetes deployment application to signoz
*context:* we have used signoz side car approach and also tested the troubleshotting guide

the setup of signoz is done correctly
as per below ss by using troubleshooting guide the log is showing that it has sent data successfully to signoz, but in the signoz dashboard we are not able to see any of the services. attached 3rd SS for the same

need urgent help for this as we require to enable signoz in multiple prod account by next week.
cc: <@4Kfba0>

Image 3 for we have enabled signoz in our env and we want to export logs, metrics and traces of out kubernetes deployment application to signoz
*context:* we have used signoz side car approach and also tested the troubleshotting guide

the setup of signoz is done correctly
as per below ss by using troubleshooting guide the log is showing that it has sent data successfully to signoz, but in the signoz dashboard we are not able to see any of the services. attached 3rd SS for the same

need urgent help for this as we require to enable signoz in multiple prod account by next week.
cc: <@4Kfba0>

Photo of md5-ce04a9988e2fd758a659dc55be6f2543

Srikanth

02:23 PM

Do you see any error in signoz collector logs?

Naman

02:24 PM

could not find any erros

Srikanth

02:25 PM

Can you help us understand better how did you instrument and configure your applications to send data to SigNoz?

Naman

02:26 PM

we have enabled a sample pod now for testing the data

02:26

Naman

02:26 PM

doc link https://signoz.io/docs/tutorial/opentelemetry-operator-usage/

02:28

Naman

02:28 PM

using the above DOC we have created a sample pod to send data to signoz the logs of the pod i can find is

Srikanth

02:32 PM

Are you sure you configured the collector to export to SigNoz other than logging?

Naman

02:34 PM

we are using otel collector to export the metrics as well

Srikanth

02:35 PM

No, my question was, does the sidecar collector export the data to SigNoz? It must have a otlp exporter that sends data to SigNoz?

02:35

Srikanth

02:35 PM

By logging , I meant the collector has a logging exporter which write the traces, metrics, logs to stdout for debugging purpose.

02:36

Srikanth

02:36 PM

You must configure the otlp exporter to send data to SigNoz

Naman

02:37 PM

in the sidecar config we have used otlp exporter enabled

service:
      pipelines:
        traces:
          receivers: [otlp]
          processors: [batch]
          exporters: [logging, otlp]
        metrics:
          receivers: [otlp]
          processors: [batch]
          exporters: [logging, otlp]

Srikanth

02:38 PM

What is the endpoint of the otlp exporter and share the logs of sidecar collector.

Naman

02:39 PM

2023-08-13T13:22:20.967Z    info    fileconsumer/file.go:192    Started watching file    {"kind": "receiver", "name": "filelog/k8s", "data_type": "logs", "component": "fileconsumer", "path": "/var/log/pods/signoz_signoz-alertmanager-0_3e6c7486-a0e6-4a8d-9df7-bc5582d92f2c/signoz-alertmanager/605.log"}
2023-08-13T13:27:26.968Z    info    fileconsumer/file.go:192    Started watching file    {"kind": "receiver", "name": "filelog/k8s", "data_type": "logs", "component": "fileconsumer", "path": "/var/log/pods/signoz_signoz-alertmanager-0_3e6c7486-a0e6-4a8d-9df7-bc5582d92f2c/signoz-alertmanager/606.log"}
2023-08-13T13:32:41.966Z    info    fileconsumer/file.go:192    Started watching file    {"kind": "receiver", "name": "filelog/k8s", "data_type": "logs", "component": "fileconsumer", "path": "/var/log/pods/signoz_signoz-alertmanager-0_3e6c7486-a0e6-4a8d-9df7-bc5582d92f2c/signoz-alertmanager/607.log"}
2023-08-13T13:37:50.966Z    info    fileconsumer/file.go:192    Started watching file    {"kind": "receiver", "name": "filelog/k8s", "data_type": "logs", "component": "fileconsumer", "path": "/var/log/pods/signoz_signoz-alertmanager-0_3e6c7486-a0e6-4a8d-9df7-bc5582d92f2c/signoz-alertmanager/608.log"}
2023-08-13T13:42:57.967Z    info    fileconsumer/file.go:192    Started watching file    {"kind": "receiver", "name": "filelog/k8s", "data_type": "logs", "component": "fileconsumer", "path": "/var/log/pods/signoz_signoz-alertmanager-0_3e6c7486-a0e6-4a8d-9df7-bc5582d92f2c/signoz-alertmanager/609.log"}

02:40

Naman

02:40 PM

endpoint
otlp:
endpoint: http://simplest-collector.signoz.svc.cluster.local:4317

Srikanth

02:41 PM

Did you generate any traffic to pet clinic application to produce any telemetry?

Naman

02:41 PM

yes generated traffic manually by giving curl req to api

Srikanth

02:43 PM

Can you confirm if the auto-instrumentation step for petclinic step is also done?

Naman

02:44 PM

yes we followed that approach previously
latter on we moved to side car approach

02:45

Naman

02:45 PM

if available can we connect in a call?

Srikanth

02:45 PM

The auto instrumentation is separate from the collector deployment.

02:45

Srikanth

02:45 PM

Send me huddle

04:10

Srikanth

04:10 PM

https://signoz.io/docs/userguide/retention-period/#kubernetes-1

Aug 14, 2023 (3 months ago)

Photo of md5-051f535431ff484f44f165e9a0b696a5

Sanket

02:50 AM

Thanks Srikanth for quick response help🙌

SigNoz Community

Built with ClickHouse as datastore, SigNoz is an open-source APM to help you find issues in your deployed applications & solve them quickly | Knowledge Base powered by Struct.AI

Indexed 1023 threads (61% resolved)

Join Our Community

Similar Threads

Troubleshooting Signoz Dashboard Not Showing Traces

prasanth encountered issues with Signoz dashboard not displaying traces. Srikanth recommended configuring the `OTEL_EXPORTER_OTLP_ENDPOINT`, but they are still facing issues with the exporter's connection.

9mo

Exporting OpenTelemetry Data from Pixie to SigNoz on Kubernetes

Nilanjan asks how to export opentelemetry data from Pixie to SigNoz on the same Kubernetes cluster. Srikanth suggests configuring the endpoint of the collector in Pixie, but viewing the data in SigNoz dashboard remains unresolved.

7mo

Troubleshooting SigNoz Auto-Instrumentation Configuration

igor is having trouble configuring auto-instrumentation for Java applications using SigNoz, with traces not appearing in the SigNoz UI. Prashant advises to check logs of the otel sidecar, use service name for endpoint, verify supported libraries, and test with telemetrygen. However, the issue still persists.

8mo

Configuring OTel Collector to Export Data to SigNoz

James asked how to configure the otel collector to send data to SigNoz. Ankit suggested using the otlp exporter in the collector configuration. James found that SigNoz uses its own otel collector and adjusted the port bindings accordingly.

5mo

Configuring SigNoz with Istio Traces and Service Monitors

Zakaria asked about integrating SigNoz with istio traces and Prometheus service monitors. Srikanth suggested using OpenTelemetry operator and provided guidance for troubleshooting and solving configuration issues in the process.

8mo