#support

Centralizing SigNoz Otel Collector across Multiple Clusters

TLDR Shravan is trying to centralize their Signoz Otel collector across AWS, Azure, and GCP. Srikanth offers insights and sample configurations, though they do not reach a definitive resolution.

4mo

Join the chat

Jul 30, 2023 (4 months ago)

Photo of md5-23d9a9ef8569484aba646a65ec1dc58f

Shravan

12:44 PM

Hi
We have setup centralised signoz for different clusters deployed over AWS, Azure and GCP
k8s-infra is setup in each cluster and getting logs and k8s metrics

Now we have enabled Prometheus in our applications on our clusters but we don't want to expose the metrics publicly for Central Signoz Otel collector

How to setup signoz-otel collector in each cluster and forward the data to central Signoz Otel collector

Photo of md5-ce04a9988e2fd758a659dc55be6f2543

Srikanth

01:46 PM

Set up a pipeline that collects the metrics within your cluster and exports to SigNoz using OTLP exporter similar how you are doing with other logs and k8s metrics.

Shravan

02:07 PM

Srikanth can you share sample config for this

02:33

Shravan

02:33 PM

not much help from https://opentelemetry.io/docs/specs/otel/metrics/sdk_exporters/prometheus/

03:13

Shravan

03:13 PM

Is this correct k8s-infra-values-override.yaml

global:
  clusterName: "stage"
  cloud: gcp
k8s-infra:
presets:
  logsCollection:
    enabled: true

otelAgent:
  receivers:
    prometheus:
      config:
      scrape_configs:
        - job_name: "my-app-metrics"
          scrape_interval: 30s
          static_configs:
            - targets: ["10.0.12.12:1234"]
  service:
    pipelines:
      metrics:
        receivers: [otlp,prometheus]

Srikanth

03:56 PM

Yes, assuming you have otlp exporter in the final values

Jul 31, 2023 (4 months ago)

Shravan

02:10 PM

Srikanth otlp is from default values.xml
https://github.com/SigNoz/charts/blob/main/charts/k8s-infra/values.yaml

Image 1 for <@4K1456> otlp is from default values.xml
<https://github.com/SigNoz/charts/blob/main/charts/k8s-infra/values.yaml>

Srikanth

02:44 PM

I am talking about the otlp exporter

02:44

Srikanth

02:44 PM

And in the context of metrics.

SigNoz Community

Built with ClickHouse as datastore, SigNoz is an open-source APM to help you find issues in your deployed applications & solve them quickly | Knowledge Base powered by Struct.AI

Indexed 1023 threads (61% resolved)

Join Our Community

Similar Threads

Configuring OTel Collector to Export Data to SigNoz

James asked how to configure the otel collector to send data to SigNoz. Ankit suggested using the otlp exporter in the collector configuration. James found that SigNoz uses its own otel collector and adjusted the port bindings accordingly.

5mo

Configuring SigNoz with Istio Traces and Service Monitors

Zakaria asked about integrating SigNoz with istio traces and Prometheus service monitors. Srikanth suggested using OpenTelemetry operator and provided guidance for troubleshooting and solving configuration issues in the process.

8mo

Troubleshooting Signoz Dashboard Not Showing Traces

prasanth encountered issues with Signoz dashboard not displaying traces. Srikanth recommended configuring the `OTEL_EXPORTER_OTLP_ENDPOINT`, but they are still facing issues with the exporter's connection.

9mo

Monitoring Multiple Kubernetes Clusters with SigNoz

Siva asks about monitoring multiple Kubernetes clusters. Viljar suggested setting up otel collectors in the remote clusters and utilizing SigNoz's k8s-infra solution if needed.

4mo

Replacing Grafana Elastic and Prometheus Setup with SigNoz

Dipen is trying to replace the current setup with SigNoz. Both Nocnica and Srikanth provide possible solutions including using OpenTelemetry and target allocator respectively.

3mo