Monitoring JVM Metrics with Signoz in Kubernetes Cluster

TLDR Ragul had trouble monitoring JVM metrics in their Kubernetes cluster with Signoz using Helm. Srikanth advised modifying the scrape config in values.yaml and checking the `host:port/path`.

Photo of Ragul
Ragul
Mon, 05 Jun 2023 17:31:17 UTC

Hi team , I've just installed signoz in k8s cluster using helm. i need to monitor metrics for my spring boot microservice ,and I can see my microservice name in services section for that i was trying to monitor metrics listed in link . in this i am getting values for only few metrics for other i am not getting data i have added screenshot of metric which i am not getting data , should i add additional config for this metrics . please suggest some solution for getting this metrics value

Photo of Srikanth
Srikanth
Tue, 06 Jun 2023 00:47:02 UTC

What does your scrape config look like? There is probably some n/w issue while scraping.

Photo of Ragul
Ragul
Tue, 06 Jun 2023 04:14:06 UTC

scrape config is default one from helm values.yaml . i have not did any changes

Photo of Srikanth
Srikanth
Tue, 06 Jun 2023 07:47:30 UTC

The default one from values.yaml doesn’t scrape the metrics exposed by general applications. You need to configure it with the endpoints where you applications emit metrics.

Photo of Ragul
Ragul
Tue, 06 Jun 2023 10:32:12 UTC

OK

Photo of Ragul
Ragul
Tue, 06 Jun 2023 10:32:57 UTC

i should add promethus config in values.yaml ?

Photo of Ragul
Ragul
Tue, 06 Jun 2023 10:34:39 UTC

if yes , please help me in overiding the values.yaml

Photo of Srikanth
Srikanth
Tue, 06 Jun 2023 11:24:20 UTC

Yes, you need to add an additional scrape config in values.yaml. It would look like following. ```otelCollectorMetrics: config: receivers: # prometheus scrape config prometheus: config: scrape_configs: ... <existing_configs_here> - job_name: 'applications-metrics' scrape_interval: 10s metrics_path: <your probe endpoint> static_configs: - targets:```

Photo of Ragul
Ragul
Tue, 06 Jun 2023 16:59:18 UTC

I added this above config in values.yaml , and upgraded helm using the command -> helm -n platform upgrade my-release signoz/signoz -f values.yaml . but still i am not getting those above mentioned metrics

Photo of Ragul
Ragul
Tue, 06 Jun 2023 17:01:45 UTC

for cross check in signoz clickhouse i tried with -> SELECT name FROM ( SELECT DISTINCT JSONExtractString(labels, '__name__') AS name FROM signoz_metrics.time_series_v2 ) AS tmp1 WHERE name ILIKE '%jdbc%' with this query

Photo of Ragul
Ragul
Tue, 06 Jun 2023 17:02:22 UTC

No data where there

Photo of Srikanth
Srikanth
Tue, 06 Jun 2023 18:35:14 UTC

Make sure the `host:port/path` is valid and outputs the metrics.