Missing k8s_pod_* Metrics in SigNoz Dashboard

TLDR Narasimhamurthi asked for help with missing k8s_pod_* metrics in the SigNoz dashboard. Prashant identified a Digital Ocean K8s issue, now tracked in a GitHub ticket.

Photo of Narasimhamurthi
Narasimhamurthi
Thu, 16 Feb 2023 11:52:38 UTC

Shall we get custom metrics in k8s using signoz ?

Photo of vishal-signoz
vishal-signoz
Thu, 16 Feb 2023 14:18:57 UTC

You can export k8s metrics to SigNoz, follow this doc:

Photo of Narasimhamurthi
Narasimhamurthi
Fri, 17 Feb 2023 08:24:18 UTC

I am not able to see k8s_pod_* metrics in the dashboard

Photo of Narasimhamurthi
Narasimhamurthi
Fri, 17 Feb 2023 08:30:28 UTC

Like pod k8s_pod_cpu_*,k8s_pod_memory* vishal-signoz

Photo of Narasimhamurthi
Narasimhamurthi
Fri, 17 Feb 2023 13:25:08 UTC

vishal-signoz signoz is not able to get k8s_pod_* metrics.Could you help?

Photo of vishal-signoz
vishal-signoz
Fri, 17 Feb 2023 13:25:49 UTC

Prashant <@4K1456> Can one of you help?

Photo of Prashant
Prashant
Fri, 17 Feb 2023 14:53:02 UTC

Check logs of pods from `k8s-infra` chart - mainly OtelAgent component

Photo of Narasimhamurthi
Narasimhamurthi
Mon, 20 Feb 2023 06:17:07 UTC

All metrics are available except k8s_pod_* .

Photo of Narasimhamurthi
Narasimhamurthi
Mon, 20 Feb 2023 06:19:40 UTC

Please find the below screenshot

Photo of Narasimhamurthi
Narasimhamurthi
Mon, 20 Feb 2023 06:19:51 UTC

Prashant

Photo of Prashant
Prashant
Mon, 20 Feb 2023 11:39:13 UTC

Narasimhamurthi details about K8s version, distribution and cloud vendor, if any?

Photo of Narasimhamurthi
Narasimhamurthi
Mon, 20 Feb 2023 11:49:32 UTC

K8s version:1.24.4 ,cloudvendor:DO

Photo of Narasimhamurthi
Narasimhamurthi
Mon, 20 Feb 2023 18:00:14 UTC

Prashant could you help with the k8s_pod_* metrics which are not appearing to create dashboard

Photo of Narasimhamurthi
Narasimhamurthi
Tue, 21 Feb 2023 13:04:43 UTC

May I have an update On this Prashant ?

Photo of Narasimhamurthi
Narasimhamurthi
Tue, 21 Feb 2023 13:05:04 UTC

What am I not able to see the k8s_pod_* metrics ?

Photo of Prashant
Prashant
Wed, 22 Feb 2023 06:35:21 UTC

> error scraperhelper/scrapercontroller.go:214 Error scraping metrics {"kind": "receiver", "name": "kubeletstats", "pipeline": "metrics", "error": "Get \"\": dial tcp: lookup pool-iytqfvim8-qo0cj on 10.245.0.10:53: no such host", "scraper": "kubeletstats"} Narasimhamurthi Issue with Digital Ocean K8s. Unable to resolve node name properly to fetch kubetlet metrics.

Photo of Prashant
Prashant
Wed, 22 Feb 2023 06:35:46 UTC

will respond when I get the fix.

Photo of Prashant
Prashant
Wed, 22 Feb 2023 07:06:06 UTC

Tracking it here:

Photo of Narasimhamurthi
Narasimhamurthi
Mon, 27 Feb 2023 16:56:25 UTC

Thanks Prashant for the update