SigNoz Not Collecting Pod Logs Issue
TLDR Maksym is experiencing issues with SigNoz not collecting pod logs. Prashant suspects it could be an issue with the kubelet stats receiver and not pod logs.
Aug 09, 2023 (4 months ago)
Maksym
12:37 PMWhat do I do?
I have this error, plz help with this
logs from signoz-blueprint-k8s-infra-otel-agent-b9ssm
2023-08-08T14:36:37.299Z error [email protected]/scraper.go:68 call to /stats/summary endpoint failed {“kind”: “receiver”, “name”: “kubeletstats”, “data_type”: “metrics”, “error”: “Get "https://blueprint-4l6smfwylzws-node-0:10250/stats/summary\”: dial tcp: lookup blueprint-4l6smfwylzws-node-0 on 10.254.0.10:53: no such host"}
github.com/open-telemetry/opentelemetry-collector-contrib/receiver/kubeletstatsreceiver.(*kubletScraper).scrape
github.com/open-telemetry/opentelemetry-collector-contrib/receiver/[email protected]/scraper.go:68
go.opentelemetry.io/collector/receiver/scraperhelper.ScrapeFunc.Scrape
go.opentelemetry.io/collector/[email protected]/scraperhelper/scraper.go:20
go.opentelemetry.io/collector/receiver/scraperhelper.(*controller).scrapeMetricsAndReport
go.opentelemetry.io/collector/[email protected]/scraperhelper/scrapercontroller.go:210
go.opentelemetry.io/collector/receiver/scraperhelper.(*controller).startScraping.func1
go.opentelemetry.io/collector/[email protected]/scraperhelper/scrapercontroller.go:192
2023-08-08T14:36:37.299Z error scraperhelper/scrapercontroller.go:213 Error scraping metrics {“kind”: “receiver”, “name”: “kubeletstats”, “data_type”: “metrics”, “error”: “Get "https://blueprint-4l6smfwylzws-node-0:10250/stats/summary\”: dial tcp: lookup blueprint-4l6smfwylzws-node-0 on 10.254.0.10:53: no such host", “scraper”: “kubeletstats”}
go.opentelemetry.io/collector/receiver/scraperhelper.(*controller).scrapeMetricsAndReport
go.opentelemetry.io/collector/[email protected]/scraperhelper/scrapercontroller.go:213
go.opentelemetry.io/collector/receiver/scraperhelper.(*controller).startScraping.func1
go.opentelemetry.io/collector/[email protected]/scraperhelper/scrapercontroller.go:192
Aug 10, 2023 (3 months ago)
Prashant
03:14 PMThis issue is known to happen for DOKS.
Are you using Digital Ocean?
Aug 11, 2023 (3 months ago)
Maksym
07:49 AMAug 14, 2023 (3 months ago)
Maksym
07:21 AMPrashant
08:19 AMMaksym
09:50 AM
Prashant
09:52 AMMaksym
09:55 AMPrashant
09:58 AMPrashant
10:01 AMPrashant
10:02 AMPrashant
10:02 AMAug 15, 2023 (3 months ago)
Maksym
01:01 PM
SigNoz Community
Indexed 1023 threads (61% resolved)
Similar Threads
Issue Accessing Pod Logs in SigNoz UI on AKS
prashant is facing an issue accessing pod logs of their application in SigNoz UI on AKS. nitya-signoz and Prashant provide suggestions related to log file paths and potential issues, but the problem remains unresolved.
Empty HostMetrics Dashboard in SigNoz v0.19.0
Riccardo explained facing issues with empty dashboard panels after installing SigNoz v0.19.0. Prashant and Srikanth offered troubleshooting suggestions, including upgrading to otel-collector 0.76.1, but the issue remains unresolved.
Troubleshooting SigNoz Auto-Instrumentation Configuration
igor is having trouble configuring auto-instrumentation for Java applications using SigNoz, with traces not appearing in the SigNoz UI. Prashant advises to check logs of the otel sidecar, use service name for endpoint, verify supported libraries, and test with telemetrygen. However, the issue still persists.
Resolving Signoz Query Service Error
Einav encountered an error related to a missing table in the Signoz service which was preventing data visibility in the UI. Srikanth guided them to restart specific components and drop a database table, which resolved the issue.
Missing k8s_pod_* Metrics in SigNoz Dashboard
Narasimhamurthi asked for help with missing k8s_pod_* metrics in the SigNoz dashboard. Prashant identified a Digital Ocean K8s issue, now tracked in a GitHub ticket.