Removing SigNoz's Own Logs from Dashboard
TLDR Geoffrey wanted to remove SigNoz's own logs from the dashboard. nitya-signoz provided a solution referencing an existing issue and a filter for ingesting only desired logs.
Jun 17, 2023 (5 months ago)
Geoffrey
07:57 AM> 2023-06-17T10:48:05+03:00 | 102.220.12.50 - - [17/Jun/2023:07:48:05 +0000] "GET /api/v1/logs/tail?timestampStart=1686986894073000000 HTTP/1.1" 200 73664 "http://signoz.domain.xyz:3301/logs?q=" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/114.0.0.0 Safari/537.36" "-"
>
> 2023-06-17T10:48:05+03:00 | 2023-06-17T07:48:05.163Z INFO app/server.go:280 /api/v1/logs/tail timeTaken: 4m50.969067478s
>
> 2023-06-17T10:48:05+03:00 | 2023-06-17T07:48:05.163Z DEBUG app/http_handler.go:2261 done!
>
> 2023-06-17T10:48:05+03:00 | 2023-06-17T07:48:05.161Z DEBUG clickhouseReader/reader.go:3541 closing go routine : 172.18.0.10:59372
>
> 2023-06-17T10:48:04+03:00 | 2023.06.17 07:48:04.850539 [ 47 ] {2107a9a8-84e4-4791-b150-561fbbba4b5d} <Information> executeQuery: Read 798 rows, 6.23 KiB in 0.002790747 sec., 285944 rows/sec., 2.18 MiB/sec.
>
> 2023-06-17T10:48:04+03:00 | 102.220.12.50 - - [17/Jun/2023:07:48:04 +0000] "GET /logs?q= HTTP/1.1" 200 791 "-" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/114.0.0.0 Safari/537.36" "-"
>
> 2023-06-17T10:48:04+03:00 | 2023-06-17T07:48:04.407Z DEBUG clickhouseReader/reader.go:3553 SELECT timestamp, id, trace_id, span_id, trace_flags, severity_text, severity_number, body,CAST((attributes_string_key, attributes_string_value), 'Map(String, String)') as attributes_string,CAST((attributes_int64_key, attributes_int64_value), 'Map(String, Int64)') as attributes_int64,CAST((attributes_float64_key, attributes_float64_value), 'Map(String, Float64)') as attributes_float64,CAST((resources_string_key, resources_string_value), 'Map(String, String)') as resources_string from signoz_logs.distributed_logs where timestamp >='1686988064851955929' and id > '2RIKkvmFr30zGjfEHHa8mJWn4HL' order by timestamp desc, id desc limit 100
Jun 19, 2023 (5 months ago)
Pranay
04:31 AMnitya-signoz
04:39 AMAs of now you will have to solve it manually as by default docker doesn’t provide metadata related to name of the pods.
Here is the solution for adding metadata to your docker container logs https://github.com/SigNoz/signoz/issues/1597#issuecomment-1259234665 and then you can use filter operator to filter out the logs you don’t want to be ingested https://github.com/open-telemetry/opentelemetry-collector-contrib/blob/main/pkg/stanza/docs/operators/filter.md
Geoffrey
10:06 AMSigNoz Community
Indexed 1023 threads (61% resolved)
Similar Threads
Parsing log entry and extracting fields with OTEL
Syed needed help parsing a log entry and extracting fields using OTEL. nitya-signoz provided guidance and the correct configurations, resolving the issue.
Removing Default Logs and Collecting Application Logs
Srikanth wanted to remove default logs and collect their application logs. nitya-signoz provided two solutions, and Srikanth chose the second one, which involves editing the ote-collector-config.yaml file.
Issues with SigNoz Setup and Data Persistence in AKS
Vaibhavi experienced issues setting up SigNoz in AKS, and faced data persistence issues after installation. Srikanth provided guidance on ClickHouse version compatibility and resource requirements, helping Vaibhavi troubleshoot and resolve the issue.