#general

Adding Traceid in Logs and Utilizing Helm for SigNoz Installation

TLDR Charan sought assistance on adding traceid in logs. nitya-signoz advised how to parse it and Prashant suggested modification of the logtransform processor or addition of a new one as a solution.

5mo

Join the chat

Jul 06, 2023 (5 months ago)

Photo of md5-1eeee6662f9b6f41f8fdf6b72050170e

Charan

06:01 AM

how to add traceid in logs section????

Photo of md5-a52b9d6c34f193d9a1ff940024f36f77

nitya-signoz

06:11 AM

You will have to parse it as attribute then it will be added to Signoz

Charan

06:49 AM

How to parse it?

06:52

Charan

06:52 AM

Already have traceid in selected fields but not getting traceid in traceid field how to solve this issue?

06:54

Charan

06:54 AM

06:56

Charan

06:56 AM

this is my issue.

nitya-signoz

07:56 AM

Trace_id is there in field because it is the top level key of logs model. https://opentelemetry.io/docs/specs/otel/logs/data-model/#log-and-event-record-definition

You can check out this example on how to parse your trace IDhttps://github.com/SigNoz/logs-benchmark/blob/0b2451e6108d8fa5fdd5808c4e174bd52b9d55d3/signoz/signoz-client/otel-collector-config.yaml#L22

Charan

09:13 AM

helm repo add signoz https://charts.signoz.io
i have used above chart for signoz installation.
Can you please tell me a way to update using helm command with added parser using set command in helm?

12:38

Charan

12:38 PM

anyupdate??

nitya-signoz

12:41 PM

You will have to create an override.yaml file and add the processor for parsing. Prashant do we have an example which we can share of override.yaml

Jul 07, 2023 (5 months ago)

Charan

05:46 AM

Prashant please provide example override.yaml with traceid attribute added.

06:45

Charan

06:45 AM

we are currently using chart version signoz-0.16.2 and app-version 0.20.2

Photo of md5-1899629483c7ab1dccfbee6cc2f637b9

Prashant

06:59 AM

you could either modify the default logtransform/internal processor, or you could add a new processor logtransform/custom as shown in override-values.yaml below:

otelCollector:
  config:
    processors:
      logstransform/custom:
        operators:
          # parse body as json to tmp
          - id: parse_json
            type: json_parser
            parse_from: body
            parse_to: attributes.temp
            output: trace_parse
          ...
    service:
      pipelines:
        logs:
          receivers: [otlp]
          processors: [logstransform/internal, logstransform/custom, batch]
          exporters: [clickhouselogsexporter]

SigNoz Community

Built with ClickHouse as datastore, SigNoz is an open-source APM to help you find issues in your deployed applications & solve them quickly | Knowledge Base powered by Struct.AI

Indexed 1023 threads (61% resolved)

Join Our Community

Similar Threads

Extracting Custom Fields as Attributes from Log in SigNoz

Harald wants to have custom fields from their body parsed as attributes in the SigNoz logger. They have tried implementing suggestions from nitya-signoz and Prashant, but the issue remains unsolved due to a potential race condition encountered while executing the code. They have provided a full example using Kind for further assistance.

209

5mo

Configuring trace_id and span_id Extraction in Node App Logs

Saad was struggling to extract trace_id and span_id from their node app logs and asked for help. nitya-signoz instructed them to add the processor to the services, and this solved the issue.

Adding Labels to Logs in SigNoz Using Pipelines

Tarek was trying to add labels from a JSON body to SigNoz logs. nitya-signoz and Shivanshu helped by providing pipeline examples and configurations. nitya-signoz's solution eventually resolved the issue.

3mo

JSON Parsing Issue with Logs in Signoz

Androw had trouble parsing logs with JSON in Signoz. nitya-signoz suggested changes to config, which resolved the issue after Androw added the missing field 'logsCollection'.

7mo

SigNoz Log Format and JSON Parsing

Luke asked about the log format for SigNoz and using operators to convert loggers. nitya-signoz shared resources about specifications and recommended using operators. Travis had issues with JSON parsing but resolved them by updating `otel-agent-config.yaml`.

9mo