#support

Issue with Extracting trace_id and span_id Using Logstash

TLDR Shivam is having trouble extracting trace_id and span_id from log bodies using Logstash and requested help. nitya-signoz suggested it could be a mapping issue and asked for more information.

3mo

Join the chat

Aug 09, 2023 (4 months ago)

Photo of md5-dfe2ccb640343537dbb50f03db6268f1

Shivam

09:33 AM

Hi team, I have stuck in a problem .As , I am saving my logs in a file and use logstash to send logs to signoz otel collector .But , I am not able to extract trace_id and span_id through logs body as its stringify. So, I write a logstash receiver as defined in docs and also edit operator from empty array to -type: json_parser. But still , I am not able yo get traced_id and span_id. Pls help . below i attached my receiver , processor code and logstash json logs for better understanding.

Aug 10, 2023 (3 months ago)

Photo of md5-a52b9d6c34f193d9a1ff940024f36f77

nitya-signoz

04:42 AM

Hi Shivam, can you share what you see in the signoz UI ? Click on the log line and share me the json.

It’s a problem of mapping as attributes in logstash doesn’t directly match with otel attributes you will have to do some transformations, we can help you do that once you share the above.

Also any reason for sticking with logstash, is it something that you are already using with your stack ?

SigNoz Community

Built with ClickHouse as datastore, SigNoz is an open-source APM to help you find issues in your deployed applications & solve them quickly | Knowledge Base powered by Struct.AI

Indexed 1023 threads (61% resolved)

Join Our Community

Similar Threads

Issues Extracting trace_id and span_id from Logstash Logs

Shivam is having trouble extracting trace_id and span_id from logstash logs. Nocnica is attempting to replicate the issue.

3mo

Configuring trace_id and span_id Extraction in Node App Logs

Saad was struggling to extract trace_id and span_id from their node app logs and asked for help. nitya-signoz instructed them to add the processor to the services, and this solved the issue.

Resolving Log Parsing Issue in Python OpenTelemetry

Diogo was experiencing issues with log tracing in Python OpenTelemetry. nitya-signoz suggests parsing trace_id and span_id from the log message body or using pipelines feature. Despite partial success, Diogo continued to experience issues with `trace_id`.

yesterday