Parsing Logs into Custom Fields with Signoz on k8s Cluster

TLDR Trọng needed help parsing logs into custom fields. nitya-signoz advised them to utilize regex parser with pipeline for achieving this, providing relevant resources.

Photo of Trọng
Trọng
Mon, 11 Sep 2023 08:29:55 UTC

Hi all, Im newbie, ive already installed successfully signoz on my k8s cluster ( by helm chart), but im stucked in trying to parse log (body field) into my custom field. For example, this is my current body field "2023-09-11 15:17:10.021 INFO [vert.x-eventloop-thread-1] io.vertx.ext.web.impl.RoutingContextImpl [2f8c407ddd7c] [17.2.5.6] [POST] [mcs-notification] [/sms] [request] [PostmanRuntime/7.29.2] [] [] [15.82.25.156:7323] [] - [257]{\"trace\":{\"frm\":\"payment\",\"cts\":164,\"cid\":\"e2a68da5-3\"},\"data\":{\"phoneNumber\":\"+849095911237\",\"contentType\":\"ADV\",\"content\":\"ting ting\"}}\n" how can i parse this. What i have to config to do it or do you guys have any references related to my problem. Thank you,

Photo of Prashant
Prashant
Tue, 12 Sep 2023 13:37:58 UTC

nitya-signoz can you look into this?

Photo of nitya-signoz
nitya-signoz
Tue, 12 Sep 2023 15:00:56 UTC

You will have to use regex parser with pipeline in your config to parse this