Masking data in logs for Signoz Clickhouse Backend
TLDR Krishnadas needed to mask data in their logs before injecting into their backend. nitya-signoz provided solutions and helped Krishnadas correct their regex commands.
Aug 02, 2023 (4 months ago)
Aug 03, 2023 (4 months ago)
replace_all_matchesin transform processor https://github.com/open-telemetry/opentelemetry-collector-contrib/tree/main/processor/transformprocessor#example
- replace_all_matches(attributes, "[email protected]", "[a-zA-Z0-9.]+@[a-zA-Z]+[.com]+")
Do I need to replace attributes with something else ? As per the json, I am seeing attributes_string instead
Aug 04, 2023 (4 months ago)
application run finished with error: invalid configuration: processors::transform: couldn't create function: the pattern supplied to replace_match is not a valid pattern: expected close range character
Not sure why it says expected close range character, when it is already close range.
transform: log_statements: - context: log statements: - replace_pattern(attributes["csusername"], "[a-zA-Z0-9.]+@[a-zA-Z]+[.com]+", "
Also used replace_pattern(body, "[a-zA-Z0-9.]+@[a-zA-Z]+[.com]+", "[email protected]") to mask content from body
Indexed 1023 threads (61% resolved)
Extracting Custom Fields as Attributes from Log in SigNoz
Harald wants to have custom fields from their body parsed as attributes in the SigNoz logger. They have tried implementing suggestions from nitya-signoz and Prashant, but the issue remains unsolved due to a potential race condition encountered while executing the code. They have provided a full example using Kind for further assistance.
Redacting Sensitive Info from Log Files Using Open Telemetry
Geoffrey needed assistance to redact certain information from log files, but the suggested redaction didn't help. They later resolved it themselves using transform processor, acting on both attributes message and body.
Parsing log entry and extracting fields with OTEL
Syed needed help parsing a log entry and extracting fields using OTEL. nitya-signoz provided guidance and the correct configurations, resolving the issue.
Debugging JSON Parsing and Logging Issue with Otel-Collector
Hannes was struggling to debug log conversion to JSON and attribute parsing in otel-collector. nitya-signoz provided guidance and updates to the processors which eventually resolved the issue.
JSON Parsing Issue with Logs in Signoz
Androw had trouble parsing logs with JSON in Signoz. nitya-signoz suggested changes to config, which resolved the issue after Androw added the missing field 'logsCollection'.