#general

Querying Logs from Different Storage Destinations in SigNoz

TLDR Thejokrishna asked about querying logs from different storage destinations in SigNoz, instead of ClickHouse. Nocnica promised to consult the team and listen to Thejokrishna's use case for alternative storages.

3mo

Join the chat

Jun 25, 2023 (3 months ago)

Photo of md5-7fc459e6fd924fd32e2c2b50f0eb335c

Thejokrishna

06:34 AM

Well, it was not about collecting logs, it was more about searching logs from different destinations…. as SigNoz UI is currently designed to query logs that are stored in ClickHouse… My question is, what if logs are stored in other destinations, eg: File system, or ObjectStore (In Azure of GCP). Is there an adaptor layer that can be re-purposed? Nocnica Pranay ? Thanks again.

Photo of md5-7d3e7e5883af6e145e90d5d5a7a25acf

Nocnica

02:42 PM

gotcha that makes more sense why we were talking about alternatives to ClickHouse storage. I'm reaching the limits of my five days of experience with SigNoz so I'll consult with the team on Monday and get you a response 🙂

Jun 26, 2023 (3 months ago)

Thejokrishna

12:59 AM

thank you Nocnica

Nocnica

02:08 AM

Looks like, while it isn't currently available, I'd love to hear what storage system you're using, and get a more complete use case. I'd be happy to schedule a call, or if you could just offer some detail in this thread.

SigNoz Community

Built with ClickHouse as datastore, SigNoz is an open-source APM to help you find issues in your deployed applications & solve them quickly | Knowledge Base powered by Struct.AI

Indexed 825 threads (61% resolved)

Join Our Community Manage subscription

Similar Threads

Issues with SigNoz Setup and Data Persistence in AKS

Vaibhavi experienced issues setting up SigNoz in AKS, and faced data persistence issues after installation. Srikanth provided guidance on ClickHouse version compatibility and resource requirements, helping Vaibhavi troubleshoot and resolve the issue.

5mo

Troubleshooting K8s Deployment and Suggested Fields

saajid had issues with k8s deployment suggested fields. nitya-signoz suggested redeploying and shared troubleshooting steps.

6mo

Customizing Clickhouse Tables to Save Application Logs

Shivam sought advice on creating custom Clickhouse tables for application logs. vishal-signoz suggested moving data to S3 to save costs, and also confirmed the required changes in query layers. nitya-signoz noted that this would entail an entire codebase rewrite.

1mo