#support

Issues with Log Retention Configuration on Self-Hosted SigNoz Installation

TLDR Cameron was having trouble configuring log retention for a self-hosted SigNoz installation. Prashant helped troubleshoot, asking for specific logs, but issue is unresolved.

2mo

Join the chat

Sep 13, 2023 (2 months ago)

Photo of md5-611f1509eb2ef9c6eb5edb797318f612

Cameron

06:20 PM

Hello. I'm trying to configure log retention on a self-hosted SigNoz installation. I'm following this faq for retention, but nothing is pushing to the bucket on gcp I have setup for this. Where would I need to look for errors to see if something is not correct or troubleshooting? Thank you.

https://signoz.io/docs/userguide/retention-period/

Photo of md5-1899629483c7ab1dccfbee6cc2f637b9

Prashant

07:41 PM

Hi Cameron 👋

Can you share your clickhouse.coldStorage section of your override config with redacted sensitive informations?

In case of Docker, storage_configuration section.

Cameron

08:38 PM

Hi Prashant. Here is a redacted config. We are using a google service account with an ssh key.

08:39

Cameron

08:39 PM

08:40

Cameron

08:40 PM

This is the clickhouse-storage.xml from docker

Prashant

09:24 PM

> <endpoint>https://storage.googleapis.com/BUCKET-NAME-HERE/data/</endpoint>
You will need to include a folder at the end for example /data/ . Is that already set?

09:25

Prashant

09:25 PM

apart from that, everything looks good.

can you check and share ClickHouse ~~pod~~ container logs related to cold storage (S3-protocol)?

Cameron

11:30 PM

Yes, folder name is data/

11:31

Cameron

11:31 PM

where would I find the clickHouse pod logs?

Sep 14, 2023 (2 months ago)

Prashant

12:08 AM

Cameron In case of Docker, that would be clickhouse container logs.

Sep 18, 2023 (2 months ago)

Cameron

10:10 PM

When going through the clickhouse logs what should I be looking for? Thanks.

Sep 19, 2023 (2 months ago)

Prashant

05:06 AM

any error/warning level logs related to S3 or including <http://storage.googleapis.com|storage.googleapis.com> in lgos

Sep 20, 2023 (2 months ago)

Cameron

03:48 PM

Hi. We are not able to see logs related to s3 or googleapis on clickhouse container logs. What else do you suggest?

Prashant

06:04 PM

Cameron are you seeing any error or warnings in the clickhouse pod?

SigNoz Community

Built with ClickHouse as datastore, SigNoz is an open-source APM to help you find issues in your deployed applications & solve them quickly | Knowledge Base powered by Struct.AI

Indexed 1023 threads (61% resolved)

Join Our Community

Similar Threads

Configuring Logs in Signoz and Clickhouse

Varaprasad queries on pushing logs to ClickHouse and analyzing from SigNoz. Srikanth advises using `signoz-otel-collector` and shares a guide. Varaprasad explains their plan of action. Ankit confirms vector parsing and sharding setup in ClickHouse.

1mo

Issues with Installing Signoz on Standalone VM with Two Additional Disks

vvpreo is having difficulty installing Signoz on a standalone VM due to an issue with OTEL collector not starting because of migration problems. Ankit and vishal-signoz proposed various solutions, but the issue remained unresolved. They planned a screen-sharing session to resolve it.

2mo

Troubleshooting Signoz Log Collection in OCI

Harsh had problems collecting logs with Signoz after moving to OCI. Prashant helped pinpoint the problem to OCI's CRI and provided a solution using a specific crio logs path.

1mo

Troubleshooting Signoz Login and Log Display Issues

Noor is experiencing issues with logging into Signoz and getting logs to display. They communicated their efforts and asked Srikanth for help. Srikanth asked for more details and promised to review the information soon.

3mo

SigNoz Installation via Helm-chart Fails due to Clickhouse Error

马璐 encountered an error when installing SigNoz via helm-chart because of a clickhouse error. After a brief exchange, they found that they needed to whitelist the node's IP for clickhouse.

2mo