#support

Issues with Log Retention Configuration on Self-Hosted SigNoz Installation

TLDR Cameron was having trouble configuring log retention for a self-hosted SigNoz installation. Prashant helped troubleshoot, asking for specific logs, but issue is unresolved.

Powered by Struct AI
Sep 13, 2023 (2 months ago)
Cameron
Photo of md5-611f1509eb2ef9c6eb5edb797318f612
Cameron
06:20 PM
Hello. I'm trying to configure log retention on a self-hosted SigNoz installation. I'm following this faq for retention, but nothing is pushing to the bucket on gcp I have setup for this. Where would I need to look for errors to see if something is not correct or troubleshooting? Thank you.

https://signoz.io/docs/userguide/retention-period/
Prashant
Photo of md5-1899629483c7ab1dccfbee6cc2f637b9
Prashant
07:41 PM
Hi Cameron 👋

Can you share your clickhouse.coldStorage section of your override config with redacted sensitive informations?

In case of Docker, storage_configuration section.
Cameron
Photo of md5-611f1509eb2ef9c6eb5edb797318f612
Cameron
08:38 PM
Hi Prashant. Here is a redacted config. We are using a google service account with an ssh key.
08:39
Cameron
08:39 PM
Image 1 for
08:40
Cameron
08:40 PM
This is the clickhouse-storage.xml from docker
Prashant
Photo of md5-1899629483c7ab1dccfbee6cc2f637b9
Prashant
09:24 PM
> <endpoint>https://storage.googleapis.com/BUCKET-NAME-HERE/data/</endpoint>
You will need to include a folder at the end for example /data/ . Is that already set?
09:25
Prashant
09:25 PM
apart from that, everything looks good.

can you check and share ClickHouse pod container logs related to cold storage (S3-protocol)?
Cameron
Photo of md5-611f1509eb2ef9c6eb5edb797318f612
Cameron
11:30 PM
Yes, folder name is data/
11:31
Cameron
11:31 PM
where would I find the clickHouse pod logs?
Sep 14, 2023 (2 months ago)
Prashant
Photo of md5-1899629483c7ab1dccfbee6cc2f637b9
Prashant
12:08 AM
Cameron In case of Docker, that would be clickhouse container logs.
Sep 18, 2023 (2 months ago)
Cameron
Photo of md5-611f1509eb2ef9c6eb5edb797318f612
Cameron
10:10 PM
When going through the clickhouse logs what should I be looking for? Thanks.
Sep 19, 2023 (2 months ago)
Prashant
Photo of md5-1899629483c7ab1dccfbee6cc2f637b9
Prashant
05:06 AM
any error/warning level logs related to S3 or including <http://storage.googleapis.com|storage.googleapis.com> in lgos
Sep 20, 2023 (2 months ago)
Cameron
Photo of md5-611f1509eb2ef9c6eb5edb797318f612
Cameron
03:48 PM
Hi. We are not able to see logs related to s3 or googleapis on clickhouse container logs. What else do you suggest?
Prashant
Photo of md5-1899629483c7ab1dccfbee6cc2f637b9
Prashant
06:04 PM
Cameron are you seeing any error or warnings in the clickhouse pod?

SigNoz Community

Built with ClickHouse as datastore, SigNoz is an open-source APM to help you find issues in your deployed applications & solve them quickly | Knowledge Base powered by Struct.AI

Indexed 1023 threads (61% resolved)

Join Our Community