S3 Configuration for Cold Storage and Query Results
TLDR Amir asked about query results when using S3 for cold storage. Srikanth confirmed it's possible with a performance hit, as metadata is kept on disk for reference.
Srikanth
Tue, 14 Mar 2023 11:58:20 UTCYou should be able to get the query results but with some hit to performance. ClickHouse keeps a metadata for s3 objects on the disk and fetches info when needed.
Amir
Tue, 14 Mar 2023 13:01:09 UTCGreat! thanks!!
SigNoz Community
Indexed 1060 threads
Built with ClickHouse as datastore, SigNoz is an open-source APM to help you find issues in your deployed applications & solve them quickly | Knowledge Base powered by Struct.AI
View in AppSimilar Threads
ClickHouse as Hot Storage and S3 as Cold Storage
Resolving Log Retention and Login Issues in Clickhouse
Services UI Goes Blank Due to Retention Issue with S3 Bucket
Querying Clickhouse Storage Usage and Configuring Cold Storage
Configuring ClickHouse for S3 Retention and EC2 Deployment
Amir
Tue, 14 Mar 2023 10:23:49 UTCHi guys, a question regarding S3 configuration for cold storage - will I be able to get query results from S3 when it is configured? If not, how can I run queries on the offloaded data. Thanks!