Managing Data Lifecycles in Clickhouse
TLDR Alejandro needed help with data management in Clickhouse. Srikanth and vishal-signoz provided links and examples for implementing tag level TTL and data deletion.
Srikanth
Fri, 12 May 2023 02:15:52 UTCSee
Alejandro
Fri, 12 May 2023 11:28:18 UTCAhaa ok. I thought I have an option via SigNoz UI to clean data from determined date
Alejandro
Fri, 12 May 2023 11:29:48 UTCOn the other hand, is a way to say for example application with tag service name helloworld keep traces from last 15 days ?
Srikanth
Fri, 12 May 2023 15:35:53 UTCYes, there is some form of tag level TTL, but there is no way to do it from UI.
Alejandro
Sun, 14 May 2023 17:06:38 UTCHow can I do it ? Without the UI ?
Srikanth
Mon, 15 May 2023 04:49:08 UTCthrough clickhouse command line
Alejandro
Mon, 15 May 2023 14:06:58 UTCcan you share that command ?
Srikanth
Mon, 15 May 2023 14:29:36 UTCI know it exists but haven’t tried it ourselves.
vishal-signoz
Mon, 15 May 2023 14:36:13 UTCHere’s an example Alejandro for the your case ```CREATE TABLE events ( `event` String, `time` DateTime, `value` UInt64 ) ENGINE = MergeTree ORDER BY (event, time) TTL time + INTERVAL 1 MONTH DELETE WHERE event != 'error', time + INTERVAL 6 MONTH DELETE WHERE event = 'error'```
vishal-signoz
Mon, 15 May 2023 14:36:40 UTCRefer:
vishal-signoz
Mon, 15 May 2023 14:37:39 UTCFollow this:
SigNoz Community
Indexed 1061 threads
Built with ClickHouse as datastore, SigNoz is an open-source APM to help you find issues in your deployed applications & solve them quickly | Knowledge Base powered by Struct.AI
View in App
Alejandro
Thu, 11 May 2023 20:36:15 UTCLooks I have not space at clickhouse: ```Cannot reserve 1.00 MiB, not enough space``` how can i drop my data from clickhouse since x days?