Resolving Error on Clickhouse Client and Otel Collector

TLDR Pruthvi faced an error with ClickHouse client. After resizing the disk, deleting a file, and restarting Otel collectors, the issue was resolved.

Photo of Pruthvi
Pruthvi
Sun, 07 May 2023 17:10:23 UTC

getting this error ```2023/05/07 17:05:14 Error creating clickhouse client: code: 76, message: There was an error on [chi-signozagent-clickhouse-cluster-0-0:9000]: Code: 76. DB::ErrnoException: Cannot open file /var/lib/clickhouse/store/731/73168718-bae3-4487-9240-41b08dbd7c02/samples_v2.sql.tmp, errno: 17, strerror: File exists. (CANNOT_OPEN_FILE) (version 22.8.8.3 (official build))```

Photo of vishal-signoz
vishal-signoz
Sun, 07 May 2023 18:07:13 UTC

Where are you seeing this error?

Photo of Srikanth
Srikanth
Mon, 08 May 2023 03:17:29 UTC

How did you arrive at this state? While you may have seen this error in collector — the real issue is with ClickHouse.

Photo of Pruthvi
Pruthvi
Mon, 08 May 2023 03:24:01 UTC

I was seeing this in otel collector.

Photo of Pruthvi
Pruthvi
Mon, 08 May 2023 03:25:13 UTC

And I connected to clickhouse pods, then saw a log that no space found. Then I resized the disk, deleted the above file and restarted Otel collectors, then it worked