Resolving Clickhouse Initialization Issues After Upgrade
TLDR surya faced issues with Clickhouse not properly initializing. Prashant suggested specific upgrade steps and a pod restart, which successfully resolved the problem.
Prashant
Fri, 14 Jul 2023 17:29:10 UTCHI surya :wave: This has been resolved in latest release.
Prashant
Fri, 14 Jul 2023 17:29:30 UTCRef:
surya
Mon, 17 Jul 2023 04:59:41 UTCok thanks will check
surya
Tue, 18 Jul 2023 08:23:46 UTCPost upgrade getting this issue
surya
Tue, 18 Jul 2023 08:24:08 UTCPrashant
Prashant
Tue, 18 Jul 2023 08:27:13 UTCIs clickhouse cluster back up after the upgrade? If yes, this should be resolved in next pod restart. You could try restarting the otel collectors. ```kubectl rollout restart -n platform deploy/my-release-signoz-otel-collector deploy/my-release-signoz-otel-collector-metrics```
surya
Tue, 18 Jul 2023 08:32:40 UTCi didn't take back up, since i am working in dev environment for testing purpose. While i get the initial issue i reinstalled everything and upgraded signoz as you suggested also now restarted
surya
Tue, 18 Jul 2023 08:33:34 UTCthis is what i am getting from *my-release-signoz-otel-collector-metrics-init ●
surya
Tue, 18 Jul 2023 08:36:01 UTCclickhouse is running properly
surya
Tue, 18 Jul 2023 08:36:14 UTCbut name is changed post upgrade Prashant
Prashant
Tue, 18 Jul 2023 09:32:04 UTC`chi-signoz-cluster-0-0-0` this is strange one.
surya
Tue, 18 Jul 2023 09:33:04 UTCinside this clickhouse only running
Prashant
Tue, 18 Jul 2023 09:35:02 UTCdid you override any existing values?
Prashant
Tue, 18 Jul 2023 09:35:18 UTCcan you share output of this? ```kubectl get all -n platform```
surya
Tue, 18 Jul 2023 09:35:44 UTCno i just used this
surya
Tue, 18 Jul 2023 09:36:06 UTCand this
surya
Tue, 18 Jul 2023 12:17:53 UTCissue resolved thanks Prashant
SigNoz Community
Indexed 1060 threads
Built with ClickHouse as datastore, SigNoz is an open-source APM to help you find issues in your deployed applications & solve them quickly | Knowledge Base powered by Struct.AI
View in App
surya
Fri, 14 Jul 2023 14:24:56 UTCHi Team, I am currently facing some issues with Clickhouse it is not initialized correctly.