Resolving Clickhouse Initialization Issues After Upgrade

TLDR surya faced issues with Clickhouse not properly initializing. Prashant suggested specific upgrade steps and a pod restart, which successfully resolved the problem.

Photo of surya
surya
Fri, 14 Jul 2023 14:24:56 UTC

Hi Team, I am currently facing some issues with Clickhouse it is not initialized correctly.

Photo of Prashant
Prashant
Fri, 14 Jul 2023 17:29:10 UTC

HI surya :wave: This has been resolved in latest release.

Photo of Prashant
Prashant
Fri, 14 Jul 2023 17:29:30 UTC

Ref:

Photo of surya
surya
Mon, 17 Jul 2023 04:59:41 UTC

ok thanks will check

Photo of surya
surya
Tue, 18 Jul 2023 08:23:46 UTC

Post upgrade getting this issue

Photo of surya
surya
Tue, 18 Jul 2023 08:24:08 UTC

Prashant

Photo of Prashant
Prashant
Tue, 18 Jul 2023 08:27:13 UTC

Is clickhouse cluster back up after the upgrade? If yes, this should be resolved in next pod restart. You could try restarting the otel collectors. ```kubectl rollout restart -n platform deploy/my-release-signoz-otel-collector deploy/my-release-signoz-otel-collector-metrics```

Photo of surya
surya
Tue, 18 Jul 2023 08:32:40 UTC

i didn't take back up, since i am working in dev environment for testing purpose. While i get the initial issue i reinstalled everything and upgraded signoz as you suggested also now restarted

Photo of surya
surya
Tue, 18 Jul 2023 08:33:34 UTC

this is what i am getting from *my-release-signoz-otel-collector-metrics-init ‚óŹ *

Photo of surya
surya
Tue, 18 Jul 2023 08:36:01 UTC

clickhouse is running properly

Photo of surya
surya
Tue, 18 Jul 2023 08:36:14 UTC

but name is changed post upgrade Prashant

Photo of Prashant
Prashant
Tue, 18 Jul 2023 09:32:04 UTC

`chi-signoz-cluster-0-0-0` this is strange one.

Photo of surya
surya
Tue, 18 Jul 2023 09:33:04 UTC

inside this clickhouse only running

Photo of Prashant
Prashant
Tue, 18 Jul 2023 09:35:02 UTC

did you override any existing values?

Photo of Prashant
Prashant
Tue, 18 Jul 2023 09:35:18 UTC

can you share output of this? ```kubectl get all -n platform```

Photo of surya
surya
Tue, 18 Jul 2023 09:35:44 UTC

no i just used this only

Photo of surya
surya
Tue, 18 Jul 2023 09:36:06 UTC

and this

Photo of surya
surya
Tue, 18 Jul 2023 12:17:53 UTC

issue resolved thanks Prashant