SigNoz Installation Issues on Kubernetes

TLDR Nond encountered issues installing SigNoz on Kubernetes and sought assistance. Srikanth attempted to gather more information, but the issue remains unresolved.

Photo of Nond
Nond
Thu, 08 Jun 2023 23:58:48 UTC

Hey team, trying to install SigNoz on K8 by following this guide . I'm able to run `helm --namespace platform install my-release signoz/signoz` and got the following output: ```coalesce.go:175: warning: skipped value for zookeeper.initContainers: Not a table. NAME: my-release LAST DEPLOYED: Thu Jun 8 16:55:48 2023 NAMESPACE: platform STATUS: deployed REVISION: 1 NOTES: 1. You have just deployed SigNoz cluster: - frontend version: '0.20.1' - query-service version: '0.20.1' - alertmanager version: '0.23.0-0.2' - otel-collector version: '0.76.1' - otel-collector-metrics version: '0.76.1'``` However, when I run `kubectl -n platform get pods` to validate the installation, I get the following error: `No resources found in platform namespace.` I've also tried searching across all namespaces in my K8 cluster and don't see any SigNoz pods running. Has anyone seen this issue before?

Photo of Srikanth
Srikanth
Mon, 12 Jun 2023 01:04:12 UTC

> No resources found in platform namespace. Does this happen in general or only specific to SigNoz deployment?

Photo of Nond
Nond
Mon, 12 Jun 2023 16:43:13 UTC

Hey Srikanth, this only happens on the SigNoz helm deployment. I have other services deployed to the cluster and get pods works fine for those services.

Photo of Srikanth
Srikanth
Tue, 13 Jun 2023 02:03:06 UTC

How to reproduce this issue?

Photo of Nond
Nond
Tue, 13 Jun 2023 16:53:21 UTC

Srikanth I'm currently running Kubernetes version 1.24. The cluster was set up using Rancher and running on AWS EC2 t3a.xlarge instances. I followed the SigNoz instructions here . Please let me know what other information I can provide to help you reproduce the issue. This is a blocking issue for me in evaluating SigNoz for our use case.

Photo of Nond
Nond
Tue, 13 Jun 2023 21:56:07 UTC

Srikanth I was able to get some error messages; ```kubectl get events --namespace platform LAST SEEN TYPE REASON OBJECT MESSAGE 2m9s Normal WaitForFirstConsumer persistentvolumeclaim/data-my-release-zookeeper-0 waiting for first consumer to be created before binding 48m Warning FailedCreate replicaset/my-release-clickhouse-operator-6c9c97cf55 Error creating: Pod "my-release-clickhouse-operator-6c9c97cf55-hf27r" is invalid: spec.containers[2].volumeMounts[0].name: Not found: "opa-config" 32m Warning FailedCreate replicaset/my-release-clickhouse-operator-6c9c97cf55 Error creating: Pod "my-release-clickhouse-operator-6c9c97cf55-72hs6" is invalid: spec.containers[2].volumeMounts[0].name: Not found: "opa-config" 15m Warning FailedCreate replicaset/my-release-clickhouse-operator-6c9c97cf55 Error creating: Pod "my-release-clickhouse-operator-6c9c97cf55-zqz4d" is invalid: spec.containers[2].volumeMounts[0].name: Not found: "opa-config" 48m Warning FailedCreate daemonset/my-release-k8s-infra-otel-agent Error creating: Pod "my-release-k8s-infra-otel-agent-t28k8" is invalid: spec.containers[1].volumeMounts[0].name: Not found: "opa-config" 32m Warning FailedCreate daemonset/my-release-k8s-infra-otel-agent Error creating: Pod "my-release-k8s-infra-otel-agent-mdmfk" is invalid: spec.containers[1].volumeMounts[0].name: Not found: "opa-config" 15m Warning FailedCreate daemonset/my-release-k8s-infra-otel-agent Error creating: Pod "my-release-k8s-infra-otel-agent-pd9zq" is invalid: spec.containers[1].volumeMounts[0].name: Not found: "opa-config" 48m Warning FailedCreate replicaset/my-release-k8s-infra-otel-deployment-6f9b58897f Error creating: Pod "my-release-k8s-infra-otel-deployment-6f9b58897f-qz48n" is invalid: spec.containers[1].volumeMounts[0].name: Not found: "opa-config" 32m Warning FailedCreate replicaset/my-release-k8s-infra-otel-deployment-6f9b58897f Error creating: Pod "my-release-k8s-infra-otel-deployment-6f9b58897f-wgggm" is invalid: spec.containers[1].volumeMounts[0].name: Not found: "opa-config" 15m Warning FailedCreate replicaset/my-release-k8s-infra-otel-deployment-6f9b58897f Error creating: Pod "my-release-k8s-infra-otel-deployment-6f9b58897f-82v48" is invalid: spec.containers[1].volumeMounts[0].name: Not found: "opa-config" 15m Warning FailedCreate statefulset/my-release-signoz-alertmanager create Pod my-release-signoz-alertmanager-0 in StatefulSet my-release-signoz-alertmanager failed error: Pod "my-release-signoz-alertmanager-0" is invalid: spec.containers[1].volumeMounts[0].name: Not found: "opa-config" 49m Warning FailedCreate replicaset/my-release-signoz-frontend-5f454c8d76 Error creating: Pod "my-release-signoz-frontend-5f454c8d76-k629r" is invalid: spec.containers[1].volumeMounts[0].name: Not found: "opa-config" 32m Warning FailedCreate replicaset/my-release-signoz-frontend-5f454c8d76 Error creating: Pod "my-release-signoz-frontend-5f454c8d76-cv8k6" is invalid: spec.containers[1].volumeMounts[0].name: Not found: "opa-config" 15m Warning FailedCreate replicaset/my-release-signoz-frontend-5f454c8d76 Error creating: Pod "my-release-signoz-frontend-5f454c8d76-mwfwz" is invalid: spec.containers[1].volumeMounts[0].name: Not found: "opa-config" 48m Warning FailedCreate replicaset/my-release-signoz-otel-collector-5496d4894 Error creating: Pod "my-release-signoz-otel-collector-5496d4894-txz5n" is invalid: spec.containers[1].volumeMounts[0].name: Not found: "opa-config" 32m Warning FailedCreate replicaset/my-release-signoz-otel-collector-5496d4894 Error creating: Pod "my-release-signoz-otel-collector-5496d4894-v95cf" is invalid: spec.containers[1].volumeMounts[0].name: Not found: "opa-config" 15m Warning FailedCreate replicaset/my-release-signoz-otel-collector-5496d4894 Error creating: Pod "my-release-signoz-otel-collector-5496d4894-fttt9" is invalid: spec.containers[1].volumeMounts[0].name: Not found: "opa-config" 48m Warning FailedCreate replicaset/my-release-signoz-otel-collector-metrics-765d8b8f84 Error creating: Pod "my-release-signoz-otel-collector-metrics-765d8b8f84-g9f8p" is invalid: spec.containers[1].volumeMounts[0].name: Not found: "opa-config" 32m Warning FailedCreate replicaset/my-release-signoz-otel-collector-metrics-765d8b8f84 Error creating: Pod "my-release-signoz-otel-collector-metrics-765d8b8f84-d7w92" is invalid: spec.containers[1].volumeMounts[0].name: Not found: "opa-config" 15m Warning FailedCreate replicaset/my-release-signoz-otel-collector-metrics-765d8b8f84 Error creating: Pod "my-release-signoz-otel-collector-metrics-765d8b8f84-mrcn4" is invalid: spec.containers[1].volumeMounts[0].name: Not found: "opa-config" 15m Warning FailedCreate statefulset/my-release-signoz-query-service create Pod my-release-signoz-query-service-0 in StatefulSet my-release-signoz-query-service failed error: Pod "my-release-signoz-query-service-0" is invalid: spec.containers[1].volumeMounts[0].name: Not found: "opa-config" 15m Warning FailedCreate statefulset/my-release-zookeeper create Pod my-release-zookeeper-0 in StatefulSet my-release-zookeeper failed error: Pod "my-release-zookeeper-0" is invalid: spec.containers[1].volumeMounts[0].name: Not found: "opa-config" 2m9s Normal WaitForFirstConsumer persistentvolumeclaim/signoz-db-my-release-signoz-query-service-0 waiting for first consumer to be created before binding 2m9s Normal WaitForFirstConsumer persistentvolumeclaim/storage-my-release-signoz-alertmanager-0 waiting for first consumer to be created before binding```