Configuring Multiple ClickHouse Clusters for Single SigNoz Frontend

TLDR Andrii inquired about configuring multiple ClickHouse clusters for a single SigNoz frontend, akin to how Grafana works with datasources. Srikanth speculated that implementing such a feature could be non-trivial.

Photo of Andrii
Andrii
Mon, 25 Sep 2023 15:45:36 UTC

Hello Everybody. Just a quick question: is it possible to configure multiple ClickHouse cluster as datasources for the single SigNoz frontend. Let's imagine we have a multiple Kubernetes clusters in different regions and/or clouds. So instead of having SigNoz instance in each and every region with unique URL, I would like to have only one with all regional ClickHouse clusters attached to it. Is is possible?

Photo of Srikanth
Srikanth
Tue, 26 Sep 2023 01:58:03 UTC

No

Photo of Srikanth
Srikanth
Tue, 26 Sep 2023 01:58:47 UTC

Are these independent Cluster or just nodes in the same cluster?

Photo of Andrii
Andrii
Tue, 26 Sep 2023 13:55:59 UTC

they are independent clusters in different regions and/or even clouds. But we want to have 1 centralized UI and then just select the proper datasource inside

Photo of Andrii
Andrii
Tue, 26 Sep 2023 13:56:35 UTC

Srikanth ^

Photo of Srikanth
Srikanth
Tue, 26 Sep 2023 14:17:47 UTC

No, this is not possible.

Photo of Andrii
Andrii
Tue, 26 Sep 2023 14:21:19 UTC

ok. does it make sense to create a feature request for such kind of functionality?

Photo of Srikanth
Srikanth
Tue, 26 Sep 2023 14:24:25 UTC

This is the first time we have seen anybody ask for it. Dynamically changing the data clickhouse DSN is non-trivial. I don’t know if there is any interest in the community. However, you can create a feature request.

Photo of Andrii
Andrii
Tue, 26 Sep 2023 14:26:48 UTC

it is not about dynamically change the DNS. It is about to have multiple ClickHouse clusters connected to the frontend at the same time. And then you just select against which cluster (datasource) you want to run the query. The same actually as Grafana works with datasources or Opensearch

Photo of Srikanth
Srikanth
Tue, 26 Sep 2023 14:28:14 UTC

And how does that happen under the hood?

Photo of Srikanth
Srikanth
Tue, 26 Sep 2023 14:28:31 UTC

I said DSN and not DNS

Photo of Andrii
Andrii
Tue, 26 Sep 2023 14:32:19 UTC

In Grafana you can configure multiple datasources of the same type. and then when for the query you can select the datasource that will actually execute it and respond with results. For graphs, you also select a datasource that will provide data. And you even can have different graphs configured to different datasources on the same dashboard.