#support

Troubleshooting Clickhouse Exporter Error

TLDR ELLIOTTCABLE encountered an error with Clickhouse exporters, likely due to a misconfiguration hinted by Srikanth. This was confirmed when ELLIOTTCABLE realized that Clickhouse's HTTP protocol was not implemented. The user subsequently inquired about HTTP-protocol support or alternative configurations.

Powered by Struct AI
Oct 09, 2023 (2 months ago)
ELLIOTTCABLE
Photo of md5-dc4cfcccaad91745f1ec367044f97482
ELLIOTTCABLE
09:04 PM
Hm. Anybody have any idea what an error like [handshake] unexpected packet [72] from server from the clickhouse exporters might indicate? (logs threaded)
09:04
ELLIOTTCABLE
09:04 PM
Oct 09 21:11:25 durian000 signoz-otel-collector[1086820]: 2023-10-09T21:11:25.743Z        info        service/telemetry.go:104        Setting up own telemetry...
Oct 09 21:11:25 durian000 signoz-otel-collector[1086820]: 2023-10-09T21:11:25.743Z        info        service/telemetry.go:127        Serving Prometheus metrics        {"address": "127.0.0.1:8888", "level": "Basic"}
Oct 09 21:11:25 durian000 signoz-otel-collector[1086820]: 2023-10-09T21:11:25.743Z        info        [email protected]/exporter.go:275        Stability level of component is undefined        {"kind": "exporter", "data_type": "traces", "name": "clickhousetraces"}
Oct 09 21:11:25 durian000 signoz-otel-collector[1086820]: Error: failed to build pipelines: failed to create "clickhousetraces" exporter for data type "traces": error connecting to primary db: [handshake] unexpected packet [72] from server
Oct 09 21:11:25 durian000 signoz-otel-collector[1086820]: 2023/10/09 21:11:25 application run finished with error: failed to build pipelines: failed to create "clickhousetraces" exporter for data type "traces": error connecting to primary db: [handshake] unexpected packet [72] from server
Oct 09 21:11:25 durian000 systemd[1]: signoz-otel-collector.service: Main process exited, code=exited, status=1/FAILURE
09:04
ELLIOTTCABLE
09:04 PM
(This is a relatively custom install on bare metal; no Docker or anything like that. Still figuring out all of the config and whatnot, it’s probably some really basic user-error.)
Oct 10, 2023 (1 month ago)
Srikanth
Photo of md5-ce04a9988e2fd758a659dc55be6f2543
Srikanth
12:16 AM
What is the DSN configured? The clickhouse exporters in SigNoz only support tcp. It’s probably an issue because of mis configuration.
ELLIOTTCABLE
Photo of md5-dc4cfcccaad91745f1ec367044f97482
ELLIOTTCABLE
02:58 PM
Ah, figured out that Clickhouse’s HTTP protocol isn’t implemented shortly after I posted the above (oof, I hate trying to use multiple Slacks) — tell-tale unexpected packet [72], since ASCII 72 is H, in HTTP/1… etc.

Is HTTP-protocol support for Clickhouse on the radar? Or alternatively, can I configure multiple host/port combinations and distribute across them? Talking to only a single server is something of a non-starter for us … HTTP allows us to use our usual NginX tunneling/balancing infrastructure for this, which is preferable.

A custom streaming Clickhouse-protocol balancer would be a significant amount of engineering effort. Hrm. :x