SigNoz Dashboard Query Assistance

TLDR Sumanth had trouble importing a Grafana dashboard and creating a custom trace between services on SigNoz. Prashant explained how to do so and then suggested Ankit who arranged a meeting with Sumanth to discuss further.

Photo of Sumanth
Sumanth
Fri, 07 Jul 2023 07:37:46 UTC

is this the right channel for this or should i ask in general?

Photo of Prashant
Prashant
Fri, 07 Jul 2023 09:46:36 UTC

Importing Grafana dashboard with variable is not supported by SigNoz at the moment.

Photo of Prashant
Prashant
Fri, 07 Jul 2023 09:47:27 UTC

You would have to create the panels on your own from the Dashboard page. You could copy the same PromQL to SigNoz widgets. Or use query-builder.

Photo of Sumanth
Sumanth
Fri, 07 Jul 2023 09:49:44 UTC

how can i get the PromQL from these dashboards on grafana?

Photo of Prashant
Prashant
Fri, 07 Jul 2023 09:54:40 UTC

If PromQL is used in grafana dashboard, then it can be seen in the JSON.

Photo of Prashant
Prashant
Fri, 07 Jul 2023 09:55:20 UTC

Download the grafana dashboard JSON, and search for `"expr":` keyword. You should find the relevant PromQL next to it.

Photo of Sumanth
Sumanth
Fri, 07 Jul 2023 09:56:37 UTC

got it, thank you

Photo of Sumanth
Sumanth
Fri, 07 Jul 2023 09:57:15 UTC

could you help out on one other question i have? how to get the time taken by a trace to go from 1 service to another?

Photo of Prashant
Prashant
Fri, 07 Jul 2023 09:58:58 UTC

you can open any trace from SigNoz Trace page to get the idea.

Photo of Prashant
Prashant
Fri, 07 Jul 2023 09:59:33 UTC

Use service and operation filters in Trace page to get relevant traces

Photo of Sumanth
Sumanth
Fri, 07 Jul 2023 10:06:13 UTC

correct but thats at an individual trace level to give context, i have a microservice A that takes an api call from a webhook integration which (after passing through multiple microservices) reaches microservice B where a final external api call is made. I want to create a dashboard to track the average time taken for api calls (grouped by client) from microservice A to microservice B

Photo of Sumanth
Sumanth
Fri, 07 Jul 2023 10:07:06 UTC

the goal being getting alerted if this time taken is beyond certain threshold for any client

Photo of Sumanth
Sumanth
Fri, 07 Jul 2023 10:08:05 UTC

I tried to create a dashboard panel using traces, but i couldnt crack how to achieve this. Do you have any insights/suggestions ? Prashant

Photo of Prashant
Prashant
Fri, 07 Jul 2023 11:13:51 UTC

<@4K15aa> would be a better person to answer this.

Photo of Ankit
Ankit
Sun, 09 Jul 2023 15:48:52 UTC

Hi Sumanth this can be done. I would use serviceName and name (operation) as filter and diff the startTime and group by traceID (or maybe grouping is not needed).

Photo of Ankit
Ankit
Sun, 09 Jul 2023 15:49:33 UTC

what's grouped by client that you would like to do? I would love to share a sample clickhouse query to enable the above use case. Let me know if I can help

Photo of Sumanth
Sumanth
Mon, 10 Jul 2023 08:21:25 UTC

hi Ankit, thanks for responding. I am not fully following the solution you are mentioning. Finding it tough to create the dashboard if okay with you, could we have a small huddle today when free? shouldnt take more than 10 mins Would love to learn from you

Photo of Ankit
Ankit
Mon, 10 Jul 2023 08:39:19 UTC

Sumanth feel free to find a convenient time from . Sometime after 7pm today or 12pm/1pm/6pm/7pm/8pm tomorrow?

Photo of Sumanth
Sumanth
Mon, 10 Jul 2023 08:54:21 UTC

i scheduled for 6:30 today if that is okay? else we can do earlier time slot tomorrow

Photo of Ankit
Ankit
Mon, 10 Jul 2023 09:19:40 UTC

should be okay