Sizgoz Docker Setup Issue with Metrics Dashboard
TLDR Rui reported issues with sizgoz docker setups and metrics dashboards, losing data and formatting. Yunus and vishal-signoz helped find a solution, which seemed to resolve the problem.
Yunus
Fri, 06 Oct 2023 12:24:51 UTCHi Rui , can you please provide any more info to help reproduce this issue.
Rui
Fri, 06 Oct 2023 14:36:17 UTCHi Yunus, thanks for following up on my report. { "description": "Cassandra Cluster", "layout": [], "tags": [ "cassandra", "metrics" ], "title": "Cassandra", the 'layout' field becomes an empty array when this issue happens. This happened just randomly when I just click and enter 'cassandra' dashboard. I even manually rebuilt a second cassandra dashboard by manually recreating each panel. After one day or two. Both dashboards become empty.
Rui
Fri, 06 Oct 2023 14:39:50 UTCI also went through docker container logs hoping to find any errors in logs. I was trying to understand where a dashboard definition(json content) is saved and how it happens that saved data could be just get lost without any explicit modifications/saving action are done from the frontend
Rui
Tue, 10 Oct 2023 18:43:23 UTCupdate: this just happened again to another dashboard - 'kafka'. All I did was to click open the dashboard and all of sudden, all the panels in that dashboard are just gone. I'm on 0.30.0. not sure if this issue has been reported by other users. Please let me know of anything I can help to troubleshoot the issue. Thanks!
Rui
Wed, 11 Oct 2023 12:54:28 UTCupdate: random loss of whole dashboard happened 4 times since my last report. eagerly waiting for the fix before giving up. thank you so much!
vishal-signoz
Fri, 13 Oct 2023 00:36:28 UTCRui Thanks for reporting. We have identified the issue and released a patch to prevent this in latest version.
Rui
Fri, 13 Oct 2023 01:39:28 UTCHi Vishal, thank you so much for reaching out with update! I've updated our installation to 0.31.0. It's been 8 hours and all my dashboards are still there. very happy! I will report back in a couple of days. Great work, thank you so much!
vishal-signoz
Fri, 13 Oct 2023 02:13:16 UTCRui Are there two people using dashboards or did you open same dashboard in multiple tabs?
SigNoz Community
Indexed 1061 threads
Built with ClickHouse as datastore, SigNoz is an open-source APM to help you find issues in your deployed applications & solve them quickly | Knowledge Base powered by Struct.AI
View in App
Rui
Thu, 05 Oct 2023 12:44:39 UTCHi Team, I've been testing with sizgoz docker setup and following every version update of Signoz. Starting with 0.29.1 update, Some of the metrics dashboards I previously built just went blank. When this happens 'last update' of that dashboard is changed even though I didn't make any modification to dashboard setting. I'm now at 0.30.0. The only way I can bring the missing panels back is to manually add 'layout' section of dashoboard json file and create a new dashboard from it. But not before too long, layout definition of the new dashboard is again wiped out. The issue is still happening to me. Any hints on how to troubleshoot this are really appreciated! Thank you!