TLDR Rui reported issues with sizgoz docker setups and metrics dashboards, losing data and formatting. Yunus and vishal-signoz helped find a solution, which seemed to resolve the problem.
Hi Team, I've been testing with sizgoz docker setup and following every version update of Signoz. Starting with 0.29.1 update, Some of the metrics dashboards I previously built just went blank. When this happens 'last update' of that dashboard is changed even though I didn't make any modification to dashboard setting. I'm now at 0.30.0. The only way I can bring the missing panels back is to manually add 'layout' section of dashoboard json file and create a new dashboard from it. But not before too long, layout definition of the new dashboard is again wiped out. The issue is still happening to me. Any hints on how to troubleshoot this are really appreciated! Thank you!
Hi Rui , can you please provide any more info to help reproduce this issue.
Hi Yunus, thanks for following up on my report.
"description": "Cassandra Cluster",
the 'layout' field becomes an empty array when this issue happens. This happened just randomly when I just click and enter 'cassandra' dashboard. I even manually rebuilt a second cassandra dashboard by manually recreating each panel. After one day or two. Both dashboards become empty.
I also went through docker container logs hoping to find any errors in logs. I was trying to understand where a dashboard definition(json content) is saved and how it happens that saved data could be just get lost without any explicit modifications/saving action are done from the frontend
update: this just happened again to another dashboard - 'kafka'. All I did was to click open the dashboard and all of sudden, all the panels in that dashboard are just gone. I'm on 0.30.0. not sure if this issue has been reported by other users. Please let me know of anything I can help to troubleshoot the issue. Thanks!
update: random loss of whole dashboard happened 4 times since my last report. eagerly waiting for the fix before giving up. thank you so much!
Rui Thanks for reporting. We have identified the issue and released a patch to prevent this in latest version.
Hi Vishal, thank you so much for reaching out with update! I've updated our installation to 0.31.0. It's been 8 hours and all my dashboards are still there. very happy! I will report back in a couple of days.
Great work, thank you so much!
Rui Are there two people using dashboards or did you open same dashboard in multiple tabs?
Indexed 1061 threads
Built with ClickHouse as datastore, SigNoz is an open-source APM to help you find issues in your deployed applications & solve them quickly | Knowledge Base powered by Struct.AI