#general

Seeking Open Source Dataset for Opentelemetry Trace Data

TLDR Vaishnavi needed varied trace data for training. vishal-signoz suggested using synthetic load generator and opentelemetry-demo.

Powered by Struct AI
May 17, 2023 (4 months ago)
Vaishnavi
Photo of md5-cab2473a3cdf839b1691ad04d47c7eab
Vaishnavi
06:42 AM
Hi Team, I'm trying to do some time series forecasting and anomaly detection in opentelemetry trace data. I do not have enough production data with me to train my model so I decided to generate some synthetic data on my own and that didn't train my model well and the variations in the data was not sufficient. Does anyone know if any open source dataset exists already or is there a way to generate traces for past three months (just for an example) with good amount of variations in it
May 18, 2023 (4 months ago)
vishal-signoz
Photo of md5-f936d3e5743d23344d6c60813189716f
vishal-signoz
04:27 AM
You can try synthetic load generator.
https://github.com/Omnition/synthetic-load-generator
Vaishnavi
Photo of md5-cab2473a3cdf839b1691ad04d47c7eab
Vaishnavi
04:32 AM
vishal-signoz thanks for sharing this. Is there a way we can give inputs to generate traces from now-1month traces ?
vishal-signoz
Photo of md5-f936d3e5743d23344d6c60813189716f
vishal-signoz
04:34 AM
No, we can only specify load for individual services.
04:35
vishal-signoz
04:35 AM
To simulate more realistic micro-services setup, try
https://github.com/open-telemetry/opentelemetry-demo
Vaishnavi
Photo of md5-cab2473a3cdf839b1691ad04d47c7eab
Vaishnavi
04:37 AM
Ok. In this repo, which make target generates traces