SigNoz is an open-source APM. It helps developers monitor their applications & troubleshoot problems, an open-source alternative to DataDog, NewRelic, etc.

SigNoz Community

hey <@U0682C1B81J> can you share how much data (number of spans) you have for 6h and what is the memory/CPU allocated to SigNoz instance?

Might be case of underprovisioning

hi Pranay, thank you for your response. It might have been the case for underprovisioning, we increased the hardware under clickhouse and eventually it did stabilize (not initially though because we had the signoz-otel-collectors load spans into clickhouse from a ±100GB kafka topic) The UI now only throws this error for getting the tags for the 1 week period. Are there some recommendations with regard to sizing clickhouse based on ingested number of entities?

hello <@U01HPVB0D2S> I checked the usage explorer, looks like we have "Total count is 1155708235". Whenever I try to load the dashboard for one week, I get the same issue, timeout from both APIs called by the frontendm seemingly cut at 3.04s. Out clickhouse cluster has since relaxed quite a bit, but for long running queries I still get this. Any idea?

nevermind, found a way for my api gateway to wait for backend calls longer than  default 3000 ms