How can I set a limit to disk space usage for self hosted Signoz?

@Prashant Shahi can you help here ?

There is no exact means to set disk space usage in ClickHouse with SigNoz. However, you could update your retention policy to appropriate duration to limit the disk usage.

That is a bit of a massive problem since now signoz is somewhat DDoS'ing the docker server buy eating up all space, even with retention set to 1h

You can use either filter processor to drop all data that you don't need. https://github.com/open-telemetry/opentelemetry-collector-contrib/blob/main/processor/filterprocessor/README.md For k8s, it is easier to do that using blacklist/whitelist log collection.

What about

defaultKeepFreeSpaceBytes

That is minimum disk to keep free. You can use it to make sure clickhouse doesn't take up all of disk storage.

that is also only a k8s coldStorage option not docker self host

currently, clickhouse cold storage retention is time duration based, and not disk-size limit based. @Srikanth Chekuri/@Vishal Sharma would be right person to answer this.

I am glad to wait on those two 😄

Hey @Stefan Schneider Clickhouse doesn't support retention based on disk size limit. It only supports time based retention. We would suggest you to get approximate time during which your space fills up and then set retention to that period.

I only use it in dev and have retention set to 1h for everything and still it accumulates to past 80Gb in a few days