Hi Team, I am trying to self-host signoz 0.49.1 on my lab cluster (self hosted k8s cluster) for evaluation. Deployed the helm chart signoz-0.45.3 for the first time and connected to an external clickhouse db (22.10.1), the otel-collector is unable to find certain columns and schema-migrator is throwing "Dirty Database version" type errors. I checked the migration scripts available in the github repo: https://github.com/SigNoz/signoz-otel-collector/blob/main/migrationmanager/migrators/metrics/migrations/ 1 example of the script that I had manually applied is for the error message "Dirty database version 7" applied the sql statements mentioned in the script https://github.com/SigNoz/signoz-otel-collector/blob/main/migrationmanager/migrators/metrics/migrations/000007_exp_hist.up.sql but clickhouse complains that quantilesDD is not a valid function. My questions are: 1. why a fresh/new install of signoz on a clean clickhouse db require migrations and not create the new tables and columns by default? 2. how to resolve the quantilesDD issue on clickhouse DB and clickhouse doesn't understand it. Can anyone help as to why this is happening and what is the way forward?

1. why a fresh/new install of signoz on a clean clickhouse db require migrations and not create the new tables and columns by default?

Because it requires a separate logic to maintain the latest state of schemas which will keep getting updated.

1. how to resolve the quantilesDD issue on clickhouse DB and clickhouse doesn't understand it.

What version of ClickHouse are you using?

I am using 22.10.1 for clickhouse. it's external

Please use the update version that is compatible with charts ClickHouse version i.e 24.1.x

okay.. is there a list of the compatibility of versions between signoz and clickhouse? that we can refer to in the future? or just look at the helm chart for signoz to find that out?

is there a list of the compatibility of versions between signoz and clickhouse? that we can refer to in the future? or just look at the helm chart for signoz to find that out?

There is no compatibility matrix as of now

would like to understand what is your recommended clickhouse DB installation method for signoz?

If you have the ability to run in the same cluster as SigNoz I would recommend it but the external ClickHouse with compatibility should work equally well.

Thanks a lot, @Srikanth Chekuri for your quick help. I will try the helm way for clickhouse in the same cluster as signoz components.