If I am hosting my own clickhouse cluster with three shards how should I mention the url of my three shards https://signoz.io/docs/operate/clickhouse/distributed-clickhouse/, in this doc we are not really changing the clickhouse url in otel-collector-config file...so does signoz automatically distribute data between different nodes/shards....should I connect a load balancer between the clickhouse instances and other services to distribute the load?(also is it possible to run migrations without toggling the setting in otel collector service env DOCKER_MULTI_NODE_CLUSTER=false)

Otel collector doesn’t need to know about the shards. It’s taken care of by clickhouse using zookeeper.

Thank you...so about the migration process in case of shards so is there a way to do it without manually changing the env variable?

Don’t think there is another way of doing it. @Vishal Sharma any thoughts on the above? Btw why do you want to avoid changing the env variable ?

In case you are using docker, you have to follow env change process.

I am hosting all the services on aws ecs fargate separately...so it would be really weird to redeploy a service after changing env variable ....but i guess it will only need to be done once at the start of deployment?

Yes, it runs when the otel collector starts. If the migrations are applied already then it is skipped. The case in which you will need migrations is when upgrading signoz.