Hi Team, Need your inputs on the below. Migration Binary Hangs / Fails with Timeout on ClickHouse Connection During v0.87 → v0.88 Upgrade We're upgrading SigNoz from v0.87.0 to v0.88.0 on a production setup using the Linux binary installation. As part of the upgrade, we attempted to run migrate-script.sh and encountered repeated hangs and connection timeout errors from the migrate binary. Error - attempt 1 failed: time-series query: clickhouse: acquire conn timeout. you can increase the number of max open conn or the dial timeout next retry in 2.6s attempt 2 failed: time-series query: clickhouse: acquire conn timeout ... Despite setting MIGRATE_WORKERS=1 and MIGRATE_MAX_OPEN_CONNS=1, the migration binary fails to acquire a connection and loops endlessly. We have already verified below - ClickHouse is running and accepts connections via clickhouse-client CH_ADDR=127.0.0.1:9000 is explicitly set (avoiding localhost) ClickHouse has no active queries or connection limits reached All values in system.metrics show 0 open or blocked connections No firewall or container network restrictions exist No error logs from ClickHouse Tried strace and saw the binary blocking on futex() or network I/O Also tried running with: GODEBUG=netdns=go ./migrate ... No error visible Are there known bugs or regressions in the migrate binary's connection handling in v0.88? Is there an option to perform the data migration using SQL manually (i.e., raw ClickHouse statements from the migration tool)? Any updated or debug-enabled version of the binary we can try? FYI I had shared the migratescript and log file for reference We’re blocked in production and would appreciate any guidance.

@Aniket Agarwal any suggestions here?

Hi @Aniket Agarwal, Need your inputs on this issue. Our team is blocked due to this. Can you please suggest once you get a moment?

Hey @Nishanth Boggavarapu, there is no issue with migrator , we have performed migration for our cloud users, without facing the above issue, please give us some time to look into this

Thanks, let me know if you need more details. The main issue is that migrator is unable to connect to clickhouse-server/db which is up and running and timesout.

Hey Nishanth did get chance to exactly pinpoint the error, give us some time please

Okay sure

Hey @Nishanth Boggavarapu, not able to find anything specific but we can get on a call tomorrow, if possible to debug this, let me know which time works for you?

Thanks for getting me back @Aniket Agarwal . Can we connect on monday at 11am EST. Please let me know if that works for you or not?

Hey @Nishanth Boggavarapu, yeah sure , here is my calendar please schedule as per your convenience https://calendly.com/aniket-signoz/30min

Hi @Aniket Agarwal Any update so far. This is blocking our migration.

Hey @Nishanth Boggavarapu, were you able to schedule a call with @Aniket Agarwal?

@Nagesh Bansal - I had a call scheduled one with @Aniket Agarwal in the last week of August. During the discussion, he mentioned he would connect with the team and follow up on the issue. However, I haven’t received any updates since then.

Hey @Nishanth Boggavarapu, didn't get the time to go through your query will give updates mostly by this week