https://signoz.io logo
#general
Title
# general
s

Saleem Shaik

07/13/2023, 6:36 PM
HI Team I have installed signoz with helm. Below pods are stuck in init:0/1 state signoz-alertmanager otel-collector otel-collector-metrics signoz-query-service current pod status is as shown below screenshot it seems clickhouse cluster is not created only two statefulsets signoz-alertmanager and signoz-query-service are created and are in init:0/1 state Below are logs of clickhouse-operator
I0713 18:24:35.520431       1 cluster.go:84] Run query on: chi-uc-care-monitor-clickhouse-cluster-0-0.uc-tools.svc.cluster.local of [chi-uc-care-monitor-clickhouse-cluster-0-0.uc-tools.svc.cluster.local]
E0713 182435.531029 1 connection.go:98] connect():FAILED Ping(http://clickhouse_operator:***@chi-uc-care-monitor-clickhouse-cluster-0-0.uc-tools.svc.cluster.local:8123/). Err: dial tcp: lookup chi-uc-care-monitor-clickhouse-cluster-0-0.uc-tools.svc.cluster.local on 10.100.0.1053 no such host E0713 182435.531214 1 connection.go:126] QueryContext():FAILED connect(http://clickhouse_operator:***@chi-uc-care-monitor-clickhouse-cluster-0-0.uc-tools.svc.cluster.local:8123/) for SQL: SELECT DISTINCT name, concat('SYSTEM SYNC REPLICA "', database, '"."', name, '"') AS sync_table_query FROM system.tables WHERE engine LIKE 'Replicated%' W0713 182435.531319 1 cluster.go:91] QueryAny():FAILED to run query on: chi-uc-care-monitor-clickhouse-cluster-0-0.uc-tools.svc.cluster.local of [chi-uc-care-monitor-clickhouse-cluster-0-0.uc-tools.svc.cluster.local] skip to next. err: FAILED connect(http://clickhouse_operator:***@chi-uc-care-monitor-clickhouse-cluster-0-0.uc-tools.svc.cluster.local:8123/) for SQL: SELECT DISTINCT name, concat('SYSTEM SYNC REPLICA "', database, '"."', name, '"') AS sync_table_query FROM system.tables WHERE engine LIKE 'Replicated%!'(MISSING) E0713 182435.531344 1 cluster.go:95] QueryAny():FAILED to run query on all hosts [chi-uc-care-monitor-clickhouse-cluster-0-0.uc-tools.svc.cluster.local] I0713 182435.531472 1 cluster_schemer.go:188] HostSyncTables():Sync tables: [] as [] I0713 182435.531631 1 worker-deleter.go:521] deleteCluster():Delete cluster uc-tools/cluster - started I0713 182435.610996 1 deleter.go:292] deleteServiceCluster():uc-tools/cluster-uc-care-monitor-clickhouse-cluster I0713 182435.638329 1 worker-deleter.go:487] deleteShard():Delete shard uc-tools/0 - started I0713 182435.688622 1 deleter.go:279] deleteServiceShard():uc-tools/shard-uc-care-monitor-clickhouse-cluster-0 I0713 182435.694098 1 worker-deleter.go:425] deleteHost():Delete host cluster/0-0 - started I0713 182436.030438 1 cluster.go:84] Run query on: chi-uc-care-monitor-clickhouse-cluster-0-0.uc-tools.svc.cluster.local of [chi-uc-care-monitor-clickhouse-cluster-0-0.uc-tools.svc.cluster.local] E0713 182436.035212 1 connection.go:98] connect():FAILED Ping(http://clickhouse_operator:***@chi-uc-care-monitor-clickhouse-cluster-0-0.uc-tools.svc.cluster.local:8123/). Err: dial tcp: lookup chi-uc-care-monitor-clickhouse-cluster-0-0.uc-tools.svc.cluster.local on 10.100.0.1053 no such host E0713 182436.035254 1 connection.go:126] QueryContext():FAILED connect(http://clickhouse_operator:***@chi-uc-care-monitor-clickhouse-cluster-0-0.uc-tools.svc.cluster.local:8123/) for SQL: SELECT DISTINCT name,
clickhouse cluster pod is created and up but still not able to connect operator
1 cluster.go:84] Run query on: chi-uc-care-monitor-clickhouse-cluster-0-0.uc-tools.svc.cluster.local of [chi-uc-care-monitor-clickhouse-cluster-0-0.uc-tools.svc.cluster.local]
E0714 030224.036026 1 connection.go:98] connect():FAILED Ping(http://clickhouse_operator:***@chi-uc-care-monitor-clickhouse-cluster-0-0.uc-tools.svc.cluster.local:8123/). Err: dial tcp: lookup chi-uc-care-monitor-clickhouse-cluster-0-0.uc-tools.svc.cluster.local on 10.100.0.1053 no such host E0714 030224.036079 1 connection.go:126] QueryContext():FAILED connect(http://clickhouse_operator:***@chi-uc-care-monitor-clickhouse-cluster-0-0.uc-tools.svc.cluster.local:8123/) for SQL: SELECT DISTINCT name, concat('SYSTEM SYNC REPLICA "', database, '"."', name, '"') AS sync_table_query FROM system.tables WHERE engine LIKE 'Replicated%'
please guid me
p

Prashant Shahi

07/14/2023, 11:39 AM
Hi @Saleem Shaik 👋 Could you please upgrade to the latest SigNoz chart
0.19.0
? And see how it goes.
s

Saleem Shaik

07/14/2023, 3:23 PM
its working now. May I know the issue caused for it?
p

Prashant Shahi

07/14/2023, 3:23 PM
glad to know that.
It was likely caused by this: https://github.com/SigNoz/charts/issues/260
s

Saleem Shaik

07/14/2023, 3:25 PM
ohh ok..Thanks alot @Prashant Shahi 🙂
p

Prashant Shahi

07/14/2023, 3:27 PM
You are welcome ✌️
2 Views