hi team. facing this error while installing signoz on civo k8s cluster in k8s infra otel collector pods -

2023-06-14T17:16:58.774Z	info	exporterhelper/queued_retry.go:433	Exporting failed. Will retry the request after interval.	{"kind": "exporter", "data_type": "logs", "name": "otlp", "error": "rpc error: code = Unavailable desc = connection error: desc = \"transport: Error while dialing: dial tcp 10.43.248.80:4317: i/o timeout\"", "interval": "30.496229307s"}

2023-06-14T17:16:59.705Z	info	exporterhelper/queued_retry.go:433	Exporting failed. Will retry the request after interval.	{"kind": "exporter", "data_type": "metrics", "name": "otlp", "error": "rpc error: code = Unavailable desc = connection error: desc = \"transport: Error while dialing: dial tcp 10.43.248.80:4317: i/o timeout\"", "interval": "17.274408022s"}

2023-06-14T17:17:12.810Z	info	exporterhelper/queued_retry.go:433	Exporting failed. Will retry the request after interval.	{"kind": "exporter", "data_type": "logs", "name": "otlp", "error": "rpc error: code = Unavailable desc = connection error: desc = \"transport: Error while dialing: dial tcp 10.43.248.80:4317: i/o timeout\"", "interval": "18.948217314s"}.

where this error could be further debugged?

Looks like a network issue, please check if

10.43.248.80:4317

is accessible. cc: @Prashant Shahi

the call has to be made from which service? @Vishal Sharma also curl wont be installed by default right?

@Jay Ghiya Hello Jay, Wondering whether this issue was fixed or no 🙂 Having the same issue

@Prashant Shahi Can you please look into this?

@Ibrahim no issue is not fixed. currently did not have much time to investigate further.

@Jay Ghiya, @Ibrahim are you seeing this at the start during the installation? If yes, it is expected in the start to throw this since the k8s-infra collector is not able to connect to SigNoz collector since ClickHouse takes some time to get ready.