GETTING BELOW ERROR IN signoz-otel-collector-metri...
# support
s
GETTING BELOW ERROR IN signoz-otel-collector-metrics POD
Copy code
{"kind": "exporter", "data_type": "metrics", "name": "clickhousemetricswrite", "error": "max elapsed time expired dial tcp 10.222.9.246:9000: connect: connection refused", "dropped_items": 881}
{"kind": "exporter", "data_type": "metrics", "name": "clickhousemetricswrite", "error": "dial tcp 10.222.9.246:9000: connect: connection refused", "interval": "0s"}
s
Is your ClickHouse running? It's seems there was a connection error
s
@Srikanth Chekuri Yes ClickHouse is Running and am able to see the latest (5) min logs from the Signoz UI
s
Do you see errors when ClickHouse is running?
s
Copy code
0. DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000c4fd017 in /usr/bin/clickhouse
1. DB::NetException::NetException<String, String, String>(int, FormatStringHelperImpl<std::type_identity<String>::type, std::type_identity<String>::type, std::type_identity<String>::type>, String&&, String&&, String&&) @ 0x000000000c793291 in /usr/bin/clickhouse
2. DB::WriteBufferFromPocoSocket::nextImpl() @ 0x000000000c792f96 in /usr/bin/clickhouse
3. DB::TCPHandler::runImpl() @ 0x00000000122355c2 in /usr/bin/clickhouse
4. DB::TCPHandler::run() @ 0x0000000012246a79 in /usr/bin/clickhouse
5. Poco::Net::TCPServerConnection::start() @ 0x0000000014c6fc52 in /usr/bin/clickhouse
6. Poco::Net::TCPServerDispatcher::run() @ 0x0000000014c70a51 in /usr/bin/clickhouse
7. Poco::PooledThread::run() @ 0x0000000014d678e7 in /usr/bin/clickhouse
8. Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000014d65edc in /usr/bin/clickhouse
9. ? @ 0x00007bb9c7c05609 in ?
10. ? @ 0x00007bb9c7b2a133 in ?
This the error i could see in chi-signoz-clickhouse-cluster pod.
and from inside the metrics pod am able to do below
Copy code
$ nc -zv $CLICKHOUSE_HOST $CLICKHOUSE_PORT
signoz-clickhouse (10.xxx.9.xxx:9000) open
signoz-clickhouse (10.xxx.9.xxx:9000) open
Copy code
global:
  storageClass: gce-resizable
  cloud: gcp

clickhouse:
  installCustomStorageClass: true
  persistence:
    size: 100Gi

ingress-nginx:
  enabled: true

frontend:
  ingress:
    enabled: true
    className: nginx
    hosts:
      - host: <http://sign.infra.MyDoamin.com|sign.infra.MyDoamin.com>
        paths:
          - path: /
            pathType: ImplementationSpecific
            port: 3301
    tls:
      - secretName: MyDoamin-infra-tls
        hosts:
          - <http://signoz.infra.MyDoamin.com|signoz.infra.MyDoamin.com>
    annotations:
      <http://cert-manager.io/cluster-issuer|cert-manager.io/cluster-issuer>: letsencrypt-prod


otelCollector:
  config:
    receivers:
      otlp:
        protocols:
          grpc:
            max_recv_msg_size_mib: 100

  ingress:
    enabled: true
    className: nginx
    hosts:
      - host: <http://otelcollect.infra.MyDoamin.com|otelcollect.infra.MyDoamin.com>
        paths:
          - path: /
            pathType: ImplementationSpecific
            port: 4318



alertmanager:
  enabled: false




exporters:
  clickhouselogsexporter:
    sending_queue:
      queue_size: 2000
Above is my values.yaml file. am i missing something????
s
Are you seeing this error continuously?
s
Yes