Hello team, I am trying to get signoz running in Nomad and I am getting the following error when ote...
r

Raphaël Grenier

over 1 year ago
Hello team, I am trying to get signoz running in Nomad and I am getting the following error when otel-collector tries to connect to clickhouse:
2024.04.30 19:33:38.290111 [ 750 ] {} <Error> TCPHandler: Code: 115. DB::Exception: Unknown setting database. (UNKNOWN_SETTING), Stack trace (when copying this message, always include the lines below):

0. DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000c800f1b in /usr/bin/clickhouse
1. DB::Exception::Exception<String>(int, FormatStringHelperImpl<std::type_identity<String>::type>, String&&) @ 0x0000000007219a43 in /usr/bin/clickhouse
2. DB::BaseSettingsHelpers::throwSettingNotFound(std::basic_string_view<char, std::char_traits<char>>) @ 0x000000001051fbab in /usr/bin/clickhouse
3. DB::BaseSettings<DB::SettingsTraits>::read(DB::ReadBuffer&, DB::SettingsWriteFormat) @ 0x000000001057a6e8 in /usr/bin/clickhouse
4. DB::TCPHandler::receiveQuery() @ 0x0000000012930419 in /usr/bin/clickhouse
5. DB::TCPHandler::receivePacket() @ 0x000000001292789b in /usr/bin/clickhouse
6. DB::TCPHandler::runImpl() @ 0x000000001291b4fb in /usr/bin/clickhouse
7. DB::TCPHandler::run() @ 0x0000000012933eb9 in /usr/bin/clickhouse
8. Poco::Net::TCPServerConnection::start() @ 0x00000000153a5a72 in /usr/bin/clickhouse
9. Poco::Net::TCPServerDispatcher::run() @ 0x00000000153a6871 in /usr/bin/clickhouse
10. Poco::PooledThread::run() @ 0x000000001549f047 in /usr/bin/clickhouse
11. Poco::ThreadImpl::runnableEntry(void*) @ 0x000000001549d67d in /usr/bin/clickhouse
12. ? @ 0x00007f46509ea609
13. ? @ 0x00007f465090f353
Any idea on what could be wrong?
I have recently Installed Signoz , But seems like its dashboard metrics are broken and i am getting ...
r

Rahul Juneja

8 months ago
I have recently Installed Signoz , But seems like its dashboard metrics are broken and i am getting these errors in otel-collector logs
{"level":"warn","ts":1737264221.6864421,"caller":"signozspanmetricsprocessor/processor.go:1177","msg":"Too many operations to track, using overflow operation name","kind":"processor","name":"signozspa │
│ nmetrics/cumulative","pipeline":"traces","maxNumberOfOperationsToTrackPerService":2048}                                                                                                                  │
│ {"level":"warn","ts":1737264221.6867743,"caller":"signozspanmetricsprocessor/processor.go:1177","msg":"Too many operations to track, using overflow operation name","kind":"processor","name":"signozspa │
│ nmetrics/delta","pipeline":"traces","maxNumberOfOperationsToTrackPerService":2048}
Span metrics config is default
signozspanmetrics/cumulative:
        metrics_exporter: clickhousemetricswrite
        latency_histogram_buckets:
          [
            100us,
            1ms,
            2ms,
            6ms,
            10ms,
            50ms,
            100ms,
            250ms,
            500ms,
            1000ms,
            1400ms,
            2000ms,
            5s,
            10s,
            20s,
            40s,
            60s,
          ]
        dimensions_cache_size: 100000
        dimensions:
          - name: service.namespace
            default: default
          - name: deployment.environment
            default: default
          - name: signoz.collector.id
      signozspanmetrics/delta:
        metrics_exporter: clickhousemetricswrite
        latency_histogram_buckets:
          [
            100us,
            1ms,
            2ms,
            6ms,
            10ms,
            50ms,
            100ms,
            250ms,
            500ms,
            1000ms,
            1400ms,
            2000ms,
            5s,
            10s,
            20s,
            40s,
            60s,
          ]
        dimensions_cache_size: 100000
        dimensions:
          - name: service.namespace
            default: default
          - name: deployment.environment
            default: default
          - name: signoz.collector.id
        aggregation_temporality: AGGREGATION_TEMPORALITY_DELTA
It seems like a blocker in adoption, can anybody guide me through this