Hi there :wave: Is there a way to debug Prometheus...
# support
v
Hi there 👋 Is there a way to debug Prometheus metrics receiver collection more deeply? I've configured 2 Prometheus jobs in
otel-collector-metrics
component like that:
Copy code
receivers:
  prometheus:
    config:
      scrape_configs:
      - job_name: ceph-prometheus-collector
        scheme: http
        scrape_interval: 60s
        static_configs:
        - targets:
          - ceph.ceph-csi-8nzj293m.svc.cluster.local:9002
      - job_name: generic-collector
        kubernetes_sd_configs:
        - role: pod
        relabel_configs:
...
...
...
No errors in metrics collector, after half an hour also no metrics in the storage. What could go wrong? 🙂
s
You can add this to exporter and check if metrics are actually getting collected https://github.com/open-telemetry/opentelemetry-collector/blob/main/exporter/debugexporter/README.md
If you do not see them in console from debug exporter, then they are not getting collected, if you do see then you may want to look into ClickHouse logs
v
Thanks!