Hello all. I'm collecting metrics from percona's m...
# support
j
Hello all. I'm collecting metrics from percona's mongo-exporter. These metrics seem duplicated when they reach SigNoz / clickhouse with a set having the label
__temporality__="unspecified"
and another set having
__scope.name="..." __scope_.version="..."
. Can you help me fix this please?
Copy code
mongodb_rs_members_state{__temporality__="Unspecified",cl_id="65f122e6db1b6a10ec31be69",collector_instance="otel-scrape",http_scheme="http",k8s_cluster_name="exo7",member_idx="mongodb-0.mongodb-svc.mongodb.svc.cluster.local:27017",member_state="SECONDARY",net_host_name="mongodb-exporter.mongodb.svc.cluster.local",net_host_port="9216",rs_nm="mongodb",rs_state="2",server_address="mongodb-exporter.mongodb.svc.cluster.local",server_port="9216",service_instance_id="mongodb-exporter.mongodb.svc.cluster.local:9216",service_name="mongodb",url_scheme="http"}
mongodb_rs_members_state{__temporality__="Unspecified",cl_id="65f122e6db1b6a10ec31be69",collector_instance="otel-scrape",http_scheme="http",k8s_cluster_name="exo7",member_idx="mongodb-1.mongodb-svc.mongodb.svc.cluster.local:27017",member_state="PRIMARY",net_host_name="mongodb-exporter.mongodb.svc.cluster.local",net_host_port="9216",rs_nm="mongodb",rs_state="2",server_address="mongodb-exporter.mongodb.svc.cluster.local",server_port="9216",service_instance_id="mongodb-exporter.mongodb.svc.cluster.local:9216",service_name="mongodb",url_scheme="http"}
mongodb_rs_members_state{__temporality__="Unspecified",cl_id="65f122e6db1b6a10ec31be69",collector_instance="otel-scrape",http_scheme="http",k8s_cluster_name="exo7",member_idx="mongodb-2.mongodb-svc.mongodb.svc.cluster.local:27017",member_state="SECONDARY",net_host_name="mongodb-exporter.mongodb.svc.cluster.local",net_host_port="9216",rs_nm="mongodb",rs_state="2",server_address="mongodb-exporter.mongodb.svc.cluster.local",server_port="9216",service_instance_id="mongodb-exporter.mongodb.svc.cluster.local:9216",service_name="mongodb",url_scheme="http"}
mongodb_rs_members_state{__scope.name__="<http://github.com/open-telemetry/opentelemetry-collector-contrib/receiver/prometheusreceiver|github.com/open-telemetry/opentelemetry-collector-contrib/receiver/prometheusreceiver>",__scope.version__="0.119.0",cl_id="65f122e6db1b6a10ec31be69",collector.instance="otel-scrape",http.scheme="http",k8s.cluster.name="exo7",member_idx="mongodb-0.mongodb-svc.mongodb.svc.cluster.local:27017",member_state="SECONDARY",net.host.name="mongodb-exporter.mongodb.svc.cluster.local",net.host.port="9216",rs_nm="mongodb",rs_state="2",server.address="mongodb-exporter.mongodb.svc.cluster.local",server.port="9216",service.instance.id="mongodb-exporter.mongodb.svc.cluster.local:9216",service.name="mongodb",url.scheme="http"}
mongodb_rs_members_state{__scope.name__="<http://github.com/open-telemetry/opentelemetry-collector-contrib/receiver/prometheusreceiver|github.com/open-telemetry/opentelemetry-collector-contrib/receiver/prometheusreceiver>",__scope.version__="0.119.0",cl_id="65f122e6db1b6a10ec31be69",collector.instance="otel-scrape",http.scheme="http",k8s.cluster.name="exo7",member_idx="mongodb-1.mongodb-svc.mongodb.svc.cluster.local:27017",member_state="PRIMARY",net.host.name="mongodb-exporter.mongodb.svc.cluster.local",net.host.port="9216",rs_nm="mongodb",rs_state="2",server.address="mongodb-exporter.mongodb.svc.cluster.local",server.port="9216",service.instance.id="mongodb-exporter.mongodb.svc.cluster.local:9216",service.name="mongodb",url.scheme="http"}
mongodb_rs_members_state{__scope.name__="<http://github.com/open-telemetry/opentelemetry-collector-contrib/receiver/prometheusreceiver|github.com/open-telemetry/opentelemetry-collector-contrib/receiver/prometheusreceiver>",__scope.version__="0.119.0",cl_id="65f122e6db1b6a10ec31be69",collector.instance="otel-scrape",http.scheme="http",k8s.cluster.name="exo7",member_idx="mongodb-2.mongodb-svc.mongodb.svc.cluster.local:27017",member_state="SECONDARY",net.host.name="mongodb-exporter.mongodb.svc.cluster.local",net.host.port="9216",rs_nm="mongodb",rs_state="2",server.address="mongodb-exporter.mongodb.svc.cluster.local",server.port="9216",service.instance.id="mongodb-exporter.mongodb.svc.cluster.local:9216",service.name="mongodb",url.scheme="http"}
Basically, the question i'm asking is this : which process creates the label
__temporality__
and how can i send/process my metrics so that this data is set correctly at the start to eliminate the duplication?
s
Hi @jfboily, We have planned to support metrics without any normalization. This meant we needed to create another component and add it to the pipeline. This is the reason why you are seeing metrics twice. The signozclickhousemetrics here is ingesting them https://github.com/SigNoz/signoz/blob/main/deploy/docker/otel-collector-config.yaml#L97
j
@Srikanth Chekuri Thank you so much for your response. So, what are my options here? Can i normalize my metrics so that they are ingested only once? is that possible? Also, i send these metrics via otlp, not prometheus... i'm a bit confused ðŸ«