cc: @Amol Umbark

Screenshot from 2023-01-19 10-08-20.png,Screenshot from 2023-01-19 10-08-08.png

can you please screenshot or payload for dashboard as well. Try creating a new panel and entering same filters, in network tab you will see a call to query range api. please share the payload

This is the request json {"start":1674102976000,"end":1674104776000,"step":60,"variables":{"SIGNOZ_START_TIME":1674102976000,"SIGNOZ_END_TIME":1674104776000},"dataSource":1,"compositeMetricQuery":{"queryType":1,"panelType":1,"builderQueries":{"A":{"queryName":"A","aggregateOperator":5,"metricName":"aws_rds_database_connections_maximum","tagFilters":{"items":[],"op":"AND"},"groupBy":[],"expression":"A","disabled":false}}}}

This is the response {"status":"success","data":{"resultType":"matrix","result":[{"queryName":"A","metric":{},"values":[[1674103080,"4.111111111111111"],[1674103140,"3.3333333333333335"],[1674103200,"3.4444444444444446"],[1674103260,"3.3333333333333335"],[1674103320,"3.4444444444444446"],[1674103380,"4"],[1674103440,"3.3333333333333335"],[1674103500,"3.6666666666666665"],[1674103560,"3.5555555555555554"],[1674103620,"3.4444444444444446"],[1674103680,"3.4444444444444446"],[1674103740,"3.3333333333333335"],[1674103800,"3.5555555555555554"],[1674103860,"3.5555555555555554"],[1674103920,"3.7777777777777777"],[1674103980,"3.3333333333333335"],[1674104040,"3.3333333333333335"],[1674104100,"3.4444444444444446"]]}]}}

one more thing for system metrics its working fine but for cloudwatch metrics its not working

Can you please create exact same query. The metric is different, this could also be cause of no -data. Notice the metric name in these two queries. It is different. JSON from Alerts:

{"start":1674102976000,"end":1674104776000,"step":60,"variables":{"SIGNOZ_START_TIME":1674102976000,"SIGNOZ_END_TIME":1674104776000},"dataSource":1,"compositeMetricQuery":{"queryType":1,"panelType":1,"builderQueries":{"A":{"queryName":"A","aggregateOperator":5,"metricName":"*aws_rds_database_connections_maximum*","tagFilters":{"items":[],"op":"AND"},"groupBy":[],"expression":"A","disabled":false}}}}

JSON from Dashboard:

{"start":1674102564000,"end":1674102864000,"step":60,"variables":{},"dataSource":1,"compositeMetricQuery":{"queryType":1,"panelType":1,"builderQueries":{"A":{"queryName":"A","aggregateOperator":5,"metricName":"*aws_rds_cpuutilization_average*","tagFilters":{"op":"AND","items":[]},"groupBy":["dbinstance_identifier"],"expression":"A","disabled":false}}}}

@Amol Umbark any luck ?

This is what ive added in the values.yml

- job_name: "CW-exporter"
              scrape_interval: 60s
              static_configs:
                - targets: ["prometheus-cloudwatch-exporter.platform.svc.cluster.local:9106"]

when i did the curl prometheus cloudwatch exporter i can see the cloudwatch metrices

@Prashant Shahi Any idea or something im not doing correcty?

One more thing how to enable a prometheus receiver in signoz helm chart.?

@Ankit Nayan can you help?

OtelCollector Metrics is the right place to include new scraper job. You would not need new prometheus receiver or pipeline.

@Vinayak Singh You can opt for scraping using pod annotations:

<http://signoz.io/scrape|signoz.io/scrape>

and

<http://signoz.io/port|signoz.io/port>

how to add the details in values.yaml

config:
          scrape_configs:
            - job_name: "CWexporter"
              scrape_interval: 120s
              static_configs: - targets: ["192.20.12.111:9106"]

is this what we need to add in docker setup. What is the kubernative alternative for this

It looks like something wrong with the exporter. Something related to the syntax. Sometime its working sometime not

One more help can you guys let me know what this log means

skipping send alert due to resend delay%!(EXTRA string=	 rule: , string=ES/Opensearch CPUUtilization, string=	 alert:, labels.Labels={alertname="ES/Opensearch CPUUtilization", domain_name="test-store-staging-new", ruleId="1", ruleSource="<https://monitoring.test.com/alerts/edit?ruleId=1>", severity="warning"})

What this resend delay is?

can you share few links?

You can follow our docs: https://signoz.io/docs/userguide/alerts-management/#2-configure-webhook-channel

But when im tryiing to add more metrices like RDS its not working. And also is there any way where i can flush the old data from the clickhouse DB