Slackbot
01/19/2023, 3:39 AMAnkit Nayan
Ankit Nayan
Vinayak Singh
01/19/2023, 4:36 AMAnkit Nayan
Vinayak Singh
01/19/2023, 4:42 AM{
"start": 1674102564000,
"end": 1674102864000,
"step": 60,
"variables": {},
"dataSource": 1,
"compositeMetricQuery": {
"queryType": 1,
"panelType": 1,
"builderQueries": {
"A": {
"queryName": "A",
"aggregateOperator": 5,
"metricName": "aws_rds_cpuutilization_average",
"tagFilters": {
"op": "AND",
"items": []
},
"groupBy": [
"dbinstance_identifier"
],
"expression": "A",
"disabled": false
}
}
}
}
Ankit Nayan
Amol Umbark
01/19/2023, 4:58 AMAmol Umbark
01/19/2023, 5:04 AMVinayak Singh
01/19/2023, 5:04 AMVinayak Singh
01/19/2023, 5:07 AMVinayak Singh
01/19/2023, 5:07 AMVinayak Singh
01/19/2023, 5:08 AMAmol Umbark
01/19/2023, 5:25 AMAmol Umbark
01/19/2023, 5:30 AM{"start":1674102976000,"end":1674104776000,"step":60,"variables":{"SIGNOZ_START_TIME":1674102976000,"SIGNOZ_END_TIME":1674104776000},"dataSource":1,"compositeMetricQuery":{"queryType":1,"panelType":1,"builderQueries":{"A":{"queryName":"A","aggregateOperator":5,"metricName":"*aws_rds_database_connections_maximum*","tagFilters":{"items":[],"op":"AND"},"groupBy":[],"expression":"A","disabled":false}}}}
JSON from Dashboard:
{"start":1674102564000,"end":1674102864000,"step":60,"variables":{},"dataSource":1,"compositeMetricQuery":{"queryType":1,"panelType":1,"builderQueries":{"A":{"queryName":"A","aggregateOperator":5,"metricName":"*aws_rds_cpuutilization_average*","tagFilters":{"op":"AND","items":[]},"groupBy":["dbinstance_identifier"],"expression":"A","disabled":false}}}}
Vinayak Singh
01/19/2023, 5:34 AMVinayak Singh
01/19/2023, 11:50 AMAmol Umbark
01/19/2023, 12:29 PMVinayak Singh
01/19/2023, 12:29 PMAmol Umbark
01/19/2023, 12:34 PMAmol Umbark
01/19/2023, 12:50 PMAnkit Nayan
Vinayak Singh
01/19/2023, 1:35 PMAnkit Nayan
Vinayak Singh
01/20/2023, 3:05 AMVinayak Singh
01/20/2023, 3:29 AM- job_name: "CW-exporter"
scrape_interval: 60s
static_configs:
- targets: ["prometheus-cloudwatch-exporter.platform.svc.cluster.local:9106"]
Vinayak Singh
01/20/2023, 3:30 AMVinayak Singh
01/20/2023, 3:55 AMVinayak Singh
01/20/2023, 6:09 AMVinayak Singh
01/20/2023, 6:10 AMPrashant Shahi
01/20/2023, 6:13 AMsometimes its working sometime its nothave you verified that metrics are scraped and accessible from Dashboard in SigNoz UI?
Prashant Shahi
01/20/2023, 6:13 AMPrashant Shahi
01/20/2023, 6:14 AM<http://signoz.io/scrape|signoz.io/scrape>
and <http://signoz.io/port|signoz.io/port>
Vinayak Singh
01/20/2023, 6:16 AMPrashant Shahi
01/20/2023, 6:20 AMVinayak Singh
01/20/2023, 6:22 AMVinayak Singh
01/20/2023, 6:31 AMconfig:
scrape_configs:
- job_name: "CWexporter"
scrape_interval: 120s
static_configs: - targets: ["192.20.12.111:9106"]
is this what we need to add in docker setup. What is the kubernative alternative for thisVinayak Singh
01/23/2023, 3:02 AMVinayak Singh
01/23/2023, 3:04 AMskipping send alert due to resend delay%!(EXTRA string= rule: , string=ES/Opensearch CPUUtilization, string= alert:, labels.Labels={alertname="ES/Opensearch CPUUtilization", domain_name="test-store-staging-new", ruleId="1", ruleSource="<https://monitoring.test.com/alerts/edit?ruleId=1>", severity="warning"})
Vinayak Singh
01/23/2023, 5:54 AMAmol Umbark
01/23/2023, 6:43 AMVinayak Singh
01/24/2023, 9:59 AMPrashant Shahi
01/24/2023, 10:11 AMVinayak Singh
01/24/2023, 10:12 AMPrashant Shahi
01/24/2023, 10:12 AMIt looks like something wrong with the exporter. Something related to the syntax. Sometime its working sometime notIf it works sometime, it means the endpoint is correct. Not sure about issue with Otel exporter. @Srikanth Chekuri might be able to help with it.
Prashant Shahi
01/24/2023, 10:13 AMcan you share few links?You can follow our docs: https://signoz.io/docs/userguide/alerts-management/#2-configure-webhook-channel
Vinayak Singh
01/24/2023, 10:14 AMSrikanth Chekuri
01/24/2023, 10:22 AMIt looks like something wrong with the exporter. Something related to the syntax. Sometime its working sometime notNot clear to me, what syntax are you talking about here. What is working sometimes and not working?
Vinayak Singh
01/24/2023, 10:25 AMconfig: |-
# This is the default configuration for prometheus-cloudwatch-exporter
region: us-east-1
period_seconds: 240
metrics:
- aws_namespace: AWS/ES
aws_metric_name: OpenSearchRequests
aws_dimensions: [ClientId, DomainName]
aws_statistics: [Sum]
- aws_namespace: AWS/ES
aws_metric_name: DeletedDocuments
aws_dimensions: [ClientId, DomainName]
aws_statistics: [Sum]
- aws_namespace: AWS/ES
aws_metric_name: FreeStorageSpace
aws_dimensions: [ClientId, DomainName]
aws_statistics: [Average]
- aws_namespace: AWS/ES
aws_metric_name: ClusterUsedSpace
aws_dimensions: [ClientId, DomainName]
aws_statistics: [Average]
- aws_namespace: AWS/ES
aws_metric_name: ElasticsearchRequests
aws_dimensions: [ClientId, DomainName]
aws_statistics: [Sum]
- aws_namespace: AWS/ES
aws_metric_name: CPUUtilization
aws_dimensions: [ClientId, DomainName]
aws_statistics: [Average]
- aws_namespace: AWS/ES
aws_metric_name: SearchableDocuments
aws_dimensions: [ClientId, DomainName]
aws_statistics: [Average]Vinayak Singh
01/24/2023, 10:27 AMSrikanth Chekuri
01/24/2023, 10:28 AM