Harshith.R.S
02/28/2023, 12:18 PMselect
toStartOfInterval(timestamp, INTERVAL 2 MINUTE) AS interval,
serviceName,
((select count() as value from signoz_traces.signoz_index_v2
where httpCode>='100' AND httpCode<='499')*100.0
/
(select count() as value from signoz_traces.signoz_index_v2
where httpCode>='100' AND httpCode<='599')*1.0)
FROM signoz_traces.distributed_signoz_index_v2
where
serviceName = 'frontend' AND
timestamp BETWEEN {{.start_datetime}} AND {{.end_datetime}}
GROUP BY (serviceName, interval);
Amol Umbark
02/28/2023, 1:15 PMHarshith.R.S
02/28/2023, 1:23 PMAmol Umbark
03/02/2023, 5:35 AMHarshith.R.S
03/02/2023, 7:44 AMAmol Umbark
03/03/2023, 8:20 AMselect
toStartOfInterval(timestamp, INTERVAL 5 MINUTE) AS interval,
serviceName,
((select count() as value from signoz_traces.signoz_index_v2
where httpCode>='100' AND httpCode<='499')*100.0
/
(select count() as value from signoz_traces.signoz_index_v2
where httpCode>='100' AND httpCode<='599')*1.0)
FROM signoz_traces.distributed_signoz_index_v2
where
serviceName = 'frontend' AND
timestamp BETWEEN {{.start_datetime}} AND {{.end_datetime}}
GROUP BY (serviceName, interval);
Also do these steps to get more clarity:
1. Get a new webhook url from webhook.site
2. Define a channel for the webhook url
3. When defining alert add webhook channel in the list of preferred channels
4. Send a test notification to see the observed value in webhook.site.
Please share the results.Harshith.R.S
03/03/2023, 8:34 AMAmol Umbark
03/03/2023, 8:39 AMHarshith.R.S
03/03/2023, 8:49 AM2023-03-03T09:10:36.514Z ERROR alertManager/notifier.go:232 alertmanager%!(EXTRA string=<http://alertmanager:9093/api/v1/alerts>, string=count, int=2, string=msg, string=Error calling alert API, string=err, *errors.errorString=bad response status 400 Bad Request)
<http://go.signoz.io/signoz/pkg/query-service/integrations/alertManager.(*Notifier).sendAll.func1|go.signoz.io/signoz/pkg/query-service/integrations/alertManager.(*Notifier).sendAll.func1>
/go/src/github.com/signoz/signoz/pkg/query-service/integrations/alertManager/notifier.go:232
2023-03-03T09:10:36.514Z WARN alertManager/notifier.go:136 msg: dropped alerts count:2
<http://go.signoz.io/signoz/pkg/query-service/integrations/alertManager.(*Notifier).Run|go.signoz.io/signoz/pkg/query-service/integrations/alertManager.(*Notifier).Run>
Amol Umbark
03/03/2023, 9:30 AMHarshith.R.S
03/03/2023, 9:34 AMlevel=error ts=2023-03-03T09:33:36.516Z caller=api.go:808 component=api version=v1 msg="API error" err="bad_data: \"divide(multiply(_subquery310, 100.), _subquery311)\" is not a valid label name"
SELECT
subq1.interval,
subq1.value * 100.0 / subq2.value AS success_rate
FROM (
SELECT
toStartOfInterval(timestamp, INTERVAL 2 MINUTE) AS interval,
COUNT() AS value
FROM signoz_traces.signoz_index_v2
WHERE
httpCode >= '100' AND
httpCode <= '499' AND
timestamp BETWEEN {{.start_datetime}} AND {{.end_datetime}}
GROUP BY interval
) AS subq1
JOIN (
SELECT
toStartOfInterval(timestamp, INTERVAL 2 MINUTE) AS interval,
COUNT() AS value
FROM signoz_traces.signoz_index_v2
WHERE
httpCode >= '100' AND
httpCode <= '599' AND
timestamp BETWEEN {{.start_datetime}} AND {{.end_datetime}}
GROUP BY interval
) AS subq2
ON subq1.interval = subq2.interval;
now after updating it is still firing the alert I've attached the necessary screencapsAmol Umbark
03/03/2023, 12:17 PMHarshith.R.S
03/03/2023, 12:25 PMError: No such container: clickhouse-setup_clickhouse_1
getting this
edit: ok so container name given in the docs is wrong now I'm able to access cli
edit2: it needs values in place of {{.start_datetime}} and {{.end_datetime}}Amol Umbark
03/03/2023, 1:40 PMHarshith.R.S
03/03/2023, 1:41 PMAmol Umbark
03/03/2023, 1:41 PMHarshith.R.S
03/03/2023, 1:42 PMAmol Umbark
03/03/2023, 1:43 PMHarshith.R.S
03/03/2023, 1:47 PM