hello guys , I added my helath check endpoints in otel collector yaml file and I'm getting info at every 10 secs . so when I stop the service then I should get slack notification error instantly but it takes around 5 minutes. why is that?
and same when service is up I should get resolved slack notification instantly.
is it as expected or I'm doing something wrong?
s
Srikanth Chekuri
12/26/2024, 1:34 AM
It doesn't take 5 minutes, it would take 2-3 minutes. First, the check runs every minute, i.e. it doesn't immediately know your service health check fails, it knows when the alert is run. Next, the alerts are delayed a bit to avoid the false, which you can adjust by setting
SigNoz is an open-source APM. It helps developers monitor their applications & troubleshoot problems, an open-source alternative to DataDog, NewRelic, etc.