Title
n
Narasimhamurthi Kota
02/20/2023, 11:48 AMHi,
To monitor health of the http endpoints ,for signoz deployed in k8s ,is it here https://github.com/SigNoz/charts/blob/main/charts/signoz/values.yaml#L2342 configuration to be update in helm chart as blow doc has for docker install method.
https://signoz.io/docs/monitor-http-endpoints/#steps-to-monitor-the-health-of-the-http-endpoints
s
Srikanth Chekuri
02/20/2023, 12:34 PMn
Narasimhamurthi Kota
02/20/2023, 4:01 PM@Srikanth Chekuri added https check/* at L1760 and metrics at 1970 and oltp collector is failing.
I think this is for docker instal method. That’s y it is failing.can you give us k8s deployment method.
s
Srikanth Chekuri
02/20/2023, 4:03 PMThe configuration is independent of the deployment method. Do you have those
...n
Narasimhamurthi Kota
02/20/2023, 4:21 PM@Srikanth Chekuri yes.I have added them properly. Please ignore … . I have added metrics https://github.com/SigNoz/charts/blob/225b9aaf4b38e8d708ce33df37aa9e563c81bb78/charts/signoz/values.yaml#L1978 .the Otel metric collector is failing
s
Srikanth Chekuri
02/20/2023, 4:21 PMWhat is the error message when it fails?
n
Narasimhamurthi Kota
02/20/2023, 4:38 PM@Srikanth Chekuri it is failing with crashloopbackoff due to otel-collector-metrics-Config.yaml
s
Srikanth Chekuri
02/20/2023, 4:41 PMWhat is the error? ``kubectl describe pod ...`` run this command and share the output for the pod
Hope you didn’t copy the receivers line as is from the example because there is no otlp receiver here, the required change would be just adding the two httpcheck receivers.
n
Narasimhamurthi Kota
02/20/2023, 4:48 PMI have oltp at the receiver line.
IMG_3876.jpg
s
Srikanth Chekuri
02/20/2023, 4:51 PMPlease share the full-text output. I can’t see the image clearly.
n
Narasimhamurthi Kota
02/20/2023, 4:53 PMI just removed the otlp and it is up and running now
How long it will take to see http endpoints health
s
Srikanth Chekuri
02/20/2023, 4:54 PMAs soon as your collection interval elapses. If it is healthy 1 otherwise 0 for the metric value.
n
Narasimhamurthi Kota
02/20/2023, 4:57 PMAnd the endpoint is publicly accessible.but I didn’t see any logs in the screen
s
Srikanth Chekuri
02/20/2023, 4:57 PMbut I didn’t see any logs in the screenWhich screen and what logs are you referring to?
n
Narasimhamurthi Kota
02/20/2023, 4:58 PMMonitor the 2 endpoint i have added i cont see here
IMG_3878.jpg
s
Srikanth Chekuri
02/20/2023, 5:00 PMThat is traces page. You will not see the metrics here. Create a dashboard and search for the metric
httpcheck_statusn
Narasimhamurthi Kota
02/20/2023, 5:08 PMHttpcheck_status is not listing.
s
Srikanth Chekuri
02/20/2023, 5:10 PMWhat do the collector-metrics pod logs show?
n
Narasimhamurthi Kota
02/20/2023, 5:11 PMI can see the pod logs.
s
Srikanth Chekuri
02/20/2023, 5:12 PMExcellent, do you see any error logs?
n
Narasimhamurthi Kota
02/20/2023, 5:14 PMI can see all other info ,except our endpoint info in the logs.
s
Srikanth Chekuri
02/20/2023, 5:16 PMSearch for
signoz_n
Narasimhamurthi Kota
02/20/2023, 5:19 PMNo metric starting with signoz.
s
Srikanth Chekuri
02/20/2023, 5:20 PMYou most probably have an issue with the config. Please share the full config for the collector-metric pod.
n
Narasimhamurthi Kota
02/20/2023, 5:25 PMJust sent you the Config file in one to one
s
Srikanth Chekuri
02/20/2023, 5:26 PMYou have not added the httpcheck receivers to the pipeline.
n
Narasimhamurthi Kota
02/20/2023, 5:27 PMInstead metrics,do I need to addd metrics/httpcheck
I just added it now the collector metrics pod is crashloopbackoff
s
Srikanth Chekuri
02/20/2023, 5:30 PMWhat does the pod describe output show?
n
Narasimhamurthi Kota
02/20/2023, 5:33 PMSent in 1:1
I don’t understand what is happening behind.am I missing something.
s
Srikanth Chekuri
02/20/2023, 5:38 PMCheck the receiver names correctly.
There was an issue with the config. It exited with status code 1. You would see the error message in the logs. Please make sure the receivers names are same
n
Narasimhamurthi Kota
02/20/2023, 5:40 PMChecked the receivers name .
Both same same
Oh 🤯
s
Srikanth Chekuri
02/20/2023, 5:41 PM/dev-agent/dev-agentsn
Narasimhamurthi Kota
02/20/2023, 5:48 PMPerfect catch.it is working now.
IMG_3884.jpg
Thanks @Srikanth Chekuri for your prompt response