Hi, can I scrape data from Query Service pod in K8...
# support
w
Hi, can I scrape data from Query Service pod in K8s in prometheus? If yes - how to config it? I successfully scrape data from otel-collector (using provided config in SigNoz values.yaml) but don't see a way to do it with Query Service pod.
n
what data do you want to scrape from query service pod ?
w
Number of queries, query execution time, "long" queries, cache usage, stuff like that - we have a situation that sometimes the query service pod gets restarted by K8S due to failed liveness/readiness probe and we don't really know what is the cause and maybe checking what Prometheus can show us would give us a hint...
Basically anything that can help us find out the cause of those restarts/failed probes.
n
As of now query-service doesn’t emit any metrics. It just emits logs. If you are on k8s you can use the pod stats to check the query-service pod
w
Hi again, pod stats didn't show anything that that could help us. But looking into query service logs we see ERRORs, can you help me to determine what is the reason we see those errors?: "Error while executing query","error":"dial tcp: lookup clickhouse: i/o timeout" "error while reading result","error":"context canceled" ERROR: sending request - Post "https://api.segment.io/v1/batch": context deadline exceeded (Client.Timeout exceeded while awaiting headers) (the errors are longer, but I'll send them if needed). Thanks