https://signoz.io logo
Title
t

Timothy Wigginton

01/18/2023, 3:34 PM
Hey I have been having this issue with query service for awhile now. It happens everytime I redeploy signoz. Eventually it seemingly resolves itself but it can take several hours to do so. I haven’t found a proper solution, I just restart pods every now and then and cross my fingers.
It works now. Not sure why
s

Srikanth Chekuri

01/18/2023, 4:12 PM
When it’s failing for liveness probe was it restarting? Were you able to look at the logs for query service?
t

Timothy Wigginton

01/18/2023, 4:15 PM
Yeah it was constantly restarting
I did not check the logs this time around but I believe last time it was restarting too often to check
s

Srikanth Chekuri

01/18/2023, 4:20 PM
Were collectors also restarting when the query service was restarting?
t

Timothy Wigginton

01/18/2023, 4:43 PM
they were not
s

Srikanth Chekuri

01/18/2023, 5:14 PM
Hmm interesting, What were the memory limits configured for the query service? Did you notice if the OOM was reason for query service restart?
t

Timothy Wigginton

01/19/2023, 3:01 PM
It’s possible, I plan on testing that soon