We have recently moved the setup to k8s - what are some metrics that we should be monitoring to ensure a healthy signoz cluster

Hey @John Silvan! You can checkout this list of Json for Dashboards that you can use to monitor your k8s infra - here. In case you haven't tried it already, you can directly import JSON files in the Dashboards section of SigNoz by selecting the

Import JSON

option when creating a New Dashboard.

Hey @Chitransh Gupta - thanks for that! we have those dashboards setup, looking for anything else to monitor especially around otel and clickhouse db

Thanks for the additional context @John Silvan. Could you provide more details about your use-case for monitoring OTel and ClickHouse db ?

We've recently seen that the database performance drops. Because of which the Otel queues got fill and they are running out of memory and signoz doesn't work till a restart

@Prashant Shahi @Srikanth Chekuri any suggestions here ?

and we've also seen that the pvc created can only be reattached to the same instance, so if existing instance is terminated due to any reason it can't be bound to another node

It's a broad topic. Please create a github issue.

got it thanks