Hi team signoz, we got installed signoz selfhost i...
# support
a
Hi team signoz, we got installed signoz selfhost in our AWS cluster for staging enviroment in the last weekes we got some problems with clickhouse resources memory consume like 7 Gb - 15Gb and got this logs
Copy code
{"level":"info","ts":1743714231.5959444,"caller":"internal/retry_sender.go:118","msg":"Exporting failed. Will retry the request after interval.","kind":"exporter","data_type":"metrics","name":"clickhousemetricswrite","error":"code: 241, message: Memory limit (total) exceeded: would use 10.88 GiB (attempt to allocate chunk of 4482809 bytes), maximum: 10.80 GiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker.","interval":"5.369721069s"}
{"level":"warn","ts":1743714240.0867674,"caller":"internal/transaction.go:128","msg":"Failed to scrape Prometheus endpoint","kind":"receiver","name":"prometheus","data_type":"metrics","scrape_timestamp":1743714240084,"target_labels":"{__name__=\"up\", instance=\"10.1.6.179:8888\", job=\"generic-collector\", job_name=\"generic-collector\", k8s_container_name=\"collector\", k8s_namespace_name=\"platform\", k8s_node_name=\"ip-10-1-4-41.us-east-2.compute.internal\", k8s_pod_name=\"signoz-otel-collector-65b6c5b7b8-fmn7q\", k8s_pod_phase=\"Failed\", k8s_pod_ready=\"false\", k8s_pod_uid=\"433b9bc9-8805-4603-8e92-41b6fc7bb84e\", signoz_k8s_component=\"otel-collector\", signoz_k8s_instance=\"signoz\", signoz_k8s_name=\"signoz\"}"}
{"level":"warn","ts":1743714269.4750335,"caller":"internal/transaction.go:128","msg":"Failed to scrape Prometheus endpoint","kind":"receiver","name":"prometheus","data_type":"metrics","scrape_timestamp":1743714269470,"target_labels":"{__name__=\"up\", instance=\"10.1.6.217:8888\", job=\"generic-collector\", job_name=\"generic-collector\", k8s_container_name=\"collector\", k8s_namespace_name=\"platform\", k8s_node_name=\"ip-10-1-6-25.us-east-2.compute.internal\", k8s_pod_name=\"signoz-otel-collector-65b6c5b7b8-tm2df\", k8s_pod_phase=\"Failed\", k8s_pod_ready=\"false\", k8s_pod_uid=\"1b04b34c-e225-4db9-9638-1232e309af90\", signoz_k8s_component=\"otel-collector\", signoz_k8s_instance=\"signoz\", signoz_k8s_name=\"signoz\"}"}
s
Hi @Andres Javier Santamaria Ariza, Please use this guide to understand CH memory usage and share us more details about what is the reason for such memory usage https://clickhouse.com/docs/guides/developer/debugging-memory-issues.