Hello team,since upgrading to 0.39.1, the memory u...
# support
k
Hello team,since upgrading to 0.39.1, the memory usage of signoz-otel-collector is very high, and writing data to clickhouse fails. How to solve this problem?
s
ClickHouse is unable to merge the data and everything else is consequence of it. How many CPU does ClickHouse has?
k
@Srikanth Chekuri Clickhouse server is 4 core CPU.
s
What is the average CPU and memory usage
k
@Srikanth Chekuri Currently, the clickhouse cluster has three 4c16 servers, with a CPU load of 3-4 and a memory usage of 4g.
s
How much data do you ingest/send to SigNoz?
k
@Srikanth Chekuri Nearly 200 instances report data to singoz-otel-collector.
s
The resources are becoming the bottleneck for ClickHouse. It tries to merge the data to improve the speed and compression but as the resources are limited the number of parts it can merge is capped and throwing this error