Hello, Does anyone have metrics on CPU requirements based on the number of requests per second? Our installation has 8 cores and is receiving around 150 requests per second, the CPU sits around 100% and we are dropping a number of requests. https://www.restack.io/docs/signoz-knowledge-signoz-hardware-requirements

CPU: The minimal CPU requirement is 4 cores. To ensure smoother operation and to accommodate higher workloads, 8 cores are recommended.

850979 101       20   0   44.0g   1.7g  62076 S 471.2  17.7  29208:00 clickhouse-serv
1592062 root      20   0 7168288   4.2g  93568 S 301.7  44.0   3:18.29 signoz-collecto

Any details on upper limits would be helpful.

@Prashant Shahi any thoughts on this?

There is no exact numbers for correlating the number of requests per second and the CPU requirements. That can vary based on the nature of data and the SigNoz set up and configuration. The resource usage pattern can change a lot based on the clickhouse shards count and collector replicas and its configurations. For very high scale, it is recommended to use messaging queue to limit the DB writes which would otherwise amount for most of the high CPU.

Do you have a guide on messaging queuing?

Do you have a guide on messaging queuing?

we don't have any docs or tutorial on this yet.