things on top of my mind
• add message size limit at kafka brokers https://stackoverflow.com/a/21343878/3243212
• The kakfkaexporter is probably used with batch processors which produces 10K times of message received by the producers
• check the size of the message being dropped at kafka
m
manohar mirle
01/31/2024, 1:14 PM
Hi Ankit,
1. We have configured below paramter in Kafka topic.
max.messaging.bytes=5000000
2. We have configured below parameters to limit the message that is getting produced by the processor:
send_batch_size: 10
send_batch_max_size: 15
timeout: 0s
3. How to check the size of the message which is getting dropped ? Can we get it from the logs of the collector ?
SigNoz is an open-source APM. It helps developers monitor their applications & troubleshoot problems, an open-source alternative to DataDog, NewRelic, etc.
