This message was deleted.

@Prashant Shahi please have a look when you get some time

@Hima Vyas You would need to increase

queue_size

from default

5000

of

otlp/signoz

exporter to avoid dropping data. Refer to this for estimating suitable value for the same: https://github.com/open-telemetry/opentelemetry-collector/blob/main/exporter/exporterhelper/README.md#configuration

Got it @Prashant Shahi, working now! Thank you! 🙌

this queue is generally used for spikes in ingestion so that it holds the data even if write is happening consistently but slowly. If the ingestion load is continuously higher than the write rate, it would start dropping again. @Hima Vyas please check the logs again. Though this error is usually not seen as clickhouse has high ingestion capacity

After increasing the queue size, the error was removed but with 5000(default), this error was there and data was being dropped.

no such loglines in otel-collector now?

No. not anymore.