Hi guys, quick question: I've been using SigNoz in my dev environment for a number of experiments, but one thing that I'd like to change is how frequently my app logs end up collected to SigNoz. It takes a while to start seeing the logs there, and I'd like to change that to be immediate. How can I do that? I'm not even sure where to start - is this a configuration in the agent or in the collector itself?

@Diogo Baeder How much time is it taking currently your app logs to appear in SigNoz UI? Also, how are you sending logs to SigNoz? Directly or via otel collector? Generally speaking there shouldn't be more than 15-30s delay for logs to appear in SigNoz

Hey @Pranay! It's taking at least a few seconds, but might be minutes, I don't know for sure. I sometimes just generate the logs and go do something else because I keep re-querying and not seeing them in a while, so I just don't wait anymore. I'm sending them via the collector; If I understand correctly, the agent collects them from container log files (I'm not sure if that's how it works), and then sends it through the collector, where I have a processor pipeline doing some stuff with the structured logs it receives.

I'm sending them via the collector; If I understand correctly, the agent collects them from container log files (I'm not sure if that's how it works), and then sends it through the collector, where I have a processor pipeline doing some stuff with the structured logs it receives.

Yes, that is correct. Do check once if the machine where processor pipelines are running are appropriately resourced (primarily CPU). If it is not getting constraint on resources, shouldn't take more than 15-30s. Let us know if you see this going into minutes

Ah, cool, thanks man! 🙂