Hi all, I'm trying to build a dashboard in signoz to monitor hundreds of web scrapers. They are made in Python and run on Kubernetes as cron jobs, each in their own pod, usually once a week.
What I would ideally want to see is:
• List of currently running scraping jobs, and their current progress.
• List of successfully finished scraping jobs, and how many pages were scraped for each one.
• List of failed scraping jobs, with possibly a way to quickly check the logs of that particular pod.
Is this possible at all with SigNoz and what can be sent via otel?