Hi, is there an option to aggregate SigNoz data fr...
# generala
Asaf Fadida
09/30/2022, 10:14 AMHi, is there an option to aggregate SigNoz data from multiple SigNoz instances into a single one?
I have multiple k8s clusters, I want to have a SigNoz deployment on each of them (to monitor a single cluster they been deployed at), and in addition I want to have a centralized SigNoz instance that will aggregate all the ‘single’-SigNoz data. I also want to be able to navigate between the different SigNoz instances-data.
Today Im implementing this setup using prometheus & thanos & grafana.
Thanks 🙂
a
Ashu
09/30/2022, 10:48 AM
This should be possible with OpenTelemetry Collectors. You can run OpenTelemetry Collectors in each of your k8s clusters, and then send the data collected by each OpenTelemetry Collector to a single SigNoz instance.
Regarding navigating between different SigNoz instance s data, that should be possible with environment variables. @Prashant Shahi might be able to shed more light on this.
p
Prashant Shahi
09/30/2022, 11:43 AMHey @Asaf Fadida 👋
We have
k8s-infrasignozk8s-infrak8s-infraa
Asaf Fadida
09/30/2022, 11:46 AMThats great, thanks!
What if I want to have multiple SigNoz instances? One for every k8s cluster (SigNoz will be installed on the monitored k8s cluster) + additional SigNoz instance that gets all the other k8s clusters data.
Is it possible?
Asaf Fadida
09/30/2022, 11:47 AM@Prashant Shahi
p
Prashant Shahi
09/30/2022, 11:47 AMIt is possible, but that would be independent signoz clusters.
Prashant Shahi
09/30/2022, 11:48 AMthat would be no related to each other.
Prashant Shahi
09/30/2022, 11:48 AMthere would be many signoz instances.
If you desire that, you can go ahead with that as well.
Prashant Shahi
09/30/2022, 11:49 AMBut it's not recommended to have N signoz instances for N K8s clusters.
a
Asaf Fadida
09/30/2022, 11:49 AMWorks for me. The question is if otel-collector can send metrics to multiple targets (one local-Signoz + one remote SigNoz)
p
Prashant Shahi
09/30/2022, 11:50 AMyes, it can.
a
Asaf Fadida
09/30/2022, 11:50 AMPerfect. Thanks
p
Prashant Shahi
09/30/2022, 11:50 AMBut would need to make changes in the config manually.
a
Asaf Fadida
09/30/2022, 11:50 AM🙏
a
Ashu
09/30/2022, 11:51 AM
Asaf, can you elaborate more on your use case? Why do you want to run local SigNoz instances for each cluster?
a
Asaf Fadida
09/30/2022, 11:56 AMOur system might be deployed on both airgapped-on-prem & non-airgapped environments.
We want to provide a monitoring solution within the product-deployment itself (deploying SigNoz on the monitored cluster), and where we can (non-airgapped), we would like to see the monitoring-related-data on a single place (centralized SigNoz)
Asaf Fadida
09/30/2022, 11:56 AMMake sense?
a
Ashu
09/30/2022, 12:32 PM
Got it. Makes sense, Asaf.
3 Views