Hi SigNoz community! I've recently started using S...
# general
j
Hi SigNoz community! I've recently started using SigNoz in my environment. While looking at the Service Map, I was surprised to see that a few services haves lines connecting them directly, rather than the connection being between a database or MQ service (as the services should be interacting). How might I go around tracking down what caused this connection in SigNoz? I've attempted to use Traces Explorer but unable to see any available traces when searching for both service names. Thanks in advance for the input!
If worth noting, the services are Java Spring Boot using OTel auto-instrumentation only at this time.
s
I was surprised to see that a few services haves lines connecting them directly, rather than the connection being between a database
message queue i understand but what you mean by database here?
j
Thanks for asking. My Java services each either pull from a message queue, or run on a scheduler to do basic ETL out of a few databases. In most cases I'm seeing the databases and message queue servers show up interacting with each service. In these few cases, I'm seeing lines and flow between the Java services that should not have any way to communicate. So I'm curious if they are in fact some how communicating, or where I may have misconfigured OTel, or even the java services themselves, that is making auto-instrumentation think they're communicating.
s
If they are showing up as connected in graph then there must be some one-to-one connection b/w them.
j
How can I use Signoz to see what that correleation might be?
s
the span that initiated the request would have the
externalHttpUrl
set to upstream url. Search by that and see the trace graph.
j
externalHttpUrl would assume that the communication is happening on port 80/443? Or that's a general term? The services typically aren't listening to any traffic, except for rare instances of Spring Actuator running for health checks.
s
It doesn't assume anything. It uses the host and port used in the network request.
j
Okay
So Signoz really can't help here
It has identified that things are 'communicating' but they really have no idea about eachother.
There is no tool or search I can use in Signoz to say 'Yo, how did you get this info? Why do you believe this is occuring?'
s
I don't understand what you mean by that. Use the traces explorer and filter by
externalHttpUrl
CONTAINS
upstream service host
. And it should give the trace which contains the call from service A (downstream) to service B (upstream).
If it's not clear
externalHttpUrl
is an attribute of span which you can search by in the SigNoz platform
j
Hmmm, okay. I'm sure it's just. a lack of my understanding. Let me take a look around with these details and come back with more questions if I get lost. These are all things I didn't look into yesterday. 🙂