Slackbot
06/22/2023, 3:36 PMPranay
Ankit Nayan
clickhousetraces
is part of signoz's distribution. You need to use a different image `signoz/signoz-otel-collector:0.79.1`https://github.com/SigNoz/signoz/blob/develop/deploy/docker/clickhouse-setup/docker-compose.yaml#L196Ankit Nayan
I receive the error that effectively nothing is running on port 9092, and I can confirm the local docker configuration doesn't expose anything on port 9092 and I'm not entirely sure if that configuration even includes kafka anything:this is true...Maybe the blog just shows an example config (@Ashu please note). @James Lai the kafkaexporter in the blog needs a kafka already running. The broker of kafka has a port address of 9092 which would make the above config work then.
Ankit Nayan
Ankit Nayan
James Lai
06/22/2023, 6:11 PMdeply/docker/clickhouse-setup/docker-compose.yaml
configuration. Having trouble knowing how to export what it receives to SigNoz atmAnkit Nayan
Ankit Nayan
exporters:
otlp:
endpoint: "<IP of machine hosting SigNoz>:4317"
tls:
insecure: true
Ankit Nayan
James Lai
06/22/2023, 7:31 PMAnkit Nayan
James Lai
06/22/2023, 9:47 PMSigNoz has otlp receivers enabled by defaultStarted looking back at this and I'm a bit confused. I configured my otelcol to send data to Signoz on port 4317, but a connection was refused. Nothing was listening on that port. Looking to the Docker configuration, we have this: https://github.com/SigNoz/signoz/blob/develop/deploy/docker/clickhouse-setup/docker-compose.yaml#L208 This appears to indicate the service which I could potentially route traffic from port 4317 to is...another otel collector? Is that the correct way to get data ingested into SigNoz? Basically: App -> OTel Collector -> SigNoz OTel Collector -> SigNoz?
Srikanth Chekuri
06/23/2023, 3:55 AMThis appears to indicate the service which I could potentially route traffic from port 4317 to is...another otel collector?No, it makes the port accessible to the host machine, which otherwise could only be accessed by other containers. The flow will be
App -> OTel Collector (optional) -> SigNoz
James Lai
06/23/2023, 6:25 PMsignoz-otel-collector
is based on in this repo, and specifically where it creates its own instance of an otel collector here: https://github.com/SigNoz/signoz-otel-collector/blob/main/cmd/signozcollector/main.go. I assumed this was the case as the configuration passed to this collector was, in fact, the identical shape of the configuration for otel.
So, in other words, if I wanted to have my own generic otel collector that I can use to send data to both Signoz AND other endpoints, such as my own company's database, the process would look like:
App > Otel > SigNoz Otel > Signoz
This is a bit challenging since, at least locally for a PoC, my own Otel is binding on port 4318 to receive telemetry, but of course the SigNoz Otel Collector wants to bind on the same port.James Lai
06/23/2023, 6:26 PMAnkit Nayan