I want to send metrics of a kafka app to signoz otel collector in a different eks cluster, I have made the otel collector publically available using virtual-service & pvt-gateway ,but the otelagent jar throws error

OTLP endpoint must be a valid URL

How to implement this??

Can you share the value of otlp endpoint you are passing ?

it will look something like this https://signoz-collector-qa.fcinternal.in:4317 cc @Prashant Shahi

tried it, same error

Can you share the entire command that you are using to run your jar?

export EXTRA_ARGS='-Dotel.exporter.otlp.endpoint="<https://signoz-collector-qa.fcinternal.in:4317>" -Dotel.resource.attributes=service.name=kafka-test -javaagent:/opentelemetry-javaagent.jar'

exec $base_dir/kafka-run-class $EXTRA_ARGS kafka.Kafka "$@"

Interesting, can you try using env vars like this and check if the same error occurs ?

OTEL_EXPORTER_OTLP_ENDPOINT="<http://localhost:4317>" OTEL_RESOURCE_ATTRIBUTES=service.name=petclinick java -javaagent:"~/opentelemetry-javaagent-1.jar" -jar target/*.jar

but that won't send metrics to signoz collector

Sorry didn’t get you.

will this send metrics to otel-collector in eks cluster ?

Yes it will.

ok

If you are running the otel agent with your service then you will need to add these env vars

does it matter that i am trying to export metrics of a kafka app?

No in that case it doesn’t matter to add them to your services.

i mean i am adding it to the kafka start command

So you just want your Kafka server metrics. While I haven’t personally tried this out, you can check out this demo doc by Otel https://opentelemetry.io/docs/demo/services/kafka/ You can also check out this kafka metrics receiver https://github.com/open-telemetry/opentelemetry-collector-contrib/blob/main/receiver/kafkametricsreceiver/README.md @Srikanth Chekuri any more ideas on monitoring the Kafka server?

It’s unclear if they are interested in the Kafka server or language client instrumentation; it seems they want to collect the client metrics. None of that is relevant to the original error. Can you share the full run command?

we want instrumentation of the kafka server??

Is that a question or confirmation?

sorry,confirmation

If you are interested in the telemetry of the Kafka server, you need to use the collector https://github.com/open-telemetry/opentelemetry-collector-contrib/tree/main/receiver/kafkametricsreceiver. Let us know if that helps or you need more clarification.