Ben Evans
08/22/2025, 5:08 AMsignoz-0.89.0
Helm chart to an EKS auto mode cluster. The deployment appears to succeed but the signoz-0
pod keeps logging the error
{
"level": "error",
"timestamp": "2025-08-22T05:34:16.103Z",
"caller": "opamp/opamp_server.go:117",
"msg": "Failed to find or create agent",
"agentID": "0198cff4-aeac-705d-90ef-b8db1ce6e534",
"error": "cannot create agent without orgId",
"errorVerbose": "cannot create agent without orgId\ngithub.com/SigNoz/signoz/pkg/query-service/app/opamp/model.(*Agents).FindOrCreateAgent\n\t/home/runner/work/signoz/signoz/pkg/query-service/app/opamp/model/agents.go:91\ngithub.com/SigNoz/signoz/pkg/query-service/app/opamp.(*Server).OnMessage\n\t/home/runner/work/signoz/signoz/pkg/query-service/app/opamp/opamp_server.go:115\ngithub.com/open-telemetry/opamp-go/server.(*server).handleWSConnection\n\t/home/runner/go/pkg/mod/github.com/open-telemetry/opamp-go@v0.19.0/server/serverimpl.go:253\nruntime.goexit\n\t/opt/hostedtoolcache/go/1.23.11/x64/src/runtime/asm_amd64.s:1700",
"stacktrace": "github.com/SigNoz/signoz/pkg/query-service/app/opamp.(*Server).OnMessage\n\t/home/runner/work/signoz/signoz/pkg/query-service/app/opamp/opamp_server.go:117\ngithub.com/open-telemetry/opamp-go/server.(*server).handleWSConnection\n\t/home/runner/go/pkg/mod/github.com/open-telemetry/opamp-go@v0.19.0/server/serverimpl.go:253"
}
...and also on the signoz-otel-collector
pod there are these errors (I assume related):
{
"level": "error",
"timestamp": "2025-08-22T05:00:16.057Z",
"caller": "opamp/server_client.go:146",
"msg": "Server returned an error response: %v",
"component": "opamp-server-client",
"": "",
"stacktrace": "github.com/SigNoz/signoz-otel-collector/opamp.(*serverClient).Start.func3\n\t/home/runner/work/signoz-otel-collector/signoz-otel-collector/opamp/server_client.go:146\ngithub.com/open-telemetry/opamp-go/client/internal.(*receivedProcessor).processErrorResponse\n\t/home/runner/go/pkg/mod/github.com/open-telemetry/opamp-go@v0.19.0/client/internal/receivedprocessor.go:247\ngithub.com/open-telemetry/opamp-go/client/internal.(*receivedProcessor).ProcessReceivedMessage\n\t/home/runner/go/pkg/mod/github.com/open-telemetry/opamp-go@v0.19.0/client/internal/receivedprocessor.go:170\ngithub.com/open-telemetry/opamp-go/client/internal.(*wsReceiver).ReceiverLoop\n\t/home/runner/go/pkg/mod/github.com/open-telemetry/opamp-go@v0.19.0/client/internal/wsreceiver.go:94"
}
The helm chart deployed fine on a local k3s instance, I only see this issue on EKS. Any ideas how I can fix or investigate further? Thanks. (edit: corrected the first error message)Ben Evans
08/22/2025, 5:38 AMVibhu Pandey
08/22/2025, 7:38 AMBen Evans
08/25/2025, 3:02 AM