Hi Team, experienced an outage of traces pertainin...
# support
s
Hi Team, experienced an outage of traces pertaining to following error:
Copy code
2022-12-27T12:12:51.083Z	error	signozspanmetricsprocessor/processor.go:429	value not found in metricKeyToDimensions cache by key "iv-prod-api-core\x00STATUS_CODE_UNSET\<http://x00archive.mandarinmansion.com|x00archive.mandarinmansion.com>\x00default\x00default"	{"kind": "processor", "name": "signozspanmetrics/prometheus", "pipeline": "traces"}
<http://github.com/SigNoz/signoz-otel-collector/processor/signozspanmetricsprocessor.(*processorImp).collectExternalCallMetrics|github.com/SigNoz/signoz-otel-collector/processor/signozspanmetricsprocessor.(*processorImp).collectExternalCallMetrics>
	/src/processor/signozspanmetricsprocessor/processor.go:429
<http://github.com/SigNoz/signoz-otel-collector/processor/signozspanmetricsprocessor.(*processorImp).buildMetrics|github.com/SigNoz/signoz-otel-collector/processor/signozspanmetricsprocessor.(*processorImp).buildMetrics>
	/src/processor/signozspanmetricsprocessor/processor.go:312
<http://github.com/SigNoz/signoz-otel-collector/processor/signozspanmetricsprocessor.(*processorImp).ConsumeTraces|github.com/SigNoz/signoz-otel-collector/processor/signozspanmetricsprocessor.(*processorImp).ConsumeTraces>
	/src/processor/signozspanmetricsprocessor/processor.go:281
<http://go.opentelemetry.io/collector/receiver/otlpreceiver/internal/trace.(*Receiver).Export|go.opentelemetry.io/collector/receiver/otlpreceiver/internal/trace.(*Receiver).Export>
	/go/pkg/mod/go.opentelemetry.io/collector@v0.55.0/receiver/otlpreceiver/internal/trace/otlp.go:60
<http://go.opentelemetry.io/collector/pdata/ptrace/ptraceotlp.rawTracesServer.Export|go.opentelemetry.io/collector/pdata/ptrace/ptraceotlp.rawTracesServer.Export>
	/go/pkg/mod/go.opentelemetry.io/collector/pdata@v0.55.0/ptrace/ptraceotlp/traces.go:167
<http://go.opentelemetry.io/collector/pdata/internal/data/protogen/collector/trace/v1._TraceService_Export_Handler.func1|go.opentelemetry.io/collector/pdata/internal/data/protogen/collector/trace/v1._TraceService_Export_Handler.func1>
	/go/pkg/mod/go.opentelemetry.io/collector/pdata@v0.55.0/internal/data/protogen/collector/trace/v1/trace_service.pb.go:216
<http://go.opentelemetry.io/collector/config/configgrpc.enhanceWithClientInformation.func1|go.opentelemetry.io/collector/config/configgrpc.enhanceWithClientInformation.func1>
	/go/pkg/mod/go.opentelemetry.io/collector@v0.55.0/config/configgrpc/configgrpc.go:385
<http://google.golang.org/grpc.chainUnaryInterceptors.func1.1|google.golang.org/grpc.chainUnaryInterceptors.func1.1>
	/go/pkg/mod/google.golang.org/grpc@v1.47.0/server.go:1117
<http://go.opentelemetry.io/contrib/instrumentation/google.golang.org/grpc/otelgrpc.UnaryServerInterceptor.func1|go.opentelemetry.io/contrib/instrumentation/google.golang.org/grpc/otelgrpc.UnaryServerInterceptor.func1>
	/go/pkg/mod/go.opentelemetry.io/contrib/instrumentation/google.golang.org/grpc/otelgrpc@v0.32.0/interceptor.go:325
<http://google.golang.org/grpc.chainUnaryInterceptors.func1.1|google.golang.org/grpc.chainUnaryInterceptors.func1.1>
	/go/pkg/mod/google.golang.org/grpc@v1.47.0/server.go:1120
<http://google.golang.org/grpc.chainUnaryInterceptors.func1|google.golang.org/grpc.chainUnaryInterceptors.func1>
	/go/pkg/mod/google.golang.org/grpc@v1.47.0/server.go:1122
<http://go.opentelemetry.io/collector/pdata/internal/data/protogen/collector/trace/v1._TraceService_Export_Handler|go.opentelemetry.io/collector/pdata/internal/data/protogen/collector/trace/v1._TraceService_Export_Handler>
	/go/pkg/mod/go.opentelemetry.io/collector/pdata@v0.55.0/internal/data/protogen/collector/trace/v1/trace_service.pb.go:218
<http://google.golang.org/grpc.(*Server).processUnaryRPC|google.golang.org/grpc.(*Server).processUnaryRPC>
	/go/pkg/mod/google.golang.org/grpc@v1.47.0/server.go:1283
<http://google.golang.org/grpc.(*Server).handleStream|google.golang.org/grpc.(*Server).handleStream>
	/go/pkg/mod/google.golang.org/grpc@v1.47.0/server.go:1620
<http://google.golang.org/grpc.(*Server).serveStreams.func1.2|google.golang.org/grpc.(*Server).serveStreams.func1.2>
	/go/pkg/mod/google.golang.org/grpc@v1.47.0/server.go:922
Error:
Copy code
2022-12-27T12:12:51.083Z	error	signozspanmetricsprocessor/processor.go:429	value not found in metricKeyToDimensions cache by key "iv-prod-api-core\x00STATUS_CODE_UNSET\<http://x00archive.mandarinmansion.com|x00archive.mandarinmansion.com>\x00default\x00default"	{"kind": "processor", "name": "signozspanmetrics/prometheus", "pipeline": "traces"}
<http://github.com/SigNoz/signoz-otel-collector/processor/signozspanmetricsprocessor.(*processorImp).collectExternalCallMetrics|github.com/SigNoz/signoz-otel-collector/processor/signozspanmetricsprocessor.(*processorImp).collectExternalCallMetrics>
	/src/processor/signozspanmetricsprocessor/processor.go:429
<http://github.com/SigNoz/signoz-otel-collector/processor/signozspanmetricsprocessor.(*processorImp).buildMetrics|github.com/SigNoz/signoz-otel-collector/processor/signozspanmetricsprocessor.(*processorImp).buildMetrics>
	/src/processor/signozspanmetricsprocessor/processor.go:312
<http://github.com/SigNoz/signoz-otel-collector/processor/signozspanmetricsprocessor.(*processorImp).ConsumeTraces|github.com/SigNoz/signoz-otel-collector/processor/signozspanmetricsprocessor.(*processorImp).ConsumeTraces>
	/src/processor/signozspanmetricsprocessor/processor.go:281
<http://go.opentelemetry.io/collector/receiver/otlpreceiver/internal/trace.(*Receiver).Export|go.opentelemetry.io/collector/receiver/otlpreceiver/internal/trace.(*Receiver).Export>
	/go/pkg/mod/go.opentelemetry.io/collector@v0.55.0/receiver/otlpreceiver/internal/trace/otlp.go:60
<http://go.opentelemetry.io/collector/pdata/ptrace/ptraceotlp.rawTracesServer.Export|go.opentelemetry.io/collector/pdata/ptrace/ptraceotlp.rawTracesServer.Export>
	/go/pkg/mod/go.opentelemetry.io/collector/pdata@v0.55.0/ptrace/ptraceotlp/traces.go:167
<http://go.opentelemetry.io/collector/pdata/internal/data/protogen/collector/trace/v1._TraceService_Export_Handler.func1|go.opentelemetry.io/collector/pdata/internal/data/protogen/collector/trace/v1._TraceService_Export_Handler.func1>
	/go/pkg/mod/go.opentelemetry.io/collector/pdata@v0.55.0/internal/data/protogen/collector/trace/v1/trace_service.pb.go:216
<http://go.opentelemetry.io/collector/config/configgrpc.enhanceWithClientInformation.func1|go.opentelemetry.io/collector/config/configgrpc.enhanceWithClientInformation.func1>
	/go/pkg/mod/go.opentelemetry.io/collector@v0.55.0/config/configgrpc/configgrpc.go:385
<http://google.golang.org/grpc.chainUnaryInterceptors.func1.1|google.golang.org/grpc.chainUnaryInterceptors.func1.1>
	/go/pkg/mod/google.golang.org/grpc@v1.47.0/server.go:1117
<http://go.opentelemetry.io/contrib/instrumentation/google.golang.org/grpc/otelgrpc.UnaryServerInterceptor.func1|go.opentelemetry.io/contrib/instrumentation/google.golang.org/grpc/otelgrpc.UnaryServerInterceptor.func1>
	/go/pkg/mod/go.opentelemetry.io/contrib/instrumentation/google.golang.org/grpc/otelgrpc@v0.32.0/interceptor.go:325
<http://google.golang.org/grpc.chainUnaryInterceptors.func1.1|google.golang.org/grpc.chainUnaryInterceptors.func1.1>
	/go/pkg/mod/google.golang.org/grpc@v1.47.0/server.go:1120
<http://google.golang.org/grpc.chainUnaryInterceptors.func1|google.golang.org/grpc.chainUnaryInterceptors.func1>
	/go/pkg/mod/google.golang.org/grpc@v1.47.0/server.go:1122
<http://go.opentelemetry.io/collector/pdata/internal/data/protogen/collector/trace/v1._TraceService_Export_Handler|go.opentelemetry.io/collector/pdata/internal/data/protogen/collector/trace/v1._TraceService_Export_Handler>
	/go/pkg/mod/go.opentelemetry.io/collector/pdata@v0.55.0/internal/data/protogen/collector/trace/v1/trace_service.pb.go:218
<http://google.golang.org/grpc.(*Server).processUnaryRPC|google.golang.org/grpc.(*Server).processUnaryRPC>
	/go/pkg/mod/google.golang.org/grpc@v1.47.0/server.go:1283
<http://google.golang.org/grpc.(*Server).handleStream|google.golang.org/grpc.(*Server).handleStream>
	/go/pkg/mod/google.golang.org/grpc@v1.47.0/server.go:1620
<http://google.golang.org/grpc.(*Server).serveStreams.func1.2|google.golang.org/grpc.(*Server).serveStreams.func1.2>
	/go/pkg/mod/google.golang.org/grpc@v1.47.0/server.go:922
no error on the otel collector pod
which otel version are we using?
s
@Shivvinay Kanswal, we have fixed this bug, which will release soon. Meanwhile, you can increase the size of dimensions_cache_size value here https://github.com/SigNoz/charts/blob/1a352acb593af3fd366ce200ec4fd742efc8e1f2/charts/signoz/values.yaml#L1288
s
we are currently on signoz version v0.11.2
@Srikanth Chekuri when can we expect this release?
s
This week
s
great!! thanks
s
@Shivvinay Kanswal, we released a new version, including this fix. Can you update and check?
s
ill check