https://signoz.io
Join Slack
This message was deleted.
# support
s
This message was deleted.
a
@User let us check this out. Is this some sample application application? Any way to replicate sending the data. You can use console exporter in opentelemetry which outputs the data to terminal and we can check what went wrong from that data
also, which language is the application in?
u
It is not the demo app. It is in JavaScript.
I did use the ConsoleSpanExporter and it looked innocent.
Why does it happen every 5 seconds?
The trace detail page seems to work in the beginning (with a small dataset) and later stops working (blank page).
I just reset all data.
a
trace-detail page breaks due to broken span data..probably due to the otel-collector error you see in logs
can you paste the output of 
ConsoleSpanExporter
here? will try to check if anything is wrong there
u
After data reset the error comes immediately (but I also ingest all the time). But the trace-detail page works in the beginning.
I will setup console export again and post it here (in a few hours, have to leave now).
Is there a way to have both exporters at the same time? (like Linux 
tee
)
a
yes there should be a way to do that. Checkout opentelemetry-js docs to add an exporter to a provider and try adding multiple exporters. I haven't tried it yet, so cannot be sure about it
u
mmh since about 3 am in the morning it stopped accepting traces and now I'm seeing the following error:
Copy code
otel-collector_1          | time="2022-03-23T16:02:43Z" level=error msg="invalid character '\\x06' in string literal" component=clickhouse
otel-collector_1          | 2022-03-23T16:02:45.592Z	error	signozspanmetricsprocessor/processor.go:412	value not found in metricKeyToDimensions cache by key "xxx-app\x00STATUS_CODE_ERROR\x00429\<http://x00xxx.com|x00xxx.com>\x00GET"	{"kind": "processor", "name": "signozspanmetrics/prometheus"}
otel-collector_1          | <http://github.com/open-telemetry/opentelemetry-collector-contrib/processor/signozspanmetricsprocessor.(*processorImp).collectExternalCallMetrics|github.com/open-telemetry/opentelemetry-collector-contrib/processor/signozspanmetricsprocessor.(*processorImp).collectExternalCallMetrics>
otel-collector_1          | 	/home/codegeas/code/work/opentelemetry-collector-contrib/processor/signozspanmetricsprocessor/processor.go:412
otel-collector_1          | <http://github.com/open-telemetry/opentelemetry-collector-contrib/processor/signozspanmetricsprocessor.(*processorImp).buildMetrics|github.com/open-telemetry/opentelemetry-collector-contrib/processor/signozspanmetricsprocessor.(*processorImp).buildMetrics>
otel-collector_1          | 	/home/codegeas/code/work/opentelemetry-collector-contrib/processor/signozspanmetricsprocessor/processor.go:314
otel-collector_1          | <http://github.com/open-telemetry/opentelemetry-collector-contrib/processor/signozspanmetricsprocessor.(*processorImp).ConsumeTraces|github.com/open-telemetry/opentelemetry-collector-contrib/processor/signozspanmetricsprocessor.(*processorImp).ConsumeTraces>
otel-collector_1          | 	/home/codegeas/code/work/opentelemetry-collector-contrib/processor/signozspanmetricsprocessor/processor.go:283
otel-collector_1          | <http://go.opentelemetry.io/collector/receiver/otlpreceiver/internal/trace.(*Receiver).Export|go.opentelemetry.io/collector/receiver/otlpreceiver/internal/trace.(*Receiver).Export>
otel-collector_1          | 	/home/codegeas/go/pkg/mod/go.opentelemetry.io/collector@v0.43.0/receiver/otlpreceiver/internal/trace/otlp.go:60
otel-collector_1          | <http://go.opentelemetry.io/collector/model/otlpgrpc.rawTracesServer.Export|go.opentelemetry.io/collector/model/otlpgrpc.rawTracesServer.Export>
otel-collector_1          | 	/home/codegeas/go/pkg/mod/go.opentelemetry.io/collector/model@v0.44.0/otlpgrpc/traces.go:166
otel-collector_1          | <http://go.opentelemetry.io/collector/model/internal/data/protogen/collector/trace/v1._TraceService_Export_Handler.func1|go.opentelemetry.io/collector/model/internal/data/protogen/collector/trace/v1._TraceService_Export_Handler.func1>
otel-collector_1          | 	/home/codegeas/go/pkg/mod/go.opentelemetry.io/collector/model@v0.44.0/internal/data/protogen/collector/trace/v1/trace_service.pb.go:217
otel-collector_1          | <http://go.opentelemetry.io/collector/config/configgrpc.enhanceWithClientInformation.func1|go.opentelemetry.io/collector/config/configgrpc.enhanceWithClientInformation.func1>
otel-collector_1          | 	/home/codegeas/go/pkg/mod/go.opentelemetry.io/collector@v0.43.0/config/configgrpc/configgrpc.go:382
otel-collector_1          | <http://google.golang.org/grpc.chainUnaryInterceptors.func1.1|google.golang.org/grpc.chainUnaryInterceptors.func1.1>
otel-collector_1          | 	/home/codegeas/go/pkg/mod/google.golang.org/grpc@v1.44.0/server.go:1116
otel-collector_1          | <http://go.opentelemetry.io/contrib/instrumentation/google.golang.org/grpc/otelgrpc.UnaryServerInterceptor.func1|go.opentelemetry.io/contrib/instrumentation/google.golang.org/grpc/otelgrpc.UnaryServerInterceptor.func1>
otel-collector_1          | 	/home/codegeas/go/pkg/mod/go.opentelemetry.io/contrib/instrumentation/google.golang.org/grpc/otelgrpc@v0.28.0/interceptor.go:325
otel-collector_1          | <http://google.golang.org/grpc.chainUnaryInterceptors.func1.1|google.golang.org/grpc.chainUnaryInterceptors.func1.1>
otel-collector_1          | 	/home/codegeas/go/pkg/mod/google.golang.org/grpc@v1.44.0/server.go:1119
otel-collector_1          | <http://google.golang.org/grpc.chainUnaryInterceptors.func1|google.golang.org/grpc.chainUnaryInterceptors.func1>
otel-collector_1          | 	/home/codegeas/go/pkg/mod/google.golang.org/grpc@v1.44.0/server.go:1121
otel-collector_1          | <http://go.opentelemetry.io/collector/model/internal/data/protogen/collector/trace/v1._TraceService_Export_Handler|go.opentelemetry.io/collector/model/internal/data/protogen/collector/trace/v1._TraceService_Export_Handler>
otel-collector_1          | 	/home/codegeas/go/pkg/mod/go.opentelemetry.io/collector/model@v0.44.0/internal/data/protogen/collector/trace/v1/trace_service.pb.go:219
otel-collector_1          | <http://google.golang.org/grpc.(*Server).processUnaryRPC|google.golang.org/grpc.(*Server).processUnaryRPC>
otel-collector_1          | 	/home/codegeas/go/pkg/mod/google.golang.org/grpc@v1.44.0/server.go:1282
otel-collector_1          | <http://google.golang.org/grpc.(*Server).handleStream|google.golang.org/grpc.(*Server).handleStream>
otel-collector_1          | 	/home/codegeas/go/pkg/mod/google.golang.org/grpc@v1.44.0/server.go:1616
otel-collector_1          | <http://google.golang.org/grpc.(*Server).serveStreams.func1.2|google.golang.org/grpc.(*Server).serveStreams.func1.2>
otel-collector_1          | 	/home/codegeas/go/pkg/mod/google.golang.org/grpc@v1.44.0/server.go:921
otel-collector_1          | 2022-03-23T16:02:45.640Z	error	signozspanmetricsprocessor/processor.go:412	value not found in metricKeyToDimensions cache by key "xxx-app\x00STATUS_CODE_ERROR\x00429\<http://x00xxx.com|x00xxx.com>\x00GET"	{"kind": "processor", "name": "signozspanmetrics/prometheus"}
otel-collector_1          | <http://github.com/open-telemetry/opentelemetry-collector-contrib/processor/signozspanmetricsprocessor.(*processorImp).collectExternalCallMetrics|github.com/open-telemetry/opentelemetry-collector-contrib/processor/signozspanmetricsprocessor.(*processorImp).collectExternalCallMetrics>
otel-collector_1          | 	/home/codegeas/code/work/opentelemetry-collector-contrib/processor/signozspanmetricsprocessor/processor.go:412
otel-collector_1          | <http://github.com/open-telemetry/opentelemetry-collector-contrib/processor/signozspanmetricsprocessor.(*processorImp).buildMetrics|github.com/open-telemetry/opentelemetry-collector-contrib/processor/signozspanmetricsprocessor.(*processorImp).buildMetrics>
otel-collector_1          | 	/home/codegeas/code/work/opentelemetry-collector-contrib/processor/signozspanmetricsprocessor/processor.go:314
otel-collector_1          | <http://github.com/open-telemetry/opentelemetry-collector-contrib/processor/signozspanmetricsprocessor.(*processorImp).ConsumeTraces|github.com/open-telemetry/opentelemetry-collector-contrib/processor/signozspanmetricsprocessor.(*processorImp).ConsumeTraces>
otel-collector_1          | 	/home/codegeas/code/work/opentelemetry-collector-contrib/processor/signozspanmetricsprocessor/processor.go:283
otel-collector_1          | <http://go.opentelemetry.io/collector/receiver/otlpreceiver/internal/trace.(*Receiver).Export|go.opentelemetry.io/collector/receiver/otlpreceiver/internal/trace.(*Receiver).Export>
otel-collector_1          | 	/home/codegeas/go/pkg/mod/go.opentelemetry.io/collector@v0.43.0/receiver/otlpreceiver/internal/trace/otlp.go:60
otel-collector_1          | <http://go.opentelemetry.io/collector/model/otlpgrpc.rawTracesServer.Export|go.opentelemetry.io/collector/model/otlpgrpc.rawTracesServer.Export>
otel-collector_1          | 	/home/codegeas/go/pkg/mod/go.opentelemetry.io/collector/model@v0.44.0/otlpgrpc/traces.go:166
otel-collector_1          | <http://go.opentelemetry.io/collector/model/internal/data/protogen/collector/trace/v1._TraceService_Export_Handler.func1|go.opentelemetry.io/collector/model/internal/data/protogen/collector/trace/v1._TraceService_Export_Handler.func1>
otel-collector_1          | 	/home/codegeas/go/pkg/mod/go.opentelemetry.io/collector/model@v0.44.0/internal/data/protogen/collector/trace/v1/trace_service.pb.go:217
otel-collector_1          | <http://go.opentelemetry.io/collector/config/configgrpc.enhanceWithClientInformation.func1|go.opentelemetry.io/collector/config/configgrpc.enhanceWithClientInformation.func1>
otel-collector_1          | 	/home/codegeas/go/pkg/mod/go.opentelemetry.io/collector@v0.43.0/config/configgrpc/configgrpc.go:382
otel-collector_1          | <http://google.golang.org/grpc.chainUnaryInterceptors.func1.1|google.golang.org/grpc.chainUnaryInterceptors.func1.1>
otel-collector_1          | 	/home/codegeas/go/pkg/mod/google.golang.org/grpc@v1.44.0/server.go:1116
otel-collector_1          | <http://go.opentelemetry.io/contrib/instrumentation/google.golang.org/grpc/otelgrpc.UnaryServerInterceptor.func1|go.opentelemetry.io/contrib/instrumentation/google.golang.org/grpc/otelgrpc.UnaryServerInterceptor.func1>
otel-collector_1          | 	/home/codegeas/go/pkg/mod/go.opentelemetry.io/contrib/instrumentation/google.golang.org/grpc/otelgrpc@v0.28.0/interceptor.go:325
otel-collector_1          | <http://google.golang.org/grpc.chainUnaryInterceptors.func1.1|google.golang.org/grpc.chainUnaryInterceptors.func1.1>
otel-collector_1          | 	/home/codegeas/go/pkg/mod/google.golang.org/grpc@v1.44.0/server.go:1119
otel-collector_1          | <http://google.golang.org/grpc.chainUnaryInterceptors.func1|google.golang.org/grpc.chainUnaryInterceptors.func1>
otel-collector_1          | 	/home/codegeas/go/pkg/mod/google.golang.org/grpc@v1.44.0/server.go:1121
otel-collector_1          | <http://go.opentelemetry.io/collector/model/internal/data/protogen/collector/trace/v1._TraceService_Export_Handler|go.opentelemetry.io/collector/model/internal/data/protogen/collector/trace/v1._TraceService_Export_Handler>
otel-collector_1          | 	/home/codegeas/go/pkg/mod/go.opentelemetry.io/collector/model@v0.44.0/internal/data/protogen/collector/trace/v1/trace_service.pb.go:219
otel-collector_1          | <http://google.golang.org/grpc.(*Server).processUnaryRPC|google.golang.org/grpc.(*Server).processUnaryRPC>
otel-collector_1          | 	/home/codegeas/go/pkg/mod/google.golang.org/grpc@v1.44.0/server.go:1282
otel-collector_1          | <http://google.golang.org/grpc.(*Server).handleStream|google.golang.org/grpc.(*Server).handleStream>
otel-collector_1          | 	/home/codegeas/go/pkg/mod/google.golang.org/grpc@v1.44.0/server.go:1616
otel-collector_1          | <http://google.golang.org/grpc.(*Server).serveStreams.func1.2|google.golang.org/grpc.(*Server).serveStreams.func1.2>
otel-collector_1          | 	/home/codegeas/go/pkg/mod/google.golang.org/grpc@v1.44.0/server.go:921
26 Views
Open in Slack
PreviousNext
Powered by

SigNoz Community

SigNoz is an open-source APM. It helps developers monitor their applications & troubleshoot problems, an open-source alternative to DataDog, NewRelic, etc.

Powered by