hello,after I upgraded signoz-otel-collector to 0....
# support
k
hello,after I upgraded signoz-otel-collector to 0.88.13, there is such an error in the signoz-otel-collector log. What is the reason? 2024-02-19T071312.639Z error prometheusexporter@v0.88.0/accumulator.go:94 failed to translate metric {“kind”: “exporter”, “data_type”: “metrics”, “name”: “prometheus”, “data_type”: “\u0004", “metric_name”: “signoz_latency”} github.com/open-telemetry/opentelemetry-collector-contrib/exporter/prometheusexporter.(*lastValueAccumulator).addMetric /home/runner/go/pkg/mod/github.com/open-telemetry/opentelemetry-collector-contrib/exporter/prometheusexporter@v0.88.0/accumulator.go:94 github.com/open-telemetry/opentelemetry-collector-contrib/exporter/prometheusexporter.(*lastValueAccumulator).Accumulate /home/runner/go/pkg/mod/github.com/open-telemetry/opentelemetry-collector-contrib/exporter/prometheusexporter@v0.88.0/accumulator.go:71 github.com/open-telemetry/opentelemetry-collector-contrib/exporter/prometheusexporter.(*collector).processMetrics /home/runner/go/pkg/mod/github.com/open-telemetry/opentelemetry-collector-contrib/exporter/prometheusexporter@v0.88.0/collector.go:92 github.com/open-telemetry/opentelemetry-collector-contrib/exporter/prometheusexporter.(*prometheusExporter).ConsumeMetrics /home/runner/go/pkg/mod/github.com/open-telemetry/opentelemetry-collector-contrib/exporter/prometheusexporter@v0.88.0/prometheus.go:85 go.opentelemetry.io/collector/exporter/exporterhelper.(*metricsRequest).Export /home/runner/go/pkg/mod/go.opentelemetry.io/collector/exporter@v0.88.0/exporterhelper/metrics.go:60 go.opentelemetry.io/collector/exporter/exporterhelper.(*timeoutSender).send /home/runner/go/pkg/mod/go.opentelemetry.io/collector/exporter@v0.88.0/exporterhelper/timeout_sender.go:41 go.opentelemetry.io/collector/exporter/exporterhelper.(*baseRequestSender).send /home/runner/go/pkg/mod/go.opentelemetry.io/collector/exporter@v0.88.0/exporterhelper/common.go:36 go.opentelemetry.io/collector/exporter/exporterhelper.(*metricsSenderWithObservability).send /home/runner/go/pkg/mod/go.opentelemetry.io/collector/exporter@v0.88.0/exporterhelper/metrics.go:176 go.opentelemetry.io/collector/exporter/exporterhelper.(*baseRequestSender).send /home/runner/go/pkg/mod/go.opentelemetry.io/collector/exporter@v0.88.0/exporterhelper/common.go:36 go.opentelemetry.io/collector/exporter/exporterhelper.(*baseExporter).send /home/runner/go/pkg/mod/go.opentelemetry.io/collector/exporter@v0.88.0/exporterhelper/common.go:196 go.opentelemetry.io/collector/exporter/exporterhelper.NewMetricsExporter.func1 /home/runner/go/pkg/mod/go.opentelemetry.io/collector/exporter@v0.88.0/exporterhelper/metrics.go:100 go.opentelemetry.io/collector/consumer.ConsumeMetricsFunc.ConsumeMetrics /home/runner/go/pkg/mod/go.opentelemetry.io/collector/consumer@v0.88.0/metrics.go:25 github.com/SigNoz/signoz-otel-collector/processor/signozspanmetricsprocessor.(*processorImp).exportMetrics /home/runner/work/signoz-otel-collector/signoz-otel-collector/processor/signozspanmetricsprocessor/processor.go:458 github.com/SigNoz/signoz-otel-collector/processor/signozspanmetricsprocessor.(*processorImp).Start.func1 /home/runner/work/signoz-otel-collector/signoz-otel-collector/processor/signozspanmetricsprocessor/processor.go:402 2024-02-19T071412.643Z error prometheusexporter@v0.88.0/accumulator.go:94 failed to translate metric {“kind”: “exporter”, “data_type”: “metrics”, “name”: “prometheus”, “data_type”: “\u0004", “metric_name”: “signoz_latency”} github.com/open-telemetry/opentelemetry-collector-contrib/exporter/prometheusexporter.(*lastValueAccumulator).addMetric /home/runner/go/pkg/mod/github.com/open-telemetry/opentelemetry-collector-contrib/exporter/prometheusexporter@v0.88.0/accumulator.go:94 github.com/open-telemetry/opentelemetry-collector-contrib/exporter/prometheusexporter.(*lastValueAccumulator).Accumulate /home/runner/go/pkg/mod/github.com/open-telemetry/opentelemetry-collector-contrib/exporter/prometheusexporter@v0.88.0/accumulator.go:71 github.com/open-telemetry/opentelemetry-collector-contrib/exporter/prometheusexporter.(*collector).processMetrics /home/runner/go/pkg/mod/github.com/open-telemetry/opentelemetry-collector-contrib/exporter/prometheusexporter@v0.88.0/collector.go:92 github.com/open-telemetry/opentelemetry-collector-contrib/exporter/prometheusexporter.(*prometheusExporter).ConsumeMetrics /home/runner/go/pkg/mod/github.com/open-telemetry/opentelemetry-collector-contrib/exporter/prometheusexporter@v0.88.0/prometheus.go:85 go.opentelemetry.io/collector/exporter/exporterhelper.(*metricsRequest).Export /home/runner/go/pkg/mod/go.opentelemetry.io/collector/exporter@v0.88.0/exporterhelper/metrics.go:60 go.opentelemetry.io/collector/exporter/exporterhelper.(*timeoutSender).send /home/runner/go/pkg/mod/go.opentelemetry.io/collector/exporter@v0.88.0/exporterhelper/timeout_sender.go:41 go.opentelemetry.io/collector/exporter/exporterhelper.(*baseRequestSender).send /home/runner/go/pkg/mod/go.opentelemetry.io/collector/exporter@v0.88.0/exporterhelper/common.go:36 go.opentelemetry.io/collector/exporter/exporterhelper.(*metricsSenderWithObservability).send /home/runner/go/pkg/mod/go.opentelemetry.io/collector/exporter@v0.88.0/exporterhelper/metrics.go:176 go.opentelemetry.io/collector/exporter/exporterhelper.(*baseRequestSender).send /home/runner/go/pkg/mod/go.opentelemetry.io/collector/exporter@v0.88.0/exporterhelper/common.go:36 go.opentelemetry.io/collector/exporter/exporterhelper.(*baseExporter).send /home/runner/go/pkg/mod/go.opentelemetry.io/collector/exporter@v0.88.0/exporterhelper/common.go:196 go.opentelemetry.io/collector/exporter/exporterhelper.NewMetricsExporter.func1 /home/runner/go/pkg/mod/go.opentelemetry.io/collector/exporter@v0.88.0/exporterhelper/metrics.go:100 go.opentelemetry.io/collector/consumer.ConsumeMetricsFunc.ConsumeMetrics /home/runner/go/pkg/mod/go.opentelemetry.io/collector/consumer@v0.88.0/metrics.go:25 github.com/SigNoz/signoz-otel-collector/processor/signozspanmetricsprocessor.(*processorImp).exportMetrics /home/runner/work/signoz-otel-collector/signoz-otel-collector/processor/signozspanmetricsprocessor/processor.go:458 github.com/SigNoz/signoz-otel-collector/processor/signozspanmetricsprocessor.(*processorImp).Start.func1 /home/runner/work/signoz-otel-collector/signoz-otel-collector/processor/signozspanmetricsprocessor/processor.go:402
s
Please upgrade the whole installation. We don't guarantee individual component compatibility with old versions.
k
@Srikanth Chekuri What other components need to be upgraded? We only used signoz-otel-collector and query-service
s
How are you using SigNoz? You need to update ClickHouse, otel-collector (along with the config we publish) and query-serivce.
k
@Srikanth Chekuri We deployed signoz to kuberentes, using external clickhouse 24.1.5.6; signoz components deployed query-service(0.39.0), signoz-frontend(0.39.0), signoz-otel-collector(0.88.13)
@Srikanth Chekuri
s
What are the configurations? Did you use our charts?
k
@Srikanth Chekuri Yaml file split using signoz’s chart
@Srikanth Chekuri I may know the reason. It may be because I only updated the otel container image and did not update the configuration file. I will update the configuration file. Thank you for your help.
s
Yes, please keep eye one the config manifests during releases because sometime we make necessary config changes to make the whole system work well.