signoz-community #support

Hi, I have 2 problems with our Signoz that need help: 1. The traces retention period process is stuck while I change the setting, is there any way to force stop and reset the retention period? 2. I tried to update Signoz from 0.11.4 to 0.12.0 running using docker-compose.yaml file, but I got an error on otel-collector. "Error: cannot build pipelines: failed to create "clickhouselogsexporter" exporter, in pipeline "logs": cannot configure clickhouse logs exporter: failed to create database, err: code: 170, message: Requested cluster 'cluster' not found. Do I miss any steps for upgrading Signoz?

Timothy Wigginton

12/23/2022, 3:43 PM

Hello I wanted to know if there was a way to filter out traces so that only unique traces showed up? Essentially just show the first span of every trace.

Shivvinay Kanswal

12/27/2022, 12:32 PM

Hi Team, experienced an outage of traces pertaining to following error:

2022-12-27T12:12:51.083Z	error	signozspanmetricsprocessor/processor.go:429	value not found in metricKeyToDimensions cache by key "iv-prod-api-core\x00STATUS_CODE_UNSET\<http://x00archive.mandarinmansion.com|x00archive.mandarinmansion.com>\x00default\x00default"	{"kind": "processor", "name": "signozspanmetrics/prometheus", "pipeline": "traces"}
<http://github.com/SigNoz/signoz-otel-collector/processor/signozspanmetricsprocessor.(*processorImp).collectExternalCallMetrics|github.com/SigNoz/signoz-otel-collector/processor/signozspanmetricsprocessor.(*processorImp).collectExternalCallMetrics>
	/src/processor/signozspanmetricsprocessor/processor.go:429
<http://github.com/SigNoz/signoz-otel-collector/processor/signozspanmetricsprocessor.(*processorImp).buildMetrics|github.com/SigNoz/signoz-otel-collector/processor/signozspanmetricsprocessor.(*processorImp).buildMetrics>
	/src/processor/signozspanmetricsprocessor/processor.go:312
<http://github.com/SigNoz/signoz-otel-collector/processor/signozspanmetricsprocessor.(*processorImp).ConsumeTraces|github.com/SigNoz/signoz-otel-collector/processor/signozspanmetricsprocessor.(*processorImp).ConsumeTraces>
	/src/processor/signozspanmetricsprocessor/processor.go:281
<http://go.opentelemetry.io/collector/receiver/otlpreceiver/internal/trace.(*Receiver).Export|go.opentelemetry.io/collector/receiver/otlpreceiver/internal/trace.(*Receiver).Export>
	/go/pkg/mod/go.opentelemetry.io/collector@v0.55.0/receiver/otlpreceiver/internal/trace/otlp.go:60
<http://go.opentelemetry.io/collector/pdata/ptrace/ptraceotlp.rawTracesServer.Export|go.opentelemetry.io/collector/pdata/ptrace/ptraceotlp.rawTracesServer.Export>
	/go/pkg/mod/go.opentelemetry.io/collector/pdata@v0.55.0/ptrace/ptraceotlp/traces.go:167
<http://go.opentelemetry.io/collector/pdata/internal/data/protogen/collector/trace/v1._TraceService_Export_Handler.func1|go.opentelemetry.io/collector/pdata/internal/data/protogen/collector/trace/v1._TraceService_Export_Handler.func1>
	/go/pkg/mod/go.opentelemetry.io/collector/pdata@v0.55.0/internal/data/protogen/collector/trace/v1/trace_service.pb.go:216
<http://go.opentelemetry.io/collector/config/configgrpc.enhanceWithClientInformation.func1|go.opentelemetry.io/collector/config/configgrpc.enhanceWithClientInformation.func1>
	/go/pkg/mod/go.opentelemetry.io/collector@v0.55.0/config/configgrpc/configgrpc.go:385
<http://google.golang.org/grpc.chainUnaryInterceptors.func1.1|google.golang.org/grpc.chainUnaryInterceptors.func1.1>
	/go/pkg/mod/google.golang.org/grpc@v1.47.0/server.go:1117
<http://go.opentelemetry.io/contrib/instrumentation/google.golang.org/grpc/otelgrpc.UnaryServerInterceptor.func1|go.opentelemetry.io/contrib/instrumentation/google.golang.org/grpc/otelgrpc.UnaryServerInterceptor.func1>
	/go/pkg/mod/go.opentelemetry.io/contrib/instrumentation/google.golang.org/grpc/otelgrpc@v0.32.0/interceptor.go:325
<http://google.golang.org/grpc.chainUnaryInterceptors.func1.1|google.golang.org/grpc.chainUnaryInterceptors.func1.1>
	/go/pkg/mod/google.golang.org/grpc@v1.47.0/server.go:1120
<http://google.golang.org/grpc.chainUnaryInterceptors.func1|google.golang.org/grpc.chainUnaryInterceptors.func1>
	/go/pkg/mod/google.golang.org/grpc@v1.47.0/server.go:1122
<http://go.opentelemetry.io/collector/pdata/internal/data/protogen/collector/trace/v1._TraceService_Export_Handler|go.opentelemetry.io/collector/pdata/internal/data/protogen/collector/trace/v1._TraceService_Export_Handler>
	/go/pkg/mod/go.opentelemetry.io/collector/pdata@v0.55.0/internal/data/protogen/collector/trace/v1/trace_service.pb.go:218
<http://google.golang.org/grpc.(*Server).processUnaryRPC|google.golang.org/grpc.(*Server).processUnaryRPC>
	/go/pkg/mod/google.golang.org/grpc@v1.47.0/server.go:1283
<http://google.golang.org/grpc.(*Server).handleStream|google.golang.org/grpc.(*Server).handleStream>
	/go/pkg/mod/google.golang.org/grpc@v1.47.0/server.go:1620
<http://google.golang.org/grpc.(*Server).serveStreams.func1.2|google.golang.org/grpc.(*Server).serveStreams.func1.2>
	/go/pkg/mod/google.golang.org/grpc@v1.47.0/server.go:922

Mohit Verma

12/27/2022, 1:06 PM

Hello Team, The portion which is bold is getting underlined in the vs code while integrating with my react application can anyone of you help me out in this ? CC @Pranay const serviceName = "frontendproject"; const resource = new Resource({ "service.name": serviceName }); const provider = new WebTracerProvider({ resource }); const collector = new CollectorTraceExporter({ url: "http://localhost:4318/v1/traces", }); provider.addSpanProcessor(*new SimpleSpanProcessor(collector))*; provider.register({ contextManager: new ZoneContextManager() });

Mohit Verma

12/27/2022, 1:58 PM

Hello team, cannot find type definition for file for 'jest'

Muhammed Hussein Karimi

12/27/2022, 3:18 PM

Hi We want to migrate from our stack to signoz and one of the things are Sentry Is there any adapter between them or making signoz to accept sentry issues api (just like Jeager support)?

Mohit Verma

12/27/2022, 3:18 PM

@channel Hello team, the below function is getting in red color while integrating with the react project registerInstrumentations({ instrumentations: [ new FetchInstrumentation({ propagateTraceHeaderCorsUrls: ["/.*/g"], clearTimingResources: true, applyCustomAttributesOnSpan: ( span: Span, request: Request | RequestInit, result: Response | FetchError ) => { const attributes = (span as any).attributes; if (attributes.component === "fetch") { span.updateName(

${attributes["http.method"]} ${attributes["http.url"]}

); } if (result instanceof Error) { span.setStatus({ code: SpanStatusCode.ERROR, message: result.message, }); span.recordException(result.stack || result.name); } }, }), ], });

Jonathan Sun

12/28/2022, 3:10 AM

hi there!

Vinayak Singh

12/28/2022, 4:50 AM

Hi team, I'm trying to pull cloudwatch metrics to signoz, but don't know how to do it. Can anyone help me or guide me to the right direction?

Mohit Verma

12/28/2022, 5:14 AM

Hello Team, can anyone tell me how to keep the folder structure while integrating signoz with the react application 1. signoz in that my react project 2 signoz in that deploy folder my react project 3) react project in that signoz or you can share any other method to go for

Rahul Rammurat Chauhan

12/28/2022, 11:50 AM

Hi team, Last time I have SSL certificate related issues and in next release we thought problem is fixed but still, I can see certificate related issues.

2022.12.01 10:43:24.102753 [ 1 ] {} <Error> CertificateReloader: Cannot obtain modification time for certificate file /etc/clickhouse-server/server.crt, skipping update. errno: 2, strerror: No such file or directory
2022.12.01 10:43:24.102761 [ 1 ] {} <Error> CertificateReloader: Cannot obtain modification time for key file /etc/clickhouse-server/server.key, skipping update. errno: 2, strerror: No such file or directory
2022.12.01 10:43:24.106704 [ 1 ] {} <Error> CertificateReloader: Poco::Exception. Code: 1000, e.code() = 0, SSL context exception: Error loading private key from file /etc/clickhouse-server/server.key: error:02000002:system library:OPENSSL_internal:No such file or directory (version 22.8.8.3 (official build))
2022.12.28 08:01:12.365479 [ 1 ] {} <Warning> Context: Linux is not using a fast TSC clock source. Performance can be degraded. Check /sys/devices/system/clocksource/clocksource0/current_clocksource
2022.12.28 08:01:12.365557 [ 1 ] {} <Warning> Context: Linux threads max count is too low. Check /proc/sys/kernel/threads-max
2022.12.28 08:01:12.807608 [ 1 ] {} <Error> CertificateReloader: Cannot obtain modification time for certificate file /etc/clickhouse-server/server.crt, skipping update. errno: 2, strerror: No such file or directory
2022.12.28 08:01:12.807630 [ 1 ] {} <Error> CertificateReloader: Cannot obtain modification time for key file /etc/clickhouse-server/server.key, skipping update. errno: 2, strerror: No such file or directory
2022.12.28 08:01:12.812139 [ 1 ] {} <Error> CertificateReloader: Poco::Exception. Code: 1000, e.code() = 0, SSL context exception: Error loading private key from file /etc/clickhouse-server/server.key: error:02000002:system library:OPENSSL_internal:No such file or directory (version 22.8.8.3 (official build))

Mohit Verma

12/28/2022, 11:57 AM

Hello Team, I have configured the signoz for my node js application but on the signoz dashboard it is not showing me the service name

Bill Cavalieri

12/28/2022, 6:06 PM

I have 34 services reporting to my SigNoz. After a hour or two my clickhouse-setup_otel-collector_1 stops accepting traces. How do I gather logs to help identify the issue? Restarting the container fixes the issue for a couple more hours... The service hosts show errors like:

OpenTelemetry error: OTLP exporter received rpc.Status{message=value not found in metricKeyToDimensions cache by key "id-staging-app01\x00GET /admin/tag_management(.:format)\x00SPAN_KIND_SERVER\x00STATUS_CODE_UNSET\x00200\x00default\x00default", details=[]}

Muhammed Hussein Karimi

12/28/2022, 9:01 PM

Hi How can I set TimeZone for signoz?

Vinayak Singh

12/29/2022, 10:31 AM

Hi Team, anyone can help me in shipping logs from elastic beanstalk to signoz? Any direction or help is highly appreciated. Thanks

Muhammed Hussein Karimi

12/29/2022, 6:38 PM

Hello Guys the Helm Chart template for query service is wrong

imagePullSecret

section indent is not correct and when you set it it will cause errors in that

StateFullSet

Bill Cavalieri

12/29/2022, 6:39 PM

I'd like to access the SigNoz UI with SSL. I'm a docker install, any docs on this that I missed? Or would it be best to setup a reverse proxy and handle the SSL there?

Muhammed Hussein Karimi

12/29/2022, 7:16 PM

Why is traces section Pagination and top chart (for counter) is not working? but when I refresh the page data will be hidden and pagination (also chart) will be fixed

Quyet Nguyen

12/30/2022, 11:55 AM

2022-12-30T11:53:13.130Z DEBUG clickhouseReader/reader.go:1806 
  WITH
   quantilesMergeState(0.5, 0.75, 0.9, 0.95, 0.99)(duration_quantiles_state) AS duration_quantiles_state,
   finalizeAggregation(duration_quantiles_state) AS result
  SELECT
   src as parent,
   dest as child,
   result[1] AS p50,
   result[2] AS p75,
   result[3] AS p90,
   result[4] AS p95,
   result[5] AS p99,
   sum(total_count) as callCount,
   sum(total_count)/ @duration AS callRate,
   sum(error_count)/sum(total_count) as errorRate
  FROM signoz_traces.dependency_graph_minutes
  WHERE toUInt64(toDateTime(timestamp)) >= @start AND toUInt64(toDateTime(timestamp)) <= @end
  GROUP BY
   src,
   dest[{start 1672399389} {end 1672401159} {duration 1770}]
2022-12-30T11:53:13.135Z ERROR clickhouseReader/reader.go:1811 Error in processing sql query: code: 184, message: Aggregate function quantilesMergeState(0.5, 0.75, 0.9, 0.95, 0.99)(duration_quantiles_state) is found inside another aggregate function in query: While processing quantilesMergeState(0.5, 0.75, 0.9, 0.95, 0.99)(duration_quantiles_state)
<http://go.signoz.io/signoz/pkg/query-service/app/clickhouseReader.(*ClickHouseReader).GetDependencyGraph|go.signoz.io/signoz/pkg/query-service/app/clickhouseReader.(*ClickHouseReader).GetDependencyGraph>
 /go/src/github.com/signoz/signoz/pkg/query-service/app/clickhouseReader/reader.go:1811
<http://go.signoz.io/signoz/pkg/query-service/app.(*APIHandler).dependencyGraph|go.signoz.io/signoz/pkg/query-service/app.(*APIHandler).dependencyGraph>
 /go/src/github.com/signoz/signoz/pkg/query-service/app/http_handler.go:1344
<http://go.signoz.io/signoz/pkg/query-service/app.ViewAccess.func1|go.signoz.io/signoz/pkg/query-service/app.ViewAccess.func1>
 /go/src/github.com/signoz/signoz/pkg/query-service/app/http_handler.go:250
net/http.HandlerFunc.ServeHTTP
 /usr/local/go/src/net/http/server.go:2047
<http://go.signoz.io/signoz/ee/query-service/app.loggingMiddleware.func1|go.signoz.io/signoz/ee/query-service/app.loggingMiddleware.func1>
 /go/src/github.com/signoz/signoz/ee/query-service/app/server.go:220
net/http.HandlerFunc.ServeHTTP
 /usr/local/go/src/net/http/server.go:2047
<http://go.signoz.io/signoz/ee/query-service/app.(*Server).analyticsMiddleware.func1|go.signoz.io/signoz/ee/query-service/app.(*Server).analyticsMiddleware.func1>
 /go/src/github.com/signoz/signoz/ee/query-service/app/server.go:264
net/http.HandlerFunc.ServeHTTP
 /usr/local/go/src/net/http/server.go:2047
<http://go.signoz.io/signoz/ee/query-service/app.setTimeoutMiddleware.func1|go.signoz.io/signoz/ee/query-service/app.setTimeoutMiddleware.func1>
 /go/src/github.com/signoz/signoz/ee/query-service/app/server.go:287
net/http.HandlerFunc.ServeHTTP
 /usr/local/go/src/net/http/server.go:2047
<http://github.com/gorilla/mux.(*Router).ServeHTTP|github.com/gorilla/mux.(*Router).ServeHTTP>
 /go/pkg/mod/github.com/gorilla/mux@v1.8.0/mux.go:210
<http://github.com/rs/cors.(*Cors).Handler.func1|github.com/rs/cors.(*Cors).Handler.func1>
 /go/pkg/mod/github.com/rs/cors@v1.7.0/cors.go:219
net/http.HandlerFunc.ServeHTTP
 /usr/local/go/src/net/http/server.go:2047
<http://github.com/gorilla/handlers.CompressHandlerLevel.func1|github.com/gorilla/handlers.CompressHandlerLevel.func1>
 /go/pkg/mod/github.com/gorilla/handlers@v1.5.1/compress.go:141
net/http.HandlerFunc.ServeHTTP
 /usr/local/go/src/net/http/server.go:2047
net/http.serverHandler.ServeHTTP
 /usr/local/go/src/net/http/server.go:2879
net/http.(*conn).serve
 /usr/local/go/src/net/http/server.go:1930

Timothy Wigginton

12/30/2022, 5:46 PM

This may be a more of an open-telemetry question but we are trying to instrument aws step functions and it seems to work fine within aws xray but when looking at the traces in signoz the majority of the traces are missing.

Shivvinay Kanswal

01/02/2023, 12:11 PM

Hi Team, is there a way to enable sharding for the clickhouse storage

Ankita Salunkhe

01/03/2023, 4:53 AM

Hi, Good Morning

Ankita Salunkhe

01/03/2023, 4:53 AM

My services are not showing on Signoz, Getting some errors, can anyone please help me on this?

Title

Ankita Salunkhe

01/03/2023, 4:53 AM

My services are not showing on Signoz, Getting some errors, can anyone please help me on this?

Shivvinay Kanswal

01/03/2023, 5:13 AM

Hi Ankita, had seen similar issue. restarting the otel-collector pod solves the issue. For more details and permenant fix, you could get the drtails here: https://signoz-community.slack.com/archives/C01HWQ1R0BC/p1672144347854659

Ankita Salunkhe

01/03/2023, 10:49 AM

Increased the value of Dimension_cache_size, but still its giving same.

Hii @Shivvinay Kanswal, can u please help me with this

Shivvinay Kanswal

01/04/2023, 5:42 AM

i guess you should upgrade to the latest version of Signosz then

this is a bug in opentelemetry agent

and will need an upgrade of stack

@Srikanth Chekuri please add your comments if i missed something

Ankita Salunkhe

01/04/2023, 5:58 AM

I have v0.11.3 signoz version

upgrade is required?

Srikanth Chekuri

01/04/2023, 7:16 AM

Yes, @Shivvinay Kanswal is correct. This is fixed in

v0.13.0

. Please upgrade and check.

Ankita Salunkhe

01/04/2023, 7:21 AM

Ok, thanks

I will try

View count: 4