SigNoz Community

This message was deleted.

s

Slackbot

over 2 years ago

This message was deleted.

s

p

+2

4
12
107

This message was deleted.

s

Slackbot

over 3 years ago

This message was deleted.

s

p

+2

4
5
107

Hi Team, I am trying to do a fresh install of signoz (self-hosted) using helm chart version 0.57.0 (...

k

kankan ghosh

9 months ago

Hi Team, I am trying to do a fresh install of signoz (self-hosted) using helm chart version 0.57.0 (signoz appVersion 0.59.0). but schema-migrator sync and async init pods are failing with the same error as below. Any idea what this error means? also, another question that I have - why is schema-migrator needed for a fresh setup of signoz? Error message:

{"L":"info","timestamp":"2024-12-12T07:36:09.723Z","C":"signozschemamigrator/main.go:162","M":"Migrating up"}

{"L":"info","timestamp":"2024-12-12T07:36:09.723Z","C":"schema_migrator/manager.go:589","M":"Running migrations up sync"}

{"L":"info","timestamp":"2024-12-12T07:36:09.723Z","C":"schema_migrator/manager.go:551","M":"Checking if migration should run","db":"signoz_metrics","migration_id":1000,"versions":[]}

{"L":"info","timestamp":"2024-12-12T07:36:09.723Z","C":"schema_migrator/manager.go:568","M":"Fetching migration status","query":"SELECT * FROM signoz_metrics.schema_migrations_v2 WHERE migration_id = 1000 SETTINGS final = 1;"}

*{"L":"error","timestamp":"2024-12-12T07:36:09.724Z","C":"schema_migrator/manager.go:576","M":"Failed to fetch migration status","error":"code: 115, message: Unknown setting final","S":"<http://github.com/SigNoz/signoz-otel-collector/cmd/signozschemamigrator/schema_migrator.(*MigrationManager).shouldRunMigration|github.com/SigNoz/signoz-otel-collector/cmd/signozschemamigrator/schema_migrator.(*MigrationManager).shouldRunMigration>*\n\t/home/runner/work/signoz-otel-collector/signoz-otel-collector/cmd/signozschemamigrator/schema_migrator/manager.go:576\<http://ngithub.com/SigNoz/signoz-otel-collector/cmd/signozschemamigrator/schema_migrator.(*MigrationManager).MigrateUpSync|ngithub.com/SigNoz/signoz-otel-collector/cmd/signozschemamigrator/schema_migrator.(*MigrationManager).MigrateUpSync>\n\t/home/runner/work/signoz-otel-collector/signoz-otel-collector/cmd/signozschemamigrator/schema_migrator/manager.go:617\nmain.registerSyncMigrate.func1\n\t/home/runner/work/signoz-otel-collector/signoz-otel-collector/cmd/signozschemamigrator/main.go:163\<http://ngithub.com/spf13/cobra.(*Command).execute|ngithub.com/spf13/cobra.(*Command).execute>\n\t/home/runner/go/pkg/mod/github.com/spf13/cobra@v1.8.1/command.go:985\<http://ngithub.com/spf13/cobra.(*Command).ExecuteC|ngithub.com/spf13/cobra.(*Command).ExecuteC>\n\t/home/runner/go/pkg/mod/github.com/spf13/cobra@v1.8.1/command.go:1117\<http://ngithub.com/spf13/cobra.(*Command).Execute|ngithub.com/spf13/cobra.(*Command).Execute>\n\t/home/runner/go/pkg/mod/github.com/spf13/cobra@v1.8.1/command.go:1041\nmain.main\n\t/home/runner/work/signoz-otel-collector/signoz-otel-collector/cmd/signozschemamigrator/main.go:70\nruntime.main\n\t/opt/hostedtoolcache/go/1.23.3/x64/src/runtime/proc.go:272"}

panic: code: 115, message: Unknown setting final

goroutine 1 [running]:

<http://github.com/SigNoz/signoz-otel-collector/cmd/signozschemamigrator/schema_migrator.(*MigrationManager).shouldRunMigration(0xc0000e7520|github.com/SigNoz/signoz-otel-collector/cmd/signozschemamigrator/schema_migrator.(*MigrationManager).shouldRunMigration(0xc0000e7520>, {0xcb5fa1, 0xe}, 0x3e8, {0x13b6a40, 0x0, 0x0})

/home/runner/work/signoz-otel-collector/signoz-otel-collector/cmd/signozschemamigrator/schema_migrator/manager.go:577 +0xb85

<http://github.com/SigNoz/signoz-otel-collector/cmd/signozschemamigrator/schema_migrator.(*MigrationManager).MigrateUpSync(0xc0000e7520|github.com/SigNoz/signoz-otel-collector/cmd/signozschemamigrator/schema_migrator.(*MigrationManager).MigrateUpSync(0xc0000e7520>, {0xe21c60, 0x13b6a40}, {0x13b6a40, 0x0, 0x0})

/home/runner/work/signoz-otel-collector/signoz-otel-collector/cmd/signozschemamigrator/schema_migrator/manager.go:617 +0x27a

main.registerSyncMigrate.func1(0xc0001ca608, {0xcb1c0b?, 0x4?, 0xcb1c0f?})

/home/runner/work/signoz-otel-collector/signoz-otel-collector/cmd/signozschemamigrator/main.go:163 +0xfe9

<http://github.com/spf13/cobra.(*Command).execute(0xc0001ca608|github.com/spf13/cobra.(*Command).execute(0xc0001ca608>, {0xc0001ce8a0, 0x3, 0x3})

/home/runner/go/pkg/mod/github.com/spf13/cobra@v1.8.1/command.go:985 +0xaaa

<http://github.com/spf13/cobra.(*Command).ExecuteC(0xc0001ca308)|github.com/spf13/cobra.(*Command).ExecuteC(0xc0001ca308)>

/home/runner/go/pkg/mod/github.com/spf13/cobra@v1.8.1/command.go:1117 +0x3ff

<http://github.com/spf13/cobra.(*Command).Execute(...)|github.com/spf13/cobra.(*Command).Execute(...)>

/home/runner/go/pkg/mod/github.com/spf13/cobra@v1.8.1/command.go:1041

main.main()

/home/runner/work/signoz-otel-collector/signoz-otel-collector/cmd/signozschemamigrator/main.go:70 +0x1f9

k

n

2
5
106

why isnt my otel-collector running awscloudwatch receiver? Im expecting it to pull cloud watch logs ...

a

Allan Oricil

over 1 year ago

why isnt my otel-collector running awscloudwatch receiver? Im expecting it to pull cloud watch logs and then send them to Signoz

a

v

n

3
16
106

Hi. We are playing around with external clickhouse setup (every other part of signoz runs on k8s), l...

w

WD

9 months ago

Hi. We are playing around with external clickhouse setup (every other part of signoz runs on k8s), latest version of chart (0.56.2, signoz 0.58.2). When we use the default clickhouse user with empty password: externalClickhouse: host: 10.10.10.10 user: default password: "" everything works correctly, signoz deployment finishes, schema-migrator completes. But when we setup a password for the default user: user: default password: yyyy or password: "yyyy" or password: 'yyyy' schema migrator seems to complete part of migrations but then fails and goes into CrashLoopBack and timeouts with this error:

Error: failed to run squashed migrations: failed to run squashed migrations

code: 516, message: Received from 10.10.10.10:9000. DB::Exception: default: Authentication failed: password is incorrect, or there is no user with such name.

If we change the user, delete the deployment and helm install fresh - same situation, same error. We use the default clickhouse ports (8123, 9000) so we don't setup them in the yaml file. Connecting locally or externally to clickhouse instance on 10.10.10.10 with the default user or the other user and providing yyyy password - works without any issues. Any idea what we are doing incorrectly?

w

s

2
5
105

Hi Team Today I upgraded signoz from 0.44.0 to 0.50.0 and getting below error, Defaulted container ...

v

Vishal Kanani

about 1 year ago

Hi Team Today I upgraded signoz from 0.44.0 to 0.50.0 and getting below error, Defaulted container "schema-migrator" out of: schema-migrator, my-release-signoz-schema-migrator-init (init), my-release-signoz-schema-migrator-ch-ready (init) {"level":"info","timestamp":"2024-07-22T190403.105Z","caller":"signozschemamigrator/migrate.go:89","msg":"Setting env var SIGNOZ_CLUSTER","component":"migrate cli","cluster-name":"cluster"} {"level":"info","timestamp":"2024-07-22T190403.105Z","caller":"signozschemamigrator/migrate.go:106","msg":"Successfully set env var SIGNOZ_CLUSTER ","component":"migrate cli","cluster-name":"cluster"} {"level":"info","timestamp":"2024-07-22T190403.105Z","caller":"signozschemamigrator/migrate.go:111","msg":"Setting env var SIGNOZ_REPLICATED","component":"migrate cli","replication":false} {"level":"info","timestamp":"2024-07-22T190403.112Z","caller":"migrationmanager/manager.go:76","msg":"Running migrations for all migrators","component":"migrationmanager"} {"level":"info","timestamp":"2024-07-22T190403.112Z","caller":"migrationmanager/manager.go:78","msg":"Running migrations for logs","component":"migrationmanager","migrator":"logs"} {"level":"error","timestamp":"2024-07-22T190403.187Z","caller":"migrationmanager/manager.go:81","msg":"Failed to run migrations for migrator","component":"migrationmanager","migrator":"logs","error":"clickhouse migrate failed to run, error: Dirty database version 12. Fix and force version.","stacktrace":"github.com/SigNoz/signoz-otel-collector/migrationmanager.(*MigrationManager).Migrate\n\t/home/runner/work/signoz-otel-collector/signoz-otel-collector/migrationmanager/manager.go81\nmain.main\n\t/home/runner/work/signoz otel collector/signoz otel collector/cmd/signozschemamigrator/migrate.go126\nruntime.main\n\t/opt/hostedtoolcache/go/1.21.11/x64/src/runtime/proc.go:267"} {"level":"fatal","timestamp":"2024-07-22T190403.187Z","caller":"signozschemamigrator/migrate.go:128","msg":"Failed to run migrations","component":"migrate cli","error":"clickhouse migrate failed to run, error: Dirty database version 12. Fix and force version.","stacktrace":"main.main\n\t/home/runner/work/signoz-otel-collector/signoz-otel-collector/cmd/signozschemamigrator/migrate.go128\nruntime.main\n\t/opt/hostedtoolcache/go/1.21.11/x64/src/runtime/proc.go267"}

4
28
104

Hi SigNoz Team, I need a help to set up SMTP server details for email alert purpose, it would be g...

r

Ramana Reddy

5 months ago

Hi SigNoz Team, I need a help to set up SMTP server details for email alert purpose, it would be great if anyone assist me to set up, i have tried all possibilities but didn't worked. I have selfhosted SigNoz on my ubuntu system through docker steps. Thanks, Ramana

r

n

2
15
103

I am missing lot of logs from signoz, is there a way to find out why this is happening? I associate ...

d

Dhruv garg

11 months ago

I am missing lot of logs from signoz, is there a way to find out why this is happening? I associate logs with traces, and even though traces are present, many times logs are not there. I am having k8s deployment, and sending logs from node.js application using pino-otel-transporter https://github.com/pinojs/pino-opentelemetry-transport

d

n

2
17
103

Hey all, I'm facing some issue while running docker compose ```$ docker-compose -f docker/clickhouse...

j

Jay Kumar

11 months ago

Hey all, I'm facing some issue while running docker compose

$ docker-compose -f docker/clickhouse-setup/docker-compose.yaml up -d
time="2024-09-20T00:00:07+05:30" level=warning msg="D:\\Jay\\Algora\\signoz\\deploy\\docker\\clickhouse-setup\\docker-compose.yaml: `version` is obsolete"
[+] Running 61/40
 ✔ zookeeper-1 Pulled                                                                                                                                                                                      185.5s
 ✔ clickhouse Pulled                                                                                                                                                                                       185.4s
 ✔ otel-collector-migrator Pulled                                                                                                                                                                           44.1s
 ✔ load-hotrod Pulled                                                                                                                                                                                      104.9s
 ✔ frontend Pulled                                                                                                                                                                                         134.8s
 ✔ hotrod Pulled                                                                                                                                                                                            80.9s
 ✔ logspout Pulled                                                                                                                                                                                          26.5s
 ✔ otel-collector Pulled                                                                                                                                                                                   127.4s
 ✔ alertmanager Pulled                                                                                                                                                                                     127.7s
 ✔ query-service Pulled                                                                                                                                                                                     38.7s






























[+] Running 11/11
 ✔ Network clickhouse-setup_default  Created                                                                                                                                                                 1.0s
 ✔ Container load-hotrod             Started                                                                                                                                                                 9.3s
 ✔ Container signoz-zookeeper-1      Started                                                                                                                                                                10.0s
 ✔ Container hotrod                  Started                                                                                                                                                                 9.4s
 ✔ Container signoz-clickhouse       Healthy                                                                                                                                                                94.4s
 ✘ Container otel-migrator           service "otel-collector-migrator" didn't complete successfully: exit 1                                                                                                102.0s
 ✔ Container signoz-query-service    Created                                                                                                                                                                 0.8s
 ✔ Container signoz-alertmanager     Created                                                                                                                                                                 0.9s
 ✔ Container signoz-otel-collector   Created                                                                                                                                                                 0.9s
 ✔ Container signoz-logspout         Created                                                                                                                                                                 0.8s
 ✔ Container signoz-frontend         Created                                                                                                                                                                 0.7s
service "otel-collector-migrator" didn't complete successfully: exit 1$ docker-compose -f docker/clickhouse-setup/docker-compose.yaml up -d
time="2024-09-20T00:00:07+05:30" level=warning msg="D:\\Jay\\Algora\\signoz\\deploy\\docker\\clickhouse-setup\\docker-compose.yaml: `version` is obsolete"
[+] Running 61/40
 ✔ zookeeper-1 Pulled                                                                                                                                                                                      185.5s
 ✔ clickhouse Pulled                                                                                                                                                                                       185.4s
 ✔ otel-collector-migrator Pulled                                                                                                                                                                           44.1s
 ✔ load-hotrod Pulled                                                                                                                                                                                      104.9s
 ✔ frontend Pulled                                                                                                                                                                                         134.8s
 ✔ hotrod Pulled                                                                                                                                                                                            80.9s
 ✔ logspout Pulled                                                                                                                                                                                          26.5s
 ✔ otel-collector Pulled                                                                                                                                                                                   127.4s
 ✔ alertmanager Pulled                                                                                                                                                                                     127.7s
 ✔ query-service Pulled                                                                                                                                                                                     38.7s






























[+] Running 11/11
 ✔ Network clickhouse-setup_default  Created                                                                                                                                                                 1.0s
 ✔ Container load-hotrod             Started                                                                                                                                                                 9.3s
 ✔ Container signoz-zookeeper-1      Started                                                                                                                                                                10.0s
 ✔ Container hotrod                  Started                                                                                                                                                                 9.4s
 ✔ Container signoz-clickhouse       Healthy                                                                                                                                                                94.4s
 ✘ Container otel-migrator           service "otel-collector-migrator" didn't complete successfully: exit 1                                                                                                102.0s
 ✔ Container signoz-query-service    Created                                                                                                                                                                 0.8s
 ✔ Container signoz-alertmanager     Created                                                                                                                                                                 0.9s
 ✔ Container signoz-otel-collector   Created                                                                                                                                                                 0.9s
 ✔ Container signoz-logspout         Created                                                                                                                                                                 0.8s
 ✔ Container signoz-frontend         Created                                                                                                                                                                 0.7s
service "otel-collector-migrator" didn't complete successfully: exit 1

j

p

j

3
13
103

I got this error. Does anyone know how to fix it. Thanks.

h

Hiep Nguyen

about 1 year ago

I got this error. Does anyone know how to fix it. Thanks.

h

i

2
16
103