https://signoz.io logo
Join Slack
Powered by
Hi team!, I've just tried to update Signoz `0.85.3...
# support
p
Hi team!, I've just tried to update Signoz 
0.85.3
(Helm chart version 
0.82.3
) to the latest version as well as 
0.68.2
(Helm chart version 
0.83.2
) and the signoz service isn't able to get healthy. Any clue what I've missed configuring? Already checked the changelog + migration guides but I wasn't able to find anything. I'll attach the logs in the thread.
Signoz service logs:
Copy code
[Deprecated] env STORAGE is deprecated and scheduled for removal. Please use SIGNOZ_TELEMETRYSTORE_PROVIDER instead.
[Deprecated] env ClickHouseUrl is deprecated and scheduled for removal. Please use SIGNOZ_TELEMETRYSTORE_CLICKHOUSE_DSN instead.
[Deprecated] flag --config is deprecated for passing prometheus config. The flag will be used for passing the entire SigNoz config. More details can be found at <https://github.com/SigNoz/signoz/issues/6805>.

                       -**********=
                  .::-=+**********+=--:.
              .-=*******++=-----==+******=-.
           :-+*******=:.            :-+******=:
        .-********+:                   .=*******=.
      :+********+:                       .=*******+:
    .+*********+   :+***+.                 -********+:
   -**********+.  .****=                    =*********=      ____  _             _   _               ____  _       _   _
 .************:   +****                      +**********:   / ___|| |_ __ _ _ __| |_(_)_ __   __ _  / ___|(_) __ _| \ | | ___ ____
.************+   .----:                      -***********-  \___ \| __/ _` | '__| __| | '_ \ / _` | \___ \| |/ _` |  \| |/ _ \_  /
*************=                               :************.  ___) | || (_| | |  | |_| | | | | (_| |  ___) | | (_| | |\  | (_) / / _ _ _
:************+    ----:                      -***********=  |____/ \__\__,_|_|   \__|_|_| |_|\__, | |____/|_|\__, |_| \_|\___/___(_|_|_)
 :************.   *****                      +**********:                                    |___/           |___/
  .=**********+   :****=                    -*********+.    Version: v0.86.2 (enterprise) [Copyright 2025 SigNoz, All rights reserved]
    :+*********+   :+***+                  -********+:
      :+********+.                        =*******+-
        :=********=.                    -*******=:
           :=*******+-.             .-+******=-.
              :-+*******+=--:::--=+******+=:
                  .:-==+***********+=-::
                       :**********=

{"level":"warn","timestamp":"2025-07-02T12:30:36.025Z","caller":"query-service/main.go:123","msg":"No JWT secret key is specified."}
{"timestamp":"2025-07-02T12:30:36.026399159Z","level":"INFO","code":{"function":"<http://github.com/SigNoz/signoz/pkg/signoz.New|github.com/SigNoz/signoz/pkg/signoz.New>","file":"/home/runner/work/signoz/signoz/pkg/signoz/signoz.go","line":64},"msg":"starting signoz","version":"v0.86.2","variant":"enterprise","commit":"b9d542a","branch":"v0.86.2","go":"go1.23.9","timestamp":"2025-06-04T14:55:39Z"}
{"timestamp":"2025-07-02T12:30:36.026753933Z","level":"INFO","code":{"function":"<http://github.com/SigNoz/signoz/pkg/sqlstore/sqlitesqlstore.New|github.com/SigNoz/signoz/pkg/sqlstore/sqlitesqlstore.New>","file":"/home/runner/work/signoz/signoz/pkg/sqlstore/sqlitesqlstore/provider.go","line":46},"msg":"connected to sqlite","logger":"<http://github.com/SigNoz/signoz/pkg/sqlitesqlstore|github.com/SigNoz/signoz/pkg/sqlitesqlstore>","path":"/var/lib/signoz/signoz.db"}
{"timestamp":"2025-07-02T12:30:36.026885089Z","level":"ERROR","code":{"function":"<http://github.com/prometheus/prometheus/promql.NewActiveQueryTracker|github.com/prometheus/prometheus/promql.NewActiveQueryTracker>","file":"/home/runner/go/pkg/mod/github.com/prometheus/prometheus@v0.300.1/promql/query_logger.go","line":137},"msg":"Failed to create directory for logging active queries","logger":"<http://github.com/SigNoz/signoz/pkg/prometheus/clickhouseprometheus|github.com/SigNoz/signoz/pkg/prometheus/clickhouseprometheus>"}
{"timestamp":"2025-07-02T12:30:36.027314573Z","level":"INFO","code":{"function":"<http://github.com/SigNoz/signoz/pkg/sqlmigrator.(*migrator).Migrate|github.com/SigNoz/signoz/pkg/sqlmigrator.(*migrator).Migrate>","file":"/home/runner/work/signoz/signoz/pkg/sqlmigrator/migrator.go","line":43},"msg":"starting sqlstore migrations","logger":"<http://github.com/SigNoz/signoz/pkg/sqlmigrator|github.com/SigNoz/signoz/pkg/sqlmigrator>","dialect":"sqlite"}
{"timestamp":"2025-07-02T12:30:36.046356994Z","level":"INFO","code":{"function":"<http://github.com/SigNoz/signoz/pkg/sqlmigrator.(*migrator).Lock|github.com/SigNoz/signoz/pkg/sqlmigrator.(*migrator).Lock>","file":"/home/runner/work/signoz/signoz/pkg/sqlmigrator/migrator.go","line":90},"msg":"acquired migration lock","logger":"<http://github.com/SigNoz/signoz/pkg/sqlmigrator|github.com/SigNoz/signoz/pkg/sqlmigrator>","dialect":"sqlite"}
{"level":"fatal","timestamp":"2025-07-02T12:30:36.072Z","caller":"query-service/main.go:147","msg":"Failed to create signoz","error":"invalid UUID length: 37","stacktrace":"main.main\n\t/home/runner/work/signoz/signoz/ee/query-service/main.go:147\nruntime.main\n\t/opt/hostedtoolcache/go/1.23.9/x64/src/runtime/proc.go:272"}
I was just checking #C01HWUTP4HH It's the JWT secret right? 😅
v
Can you exec into the signoz container and run:
Copy code
apk add sqlite
sqlite3 /var/lib/signoz/signoz.db
> SELECT * FROM migration
👀 1
and dump the output here?
Some migration failed to run. The output will help me understand which migration failed.
p
The container exits because of this exception, I try another approach to get this data and provide you the info
It shows me this output
Copy code
1|000|1|2025-03-24 12:48:57
2|001|1|2025-03-24 12:48:57
3|002|1|2025-03-24 12:48:57
4|003|1|2025-03-24 12:48:57
5|004|1|2025-03-24 12:48:57
6|005|1|2025-03-24 12:48:57
7|006|1|2025-03-24 12:48:57
8|007|1|2025-03-24 12:48:57
9|008|1|2025-03-24 12:48:58
10|009|1|2025-03-24 12:48:58
11|011|1|2025-03-24 12:48:58
12|012|1|2025-03-24 12:48:58
13|013|1|2025-03-24 12:48:58
14|014|1|2025-03-24 12:48:58
15|015|1|2025-03-24 12:48:58
16|016|2|2025-04-07 15:13:13
17|017|2|2025-04-07 15:13:14
18|018|2|2025-04-07 15:13:14
19|019|2|2025-04-07 15:13:14
20|020|2|2025-04-07 15:13:14
21|021|3|2025-06-04 07:28:52
22|022|3|2025-06-04 07:28:52
23|023|3|2025-06-04 07:28:52
24|024|3|2025-06-04 07:28:52
25|025|3|2025-06-04 07:28:52
26|026|3|2025-06-04 07:28:52
27|027|3|2025-06-04 07:28:52
28|028|3|2025-06-04 07:28:52
29|029|3|2025-06-04 07:28:52
30|030|3|2025-06-04 07:28:52
31|031|3|2025-06-04 07:28:52
32|032|3|2025-06-04 07:28:53
33|033|3|2025-06-04 07:28:53
34|034|3|2025-06-04 07:28:53
35|035|3|2025-06-04 07:28:53
36|036|4|2025-07-02 12:19:06
37|037|4|2025-07-02 12:19:06
v
Alright, there's an issue with existing dashboards.
Can you do 
SELECT id,uuid FROM dashboard
?
Whenever you see this, you just need to delete the dashboard which doesn't have a valid 
uuid
. Please run
Copy code
DELETE FROM dashboard FROM id = <id> where id is the id of the offending uuid.
p
That resolves the issue 🎉 Thanks @Vibhu Pandey!
27 Views
Open in Slack
PreviousNext
Powered by