Mario Giampietri
10/24/2023, 10:11 AMhelm update
I'm back to the issue below.
Is there a way to increase that distributed_ddl_task_timeout
? It's not obvious to me where and how should be set.
{"level":"error","timestamp":"2023-10-24T09:53:26.669Z","caller":"migrationmanager/manager.go:79","msg":"Failed to run migrations for migrator","component":"migrationmanager","migrator":"logs","error":"failed to create database, err: code: 159, message: Watching task /clickhouse/signoz-clickhouse/task_queue/ddl/query-0000000251 is executing longer than distributed_ddl_task_timeout (=180) seconds. There are 1 unfinished hosts (0 of them are currently active), they are going to execute the query in background","stacktrace":"<http://github.com/SigNoz/signoz-otel-collector/migrationmanager.(*MigrationManager).Migrate|github.com/SigNoz/signoz-otel-collector/migrationmanager.(*MigrationManager).Migrate>\n\t/home/runner/work/signoz-otel-collector/signoz-otel-collector/migrationmanager/manager.go:79\nmain.main\n\t/home/runner/work/signoz-otel-collector/signoz-otel-collector/cmd/signozschemamigrator/migrate.go:83\nruntime.main\n\t/opt/hostedtoolcache/go/1.20.10/x64/src/runtime/proc.go:250"}
{"level":"fatal","timestamp":"2023-10-24T09:53:26.972Z","caller":"signozschemamigrator/migrate.go:85","msg":"Failed to run migrations","component":"migrate cli","error":"failed to create database, err: code: 159, message: Watching task /clickhouse/signoz-clickhouse/task_queue/ddl/query-0000000251 is executing longer than distributed_ddl_task_timeout (=180) seconds. There are 1 unfinished hosts (0 of them are currently active), they are going to execute the query in background","stacktrace":"main.main\n\t/home/runner/work/signoz-otel-collector/signoz-otel-collector/cmd/signozschemamigrator/migrate.go:85\nruntime.main\n\t/opt/hostedtoolcache/go/1.20.10/x64/src/runtime/proc.go:250"}
422 / Unprocessable entity
, and visually it appears as if there are no dashboards;
• as I don't mind recreating them (I use some among the ones available here), if I try to recreate one the operation fails and the page goes 404;
The impression is that dashboards are actually there but something is misaligned. Is there a way to reset/clean the dashboard storage?Srikanth Chekuri
10/27/2023, 11:54 AMMario Giampietri
11/01/2023, 9:37 AM