Hi, I ran into issues setting metrics total retention period in v0.46 and tried now on v0.47 as well. I did see some logs in the query service

signoz-with-clickhouse-query-service-0 signoz-with-clickhouse-query-service {"level":"INFO","timestamp":"2024-06-06T13:05:18.162Z","caller":"app/server.go:388","msg":"/api/v1/settings/ttl\ttimeTaken:42.476559ms","timeTaken":42,"path":"/api/v1/settings/ttl"}
signoz-with-clickhouse-query-service-0 signoz-with-clickhouse-query-service {"level":"ERROR","timestamp":"2024-06-06T13:05:18.171Z","caller":"clickhouseReader/reader.go:2406","msg":"error while setting ttl.","error":"code: 47, message: There was an error on [chi-signoz-with-clickhouse-cluster-0-0:9000]: Code: 47. DB::Exception: Missing columns: 'timestamp_ms' while processing query: 'toDateTime(toUInt32(timestamp_ms / 1000), 'UTC') + toIntervalSecond(604800)', required columns: 'timestamp_ms' 'timestamp_ms'. (UNKNOWN_IDENTIFIER) (version 24.1.2.5 (official build))","stacktrace":"<http://go.signoz.io/signoz/pkg/query-service/app/clickhouseReader.(*ClickHouseReader).SetTTL.func2|go.signoz.io/signoz/pkg/query-service/app/clickhouseReader.(*ClickHouseReader).SetTTL.func2>\n\t/home/runner/work/signoz/signoz/pkg/query-service/app/clickhouseReader/reader.go:2406"}
signoz-with-clickhouse-query-service-0 signoz-with-clickhouse-query-service {"level":"ERROR","timestamp":"2024-06-06T13:05:18.238Z","caller":"clickhouseReader/reader.go:2406","msg":"error while setting ttl.","error":"code: 47, message: There was an error on [chi-signoz-with-clickhouse-cluster-0-0:9000]: Code: 47. DB::Exception: Missing columns: 'timestamp_ms' while processing query: 'toDateTime(toUInt32(timestamp_ms / 1000), 'UTC') + toIntervalSecond(604800)', required columns: 'timestamp_ms' 'timestamp_ms'. (UNKNOWN_IDENTIFIER) (version 24.1.2.5 (official build))","stacktrace":"<http://go.signoz.io/signoz/pkg/query-service/app/clickhouseReader.(*ClickHouseReader).SetTTL.func2|go.signoz.io/signoz/pkg/query-service/app/clickhouseReader.(*ClickHouseReader).SetTTL.func2>\n\t/home/runner/work/signoz/signoz/pkg/query-service/app/clickhouseReader/reader.go:2406"}
signoz-with-clickhouse-query-service-0 signoz-with-clickhouse-query-service {"level":"ERROR","timestamp":"2024-06-06T13:05:18.250Z","caller":"clickhouseReader/reader.go:2406","msg":"error while setting ttl.","error":"code: 47, message: There was an error on [chi-signoz-with-clickhouse-cluster-0-0:9000]: Code: 47. DB::Exception: Missing columns: 'timestamp_ms' while processing query: 'toDateTime(toUInt32(timestamp_ms / 1000), 'UTC') + toIntervalSecond(604800)', required columns: 'timestamp_ms' 'timestamp_ms'. (UNKNOWN_IDENTIFIER) (version 24.1.2.5 (official build))","stacktrace":"<http://go.signoz.io/signoz/pkg/query-service/app/clickhouseReader.(*ClickHouseReader).SetTTL.func2|go.signoz.io/signoz/pkg/query-service/app/clickhouseReader.(*ClickHouseReader).SetTTL.func2>\n\t/home/runner/work/signoz/signoz/pkg/query-service/app/clickhouseReader/reader.go:2406"}
signoz-with-clickhouse-query-service-0 signoz-with-clickhouse-query-service {"level":"ERROR","timestamp":"2024-06-06T13:05:18.264Z","caller":"clickhouseReader/reader.go:2406","msg":"error while setting ttl.","error":"code: 47, message: There was an error on [chi-signoz-with-clickhouse-cluster-0-0:9000]: Code: 47. DB::Exception: Missing columns: 'timestamp_ms' while processing query: 'toDateTime(toUInt32(timestamp_ms / 1000), 'UTC') + toIntervalSecond(604800)', required columns: 'timestamp_ms' 'timestamp_ms'. (UNKNOWN_IDENTIFIER) (version 24.1.2.5 (official build))","stacktrace":"<http://go.signoz.io/signoz/pkg/query-service/app/clickhouseReader.(*ClickHouseReader).SetTTL.func2|go.signoz.io/signoz/pkg/query-service/app/clickhouseReader.(*ClickHouseReader).SetTTL.func2>\n\t/home/runner/work/signoz/signoz/pkg/query-service/app/clickhouseReader/reader.go:2406"}
signoz-with-clickhouse-query-service-0 signoz-with-clickhouse-query-service {"level":"INFO","timestamp":"2024-06-06T13:05:19.224Z","caller":"clickhouseReader/reader.go:2499","msg":"checkTTLStatusItem query","query":"SELECT id, status, ttl, cold_storage_ttl FROM ttl_status WHERE table_name = ? ORDER BY created_at DESC","tableName":"signoz_metrics.samples_v4"}
signoz-with-clickhouse-query-service-0 signoz-with-clickhouse-query-service {"level":"INFO","timestamp":"2024-06-06T13:05:19.228Z","caller":"clickhouseReader/reader.go:2499","msg":"checkTTLStatusItem query","query":"SELECT id, status, ttl, cold_storage_ttl FROM ttl_status WHERE table_name = ? ORDER BY created_at DESC","tableName":"signoz_metrics.samples_v4"}
signoz-with-clickhouse-query-service-0 signoz-with-clickhouse-query-service {"level":"INFO","timestamp":"2024-06-06T13:05:19.229Z","caller":"clickhouseReader/reader.go:2591","msg":"Parsing TTL from: ","queryResp":"MergeTree PARTITION BY toDate(unix_milli / 1000) ORDER BY (env, temporality, metric_name, fingerprint, unix_milli) TTL toDateTime(unix_milli / 1000) + toIntervalSecond(2592000) SETTINGS ttl_only_drop_parts = 1, index_granularity = 8192"}

is this a known issue?

Yes, it's known issue and will be fixed soon

Perfect! Thank you!

@Srikanth Chekuri Is the above issue fixed? I am getting same error.