`signoz-clickhouse | 2024.05.09 133329.051309 [ 825 ] {36467810-0dbd-4c76-be1a-4220d34422a0} <Error> executeQuery: Code: 173. DB:Exception Couldn't allocate 602 bytes when parsing JSON: while executing 'FUNCTION JSONExtractString(labels : 0, 'state' :: 1) -> JSONExtractString(labels, 'state') String : 7': While executing MergeTreeSelect(pool: ReadPool, algorithm: Thread). (CANNOT_ALLOCATE_MEMORY) (version 24.1.2.5 (official build)) (from 172.20.0.5:51866) (comment: {"alertID":"","client":"browser","dashboardID":"fd1a403b-1d09-4389-9251-46689dabbcc6","path":"/dashboard/fd1a403b-1d09-4389-9251-46689dabbcc6","servicesTab":"","source":"dashboards","viewName":""}) (in query: SELECT B.

ts

as

ts

, B.value / (A.value + B.value) as value FROM (SELECT fingerprint, labels as fullLabels, toStartOfInterval(toDateTime(intDiv(timestamp_ms, 1000)), INTERVAL 1980 SECOND) as ts, any(value) as value FROM signoz_metrics.distributed_samples_v2 INNER JOIN (SELECT labels, fingerprint FROM signoz_metrics.time_series_v2 WHERE metric_name = 'system_filesystem_usage' AND temporality IN ['Cumulative', 'Unspecified'] AND JSONExtractString(labels, 'state') = 'used' AND JSONExtractString(labels, 'mountpoint') = '/var/lib/docker/containers' AND JSONExtractString(labels, 'host_name') = 'signoz-host') as filtered_time_series USING fingerprint WHERE metric_name = 'system_filesystem_usage' AND timestamp_ms >= 1715258160000 AND timestamp_ms < 1715261580000 GROUP BY fingerprint, labels, ts ORDER BY fingerprint, labels, ts) as B INNER JOIN (SELECT fingerprint, labels as fullLabels, toStartOfInterval(toDateTime(intDiv(timestamp_ms, 1000)), INTERVAL 1980 SECOND) as ts, any(value) as value FROM signoz_metrics.distributed_samples_v2 INNER JOIN (SELECT labels, fingerprint FROM signoz_metrics.time_series_v2 WHERE metric_name = 'system_filesystem_usage' AND temporality IN ['Cumulative', 'Unspecified'] AND JSONExtractString(labels, 'state') = 'free' AND JSONExtractString(labels, 'mountpoint') = '/var/lib/docker/containers' AND JSONExtractString(labels, 'host_name') = 'signoz-host') as filtered_time_series USING fingerprint WHERE metric_name = 'system_filesystem_usage' AND timestamp_ms >= 1715258160000 AND timestamp_ms < 1715261580000 GROUP BY fingerprint, labels, ts ORDER BY fingerprint, labels, ts) as A ON B.

ts

= A.

ts

), Stack trace (when copying this message, always include the lines below):`

signoz-clickhouse          |

signoz-clickhouse          | 0. DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000c800f1b in /usr/bin/clickhouse

signoz-clickhouse          | 1. DB::Exception::Exception<unsigned long&>(int, FormatStringHelperImpl<std::type_identity<unsigned long&>::type>, unsigned long&) @ 0x00000000072fd210 in /usr/bin/clickhouse

signoz-clickhouse          | 2. DB::SimdJSONParser::reserve(unsigned long) @ 0x0000000007bbd5a9 in /usr/bin/clickhouse

signoz-clickhouse          | 3. DB::ExecutableFunctionJSON<DB::NameJSONExtractString, DB::JSONExtractStringImpl>::executeImpl(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long) const @ 0x0000000007bd8de2 in /usr/bin/clickhouse

signoz-clickhouse          | 4. DB::IExecutableFunction::executeWithoutLowCardinalityColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x000000000fdaa7be in /usr/bin/clickhouse

signoz-clickhouse          | 5. DB::IExecutableFunction::executeWithoutSparseColumns(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x000000000fdab33e in /usr/bin/clickhouse

signoz-clickhouse          | 6. DB::IExecutableFunction::execute(std::vector<DB::ColumnWithTypeAndName, std::allocator<DB::ColumnWithTypeAndName>> const&, std::shared_ptr<DB::IDataType const> const&, unsigned long, bool) const @ 0x000000000fdac8db in /usr/bin/clickhouse

signoz-clickhouse          | 7. DB::ExpressionActions::execute(DB::Block&, unsigned long&, bool) const @ 0x0000000010d3e099 in /usr/bin/clickhouse

signoz-clickhouse          | 8. DB::ExpressionActions::execute(DB::Block&, bool) const @ 0x0000000010d3f346 in /usr/bin/clickhouse

signoz-clickhouse          | 9. DB::MergeTreeRangeReader::executePrewhereActionsAndFilterColumns(DB::MergeTreeRangeReader::ReadResult&) const @ 0x000000001253b38d in /usr/bin/clickhouse

signoz-clickhouse          | 10. DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x0000000012539678 in /usr/bin/clickhouse

signoz-clickhouse          | 11. DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000001253740e in /usr/bin/clickhouse

signoz-clickhouse          | 12. DB::MergeTreeRangeReader::read(unsigned long, DB::MarkRanges&) @ 0x000000001253740e in /usr/bin/clickhouse

signoz-clickhouse          | 13. DB::MergeTreeReadTask::read(DB::MergeTreeReadTask::BlockSizeParams const&) @ 0x000000001253fd56 in /usr/bin/clickhouse

signoz-clickhouse          | 14. DB::MergeTreeThreadSelectAlgorithm::readFromTask(DB::MergeTreeReadTask&, DB::MergeTreeReadTask::BlockSizeParams const&) @ 0x0000000012ddb1af in /usr/bin/clickhouse

signoz-clickhouse          | 15. DB::MergeTreeSelectProcessor::read() @ 0x000000001252cb96 in /usr/bin/clickhouse

^