Any unused memory is a wasted memory from a kernel perspective. ClickHouse uses a lot of pagecache etc to make things faster but this memory can be claimed by other processes when needed. It will lead to a little slower queries but this high memory is cache memory.