Like S3 for cost efficiency
# general
s
Like S3 for cost efficiency
n
So you can store logs for certain days in hot storage i.e clickhouse and then it can be moved to S3. Is that what you are asking?
s
Yes
v
Can be like loki , entire backend can be on s3.
Anything on ebs or elastic search will be expensive
n
We are using clickhouse for fast query performance and good compression. We don’t support s3 directly, but you can move data to s3 as soon as you want from clickhouse while compromising on query performance. Though recommendation will be to store the most frequent data on clickhouse for example 1 day and then move to s3.
s
What is clickhouse backend?
Ebs or something else
n
Yes EBS.
s
Ok
And retention period?
n
But it can query data present in S3, but as mentioned it will be slower.
s
Or its up to is
n
It upto the user to configure retention period.
s
Means clickhouse can query data presented in s3
But it will be sloow
n
Correct.
s
That's nice
@Vibhav Parameswara Chary
v
yeah, ebs is better than elasticsearch :)