This message was deleted.
# supports
Slackbot
10/03/2023, 5:11 AMThis message was deleted.
s
Srikanth Chekuri
10/04/2023, 4:11 PMBy to push logs to clickhouse and anlayse from signoz You mean to write to the table yourself? That’s not recommended. You should use some log collection and let the
signoz-otel-collectorSrikanth Chekuri
10/04/2023, 4:23 PMv
Varaprasad Neerukattu
10/07/2023, 12:01 PMThanks Srikanth for the response.. we are planning to move logs to clickhouse using vector as raw log, use views at clickhouse and visualize at signoz.
Is that possible, else we have to parse all logs to signoz otel collector and parse all otel collector ?.. if so single DB or Table?
Varaprasad Neerukattu
10/13/2023, 2:23 AMHi @Srikanth Chekuri..thanks for inputs.. we finally started signoz on multinode clickhouse cluster...
Otel collectors (from K8s, VM) --- > signoz otel collectors(LBs) -- > clickhouse (multi shards) --> signoz.. We are fully evaluating the scale/HA in comming day.. ~ 70TB per day logs scale
a
Ankit Nayan
10/13/2023, 5:04 AM
Is that possible, else we have to parse all logs to signoz otel collector and parse all otel collector ?.. if so single DB or Table?parsing at vector should be fine, right @nitya-signoz?
Ankit Nayan
10/13/2023, 5:05 AM
clickhouse sharding is already in place. You should be able to increase the shard count and work with scale. There is no limitation on single table, db, shard if you use the setup given by SigNoz.