Samuel Olowoyeye
09/24/2024, 9:46 PMclickhouse:
layout:
shardsCount: 2
replicasCount: 1
zookeeper:
replicaCount: 3
podDistribution:
- type: ClickHouseAntiAffinity
topologyKey: kubernetes.io/hostname
- type: ReplicaAntiAffinity
topologyKey: kubernetes.io/hostname
- type: ShardAntiAffinity
topologyKey: kubernetes.io/hostname
persistence:
size: 1100Gi
clickhouseOperator:
zookeeperLog:
ttl: 4
schemaMigrator:
enableReplication: false
However, i'm having issues with low batch insert size, How can i increase this.
on my other cluster pushing to data to the signoz platform i have this already set
global:
clusterName: cluster-02b
otelCollectorEndpoint: IP:4317
otelInsecure: true
otelDeployment:
enabled: false
presets:
hostMetrics:
enabled: false
kubeletMetrics:
enabled: false
clusterMetrics:
enabled: false
logsCollection:
# whether to enable log collection
enabled: true
whitelist:
enabled: true
signozLogs: false
namespaces:
- madapi-prod
otelAgent:
config:
processors:
batch:
send_batch_size: 10000
resource/upsert:
attributes:
- key: deployment.environment
value: "cluster02b"
action: upsert
tail_sampling:
policies:
- name: drop_noisy_traces_url
type: string_attribute
string_attribute:
key: url.path
values:
- \/actuator*
- \/health*
enabled_regex_matching: true
invert_match: true
exporters:
otlp:
sending_queue:
queue_size: 10000
service:
pipelines:
traces:
processors: [resource/upsert, batch,tail_sampling]
metrics:
processors: [resource/upsert, batch]
logs:
processors: [resource/upsert, batch]
What should i do?Srikanth Chekuri
09/25/2024, 5:30 AMSamuel Olowoyeye
09/25/2024, 3:10 PM