I'm running a self hosted signoz on k8s cluster wi...
# support
s
I'm running a self hosted signoz on k8s cluster with this override.yaml
Copy code
clickhouse:
  layout:
    shardsCount: 2
    replicasCount: 1
  zookeeper:
    replicaCount: 3
  podDistribution:
    - type: ClickHouseAntiAffinity
      topologyKey: kubernetes.io/hostname
    - type: ReplicaAntiAffinity
      topologyKey: kubernetes.io/hostname
    - type: ShardAntiAffinity
      topologyKey: kubernetes.io/hostname

  persistence:
    size: 1100Gi

  clickhouseOperator:
    zookeeperLog:
      ttl: 4

schemaMigrator:
  enableReplication: false
However, i'm having issues with low batch insert size, How can i increase this. on my other cluster pushing to data to the signoz platform i have this already set
Copy code
global:
  clusterName: cluster-02b

otelCollectorEndpoint: IP:4317
otelInsecure: true

otelDeployment:
  enabled: false

presets:
  hostMetrics:
    enabled: false
  kubeletMetrics:
    enabled: false
  clusterMetrics:
    enabled: false
  logsCollection:
    # whether to enable log collection
    enabled: true
    whitelist:
      enabled: true
      signozLogs: false
      namespaces:
        - madapi-prod
otelAgent:
  config:
    processors:
      batch:
        send_batch_size: 10000
      resource/upsert:
        attributes:
          - key: deployment.environment
            value: "cluster02b"
            action: upsert
      tail_sampling:
        policies:
          - name: drop_noisy_traces_url
            type: string_attribute
            string_attribute:
              key: url.path
              values:
                - \/actuator*
                - \/health*
              enabled_regex_matching: true
              invert_match: true
    exporters:
      otlp:
        sending_queue:
          queue_size: 10000
    service:
      pipelines:
        traces:
          processors: [resource/upsert, batch,tail_sampling]
        metrics:
          processors: [resource/upsert, batch]
        logs:
          processors: [resource/upsert, batch]
What should i do?
s
How big batches are you sending ?
s
10,000