SigNoz is an open-source APM. It helps developers monitor their applications & troubleshoot problems, an open-source alternative to DataDog, NewRelic, etc.

SigNoz Community

image.png

I configured tail_sampling in otel colletcor as below
```      tail_sampling:
        decision_wait: 10s
        num_traces: 150000
        expected_new_traces_per_sec: 50000
        policies:
          - name: error-policy-100
            type: status_code
            status_code:
              status_codes: [ ERROR ]
          - name: sampling-policy-10
            type: probabilistic
            probabilistic:
              sampling_percentage: 10```
After running for a period of time（about 3 days）, the traces will be significantly reduced and will recover after restarting otel-colletor.
Happened twice in the past week.