{"level":"error","ts":1724315376.3185623,"caller":...
# supportp
Parth prajapati
08/22/2024, 8:32 AM{"level":"error","ts":1724315376.3185623,"caller":"clickhousetracesexporter/writer.go:419","msg":"Could not write a batch of spans to index table: ","kind":"exporter","data_type":"traces","name":"clickhousetraces","error":"code: 243, message: Cannot reserve 1.00 MiB, not enough space: while pushing to view signoz_traces.dependency_graph_minutes_db_calls_mv .....................
{"level":"error","ts":1724315473.5250552,"caller":"exporterhelper/queue_sender.go:93","msg":"Exporting failed. No more retries left. Dropping data.","kind":"exporter","data_type":"metrics","name":"clickhousemetricswrite","error":"max elapsed time expired code: 243, message: Cannot reserve 1.00 MiB, not enough space","dropped_items":1033,"stacktrace":"go.opentelemetry.io/collector/exporter/exporterhelper.
I am getting this error logs in my otel-collector pod, can anyone look into this and tell that what exactly the issue is?
s
Srikanth Chekuri
08/22/2024, 9:49 AMClickHouse doesn't have enough disk space
p
Parth prajapati
08/23/2024, 5:33 AMI am getting another issue that, suddenly from last 3 days, my services is not showing in an signoz, in "services" section, but traces and logs we are getting, but services is not coming...., what could be the reason for that.?
do u have any idea about that?
@Prashant Shahi @Srikanth Chekuri
Parth prajapati
08/23/2024, 7:55 AMi am also getting this error logs in otel-collector pod,
{"level":"error","ts":1724399621.711552,"caller":"clickhousetracesexporter/writer.go:419","msg":"Could not write a batch of spans to index table: ","kind":"exporter","data_type":"traces","name":"clickhousetraces","error":"code: 243, message: Cannot reserve 1.00 MiB, not enough space: while pushing to view signoz_traces.root_operations (cd9f81a8-6123-412b-a3e6-549f29e477e8)","stacktrace":"github.com/SigNoz/signoz-otel-collector/exporter/clickhousetracesexporter.(*SpanWriter).WriteBatchOfSpans\n\t/home/runner/work/signoz-otel-collector/signoz-otel-collector/exporter/clickhousetracesexporter/writer.go:419\ngithub.com/SigNoz/signoz-otel-collector/exporter/clickhousetracesexporter.(*storage).pushTraceData\n\t/home/runner/work/signoz-otel-collector/signoz-otel-collector/exporter/clickhousetracesexporter/clickhouse_exporter.go:439\ngo.opentelemetry.io/collector/exporter/exporterhelper.(*tracesRequest).Export\n\t/home/runner/go/pkg/mod/go.opentelemetry.io/collector/exporter@v0.88.0/exporterhelper/traces.go:60\ngo.opentelemetry.io/collector/exporter/exporterhelper.(*timeoutSender).send\n\t/home/runner/go/pkg/mod/go.opentelemetry.io/collector/exporter@v0.88.0/exporterhelper/timeout_sender.go:41\ngo.opentelemetry.io/collector/exporter/exporterhelper.(*retrySender).send\n\t/home/runner/go/pkg/mod/go.opentelemetry.io/collector/exporter@v0.88.0/exporterhelper/retry_sender.go:138\ngo.opentelemetry.io/collector/exporter/exporterhelper.(*tracesExporterWithObservability).send\n\t/home/runner/go/pkg/mod/go.opentelemetry.io/collector/exporter@v0.88.0/exporterhelper/traces.go:177\ngo.opentelemetry.io/collector/exporter/exporterhelper.(*queueSender).start.func1\n\t/home/runner/go/pkg/mod/go.opentelemetry.io/collector/exporter@v0.88.0/exporterhelper/queue_sender.go:126\ngo.opentelemetry.io/collector/exporter/exporterhelper/internal.(*boundedMemoryQueue).Start.func1\n\t/home/runner/go/pkg/mod/go.opentelemetry.io/collector/exporter@v0.88.0/exporterhelper/internal/bounded_memory_queue.go:52"}
there is sufficient dish avaible, memory and cpu is also sufficient.
Parth prajapati
08/23/2024, 7:55 AM@Prashant Shahi @Srikanth Chekuri
s
Srikanth Chekuri
08/25/2024, 8:31 AMthere is sufficient dish avaible
Could not write a batch of spans to index table: ","kind":"exporter","data_type":"traces","name":"clickhousetraces","error":"code: 243, message: Cannot reserve 1.00 MiB, not enoughThere is not enough disk space available for clickhouse
13 Views