Sourav Musib
07/26/2024, 8:35 PMSourav Musib
07/26/2024, 8:34 PMts=2024-07-26T15:43:36.806Z caller=query_logger.go:138 level=error component=activeQueryTracker msg="Failed to create directory for logging active queries"
ts=2024-07-26T15:43:36.806Z caller=query_logger.go:114 level=error component=activeQueryTracker msg="Error opening query log file" file=/root/queries.active err="open queries.active: permission denied"
panic: Unable to create mmap-ed active query log
goroutine 98 [running]:
<http://github.com/prometheus/prometheus/promql.NewActiveQueryTracker({0x0|github.com/prometheus/prometheus/promql.NewActiveQueryTracker({0x0>, 0x0}, 0x14, {0x269e900, 0xc0000ac8c0})
/home/runner/go/pkg/mod/github.com/!sig!noz/prometheus@v1.11.1/promql/query_logger.go:146 +0x411
<http://go.signoz.io/signoz/pkg/query-service/app/clickhouseReader.(*ClickHouseReader).Start(0xc000702820|go.signoz.io/signoz/pkg/query-service/app/clickhouseReader.(*ClickHouseReader).Start(0xc000702820>, 0x0?)
Giorgos Athanasopoulos
07/26/2024, 11:30 AMDhruv garg
07/26/2024, 10:29 AMGeeBee
07/25/2024, 11:15 AMShrinidhi Rao
07/25/2024, 5:36 AMJP Bader
07/24/2024, 8:34 PMconfig :opentelemetry, :resource, service: %{name: "MY_APP_NAME"}
config :opentelemetry, :processors,
otel_batch_processor: %{
exporter: {
:opentelemetry_exporter,
%{endpoints: ["<http://0.0.0.0:4318>"]}
}
}
I'm not seeing any errors in any logs from the containers, so maybe I'm missing something altogether different?Machhindra
07/23/2024, 9:52 PM{
"level": "error",
"timestamp": "2024-07-23T21:46:37.252Z",
"caller": "migrationmanager/manager.go:81",
"msg": "Failed to run migrations for migrator",
"component": "migrationmanager",
"migrator": "logs",
"error": "clickhouse migrate failed to run, error: Dirty database version 10. Fix and force version.",
"stacktrace": "<http://github.com/SigNoz/signoz-otel-collector/migrationmanager.(*MigrationManager).Migrate|github.com/SigNoz/signoz-otel-collector/migrationmanager.(*MigrationManager).Migrate>\n\t/home/runner/work/signoz-otel-collector/signoz-otel-collector/migrationmanager/manager.go:81\nmain.main\n\t/home/runner/work/signoz-otel-collector/signoz-otel-collector/cmd/signozschemamigrator/migrate.go:126\nruntime.main\n\t/opt/hostedtoolcache/go/1.21.11/x64/src/runtime/proc.go:267"
}
Harish Kunche
07/23/2024, 11:35 AMNagesh Rathod
07/23/2024, 4:35 AMNagesh Rathod
07/23/2024, 4:20 AM2024-07-08T17:37:49.360Z info service@v0.88.0/telemetry.go:84 Setting up own telemetry...
2024-07-08T17:37:49.361Z info service@v0.88.0/telemetry.go:201 Serving Prometheus metrics {"address": "0.0.0.0:8888", "level": "Basic"}
2024-07-08T17:37:49.361Z info exporter@v0.88.0/exporter.go:275 Stability level of component is undefined {"kind": "exporter", "data_type": "metrics", "name": "clickhousemetricswrite"}
2024-07-08T17:37:49.361Z info exporter@v0.88.0/exporter.go:275 Stability level of component is undefined {"kind": "exporter", "data_type": "traces", "name": "clickhousetraces"}
time="2024-07-08T17:37:49Z" level=error msg="code: 81, message: Database signoz_metrics does not exist" component=clickhouse
{"level":"error","timestamp":"2024-07-08T17:37:49.363Z","caller":"opamp/server_client.go:268","msg":"Collector failed for restart during rollback","component":"opamp-server-client","error":"failed to build pipelines: failed to create \"clickhousetraces\" exporter for data type \"traces\": error connecting to primary db: code: 81, message: Database signoz_traces does not exist","stacktrace":"<http://github.com/SigNoz/signoz-otel-collector/opamp.(*serverClient).reload|github.com/SigNoz/signoz-otel-collector/opamp.(*serverClient).reload>\n\t/home/runner/work/signoz-otel-collector/signoz-otel-collector/opamp/server_client.go:268\ngithub.com/SigNoz/signoz-otel-collector/opamp.(*agentConfigManager).applyRemoteConfig\n\t/home/runner/work/signoz-otel-collector/signoz-otel-collector/opamp/config_manager.go:173\ngithub.com/SigNoz/signoz-otel-collector/opamp.(*agentConfigManager).Apply\n\t/home/runner/work/signoz-otel-collector/signoz-otel-collector/opamp/config_manager.go:159\ngithub.com/SigNoz/signoz-otel-collector/opamp.(*serverClient).onRemoteConfigHandler\n\t/home/runner/work/signoz-otel-collector/signoz-otel-collector/opamp/server_client.go:209\ngithub.com/SigNoz/signoz-otel-collector/opamp.(*serverClient).onMessageFuncHandler\n\t/home/runner/work/signoz-otel-collector/signoz-otel-collector/opamp/server_client.go:199\ngithub.com/open-telemetry/opamp-go/client/types.CallbacksStruct.OnMessage\n\t/home/runner/go/pkg/mod/github.com/open-telemetry/opamp-go@v0.5.0/client/types/callbacks.go:162\ngithub.com/open-telemetry/opamp-go/client/internal.(*receivedProcessor).ProcessReceivedMessage\n\t/home/runner/go/pkg/mod/github.com/open-telemetry/opamp-go@v0.5.0/client/internal/receivedprocessor.go:131\ngithub.com/open-telemetry/opamp-go/client/internal.(*wsReceiver).ReceiverLoop\n\t/home/runner/go/pkg/mod/github.com/open-telemetry/opamp-go@v0.5.0/client/internal/wsreceiver.go:57\ngithub.com/open-telemetry/opamp-go/client.(*wsClient).runOneCycle\n\t/home/runner/go/pkg/mod/github.com/open-telemetry/opamp-go@v0.5.0/client/wsclient.go:243\ngithub.com/open-telemetry/opamp-go/client.(*wsClient).runUntilStopped\n\t/home/runner/go/pkg/mod/github.com/open-telemetry/opamp-go@v0.5.0/client/wsclient.go:265\ngithub.com/open-telemetry/opamp-go/client/internal.(*ClientCommon).StartConnectAndRun.func1\n\t/home/runner/go/pkg/mod/github.com/open-telemetry/opamp-go@v0.5.0/client/internal/clientcommon.go:197"}
{"level":"error","timestamp":"2024-07-08T17:37:49.363Z","caller":"opamp/server_client.go:216","msg":"failed to apply config","component":"opamp-server-client","error":"failed to reload config: /var/tmp/collector-config.yaml: collector failed to restart: failed to build pipelines: failed to create \"clickhousetraces\" exporter for data type \"traces\": error connecting to primary db: code: 81, message: Database signoz_traces does not exist","stacktrace":"<http://github.com/SigNoz/signoz-otel-collector/opamp.(*serverClient).onRemoteConfigHandler|github.com/SigNoz/signoz-otel-collector/opamp.(*serverClient).onRemoteConfigHandler>\n\t/home/runner/work/signoz-otel-collector/signoz-otel-collector/opamp/server_client.go:216\ngithub.com/SigNoz/signoz-otel-collector/opamp.(*serverClient).onMessageFuncHandler\n\t/home/runner/work/signoz-otel-collector/signoz-otel-collector/opamp/server_client.go:199\ngithub.com/open-telemetry/opamp-go/client/types.CallbacksStruct.OnMessage\n\t/home/runner/go/pkg/mod/github.com/open-telemetry/opamp-go@v0.5.0/client/types/callbacks.go:162\ngithub.com/open-telemetry/opamp-go/client/internal.(*receivedProcessor).ProcessReceivedMessage\n\t/home/runner/go/pkg/mod/github.com/open-telemetry/opamp-go@v0.5.0/client/internal/receivedprocessor.go:131\ngithub.com/open-telemetry/opamp-go/client/internal.(*wsReceiver).ReceiverLoop\n\t/home/runner/go/pkg/mod/github.com/open-telemetry/opamp-go@v0.5.0/client/internal/wsreceiver.go:57\ngithub.com/open-telemetry/opamp-go/client.(*wsClient).runOneCycle\n\t/home/runner/go/pkg/mod/github.com/open-telemetry/opamp-go@v0.5.0/client/wsclient.go:243\ngithub.com/open-telemetry/opamp-go/client.(*wsClient).runUntilStopped\n\t/home/runner/go/pkg/mod/github.com/open-telemetry/opamp-go@v0.5.0/client/wsclient.go:265\ngithub.com/open-telemetry/opamp-go/client/internal.(*ClientCommon).StartConnectAndRun.func1\n\t/home/runner/go/pkg/mod/github.com/open-telemetry/opamp-go@v0.5.0/client/internal/clientcommon.go:197"}
{"level":"info","timestamp":"2024-07-08T17:37:49.364Z","logger":"agent-config-manager","caller":"opamp/config_manager.go:172","msg":"Config has changed, reloading","path":"/var/tmp/collector-config.yaml"}
{"level":"info","timestamp":"2024-07-08T17:37:49.364Z","caller":"signozcol/collector.go:168","msg":"Restarting collector service"}
{"level":"info","timestamp":"2024-07-08T17:37:49.364Z","caller":"signozcol/collector.go:144","msg":"Shutting down collector service"}
{"level":"info","timestamp":"2024-07-08T17:37:49.364Z","caller":"signozcol/collector.go:152","msg":"Collector service is shut down"}
{"level":"info","timestamp":"2024-07-08T17:37:49.364Z","caller":"signozcol/collector.go:103","msg":"Starting collector service"}
2024-07-08T17:37:49.373Z info service@v0.88.0/telemetry.go:84 Setting up own telemetry...
2024-07-08T17:37:49.374Z info service@v0.88.0/telemetry.go:201 Serving Prometheus metrics {"address": "0.0.0.0:8888", "level": "Basic"}
2024-07-08T17:37:49.374Z info exporter@v0.88.0/exporter.go:275 Stability level of component is undefined {"kind": "exporter", "data_type": "metrics", "name": "clickhousemetricswrite"}
2024-07-08T17:37:49.374Z info kube/client.go:107 k8s filtering {"kind": "processor", "name": "k8sattributes", "pipeline": "metrics/internal", "labelSelector": "", "fieldSelector": "spec.nodeName=aks-ondemand-26236767-vmss00000h"}
2024-07-08T17:37:49.374Z info exporter@v0.88.0/exporter.go:275 Stability level of component is undefined {"kind": "exporter", "data_type": "traces", "name": "clickhousetraces"}
time="2024-07-08T17:37:49Z" level=error msg="code: 81, message: Database signoz_metrics does not exist" component=clickhouse
{"level":"info","timestamp":"2024-07-08T17:37:49.377Z","caller":"signozcol/collector.go:168","msg":"Restarting collector service"}
{"level":"info","timestamp":"2024-07-08T17:37:49.377Z","caller":"signozcol/collector.go:144","msg":"Shutting down collector service"}
pratik kumar
07/22/2024, 12:44 PMSanjeev Kumar
07/22/2024, 10:38 AMhamza
07/22/2024, 5:36 AMNagesh Rathod
07/17/2024, 4:35 PMNagesh Rathod
07/17/2024, 4:31 PMAnshuman Patel
07/17/2024, 4:19 AMNAME READY STATUS RESTARTS AGE
chi-my-release-clickhouse-cluster-0-0-0 0/1 Pending 0 3m49s
my-release-clickhouse-operator-f8f59fcf7-g2hgb 2/2 Running 2 (4m1s ago) 4m3s
my-release-k8s-infra-otel-agent-tc8zs 1/1 Running 0 4m3s
my-release-k8s-infra-otel-deployment-bc6b96d9b-b64pr 1/1 Running 0 4m3s
my-release-signoz-alertmanager-0 0/1 Pending 0 4m3s
my-release-signoz-frontend-77f96cd85b-9ll55 0/1 Init:0/1 0 4m3s
my-release-signoz-otel-collector-6d7d58fb79-xcvsp 0/1 Init:0/1 0 4m3s
my-release-signoz-otel-collector-metrics-5cc546d89c-jlkcm 0/1 Init:0/1 0 4m3s
my-release-signoz-query-service-0 0/1 Pending 0 4m3s
my-release-signoz-schema-migrator-init-n4jhn 0/1 Init:0/2 0 4m3s
my-release-zookeeper-0 0/1 Pending 0 4m3s
All services are not running, only a few. Could you please help me?
Any extra information about the deployment process you need?Darren Smith
07/16/2024, 4:59 PMDeepsikha kar
07/15/2024, 10:49 AMShuvam Manna
07/12/2024, 9:04 AMPruthvi Narapareddy
07/12/2024, 6:30 AMPruthvi Narapareddy
07/12/2024, 6:29 AMChristian Theilemann
07/10/2024, 11:16 AMGabriel Chaves Camboim
07/09/2024, 1:38 PMNoel McGrath
07/09/2024, 8:49 AMKeshavram Kuduwa
07/08/2024, 1:05 PMChung-Yuan Hung
07/08/2024, 8:22 AMlogExporter, err := otlploggrpc.New(context.Background(),
otlploggrpc.WithEndpoint(collectorURL),
)
if err != nil {
// handle error
}
processor := log.NewBatchProcessor(logExporter)
logProvider = log.NewLoggerProvider(
log.WithResource(resources),
log.WithProcessor(processor),
)
global.SetLoggerProvider(logProvider)
slog.SetDefault(otelslog.NewLogger("app_name", otelslog.WithLoggerProvider(logProvider)))
// somewhere in the code base
<http://slog.Info|slog.Info>("some logs")
I'm expecting to see the logs in SigNoz dashboard but didn't see them.
I saw there's official document suggesting exporting log using log file, is that the only way ?
thanks for the helpArunachalam k
07/08/2024, 5:46 AMAditya Tidke
07/07/2024, 11:27 AM