https://signoz.io logo
Join Slack
Powered by
This message was deleted.
# general
s
This message was deleted.
p
can you share screenshot of the empty dashboard? Can you open a widget and try plotting any of the metrics below? https://signoz.io/docs/tutorial/opentelemetry-binary-usage-in-virtual-machine/#list-of-metrics
Also, do check logs of otel-collectors if there were any errors.
r
Hi Prashant, thank you for your help. Here is the screenshot of empty dashboard: And the screenshot of Traces section. I also attached the log of otel-collector on source VM; it show a "connection refused" that seems replied by application, because there is no firewall between VMs and if from source I try to telnet the destination I obtain the following:
Copy code
Trying 213.152.204.19...
Connected to <http://signoz.xtserver.it|signoz.xtserver.it>.
Escape character is '^]'.
@PuTTY^]
telnet>
Thanks again for your support. Riccardo
p
@Riccardo Leonardi which version of signoz are you using? also, did you select hostname from top selection bar?
r
Signoz v0.19.0
I can't see top selection bar
p
From logs, it seems like SigNoz-Otel-Collector is either not accessible or not healthy.
logs of signoz-otel-collector would be helpful.
also, look for errors in clickhouse container.
r
I already have attached the log from otel collector on source VM
do you need some other log?
p
The one you shared would be logs from otel-collector binary.
r
yes
p
But the signoz cluster contains of two collector components: signoz-otel-collector and signoz-otel-collector-metrics.
which has the OTLP receiver and responsible for writing data to clickhouse db.
logs of signoz-otel-collector container would be helpful
r
could you please tell me where to find those logs?
p
how did you install signoz? where is it deployed?
r
I've installed it as docker standalone, following tutorial on signoz.io
with
Copy code
docker ps
all containers seem to be working:
Copy code
CONTAINER ID   IMAGE                                          COMMAND                  CREATED        STATUS                  PORTS                                                                                                                                       NAMES
095aa079cd0c   signoz/frontend:0.19.0                         "nginx -g 'daemon of…"   23 hours ago   Up 21 hours             80/tcp, 0.0.0.0:3301->3301/tcp, :::3301->3301/tcp                                                                                           frontend
e0d39167b1b5   signoz/alertmanager:0.23.1                     "/bin/alertmanager -…"   23 hours ago   Up 21 hours             9093/tcp                                                                                                                                    clickhouse-setup_alertmanager_1
f07b23de2200   signoz/signoz-otel-collector:0.76.1            "/signoz-collector -…"   23 hours ago   Up 21 hours             0.0.0.0:4317-4318->4317-4318/tcp, :::4317-4318->4317-4318/tcp                                                                               clickhouse-setup_otel-collector_1
e254a8502327   signoz/signoz-otel-collector:0.76.1            "/signoz-collector -…"   23 hours ago   Up 21 hours             4317-4318/tcp                                                                                                                               clickhouse-setup_otel-collector-metrics_1
80ed2daaa665   signoz/query-service:0.19.0                    "./query-service -co…"   23 hours ago   Up 21 hours (healthy)   8080/tcp                                                                                                                                    query-service
9ac491ef7bee   clickhouse/clickhouse-server:22.8.8-alpine     "/entrypoint.sh"         23 hours ago   Up 21 hours (healthy)   0.0.0.0:8123->8123/tcp, :::8123->8123/tcp, 0.0.0.0:9000->9000/tcp, :::9000->9000/tcp, 0.0.0.0:9181->9181/tcp, :::9181->9181/tcp, 9009/tcp   clickhouse
ac8aed417d9f   bitnami/zookeeper:3.7.1                        "/opt/bitnami/script…"   23 hours ago   Up 21 hours             0.0.0.0:2181->2181/tcp, :::2181->2181/tcp, 0.0.0.0:2888->2888/tcp, :::2888->2888/tcp, 0.0.0.0:3888->3888/tcp, :::3888->3888/tcp, 8080/tcp   zookeeper-1
79a1737c0e82   jaegertracing/example-hotrod:1.30              "/go/bin/hotrod-linu…"   23 hours ago   Up 21 hours             8080-8083/tcp                                                                                                                               hotrod
07ab59b1e368   grubykarol/locust:1.2.3-python3.9-alpine3.12   "/docker-entrypoint.…"   23 hours ago   Up 21 hours             5557-5558/tcp, 8089/tcp
p
Logs of signoz otel-collector:
Copy code
docker logs clickhouse-setup_otel-collector_1
Logs of `clickhouse`:
Copy code
docker logs --tail 200 clickhouse
2023-06-06T125226.041Z error clickhousetracesexporter/writer.go:416 Could not append span to batch:
"name": "TestingSpan", "startTimeUnixNano": 11651379494838206464, "serviceName": "<nil-service-name>",
...
error": "clickhouse: dateTime overflow. timestamp must be between 1925-01-01 000000 and 2283-11-11 000000"}
I see dummy trace data with 
2339
year as start time. Can you make sure you have correct time set on the instance or the environment? cc @Ankit Nayan @Srikanth Chekuri
r
the date should be correct:
Copy code
root@signoz:~# date
Wed 07 Jun 2023 10:35:53 AM CEST
p
@Srikanth Chekuri could you please look into this?
on side note, can you upgrade the binary from 
0.66.0
to 
0.76.x
?
0.76.1
to be exact
r
yes, I could, but I have to tell you that I tried with 0.78.0 binary and it was not working (a lot of errors on startup) So I had to fall back to the version named in the tutorial, because I'm not expert in signoz
could you please paste the exact link to download the right binary version?
The source VM is a Debian 10 x64
p
r
I have installed 0.76.1 binary, but now the binary log show the following:
Copy code
Jun 07 12:12:00 <http://isp1.yndetech.com|isp1.yndetech.com> otelcol-contrib[17452]: 2023-06-07T12:12:00.553+0200        info        prometheusreceiver@v0.76.3/metrics_receiver.go:289        Starting scrape manager        {"kind"
Jun 07 12:12:31 <http://isp1.yndetech.com|isp1.yndetech.com> otelcol-contrib[17452]: 2023-06-07T12:12:31.080+0200        error        scraperhelper/scrapercontroller.go:212        Error scraping metrics        {"kind": "receiver"
Jun 07 12:12:31 <http://isp1.yndetech.com|isp1.yndetech.com> otelcol-contrib[17452]: <http://go.opentelemetry.io/collector/receiver/scraperhelper.(*controller).scrapeMetricsAndReport|go.opentelemetry.io/collector/receiver/scraperhelper.(*controller).scrapeMetricsAndReport>
Jun 07 12:12:31 <http://isp1.yndetech.com|isp1.yndetech.com> otelcol-contrib[17452]:         <http://go.opentelemetry.io/collector/receiver@v0.76.1/scraperhelper/scrapercontroller.go:212|go.opentelemetry.io/collector/receiver@v0.76.1/scraperhelper/scrapercontroller.go:212>
Jun 07 12:12:31 <http://isp1.yndetech.com|isp1.yndetech.com> otelcol-contrib[17452]: <http://go.opentelemetry.io/collector/receiver/scraperhelper.(*controller).startScraping.func1|go.opentelemetry.io/collector/receiver/scraperhelper.(*controller).startScraping.func1>
Jun 07 12:12:31 <http://isp1.yndetech.com|isp1.yndetech.com> otelcol-contrib[17452]:         <http://go.opentelemetry.io/collector/receiver@v0.76.1/scraperhelper/scrapercontroller.go:191|go.opentelemetry.io/collector/receiver@v0.76.1/scraperhelper/scrapercontroller.go:191>
Jun 07 12:13:00 <http://isp1.yndetech.com|isp1.yndetech.com> otelcol-contrib[17452]: 2023-06-07T12:13:00.863+0200        error        scraperhelper/scrapercontroller.go:212        Error scraping metrics        {"kind": "receiver"
Jun 07 12:13:00 <http://isp1.yndetech.com|isp1.yndetech.com> otelcol-contrib[17452]: <http://go.opentelemetry.io/collector/receiver/scraperhelper.(*controller).scrapeMetricsAndReport|go.opentelemetry.io/collector/receiver/scraperhelper.(*controller).scrapeMetricsAndReport>
Jun 07 12:13:00 <http://isp1.yndetech.com|isp1.yndetech.com> otelcol-contrib[17452]:         <http://go.opentelemetry.io/collector/receiver@v0.76.1/scraperhelper/scrapercontroller.go:212|go.opentelemetry.io/collector/receiver@v0.76.1/scraperhelper/scrapercontroller.go:212>
Jun 07 12:13:00 <http://isp1.yndetech.com|isp1.yndetech.com> otelcol-contrib[17452]: <http://go.opentelemetry.io/collector/receiver/scraperhelper.(*controller).startScraping.func1|go.opentelemetry.io/collector/receiver/scraperhelper.(*controller).startScraping.func1>
Jun 07 12:13:00 <http://isp1.yndetech.com|isp1.yndetech.com> otelcol-contrib[17452]:         <http://go.opentelemetry.io/collector/receiver@v0.76.1/scraperhelper/scrapercontroller.go:191|go.opentelemetry.io/collector/receiver@v0.76.1/scraperhelper/scrapercontroller.go:191>
Jun 07 12:13:31 <http://isp1.yndetech.com|isp1.yndetech.com> otelcol-contrib[17452]: 2023-06-07T12:13:31.035+0200        error        scraperhelper/scrapercontroller.go:212        Error scraping metrics        {"kind": "receiver"
Jun 07 12:13:31 <http://isp1.yndetech.com|isp1.yndetech.com> otelcol-contrib[17452]: <http://go.opentelemetry.io/collector/receiver/scraperhelper.(*controller).scrapeMetricsAndReport|go.opentelemetry.io/collector/receiver/scraperhelper.(*controller).scrapeMetricsAndReport>
Jun 07 12:13:31 <http://isp1.yndetech.com|isp1.yndetech.com> otelcol-contrib[17452]:         <http://go.opentelemetry.io/collector/receiver@v0.76.1/scraperhelper/scrapercontroller.go:212|go.opentelemetry.io/collector/receiver@v0.76.1/scraperhelper/scrapercontroller.go:212>
Jun 07 12:13:31 <http://isp1.yndetech.com|isp1.yndetech.com> otelcol-contrib[17452]: <http://go.opentelemetry.io/collector/receiver/scraperhelper.(*controller).startScraping.func1|go.opentelemetry.io/collector/receiver/scraperhelper.(*controller).startScraping.func1>
Jun 07 12:13:31 <http://isp1.yndetech.com|isp1.yndetech.com> otelcol-contrib[17452]:         <http://go.opentelemetry.io/collector/receiver@v0.76.1/scraperhelper/scrapercontroller.go:191|go.opentelemetry.io/collector/receiver@v0.76.1/scraperhelper/scrapercontroller.go:191>
Jun 07 12:14:01 <http://isp1.yndetech.com|isp1.yndetech.com> otelcol-contrib[17452]: 2023-06-07T12:14:01.048+0200        error        scraperhelper/scrapercontroller.go:212        Error scraping metrics        {"kind": "receiver"
Jun 07 12:14:01 <http://isp1.yndetech.com|isp1.yndetech.com> otelcol-contrib[17452]: <http://go.opentelemetry.io/collector/receiver/scraperhelper.(*controller).scrapeMetricsAndReport|go.opentelemetry.io/collector/receiver/scraperhelper.(*controller).scrapeMetricsAndReport>
Jun 07 12:14:01 <http://isp1.yndetech.com|isp1.yndetech.com> otelcol-contrib[17452]:         <http://go.opentelemetry.io/collector/receiver@v0.76.1/scraperhelper/scrapercontroller.go:212|go.opentelemetry.io/collector/receiver@v0.76.1/scraperhelper/scrapercontroller.go:212>
Jun 07 12:14:01 <http://isp1.yndetech.com|isp1.yndetech.com> otelcol-contrib[17452]: <http://go.opentelemetry.io/collector/receiver/scraperhelper.(*controller).startScraping.func1|go.opentelemetry.io/collector/receiver/scraperhelper.(*controller).startScraping.func1>
Jun 07 12:14:01 <http://isp1.yndetech.com|isp1.yndetech.com> otelcol-contrib[17452]:         <http://go.opentelemetry.io/collector/receiver@v0.76.1/scraperhelper/scrapercontroller.go:191|go.opentelemetry.io/collector/receiver@v0.76.1/scraperhelper/scrapercontroller.go:191>
s
What’s the SDK you are using?
r
Currently no SDK, just otel-collector binary installed on a Debian 10 Next step will be to evaluate wordpress (php) instrumenting
s
Can you share what is the main problem here?
r
The main problem: the dashboard is empty:

https://files.slack.com/files-pri/T01HWUTP0LT-F05B56Z1Y22/image.png▾

s
Share the signoz version and dashboard json you are using.
r
signoz v0.19.0
52 Views
Open in Slack
PreviousNext
Powered by