Hi Team I m having issue with sending logs from logstash to

Question

Hi Team I m having issue with sending logs from logstash to signoz I followed this guide <https signoz io docs userguide logstash to signoz > but in signoz dashboard there s still no logs at all

Chủ Huỳnh Minh · Answer

Here s all my configurations otel collector config yaml `receivers ` `tcplog logstash ` `max log size 1MiB` `listen address 0 0 0 0 2255 ` `attributes ` `resource ` `add attributes false` `operators ` `service ` ` ` `logs ` `receivers otlp filelog dockercontainers tcplog logstash ` `processors batch ` `exporters clickhouselogsexporter ` In logstash config `output ` `tcp ` `codec = gt json lines this is required otherwise it will send eveything in a single line` `host = gt my otelcollector host private IP ` `port = gt 2255` ` ` ` ` I also mapped port 2255 gt 2255 for otel collector in docker compose as well

Pranay · Answer

< nitya signoz> do you have insights on this

nitya-signoz · Answer

Hi < Chủ Huỳnh Minh> can you share if you are able to see any error logs in otel collector or logstash

Chủ Huỳnh Minh · Answer

Hi < nitya signoz> I only see error logs in logstash Its something like this `tcp output exception host= gt 10 100 6 91 port= gt 54525 exception= gt lt EOFError End of file reached gt backtrace= gt org jruby RubyIO java 3021 in `sysread usr share logstash vendor bundle jruby 2 5 0 gems logstash output tcp 6 0 2 lib logstash outputs tcp rb 161 in `block in register usr share logstash vendor bundle jruby 2 5 0 gems logstash codec json lines 3 1 0 lib logstash codecs json lines rb 67 in `encode usr share logstash logstash core lib logstash codecs delegator rb 48 in `block in encode org logstash instrument metrics AbstractSimpleMetricExt java 65 in `time org logstash instrument metrics AbstractNamespacedMetricExt java 64 in `time usr share logstash logstash core lib logstash codecs delegator rb 47 in `encode usr share logstash vendor bundle jruby 2 5 0 gems logstash output tcp 6 0 2 lib logstash outputs tcp rb 209 in `receive usr share logstash logstash core lib logstash outputs base rb 105 in `block in multi receive org jruby RubyArray java 1821 in `each usr share logstash logstash core lib logstash outputs base rb 105 in `multi receive org logstash config ir compiler OutputStrategyExt java 143 in `multi receive org logstash config ir compiler AbstractOutputDelegatorExt java 121 in `multi receive usr share logstash logstash core lib logstash java pipeline rb 300 in `block in start workers `

Chủ Huỳnh Minh · Answer

My input format in case you want to know ` ` ` timestamp $time iso8601 ` ` hostname $hostname ` ` source $server addr ` ` client $remote addr ` ` ` ` request length $request length ` ` protocol $server protocol ` ` upstreamhost $upstream addr ` ` `

Chủ Huỳnh Minh · Answer

I also used netstat and telnet to verify that the logstash receiver is listening on port 2255 as well so i don t think its firewall related

nitya-signoz · Answer

Can you share your logstash version so that I can try to replicate this issue once I get some bandwidth

Chủ Huỳnh Minh · Answer

i m using logstash 7 8 1 and newest signoz

Chủ Huỳnh Minh · Answer

Hi I ve just tested again and see this error in otel collector `2022 10 11T03 13 02 876Z error tcp tcp go 282 Scanner error kind receiver name tcplog logstash pipeline logs operator id tcp input operator type tcp input error bufio Scanner token too long `

Chủ Huỳnh Minh · Answer

I tried to increase max log size to 10MiB in otel collector config but it doesnt seem to fix it I dont see any error logs at all