Hi Signoz team, We are looking to add log monitor...
# support
u
Hi Signoz team, We are looking to add log monitoring to our product and following this doc----->https://signoz.io/docs/userguide/collect_logs_from_file/ In our case signoz is running on a different host. But after mounting our logs file, we are getting this error in out docker logs---->
Copy code
Err: connection error: desc = "transport: Error while dialing dial tcp: address tcp/8080/: unknown port"     {"grpc_log": true}
2023-03-16T08:48:25.681Z        info    fileconsumer/file.go:178        Started watching file   {"kind": "receiver", "name": "filelog", "pipeline": "logs", "component": "fileconsumer", "path": "/home/ubuntu/.pm2/logs/DISHA-PROD-out.log"}
2023-03-16T08:48:25.682Z        error   helper/transformer.go:110       Failed to process entry {"kind": "receiver", "name": "filelog", "pipeline": "logs", "operator_id": "json_parser", "operator_type": "json_parser", "error": "ReadMapCB: expect { or n, but found 2, error found in #1 byte of ...|2023-03-15 |..., bigger context ...|2023-03-15 12:37:31.260 +00:00: socket sever starte|...", "action": "send", "entry": {"observed_timestamp":"2023-03-16T08:48:25.682141943Z","timestamp":"0001-01-01T00:00:00Z","body":"2023-03-15 12:37:31.260 +00:00: socket sever started on PORT 4000","attributes":{"log.file.name":"DISHA-PROD-out.log"},"severity":0,"scope_name":""}}
Would really appreciate some help with this.
v
@nitya-signoz
n
I can see there are two errors 1. There is some connection error. 2. There is a parsing error in
json_parser
can you share your config file and some sample logs which you are parsing using that config file.
p
@Utkarsh Shendge 👆
u
@nitya-signoz God rid of the parsing error but still facing connection error.
Copy code
led to connect to {
  "Addr": "localhost:8080/",
  "ServerName": "localhost:8080/",
  "Attributes": null,
  "BalancerAttributes": null,
  "Type": 0,
  "Metadata": null
}. Err: connection error: desc = "transport: Error while dialing dial tcp: address tcp/8080/: unknown port"     {"grpc_log": true}
2023-03-16T12:07:39.656Z        info    fileconsumer/file.go:178        Started watching file   {"kind": "receiver", "name": "filelog", "pipeline": "logs", "component": "fileconsumer", "path": "/home/ubuntu/.pm2/logs/DISHA-PROD-out.log"}
Did anyone come across this before?
n
please share your config it will help me understand what you are trying to do.
u
@nitya-signoz Sure.
Copy code
receivers:
  filelog:
    include: [ /home/ubuntu/.pm2/logs/DISHA-PROD-out.log ]
    start_at: beginning
processors:
  batch:
    send_batch_size: 10000
    send_batch_max_size: 11000
    timeout: 10s
exporters:
  otlp/log:
    endpoint: <http://localhost:8080/>
    tls:
      insecure: true
service:
  pipelines:
    logs:
      receivers: [filelog]
      processors: [batch]
      exporters: [ otlp/log ]
Path----->/signoz/deploy/docker/clickhouse-setup. Our log file is at this path----->/home/ubuntu/.pm2/logs/DISHA-PROD-out.log We are using this command to mount it ----->
Copy code
docker run -d --name signoz-host-otel-collector --user root -v /home/ubuntu/.pm2/logs/DISHA-PROD-out.log:/home/ubuntu/.pm2/logs/DISHA-PROD-out.log:ro -v $(pwd)/otel-collector-config.yaml:/etc/otel/config.yaml signoz/signoz-otel-collector:0.55.0-rc.3
n
the otlp exporter port is not correct, it should be 4317