Hi guys - I work for MSFT in Azure Kubernetes Team and I am working on a POC using Singnoz. I tested it yesterday and I love it but I am having issues getting logs from another log file, I changed the name, file type like .log json in my deployment but signoz is not refreshing the file.name or logs. It is still showing logs from old file somehow.

receivers:

filelog:

include: [ /var/log/audit/aks.log ]

start_at: end

operators:

- type: json_parser

service:

pipelines:

logs:

receivers: [otlp, filelog, httplogreceiver/heroku, httplogreceiver/json]

processors: [batch]

exporters: [clickhouselogsexporter]

extraVolumeMounts:

- mountPath: /var/log/audit/audit.log

name: audit-log

- mountPath: /var/log/audit/aks.log

name: aks-log

- mountPath: /mnt/blob

name: blob-log

extraVolumes:

- hostPath:

path: /var/log/audit/audit.log

type: FileOrCreate

name: audit-log

- hostPath:

path: /var/log/audit/aks.log

type: FileOrCreate

name: aks-log

- name: blob-log

persistentVolumeClaim:

claimName: pvc-blob-fuse

See I am trying to search for newlog file name but it's still shows old file name. No result on file aks.log which I have configured above. I can see the file in the pod

Pod: default/signoz-otel-collector-8cc98f667-b9grm | Container: signoz-otel-collector

~ $ ls /var/log/audit/

aks.log    audit.log

cat conf/otel-collector-config.yaml

receivers:
  filelog:
    include:
    - /var/log/audit/aks.log
    operators:
    - type: json_parser
    start_at: end

did you restart the collector ?

Yes, many times

can you check the collector logs, it will print the name of files which it has started to watch. also

start_at: end

will only read new log lines, are new logs continiously written to the file ? else you can try

start_at: beginning

No, it’s not continuously written

Also check the logs of the collector if you find anything interesting.

Yeah, I found multiple issues in the collector logs and I resolved all of them but I still can’t get a large 150mb json log file to show up in signoz

can you exec into the collector container and check if the

/var/log/audit/aks.log

file actually exists inside the container and is readable, sometimes there are permission issues.

Yes, I already checked it's there. What should be the permission?

can you check the collector logs, it will print the name of files which it has started to watch.

can you check this ? try restarting before checking, it prints in during the start

It's reading only one file not the other one?

"logs", "component": "fileconsumer", "path": "/var/log/audit/audit.log"}
{"level":"info","timestamp":"2024-03-11T03:48:08.778Z","caller":"service/service.go:73","msg":"Client started successfully"}
{"level":"info","timestamp":"2024-03-11T03:48:08.778Z","caller":"opamp/client.go:49","msg":"Ensuring collector is running","component":"opamp-server-client"}

can you remove the

- /var/log/audit/audit.log

and try ?

I need

start_at: end

for the other file which is continuously writing.

I am in a low network area, call will be difficult. also does it add this log line with just the json file https://signoz-community.slack.com/archives/C01HWUTP4HH/p1710129092867489?thread_ts=1710011370.078749&cid=C01HWUTP4HH

Let me check

I will have to check the permission things, I don’t remember exactly. But you can try a dummy json file with all permissions and then try.

Let me check the permission on working file

root vs nobody , user

Good catch

it’s a good direction to look into, should be the issue

I am deploying with this config now

config:

receivers:

filelog:

include: [ /mnt/PT1H.json ]

start_at: end

yeah, this is mostly pointing to the permission issue due to different user.

Okay, I am trying to fix the permission and will try again.

if the pvc is mounted and you can view it by doing exec into the container then it’s alright. were you able to make progress here ? @Prashant Shahi might have some idea as well.

No, it never worked. I eventually used azure monitor collector but the log formatting is really messed up.

Hey can you help me ? I'm trying to set Path based logs and i followed the same as tutorial but it's not working Here is my config details

filelog/app:
    include: [ /home/anuragvishwakarma/signoz/docker-container-logs/animals.log ]
    start_at: beginning

---

  pipelines:
    logs:
      receivers: [tcplog/docker, otlp, filelog/app, syslog]
      processors: [batch]
      exporters: [otlp, otlp/log]

please check the otel collector logs, it will emit logs if it is able to read the

/home/anuragvishwakarma/signoz/docker-container-logs/animals.log

file.

No I can't find any logs. You can check here

I don’t see anything in the above file

signoz-otel-logs.txt

please restart your collector and share the inital logs