Hi all I am trying to test parsing a logfile with entries li

Question

Hi all I am trying to test parsing a logfile with entries like below but nothings comes up in the UI under logs or elsewhere any suggestions on where I might be going wrong ```2022 11 25 22 55 47 673 DEBUG ca770 output timestamp 1669377347 7902305 Type 2 event 7 2022 11 25 22 55 47 689 INFO Latency 0 101148 seconds``` otel collector config ```filelog cav include testlog log start at beginning include file path true include file name false operators type regex parser regex ^ P lt log timestamp gt d 4 d 2 d 2 s+ d 2 d 2 d 2 d 3 s+ s+ P lt log entry type gt w+ s+ s+ P lt log msg gt $ ```

Palash Gupta · Answer

< nitya signoz>

nitya-signoz · Answer

From the operators that you have used the timestamp is parsed by the regex but you will have to use to populate the value eg Right now your timestamp is getting set to epoch 0

Rahul v · Answer

Thanks for the quick response sure I will chain more operators to get the final output but from the first transformation shouldn t I see something in the UI I was expecting to see 3 attributes with string values named log timestamp log entry type log msg

nitya-signoz · Answer

Are you able to see the attributes on the left side in interesting fields

Rahul v · Answer

yes I do

nitya-signoz · Answer

If your log is ingested you will be able to see logs when you change the time range in top right to something like ~Dec 1969 to current~ As epoch 0 corresponds to 1 January 1970

Rahul v · Answer

ok I set the time frame to what you suggested but still no log entries what container logs should I look at to confirm log entries were consumed

Rahul v · Answer

do the otel collector logs show this info the last log entry says ```2022 11 28T09 03 39 192Z info fileconsumer file go 159 Started watching file kind receiver name filelog cav pipeline logs component fileconsumer path testlog interface mod log ```

nitya-signoz · Answer

You can exec into the clickhouse pod and check ```docker exec it clickhouse setup clickhouse 1 bin bash clickhouse client select from signoz logs logs limit 5 ```

nitya-signoz · Answer

You should see the logs would suggest you to use the time parser after that

Rahul v · Answer

ok let me try

Rahul v · Answer

Thanks < nitya signoz> parsing the timestamp made the logs show up they were ingested but not showing up in the UI This did the trick ``` type regex parser regex ^ P lt log timestamp gt d 4 d 2 d 2 s+ d 2 d 2 d 2 d 3 s+ s+ P lt log entry type gt w+ s+ s+ P lt log msg gt $ timestamp parse from attributes log timestamp layout type strptime layout Y m d H M S f ``` looks like the first operation requires the timestamp will remember that cheers