```2022 10 24T09 49 29 995Z error helper transformer go 110

Question

```2022 10 24T09 49 29 995Z error helper transformer go 110 Failed to process entry kind receiver name filelog k8s pipeline logs operator id parser nucash regex operator type regex parser error regex pattern does not match action send entry observed timestamp 2022 10 24T09 49 29 995336396Z timestamp 2022 10 24T09 49 29 908076398Z body component aaa env dev file go src bitbucket org nucashin sample main go 73 func main main level info msg Something service aaa time 2022 10 24T09 49 29Z n attributes k8s container name sample k8s container restart count 0 k8s namespace name services k8s pod name sample 6c879cc484 6vmbr k8s pod uid 94b40e31 b854 4af4 9a83 f4daadadd951 log file path var log pods services sample 6c879cc484 6vmbr 94b40e31 b854 4af4 9a83 f4daadadd951 sample 0 log log iostream stderr time 2022 10 24T09 49 29 908076398Z severity 0 scope name ``` Getting this error in k8s agent below is the updated configmap for k8s agent any idea why ``` from attributes restart count to attributes k8s container restart count type move from attributes uid to attributes k8s pod uid type move from attributes log to body type move id parser nucash regex parse from body regex ^ P lt nucash json gt n type regex parser id parser nucash json parse from attributes nucash json type json parser```

Pranay · Answer

< nitya signoz> may have more insights on this

nitya-signoz · Answer

Hi < Apoorva> can you please explain what you are trying to achieve here I can see that you are trying to parse something out from the logs but some explanation will be great It will help us to suggest a proper configuration for parsing and help you debug the issue

Apoorva · Answer

``` body component aaa env dev file go src bitbucket org nucashin sample main go 73 func main main level info msg Something service aaa time 2022 10 24T09 49 29Z n ``` I am trying to get the fields of this json to be displayed and to be filtered in dasboard based on env service components log level etc < nitya signoz>

nitya-signoz · Answer

Got it can you please share the number of applications that emit the same kind of logs because this is a parsing usecase is specific to an application and it will require error handling or some kind of separation via routing

Apoorva · Answer

All the application in services namespace send me same kind of logs < nitya signoz>

Apoorva · Answer

With the below configmap I was trying to parse any json if present in the body it is giving me regex parsing error not sure why ``` id parser nucash regex parse from body regex ^ P lt nucash json gt n type regex parser id parser nucash json parse from attributes nucash json type json parser```

nitya-signoz · Answer

Sure getting back on this

nitya-signoz · Answer

< Apoorva> you don t need to use a regex parser This is what I understand Your applications emit logs in JSON format something like this ``` component aaa env dev file go src bitbucket org nucashin sample main go 73 func main main level info msg Something service aaa time 2022 10 24T09 49 29Z ``` Now you want these keys fields to be parsed so that you can filter them on the UI For this you can directly use the JSON parser and add the following operator towards the end of your config file ``` id parser nucash json parse from body type json parser``` This will convert all the keys to fields If you don t want some of these keys to be present as fields you can use the

nitya-signoz · Answer

I would also recommend you to setup a new receiver for this namespace as you are modifying the parsing rules for specifiec namespace for this you can create a new filelog receiver with and configure it only for that namespace where you can copy the config of normal k8s receiver and add your logic ``` filelog services include Include logs from all container in services namespace var log pods services log``` If you decide going with this approach do disable this namespace from the normal k8s log receiver ``` filelog k8s include Include logs from all container var log pods log exclude exclude services logs var log pods services log Exclude logs from all containers from kube system namespace var log pods kube system log Exclude logs from all hotrod containers var log pods hotrod log var log pods locust log```

Apoorva · Answer

< nitya signoz> Thanks a lot this works for me