Hey team I'm facing an issue to get logs into Sign...
# support
g
Hey team I'm facing an issue to get logs into Signoz. Here an exemple of the format of log I have
Copy code
10:13:43.225 [main] DEBUG org.jboss.logging -- Logging Provider: org.jboss.logging.Slf4jLoggerProvider
10:13:43.254 [main] DEBUG org.hibernate.jpa.internal.util.LogHelper -- PersistenceUnitInfo [
10:13:43.274 [main] DEBUG org.hibernate.integrator.internal.IntegratorServiceImpl -- Adding Integrator [org.hibernate.cfg.beanvalidation.BeanValidationIntegrator].
10:13:43.280 [main] DEBUG org.hibernate.integrator.internal.IntegratorServiceImpl -- Adding Integrator [org.hibernate.cache.internal.CollectionCacheInvalidator].
10:13:43.370 [main] INFO org.hibernate.Version -- HHH000412: Hibernate ORM core version 6.1.7.Final
10:13:43.372 [main] DEBUG org.hibernate.cfg.Environment -- HHH000206: hibernate.properties not found
10:13:43.672 [main] INFO org.hibernate.orm.beans -- HHH10005002: No explicit CDI BeanManager reference was passed to Hibernate, but CDI is available on the Hibernate ClassLoader.
10:13:43.673 [main] DEBUG org.hibernate.orm.idgen.factory -- Resolving IdentifierGenerator instances will not use CDI as it was not configured
10:13:43.680 [main] DEBUG org.hibernate.orm.idgen.factory -- Registering IdentifierGenerator strategy [uuid2] -> [org.hibernate.id.UUIDGenerator]
10:13:43.681 [main] DEBUG org.hibernate.orm.idgen.factory -- Registering IdentifierGenerator strategy [guid] -> [org.hibernate.id.GUIDGenerator]
If the receiver/filelog is simple, just the path of the file I got everything but I don't take advantage of the parsing and filter capabality like for the level of information i can filter (ERROR|WARN...) So I added and operator with regex like :
Copy code
filelog/passport:
    include: ["/voldisk2/3dx/logs/passport/tomee/catalina.out"]
    start_at: end
#    multiline:
#      line_start_pattern: '^\d{4}-\d{2}-\d{2} \d{2}:\d{2}:\d{2}\s+\['
    operators:
      - type: regex_parser
        regex: '^(?P<timestamp>\d{2}:\d{2}:\d{2}\.\d{3})\s+\[(?P<thread>[^\]]+)\]\s+(?P<severity>\w+)\s+(?P<logger>[^\s]+)\s+--\s+(?P<message>.*)$'
        timestamp:
          parse_from: attributes.timestamp
          layout: '%H:%M:%S.%L'
#        on_error: skip
      - type: severity_parser
        parse_from: attributes.severity
        severity:
          mapping:
            debug: DEBUG
            info: INFO
            warn: WARN
            warning: WARN
            error: ERROR
            critical: CRITICAL
And now it's only what is not matching this regex that come up to signoz (I have some multiline trace I will handle later). Yet if i try this regex directly on the file like
grep -P '^\d{2}:\d{2}:\d{2}\.\d{3} \[[^\]]+\] \w+ [^\s]+ -- .*' /voldisk2/3dx/logs/passport/tomee/catalina.out | head -10
I have my lines. What did I miss here ?