I have 5 services built with ExpressJS running out of Amazon ECS in a Fargate cluster
Is there anyway to export logs from those services directly to SigNoz, since it is fargate and we technically don’t have access to the “host” I figured there is no way for the same since log collectors generally scrape logs from the
of a container
Any ideas on how this could be done?
03/02/2023, 7:03 AM
We collected logs from fargate using aws firelens, where we used a custom fluent bit image to forward logs to signoz otel collector service which is also hosted on our fargate cluster....if you are using copilot to deploy you can just configure the image in the manifest file of the node.js service
Also you have to configure the otel metrics collector to accept logs from there
03/02/2023, 7:15 AM
That sounds like a doable approach, I’m gonna try that out
Thanks a ton!!
@Kshitij Gang what do you think about writing all express logs to a file, mounting that file as a volume and using a local otel-collector as a sidecar to send that file further to signoz
03/02/2023, 10:18 AM
I am using aws copilot cli to deploy a go application so adding a fluentbit log forwarder seemed much simpler..just had to add two lines to the config ....so I did not try the file mounting method