https://signoz.io logo
a

Ankit Nayan

09/11/2022, 6:21 AM
I hope you are running signoz outside the resource limits of the application. Let's say, signoz in 1 cluster and your applications in another cluster so that signoz does not limit the resource needs of the application.
u

Upesh Jindal

09/11/2022, 6:28 AM
Signoz is on a separate cluster, yes.
I guess it's because of the open-telemetry exporter itself getting slow.
a

Ankit Nayan

09/11/2022, 6:48 AM
hmm..will have to drill deeper. Did you plot the memory usage of the application too? Whether it increased with signoz? IMO the default batch size should be good enough
Let us drill down deeper sometime coming week cc: @Srikanth Chekuri
u

Upesh Jindal

09/11/2022, 7:00 AM
Did not plot the memory usage. Can do it though.
s

Srikanth Chekuri

09/11/2022, 12:06 PM
All SDK stuff happens in the background and shouldn’t affect the application. That’s strict requirement for all SDK. There must be something else. Can you run it with https://github.com/benfred/py-spy and see what’s happening
u

Upesh Jindal

09/11/2022, 12:06 PM
Will do @Srikanth Chekuri
@Srikanth Chekuri I think I need help. I'm not able to get this run with py-spy.
Keep getting: Error: No python processes found in process 14881 or any of its subprocesses
s

Srikanth Chekuri

09/12/2022, 7:18 AM
Are you sure you are passing the correct PID? Can you verify it by grepping or something similar in the process list?
u

Upesh Jindal

09/12/2022, 7:18 AM
Yep, verified
It's a gunicorn process
s

Srikanth Chekuri

09/12/2022, 7:19 AM
What’s the worker class you are using?
u

Upesh Jindal

09/12/2022, 7:20 AM
uvicorn.workers.UvicornWorker
s

Srikanth Chekuri

09/12/2022, 7:26 AM
That’s strange. Is it happening with your web service gunicorn process or everything? Can you share process list output for master and worker processes?
u

Upesh Jindal

09/12/2022, 7:26 AM
I'm trying it without otel wrapper. Still the same. I think it's happening for Mac
Will keep you posted
I ran it for a very small time. Let me know please if anything else is needed
s

Srikanth Chekuri

09/13/2022, 5:22 AM
This is just bootstrap part of it. Please run it and collect info when you observe the issue.
u

Upesh Jindal

09/13/2022, 9:57 AM
I'll run for a bit longer and will share
This particular run started giving the issue within first minute itself