This message was deleted.
# supports
Slackbot
09/11/2022, 3:31 AMThis message was deleted.
a
Ankit Nayan
09/11/2022, 6:21 AM
I hope you are running signoz outside the resource limits of the application. Let's say, signoz in 1 cluster and your applications in another cluster so that signoz does not limit the resource needs of the application.
u
Upesh Jindal
09/11/2022, 6:28 AMSignoz is on a separate cluster, yes.
Upesh Jindal
09/11/2022, 6:29 AMI guess it's because of the open-telemetry exporter itself getting slow.
a
Ankit Nayan
09/11/2022, 6:48 AM
hmm..will have to drill deeper. Did you plot the memory usage of the application too? Whether it increased with signoz? IMO the default batch size should be good enough
Ankit Nayan
09/11/2022, 6:48 AM
Let us drill down deeper sometime coming week cc: @Srikanth Chekuri
u
Upesh Jindal
09/11/2022, 7:00 AMDid not plot the memory usage. Can do it though.
s
Srikanth Chekuri
09/11/2022, 12:06 PMAll SDK stuff happens in the background and shouldn’t affect the application. That’s strict requirement for all SDK. There must be something else. Can you run it with https://github.com/benfred/py-spy and see what’s happening
u
Upesh Jindal
09/11/2022, 12:06 PMWill do @Srikanth Chekuri
Upesh Jindal
09/12/2022, 7:00 AM@Srikanth Chekuri I think I need help. I'm not able to get this run with py-spy.
Upesh Jindal
09/12/2022, 7:00 AMKeep getting: Error: No python processes found in process 14881 or any of its subprocesses
s
Srikanth Chekuri
09/12/2022, 7:18 AMAre you sure you are passing the correct PID? Can you verify it by grepping or something similar in the process list?
u
Upesh Jindal
09/12/2022, 7:18 AMYep, verified
Upesh Jindal
09/12/2022, 7:19 AMIt's a gunicorn process
s
Srikanth Chekuri
09/12/2022, 7:19 AMWhat’s the worker class you are using?
u
Upesh Jindal
09/12/2022, 7:20 AMuvicorn.workers.UvicornWorker
s
Srikanth Chekuri
09/12/2022, 7:26 AMThat’s strange. Is it happening with your web service gunicorn process or everything? Can you share process list output for master and worker processes?
u
Upesh Jindal
09/12/2022, 7:26 AMI'm trying it without otel wrapper. Still the same. I think it's happening for Mac
Upesh Jindal
09/12/2022, 7:26 AMWill keep you posted
Upesh Jindal
09/13/2022, 3:39 AM@Srikanth Chekuri Ran the profiler with and without otel. Here is the svg with otel.
Upesh Jindal
09/13/2022, 4:46 AMI ran it for a very small time. Let me know please if anything else is needed
s
Srikanth Chekuri
09/13/2022, 5:22 AMThis is just bootstrap part of it. Please run it and collect info when you observe the issue.
u
Upesh Jindal
09/13/2022, 9:57 AMI'll run for a bit longer and will share
Upesh Jindal
09/13/2022, 9:58 AMThis particular run started giving the issue within first minute itself
12 Views