https://signoz.io logo
Join Slack
Powered by
Hi Everyone and <@U01HPVB0D2S> we've a big issue ...
# general
j
Hi Everyone and @Pranay we've a big issue with SigNoz v.0.22 Can you help us check. • our language: python
Copy code
[2023-10-17 16:54:42,270: INFO/ForkPoolWorker-17] Task ai_avatar.tasks.generate_answer[9c071a62-a330-43f0-8b1b-50556701061f] succeeded in 3.2202219385653734s: 10670
[2023-10-17 16:54:42,271: WARNING/ForkPoolWorker-17] Attribute 'celery.timelimit' mixes types str and int in attribute value sequence
[2023-10-17 16:54:42,271: INFO/ForkPoolWorker-4] Task ai_avatar.tasks.text_to_speech[c308199e-14a0-4005-b5d6-c23b15d7dab5] succeeded in 0.8612259635701776s: None
[2023-10-17 16:54:42,272: WARNING/ForkPoolWorker-4] Attribute 'celery.timelimit' mixes types str and int in attribute value sequence
{"time": "2023-10-17T16:54:42.3292", "message": "[tasks.send_success_message_to_channel] Sent message to channel with channel=653ec430-c689-4999-bea6-1fc938794693, data={'type': 'chat.message', 'code': 200, 'data': {'event': 'on_completed_chat_message', 'data': {'id': 10541, 'chat_group_id': 169, 'is_avatar': False, 'content': 'Can you hear me?', 'created_at': 1697458198182, 'updated_at': 1697529279002, 'is_read': True, 'type': ChatMessage.ChatMessageType.CHAT}}}", "service_name": "ai_avatar_backend_worker", "level": "INFO"}
{"time": "2023-10-17T16:54:42.3577", "message": "[tasks.send_success_message_to_channel] Sent message to channel with channel=653ec430-c689-4999-bea6-1fc938794693, data={'type': 'chat.message', 'code': 200, 'data': {'event': 'on_completed_chat_message', 'data': {'id': 10671, 'chat_group_id': 157, 'is_avatar': True, 'content': 'Indeed, I can. How may I assist you today?', 'created_at': 1697529282288, 'updated_at': 1697529282288, 'is_read': True, 'type': ChatMessage.ChatMessageType.CHAT}}}", "service_name": "ai_avatar_backend_worker", "level": "INFO"}
[2023-10-17 16:54:42,358: INFO/ForkPoolWorker-15] Task ai_avatar.tasks.generate_answer[0159a3fa-1777-401f-847a-51d895364aac] succeeded in 3.341069692745805s: 10671
[2023-10-17 16:54:42,358: WARNING/ForkPoolWorker-15] Attribute 'celery.timelimit' mixes types str and int in attribute value sequence
[2023-10-17 16:54:42,746: WARNING/Beat] Transient error StatusCode.UNAVAILABLE encountered while exporting traces to x.x.x.x:4317, retrying in 1s.
E1017 16:54:43.750113300     398 ev_epoll1_linux.cc:378]               epoll_ctl failed: Invalid argument
[2023-10-17 16:54:43,751: WARNING/Beat] Transient error StatusCode.UNAVAILABLE encountered while exporting traces to x.x.x.x:4317, retrying in 2s.
[2023-10-17 16:54:43,899: WARNING/ForkPoolWorker-2] Transient error StatusCode.UNAVAILABLE encountered while exporting traces to x.x.x.x:4317, retrying in 1s.
[2023-10-17 16:54:44,083: WARNING/ForkPoolWorker-3] Transient error StatusCode.UNAVAILABLE encountered while exporting traces to x.x.x.x:4317, retrying in 1s.
[2023-10-17 16:54:44,263: WARNING/ForkPoolWorker-4] Transient error StatusCode.UNAVAILABLE encountered while exporting traces to x.x.x.x:4317, retrying in 1s.
E1017 16:54:44.753760609     391 ev_epoll1_linux.cc:378]               epoll_ctl failed: Invalid argument
[2023-10-17 16:54:45,754: WARNING/Beat] Transient error StatusCode.UNAVAILABLE encountered while exporting traces to x.x.x.x:4317, retrying in 4s.
E1017 16:54:46.197197862     392 ev_epoll1_linux.cc:378]               epoll_ctl failed: Invalid argument
E1017 16:54:47.162997713     395 backup_poller.cc:127]                 Run client channel backup poller: UNKNOWN:pollset_work {created_time:"2023-10-17T16:54:47.162944278+09:00", children:[UNKNOWN:Bad file descriptor {created_time:"2023-10-17T16:54:47.162930517+09:00", errno:9, os_error:"Bad file descriptor", syscall:"epoll_wait"}]}
entrypoint_jobs_backend_worker.sh: line 33:     8 Segmentation fault      (core dumped) opentelemetry-instrument celery -A backend.celery worker -B --loglevel=INFO -c 20
s
What is the big issue?
j
my app was be crash, can't run when i run with command opentelemetry-instrument celery -A backend.celery worker -B --loglevel=INFO -c 20
I think Signoz don't stable with python.
s
Does it run fine without 
opentelemetry-instrument
j
no running well when it does not have opentelemetry-instrument
s
there is no punctuation, so it’s unclear what your statement means. did you mean to say it runs fine without 
opentelemetry-instrument
? What has changed since last time? Did you upgrade the 
opentelemetry-instrument
version?
j
current server we're using signoz 0.22
1.png
s
SigNoz version is not relevant here. Your instrumentation lib version is relevant.
j
Ok let me check
Copy code
opentelemetry-distro==0.41b0
opentelemetry-exporter-otlp==1.20.0
Please check.
and python OS docker image 3.11
s
Does your application run fine without 
opentelemetry-instrument
? Just answer Yes/No.
j
Yes.
s
Thanks, did you upgrade any Python version or 
opentelemetry-distro
/ 
opentelemetry-exporter-otlp
?
j
no current I still keep python 3.11
s
Are you instrumenting for the first time or did you have the instrumentation running already and now it’s not working?
j
yes.
actually 4 days ago, it's working well
but about 2 days ago it's not working even we don't change anything source code.
only build Dockerfile and then it' was be crash.
s
Did you change anything in Dockerfile?
j
No, don't changeg any thing.
I don't understand why it was be crash
Copy code
FROM python:3.11

EXPOSE 8000

WORKDIR /
RUN apt update \
    && apt install -y ffmpeg build-essential libssl-dev ca-certificates libasound2 wget \
    && wget -O - <https://www.openssl.org/source/openssl-1.1.1u.tar.gz> | tar zxf - \
    && cd openssl-1.1.1u \
    && ./config --prefix=/usr/local \
    && make -j $(nproc) \
    && make install_sw install_ssldirs \
    && ldconfig -v \
    && apt-get install netcat-traditional
# Set work directory
WORKDIR /usr/src/app

# Set environment variables
ENV PYTHONDONTWRITEBYTECODE 1
ENV PYTHONUNBUFFERED 1
ENV SSL_CERT_DIR /etc/ssl/certs
ENV LD_LIBRARY_PATH /usr/local/lib:$LD_LIBRARY_PATH


# Install dependencies
RUN pip install --upgrade pip
COPY ./requirements.txt .
RUN python -m pip install -r requirements.txt
RUN opentelemetry-bootstrap --action=install

# Copy project
COPY src .

# Create the log directory and set permissions
RUN mkdir -p /logs
RUN chmod 777 /logs
4 Views
Open in Slack
PreviousNext
Powered by