https://signoz.io logo
Join the conversationJoin Slack
Channels
contributing
contributing-frontend
general
github-activities
incidents
k8s_operator_helm
reactjs-config
signoz-alert-testing
support
testsupport
watercooler
webhook-dev
write-for-signoz
Powered by Linen
support
  • f

    Farisology

    03/23/2022, 7:15 AM
    I have created an instrument for my fastapi stagin app and I notice that if there are no requests signoz will not detect the application it will just disappear. is this normal?
    p
    • 2
    • 3
  • m

    MSP

    03/23/2022, 10:00 AM
    Hi <!here> i have installed signoz in my machine will click house DB query service and everything be auto installed
    a
    • 2
    • 9
  • i

    Ian Jeffries

    03/23/2022, 4:38 PM
    I could use advice on hosting SigNoz. We're using Heroku which doesn't support docker compose or VMs, so I was planning to host SigNoz elsewhere. However the lack of authentication support means that won't work. I see that authentication is underway in https://github.com/SigNoz/signoz/issues/625, should I wait until that lands?
    p
    • 2
    • 2
  • k

    Kumaran Ilangovan

    03/24/2022, 12:37 PM
    Hi @User - I very much eager to see alertmanager with custom webhook support, this week. Also, need few clarity on fields available in defining an alert. Do we have a documentation - to understand the available fields for defining an alert? Mainly I am looking for some fields like, • Traces time span is more than 20 sec • DB queries per min is more than 100 If there is a documentation for the available fields - it will be super awesome. Thanks!
    👍 1
    p
    a
    • 3
    • 6
  • k

    Kaushal Nagrecha

    03/25/2022, 7:46 AM
    Hey everyone, m new to promql…was looking for some help setting up alerting rules…specifically have different conditions for different apis based on request rates and outcomes…if anyone has any suggestions/links it'll be great..thanks in advance!
    p
    • 2
    • 3
  • k

    Kumaran Ilangovan

    03/25/2022, 3:54 PM
    hi #support - I am trying to add auth for my collector - and adding the credentials for my agent. This is a reference for agent config. https://gist.github.com/jpkrohling/9058110b7ca99f9658a123448084f608#file-agent-with-oauth2client-yaml-L5 In opentelemetry agents - can we provide all these extension fields as environment variables? Something like, For yaml, extensions: oauth2client: client_id: agent client_secret: Dl76n1p8P2SEdqhcyfcqtmNJi8Kf5LG3 token_url: http://localhost:8080/auth/realms/opentelemetry/protocol/openid-connect/token Can i add these in envi like, OTEL_EXTENSIONS_OAUTH2CLIENT_CLIENT_ID and so on?
    s
    • 2
    • 4
  • k

    Kaushal Nagrecha

    03/30/2022, 10:08 AM
    Hey…was kinda looking to setup alerts using the signoz metrics itself in promql - like the sample rps alert uses a signoz metric…any resources for that…?
    p
    • 2
    • 4
  • r

    rakesh shah

    03/31/2022, 6:02 AM
    Any one has written article for k8s deployment? -
    v
    • 2
    • 2
  • h

    Hima Vyas

    03/31/2022, 12:39 PM
    Hi team I have setup signoz on kubernates following this - https://signoz.io/docs/install/kubernetes/ I am able to instrument the sample application and see results. Now according to our use-case, we have a otel collector installed separately and we have to provide signoz backend end point to it. I am creating a kubernates service of type load balancer for the same. In which, I will have to provide labels and selectors. From kubernates, Would workload with name : my-release-signoz-query-service be the correct one for <backend of signoz>?
    p
    • 2
    • 5
  • n

    Naveen

    03/31/2022, 4:34 PM
    Hi team, how can we remove the p50 and p95 from signoz application metrics permanently?
    p
    v
    a
    • 4
    • 5
  • n

    Naveen

    03/31/2022, 4:42 PM
    In signoz, How can i get the cpu utilisation, memory utilisation etc for a server and for particular application?
    v
    p
    • 3
    • 8
  • u

    郑伟

    04/01/2022, 5:45 AM
    how can i monitor my prisma orm performance in signoz?
    s
    • 2
    • 1
  • z

    Zishan Shaikh

    04/01/2022, 7:54 AM
    Hi #support facing issue with capturing http request header in the traces tags search, i have set an environment variable to capture nonce but i cannot see nonce in the signoz trace tags OTEL_INSTRUMENTATION_HTTP_CAPTURE_HEADERS_SERVER_REQUEST=nonce OTEL_INSTRUMENTATION_HTTP_CAPTURE_HEADERS_CLIENT_REQUEST=nonce I am looking to filter the traces based on a specific header value i.e. nonce id second question is: is there a way to enable method level tracing using opentelemetry & signoz ? kindly help with this. #support please help out with this, appreciate any help with this
    a
    s
    • 3
    • 7
  • m

    Mayank Pathak

    04/01/2022, 8:51 AM
    Hello team, We are trying to setup our metrics collection and tracing through signoz. We have been following this blog for the setup https://signoz.io/blog/opentelemetry-django/ We are building the Dockerfile provided with the sample-django app using the following compose file.
    version: "3.8"
    
    services:
      django:
        command: "opentelemetry-instrument gunicorn mysite.wsgi -c gunicorn.config.py --workers 2 --threads 2 --reload --bind 0.0.0.0:8000"
        image: signoz-sample-django:latest
        build:
          context: .
        environment:
          - OTEL_METRICS_EXPORTER=none
          - OTEL_SERVICE_NAME=djangoApp
          - OTEL_EXPORTER_OTLP_ENDPOINT=host.docker.internal:4317
          - DJANGO_SETTINGS_MODULE=mysite.settings
        ports:
          - 8000:8000
    The issue that we are facing is that the django service is not recognized by the signoz setup and we are unavailable to get the service shown in our dashboard. Please help us in identifying any issues if any from our end. Also when we went through the source code for the sample django app we saw that you people are using a custom middleware polls.middleware.StatsdMetricsMiddleware upon checking the source code for that middleware we found out that you have instantiated a DogStatsd client (link). Can you also help us in telling what this client is used for as we do not have any service running on this port in our host? Is it a miss in the documentation, if yes please provide the correct way going forward with this.
    v
    s
    a
    • 4
    • 7
  • z

    Zishan Shaikh

    04/01/2022, 10:30 AM
    Hi #support facing this issue, we are evaluating signoz , running into this issue, this is a little urgent, requesting for help on this
    transport: Got too many pings from the client, closing the connection.
    s
    a
    • 3
    • 24
  • n

    Naveen

    04/01/2022, 10:34 AM
    Is it mandatory to install signoz in every server and map the required ip.. ? For ex: if I have server 1 with (Application1) and server2 with Application2. I installed signoz in server 1 .. And able to see the application 1 in the ui.. If I want to see application 2 in the same ui, do I need to install signoz in server 2 and configure the ip as server 1?
    s
    a
    • 3
    • 4
  • z

    Zishan Shaikh

    04/01/2022, 1:35 PM
    #support is there a way to export the data collected in signoz, like a report into excel sheet or any other format ?
    a
    • 2
    • 3
  • k

    Kumaran Ilangovan

    04/01/2022, 2:55 PM
    Hi @User - I installed latest version of Signoz 0.7.4. I used helm to update the tag - and currently running in 0.7.4. In UI - i still could see only slack as an channel - and not webhook. Please let me know, how to configure webhooks for my alert added in Signoz?
    • 1
    • 1
  • k

    Kumaran Ilangovan

    04/01/2022, 3:26 PM
    Hi @User - when trying to add a webhook channel - I am getting below error: 1. error: "Error in getting 2xx response in API call to alertmanager(POST http://signoz-alertmanager:9093/api/v1/routes)\n%!(EXTRA string=404 Not Found)" I installed Signoz thru Helm and my pod name for alertManager is "alertManager" and not "signoz-alertmanager". Note: In existing helm, values.yaml - I updated the versions alone to 0.7.4. Do we have latest helm - incase, I am missing. Thanks!
    a
    p
    • 3
    • 12
  • z

    Zishan Shaikh

    04/04/2022, 6:11 AM
    Hi #support, opening some of the traces in the browser is showing blank page, here is what is shown in the browser response tab "Failed to load response data: Request content was evicted from Inspector cache" Getting this error in the console: main.b071ad0f299f23e97d2f.js:2 TypeError: Cannot read properties of undefined (reading 'multiplier') at p (TraceDetail Page.596df714484c919d6220.js1️⃣42496) at d (TraceDetail Page.596df714484c919d6220.js1️⃣26738) at TraceDetail Page.596df714484c919d6220.js1️⃣24736 at Object.useMemo (main.b071ad0f299f23e97d2f.js2️⃣1205699) at t.useMemo (main.b071ad0f299f23e97d2f.js2️⃣1374281) at p (TraceDetail Page.596df714484c919d6220.js1️⃣24513) at ii (main.b071ad0f299f23e97d2f.js2️⃣1199776) at Ys (main.b071ad0f299f23e97d2f.js2️⃣1251893) at Oc (main.b071ad0f299f23e97d2f.js2️⃣1239130) at Sc (main.b071ad0f299f23e97d2f.js2️⃣1239058) ls @ main.b071ad0f299f23e97d2f.js:2 n.callback @ main.b071ad0f299f23e97d2f.js:2 ha @ main.b071ad0f299f23e97d2f.js:2 gs @ main.b071ad0f299f23e97d2f.js:2 Mc @ main.b071ad0f299f23e97d2f.js:2 t.unstable_runWithPriority @ main.b071ad0f299f23e97d2f.js:2 Bo @ main.b071ad0f299f23e97d2f.js:2 Tc @ main.b071ad0f299f23e97d2f.js:2 _c @ main.b071ad0f299f23e97d2f.js:2 (anonymous) @ main.b071ad0f299f23e97d2f.js:2 t.unstable_runWithPriority @ main.b071ad0f299f23e97d2f.js:2 Bo @ main.b071ad0f299f23e97d2f.js:2 $o @ main.b071ad0f299f23e97d2f.js:2 qo @ main.b071ad0f299f23e97d2f.js:2 pc @ main.b071ad0f299f23e97d2f.js:2 Pi @ main.b071ad0f299f23e97d2f.js:2 (anonymous) @ TraceDetail Page.596df714484c919d6220.js:1 u @ main.b071ad0f299f23e97d2f.js:2 (anonymous) @ main.b071ad0f299f23e97d2f.js:2 (anonymous) @ main.b071ad0f299f23e97d2f.js:2 i @ TraceDetail Page.596df714484c919d6220.js:1 l @ TraceDetail Page.596df714484c919d6220.js:1 Promise.then (async) i @ TraceDetail Page.596df714484c919d6220.js:1 l @ TraceDetail Page.596df714484c919d6220.js:1 (anonymous) @ TraceDetail Page.596df714484c919d6220.js:1 (anonymous) @ TraceDetail Page.596df714484c919d6220.js:1 (anonymous) @ TraceDetail Page.596df714484c919d6220.js:1 Hc @ main.b071ad0f299f23e97d2f.js:2 t.unstable_runWithPriority @ main.b071ad0f299f23e97d2f.js:2 Bo @ main.b071ad0f299f23e97d2f.js:2 Rc @ main.b071ad0f299f23e97d2f.js:2 (anonymous) @ main.b071ad0f299f23e97d2f.js:2 N @ main.b071ad0f299f23e97d2f.js:2 b.port1.onmessage @ main.b071ad0f299f23e97d2f.js:2 TraceDetail Page.596df714484c919d6220.js:1 Uncaught (in promise) TypeError: Cannot read properties of undefined (reading 'multiplier') at p (TraceDetail Page.596df714484c919d6220.js1️⃣42496) at d (TraceDetail Page.596df714484c919d6220.js1️⃣26738) at TraceDetail Page.596df714484c919d6220.js1️⃣24736 at Object.useMemo (main.b071ad0f299f23e97d2f.js2️⃣1205699) at t.useMemo (main.b071ad0f299f23e97d2f.js2️⃣1374281) at p (TraceDetail Page.596df714484c919d6220.js1️⃣24513) at ii (main.b071ad0f299f23e97d2f.js2️⃣1199776) at Ys (main.b071ad0f299f23e97d2f.js2️⃣1251893) at Oc (main.b071ad0f299f23e97d2f.js2️⃣1239130) at Sc (main.b071ad0f299f23e97d2f.js2️⃣1239058)
    a
    p
    • 3
    • 10
  • z

    Zaid Khan

    04/04/2022, 8:21 AM
    Hi Team, my server is down as most of the memory is used by Signoz. Attached is the picture:
    p
    a
    • 3
    • 8
  • m

    Moses Altruism

    04/04/2022, 9:59 AM
    Hi team. Can I run SigNoiz as a service in AWS? Do I use an EC2 instance or is there any other AWS service I can use or a sack of AWS service.
    p
    • 2
    • 3
  • n

    Naveen

    04/04/2022, 12:15 PM
    In signoz ui, under metrics tab, we could see some spikes in p99 latency does it indicates issue or requests are fine?
    a
    v
    • 3
    • 9
  • n

    Neethu Joy

    04/04/2022, 12:45 PM
    Hi, while using signoz ui traces submenu, I am getting blank page...error in console TypeError: Cannot read properties of undefined (reading 'multiplier') at p (TraceDetail Page.596df714484c919d6220.js1️⃣42496) at d (TraceDetail Page.596df714484c919d6220.js1️⃣26738) at TraceDetail Page.596df714484c919d6220.js1️⃣24736 at Object.useMemo (main.b071ad0f299f23e97d2f.js2️⃣1205699) at t.useMemo (main.b071ad0f299f23e97d2f.js2️⃣1374281) at p (TraceDetail Page.596df714484c919d6220.js1️⃣24513) at ii (main.b071ad0f299f23e97d2f.js2️⃣1199776) at Ys (main.b071ad0f299f23e97d2f.js2️⃣1251893) at Oc (main.b071ad0f299f23e97d2f.js2️⃣1239130) at Sc (main.b071ad0f299f23e97d2f.js2️⃣1239058)
    p
    • 2
    • 6
  • n

    Naveen

    04/05/2022, 2:53 PM
    What context we can use to access the signoz ui in bowser ( while enable the proxypass through apache2)
    p
    p
    • 3
    • 20
  • b

    Brian Bills

    04/05/2022, 6:45 PM
    Hey @User, We have adopted SigNoz as our preferred ADM here at DocMagic. I created a proof of concept server and two sample apps to demonstrate it's utility to my superiors and they liked it. I know this is outside the scope of your support, but I need to integrate it into our environment. Here's our docker file:
    # syntax=docker/dockerfile:experimental
    FROM <http://harbor.docmagic.com/library/dm-maven:3.6.3-openjdk-15-slim|harbor.docmagic.com/library/dm-maven:3.6.3-openjdk-15-slim> AS buildimage
    COPY source .
    RUN --mount=type=cache,id=maven-cache,target=/root/.m2/repository \
        mvn clean install -U spring-boot:repackage
    
    FROM <http://harbor.docmagic.com/library/dm-openjdk:15-jdk-buster-012122164131|harbor.docmagic.com/library/dm-openjdk:15-jdk-buster-012122164131> 
    COPY --from=buildimage /root/target/cascustomer-service.war /root/target/cascustomer-service-etc.zip /app/
    RUN unzip /app/cascustomer-service-etc.zip -d /
    ENTRYPOINT ["entrypoint.sh", "-j", "/app/cascustomer-service.war"]
    Is there a way to get the setenv.sh for open telemetry into /opt/tomcat/bin folder of the openjdk image by using the docker file, and also add the
    opentelemetry-javaagent.jar
    file to a path location that gets pointed to by the setenv.sh script inside the image? Thanks, Brian
    👍 1
    🔥 2
    a
    p
    • 3
    • 47
  • a

    Alfian Firmansyah

    04/06/2022, 5:12 AM
    #support [ask] Greetings everyone! Thanks for providing a great APM tool. I found a problem regarding the signoz's alerting. • I installed signoz by executing the signoz helm chart to GKE autopilot v1.21.9-gke.1002. (port-forwarding the 4317 port to my localhost) • Created the notification channel with slack webhook with our valid webhook URL. (image 1) • Created the alert rules (4 rps threshold) and emulated the traffic by executing a loop script (+- 4rps) to golang apps so that the status becomes
    firing
    (image 2) Even though the alert rules is firing, the
    triggered alert
    tab didn't show anything (image 3: no data), and no alert send to slack. Any suggestion regarding this problem?
    ✅ 1
    a
    p
    • 3
    • 18
  • s

    Slackbot

    04/06/2022, 11:10 AM
    This message was deleted.
    n
    p
    • 3
    • 3
  • h

    Hardik Agrawal

    04/07/2022, 4:05 AM
    QQ : 1. Service map does not load for us as smoothly as other pages in UI. The loader keeps on loading. 2. UI is breaking on clicking on trace randomly. 3. How are the tabs Database calls and External calls supposed to work? Do we need to send any attributes from backend so that signoz recognizes these? Right now everything is seen in Application metrics tabs
    v
    a
    p
    • 4
    • 15
  • m

    Monesh s

    04/07/2022, 9:35 AM
    configure opentelementry in my ruby application but its throws error, can u please help on this issue App 1175968 output: E, [2022-04-07T09:29:42.264464 #1175968] ERROR -- : OpenTelemetry error: Unable to export 59 spans App 1176031 output: E, [2022-04-07T09:29:43.588552 #1176031] ERROR -- : OpenTelemetry error: unexpected error in OTLP::Exporter#send_bytes - undefined method `include?' for nil:NilClass App 1176031 output: E, [2022-04-07T09:29:43.588731 #1176031] ERROR -- : OpenTelemetry error: Unable to export 5 spans App 1175968 output: E, [2022-04-07T09:29:57.274309 #1175968] ERROR -- : OpenTelemetry error: unexpected error in OTLP::Exporter#send_bytes - undefined method `include?' for nil:NilClass App 1175968 output: E, [2022-04-07T09:29:57.274468 #1175968] ERROR -- : OpenTelemetry error: Unable to export 71 spans App 1176031 output: E, [2022-04-07T09:29:58.597884 #1176031] ERROR -- : OpenTelemetry error: unexpected error in OTLP::Exporter#send_bytes - undefined method `include?' for nil:NilClass App 1176031 output: E, [2022-04-07T09:29:58.597981 #1176031] ERROR -- : OpenTelemetry error: Unable to export 3 spans App 1176073 output: E, [2022-04-07T09:30:00.816435 #1176073] ERROR -- : OpenTelemetry error: unexpected error in OTLP::Exporter#send_bytes - undefined method `include?' for nil:NilClass App 1176073 output: E, [2022-04-07T09:30:00.816531 #1176073] ERROR -- : OpenTelemetry error: Unable to export 3 spans
    s
    • 2
    • 10
Powered by Linen
Title
m

Monesh s

04/07/2022, 9:35 AM
configure opentelementry in my ruby application but its throws error, can u please help on this issue App 1175968 output: E, [2022-04-07T09:29:42.264464 #1175968] ERROR -- : OpenTelemetry error: Unable to export 59 spans App 1176031 output: E, [2022-04-07T09:29:43.588552 #1176031] ERROR -- : OpenTelemetry error: unexpected error in OTLP::Exporter#send_bytes - undefined method `include?' for nil:NilClass App 1176031 output: E, [2022-04-07T09:29:43.588731 #1176031] ERROR -- : OpenTelemetry error: Unable to export 5 spans App 1175968 output: E, [2022-04-07T09:29:57.274309 #1175968] ERROR -- : OpenTelemetry error: unexpected error in OTLP::Exporter#send_bytes - undefined method `include?' for nil:NilClass App 1175968 output: E, [2022-04-07T09:29:57.274468 #1175968] ERROR -- : OpenTelemetry error: Unable to export 71 spans App 1176031 output: E, [2022-04-07T09:29:58.597884 #1176031] ERROR -- : OpenTelemetry error: unexpected error in OTLP::Exporter#send_bytes - undefined method `include?' for nil:NilClass App 1176031 output: E, [2022-04-07T09:29:58.597981 #1176031] ERROR -- : OpenTelemetry error: Unable to export 3 spans App 1176073 output: E, [2022-04-07T09:30:00.816435 #1176073] ERROR -- : OpenTelemetry error: unexpected error in OTLP::Exporter#send_bytes - undefined method `include?' for nil:NilClass App 1176073 output: E, [2022-04-07T09:30:00.816531 #1176073] ERROR -- : OpenTelemetry error: Unable to export 3 spans
i have install required gems and configured config/initializers/opentelemetry.rb file
and added in .env
OTEL_TRACES_EXPORTER='otlp' OTEL_METRICS_EXPORTER='none' OTEL_EXPORTER_OTLP_ENDPOINT="my-release-signoz-otel-collector.platform.svc.cluster.local"
s

Srikanth Chekuri

04/07/2022, 9:39 AM
Collector runs on port 4317/grpc and 4318/http. Make that part of endpoint for based on which protocol you are using
m

Monesh s

04/07/2022, 9:42 AM
service/my-release-signoz-otel-collector ClusterIP 100.71.79.116 <none> 4317/TCP,4318/TCP,55680/TCP,55681/TCP,14250/TCP,14268/TCP,9411/TCP,8888/TCP,8889/TCP
collertor is running cluster ip
so i m using the dns of the service
everthing is inside the cluster so pod to pod communication should work with dns right?
s

Srikanth Chekuri

04/07/2022, 9:45 AM
You should also specify the port in the endpoint config
m

Monesh s

04/07/2022, 9:53 AM
its working now @User Thanks
View count: 2