using docker-compose

image.png

Hello all, I have installed the signoz on EKS successfully and it is working fine and able to upload the traces and logs to S3 also. But the doubt I have is, how to restore the logs/traces from the S3? after the retention period

Hi Team, @Ankit Nayan @nitya-signoz What is the operator in signoz to get country information from IP? like we are doing in fluentd

<filter nginxweblogs>
    @type    geoip
    geoip_lookup_keys  host
    <record>
    city  ${city.names.en["host"]}
        lat   ${location.latitude["host"]}
        lon   ${location.longitude["host"]}
        country ${country.iso_code["host"]}
        country_name    ${country.names.en["host"]}
      </record>
    </filter>

How can I achieve this in signoz?

I want to send metrics of a kafka app to signoz otel collector in a different eks cluster, I have made the otel collector publically available using virtual-service & pvt-gateway ,but the otelagent jar throws error

OTLP endpoint must be a valid URL

How to implement this??

Hello all, i have installed signoz v0.18 on an on-prem server; but i try to create an alert on an http query for a specifc URL: https://browser.s3.prodinfo.gca; how can i make it:

Hi Team! Our K8S runs on a private cluster on AWS - no access to any public services/addresses, only AWS services are available. We installed the SigNoz on the cluster based on your helm charts. But we had at least two issues: • The location of the DB installation scripts can't be configured thru helm charts. It was hardcoded somewhere to http://github.com, which is not accessible from our cluster. We copied the scrips to our S3 bucker and changed the location in the service K8S service. • The second issue is that on the first login the Admin user should be created. But the "invite URL" should be sent (I see errors in the service log

ERROR: sending request - Post "<https://api.segment.io/v1/batch>": context deadline exceeded

) via an external email service. As you can guess - the service also is not accessible. Finally, after some timeout we were able to login into the UI but the system does not feel well - sometimes we can't login, the "Settings" screen can't be opened, and some Admin functionality are not available. • Maybe there are additional cases when installation or SigNoz's services are trying to access public services? Can SygNoz be installed on the private cluster? Is there any fixes/patches to resolve the above problems?

hi all, I need for support… We install SigNoz on GCP/GKE via helm, with the following values:

global:
  storageClass: gce-resizable
  cloud: gcp

clickhouse:
  installCustomStorageClass: true

The instrumented pyhon application we are calling this way:

WORKDIR / app
CMD ["bash", "-c", "OTEL_RESOURCE_ATTRIBUTES=service.name=zagpt-python OTEL_EXPORTER_OTLP_ENDPOINT='<http://signoz-otel-collector.platform.svc.cluster.local:4317>' opentelemetry-instrument --traces_exporter otlp_proto_http --metrics_exporter otlp_proto_http python webhook.py"]

In the log of the signoz-otel-collector pod, it gives me the error:

api-stg-00042-deployment-65f9c6d996-48wtk app Transient error Bad Gateway encountered while exporting span batch, retrying in 32s.

Does anyone have any idea where the error is for not letting me instrument my app service with python and FastAPI?

Hello all , as i installed signoz on aws t3.medium 12 gb ssd, 4gb ram instance and integrated one of running java based microservice , as ram usage is around 1 to 1.25 gb , but after one day of analysis i saw that cpu utilization is crossing 50 % sometimes and signoz-collector is consuming , can anyone tell me the reason of this much high cpu utilization and how much ssd space should i attach ideally as for initial capacity planning as currently 12 gb space is also almost full ..

hello, Has anyone come across this error when upgrading to a different chart? Could not write a batch of spans {"kind": "exporter", "data_type": "traces", "name": "clickhousetraces", "error": "clickhouse [Append]: clickhouse: expected 36 arguments, got 35"}

There seems to be an extra column in clickhouse, otel collector sends 1 argument less

I am trying to nail down which column is that and delete it to make the export reconcile with clickhouse but I just can't seem to throw a dart on which one it is, do you recommend a way to debug this?

or which version I should downgrade to so the traces sent are exactly what clickhouse expects

@Pranay could you help us with this

Hi! I tried to install Signoz on EKS using Helm and

otelcollector

,

otelcollectormetric

, and

query-service

all encountered the same error:

Error creating clickhouse client: code: 516, message: admin: Authentication failed: password is incorrect or there is no user with such name

I have checked the credentials in the pod env for all pods and they are correct Environment: • EKS Cluster:

v1.26

• Chart Version:

signoz-0.14.2

I tried setting up the same Helm chart on Docker Desktop cluster, everything works fine. Anyone knows how to solve the issue?

Guys, I use some google libs, such as Pub/Sub, when I start this way:

opentelemetry-instrument --traces_exporter otlp_proto_grpc --metrics_exporter otlp_proto_grpc python consumer.py

Gives this error:

Thread-ConsumeBidirectionalStream caught unexpected exception 'generator' object has no attribute 'add_done_callback' and will exit.
Traceback (most recent call last):

And with that my python instructions don’t work, has anyone faced this error?

i was setting up metric based alerts in signoz to track my disk usage and other things , can anyone let me know what is this units on y-axis over graph as : bil/mil ??

i was using query builder with system_filesystem_usage metric with MAX aggregation

and also tell me how can i know exact data ingested size , like in usage explorer section , what the value of span count signifies that is shown in terms of kb/mb/gb (size) so that i can make some capacity estimation for attaching storage to my running instance .

hello everyone , can anyone tell what metric i can use for plotting the service wise throughputs and latencies accurately ??

using docker standalone on signoz/signoz-otel-collector:0.66.7 i am unable to access this api. Using the troubleshooter container i receive error : not able to send data to SigNoz endpoint ... rpc error: code = Unavailable desc = connection closed before server preface received

hello everyone , is it recommended to use sharding to horizantally scale the clickhouse cluster over multiple nodes if data ingestion requirement in db can max reach to 7200gb that is retainable and to be queried to display metrics/traces or it will be better to keep clickhouse in single node with required storage , just want to anaylse the performance trade offs .

Where I can check the number of events sigoz ingesting per sec?

Not sure if this might cause some issues in service recreation during update but I jut got few install script error on executing sh install.sh

ubuntu@ip-my-ip:/var/www/signoz/deploy$ sh install.sh

-e 👋 Thank you for trying out SigNoz! 

install.sh: 304: !=: not found
-e 🌏 Detecting your OS ...

install.sh: 36: [[: not found
install.sh: 341: [[: not found
install.sh: 421: [[: not found
install.sh: 436: [[: not found
-e 🐳 Starting Docker ...

install.sh: 205: [[: not found
install.sh: 218: [[: not found

-e 
🟡 Pulling the latest container images for SigNoz.

Pulling zookeeper-1            ... done
Pulling clickhouse             ... done
Pulling query-service          ... done
Pulling alertmanager           ... done
Pulling frontend               ... done
Pulling otel-collector         ... done
Pulling otel-collector-metrics ... done

🟡 Starting the SigNoz containers. It may take a few minutes ...

Starting zookeeper-1 ... done
Starting clickhouse  ... done
Recreating query-service                           ... done
Starting clickhouse-setup_otel-collector_1         ... done
Starting clickhouse-setup_otel-collector-metrics_1 ... done
Recreating clickhouse-setup_alertmanager_1         ... done
Recreating frontend                                ... done
install.sh: 230: [[: not found


install.sh: 496: [[: not found
install.sh: 421: [[: not found
++++++++++++++++++ SUCCESS ++++++++++++++++++++++

🟢 Your installation is complete!

-e 🟢 Your frontend is running on <http://localhost:3301>

ℹ️  By default, retention period is set to 7 days for logs and traces, and 30 days for metrics.
-e To change this, navigate to the General tab on the Settings page of SigNoz UI. For more details, refer to <https://signoz.io/docs/userguide/retention-period> 

ℹ️  To bring down SigNoz and clean volumes : sudo docker-compose -f ./docker/clickhouse-setup/docker-compose.yaml down -v

+++++++++++++++++++++++++++++++++++++++++++++++++

👉 Need help in Getting Started?
-e Join us on Slack <https://signoz.io/slack>

-e 
📨 Please share your email to receive support & updates about SigNoz!
Email: <mailto:nishant@stratzy.in|nishant@stratzy.in>
install.sh: 533: [[: not found
install.sh: 421: [[: not found
-e 
🙏 Thank you!

install.sh: 245: [[: not found

commit head -

commit d5e112a9bc809e0706f1f86032a4590bbbf75ecc (HEAD -> main, origin/main)
Merge: 975d57ca 428b10f7
Author: Ankit Nayan <ankit@signoz.io>
Date:   Wed Apr 26 16:51:41 2023 +0530

    Merge pull request #2634 from SigNoz/release/v0.18.3
    
    Release/v0.18.3

Machine config • AWS t3a.2xlarge ubuntu running signoz community version This never happened before but my update seems to work fine

Was looking the doc for using variables for dashboard from https://signoz.io/docs/userguide/manage-variables/ I dont find any example on how to use the declared variables to use in query builder. For my current problem statement I have to display 2 of our api server metrics by using variable tagged with the value captured in metrics i.e api-1 api-2

Hi, is it possible to show only traces in the traces view, by default Signoz shows both traces and their spans which makes it a bit hard for me to find the information that I need (screenshot for a reference). Also, is it possible to exclude certain routes, as I have healthcheck route which is triggered every few seconds and unnecessarily bloats the view. Thanks!

hi , is there a way or some configuration tag in clickhouse-storage.xml to write a rule to move data on s3 based on time period eg : 1 month and empty the clickhouse tables so that it can ingest data periodically without any space issues .

Hi, I encountered problem, after a while, all pods deleted

I install signoz via helm chart on EKS cluster

after a while