#2540 Add int64/float64 instead of number in AttributeKeyDataType Issue created by nityanandagohain SigNoz/signoz

#2541 feat: int64/float64 added for AttributeKeyDataType along with validation Pull request opened by nityanandagohain Fixes #2540 SigNoz/signoz GitHub Actions: lint-commits GitHub Actions: playwright ✅ 8 other checks have passed 8/10 successful checks

Release - v0.18.1 New release published by prashant-shahi 🚀 Features • feat(builder): add aggregator filter (#2516) @yeshev 🐛 Bug Fixes • fix: slider duration is fixed (#2537) @palashgdev • fix: 2427 latency graph onclick is updated (#2534) @palashgdev • fix: global time navigation is fixed (#2533) @palashgdev SigNoz/signoz

#198 Allow to run blackbox exporter for SSL certs expiration Pull request opened by srikanthccv SigNoz/charts GitHub Actions: test-chart GitHub Actions: lint-chart ✅ No checks have passed 0/2 successful checks

#2412 feat: search bar Pull request opened by KolesnikAntony close #2286 -Created context wrapper with form state. It gives us posibility to add antother fields for "query bulder" inside context form. -Created "search form" component -Connected API for searching keys and values -Added operators for each key -Added multiply selection as tags of queries -Added possibilities to choose the tag without of value when we have the operator 'exist' or 'nor exist' -Added unit tests For testig of component we can add context wrapper and component as child there you needed; SigNoz/signoz GitHub Actions: create_issue_on_merge GitHub Actions: build-query-service GitHub Actions: build-frontend GitHub Actions: playwright GitHub Actions: lint-commits ✅ 8 other checks have passed 8/13 successful checks

#2543 logs(FE): Clear filter is not working as expected Issue created by palashgdev Bug description Please describe. If this affects the front-end, screenshots would be of great help. Clear filter is not working as expected SigNoz/signoz

#2544 fix: clear filter is fixed Pull request opened by palashgdev Close #2543 SigNoz/signoz GitHub Actions: playwright GitHub Actions: lint-commits GitHub Actions: Ensure Pull Request has a linked issue. ✅ 7 other checks have passed 7/10 successful checks

#2545 feat: allow selection of individual service in Trace filter page Pull request opened by gitstart Fixes #2470 Demo https://www.loom.com/share/ada8b2fa84284c87babbbccb191d6ba5 SigNoz/signoz GitHub Actions: playwright GitHub Actions: Codeball GitHub Actions: lint-commits ✅ 6 other checks have passed 6/9 successful checks

#2546 Clickable body area in logs tab Issue created by ankit01-oss Please check out the loom video for details https://www.loom.com/share/d12c343281804b268b6e0b3faecb53f9 SigNoz/signoz

#2547 fix: cursor pointer is removed the table view Pull request opened by palashgdev Close #2546 SigNoz/signoz GitHub Actions: Ensure Pull Request has a linked issue. GitHub Actions: playwright GitHub Actions: lint-commits ✅ 6 other checks have passed 6/9 successful checks

1 new commit pushed to

<https://github.com/SigNoz/signoz/tree/develop|develop>

by palashgdev

<https://github.com/SigNoz/signoz/commit/c74896b213f396aa0ebbe37519a66468a59f8182|c74896b2>

- fix: cursor pointer is removed the table view (#2547) SigNoz/signoz

Deployment to staging by palashgdev SigNoz/signoz

#2548 (alerts): query result plot y-axis and threshold should support unit configuration Issue created by srikanthccv There can be many scenarios where the absolute value of the query can be big. For instance, the memory usage is measured in

bytes

, and if the current memory usage is in a few gigs, the charts will start to show numbers in million or billion. This will make it difficult for users to make sense of. Example: The user should be able to configure the unit, which should be honoured for the threshold input value. SigNoz/signoz

#2504 chore: set Cache-Control for auto complete requests Pull request opened by srikanthccv Fixes #2282 SigNoz/signoz GitHub Actions: playwright GitHub Actions: lint-commits GitHub Actions: Ensure Pull Request has a linked issue. ✅ 7 other checks have passed 7/10 successful checks

1 new commit pushed to

<https://github.com/SigNoz/signoz/tree/develop|develop>

by srikanthccv

<https://github.com/SigNoz/signoz/commit/d4bfe3a096f6cd114d9642ac27c1d78cc6b42b2a|d4bfe3a0>

- chore: set Cache-Control for auto complete requests (#2504) SigNoz/signoz

#2282 use browser's HTTP cache with small expiry for tag key/value requests Issue created by srikanthccv When a user works with the query builder, the client will send requests to the server asking for the new tag key/value results matching the criteria. The user's typing is instant and frequent; querying the database multiple times within a short duration is inefficient for reasons including the ClickHouse query concurrency. The server can set the `Cache-Control` with small expiry that is reasonable enough that it doesn't stale results for regular use cases. @Palash Gupta this is what we were referring to when the cache was brought up. With the

Cache-Control

headers set, the browser does all the work. SigNoz/signoz

Deployment to staging by srikanthccv SigNoz/signoz

#201 ability to specify the custom run commands for clickhouse init container Issue created by srikanthccv ClickHouse server fails to start when it finds a broken parts count greater than the maximum allowed. The broken "part" means the data is corrupted. There are several reasons for it, with the following being the most commonly noticed. This is seen often for the users whose ingestion volume is high. 1. User didn't wait for a graceful shutdown, causing the data not to be flushed to disk. 2. User did manual management of shards incompletely. It can be solved by detaching the broken parts. We must use the init container command to force restore the data so that ClickHouse can run again. This is not configurable today in SigNoz charts. The user should be able to run additional run commands with the init container from

values.yaml

. SigNoz/charts

1 new commit pushed to

<https://github.com/SigNoz/signoz/tree/develop|develop>

by palashgdev

<https://github.com/SigNoz/signoz/commit/5f73a82d9f943ee58338512234e76fb3661b28e6|5f73a82d>

- feat(filter): add group by filter (#2538) SigNoz/signoz

#2307 FE(QB): Add Group By Filter Issue created by palashgdev API Endpoint:

api/v3/autocomplete/attribute_keys

Query params example Metrics:

aggregateOperator=sum&dataSource=metrics&aggregateAttribute=signoz_calls_total&searchText=s

Logs:

aggregateOperator=sum_rate&dataSource=logs&aggregateAttribute=bytes&searchText=service_

Traces:

aggregateOperator=count&dataSource=traces&aggregateAttribute=&searchText=http_status

This is a searchable box where users can type the text, and matching attribute keys will be populated for the user selection. This is a multi-select field, i.e. group by can be one multiple attributes. https://ant.design/~demos/components-select-demo-tags SigNoz/signoz

Deployment to staging by palashgdev SigNoz/signoz

#2549 feat(builder): add additional filter toggler Pull request opened by yeshev SigNoz/signoz GitHub Actions: Ensure Pull Request has a linked issue. GitHub Actions: playwright GitHub Actions: lint-commits ✅ 7 other checks have passed 7/10 successful checks

#2550 Add SigNoz to `fly-log-shipper` Issue created by ankitnayan Add SigNoz as a sink at https://github.com/superfly/fly-log-shipper SigNoz/signoz

#2551 feat: added Order By filter Pull request opened by techchintan Close: #2308 @Srikanth Chekuri right now there is no data for Traces & Logs. So I have implemented it as per matrics. SigNoz/signoz GitHub Actions: build-query-service GitHub Actions: e2e-k3s GitHub Actions: e2e-k3s GitHub Actions: lint-commits GitHub Actions: build-frontend GitHub Actions: Deploy PR branch to testing GitHub Actions: e2e-k3s GitHub Actions: Deploy PR branch to testing GitHub Actions: update_release_draft GitHub Actions: Ensure Pull Request has a linked issue. GitHub Actions: build-ee-query-service GitHub Actions: dependency-review GitHub Actions: Deploy PR branch to testing GitHub Actions: Codeball GitHub Actions: playwright ✅ No checks have passed 0/15 successful checks

#2112 High CPU usage by ClickHouse Issue created by vasicvuk In what situation are you experiencing subpar performance? I have installed the SigNoz using the official charts. Currently, it processes 17k spans per hour, and I would like to get it to process nearly 500k per hour. The main issue I have is the high CPU usage on the click house pod. It constantly is using 430% CPU (4.3 cpus). The only thing that I see in logs of click house is repeating:

2023.01.24 21:39:40.466440 [ 25 ] {ddd16d9e-c070-4213-b281-62a2f1985bc0::20221002_4478_4478_0_7094} <Error> virtual bool DB::MutatePlainMergeTreeTask::executeStep(): Code: 10. DB::Exception: Not found column MethodInfo in block. There are only columns: timestamp, id, trace_id, span_id, severity_text, body, observed_timestamp, trace_flags, severity_number, resources_string_key, resources_string_value, attributes_string_key, attributes_string_value, attributes_int64_key, attributes_int64_value, attributes_float64_key, attributes_float64_value, k8s_pod_name, k8s_container_name. (NOT_FOUND_COLUMN_IN_BLOCK), Stack trace (when copying this message, always include the lines below):

0. DB::Exception::Exception(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&, int, bool) @ 0xa3ef75a in /usr/bin/clickhouse
1. DB::Block::getByName(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&, bool) const @ 0x13ef0872 in /usr/bin/clickhouse
2. DB::getBlockAndPermute(DB::Block const&, std::__1::vector<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> >, std::__1::allocator<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > > > const&, DB::PODArray<unsigned long, 4096ul, Allocator<false, false>, 15ul, 16ul> const*) @ 0x158db96f in /usr/bin/clickhouse
3. DB::MergeTreeDataPartWriterCompact::writeDataBlockPrimaryIndexAndSkipIndices(DB::Block const&, std::__1::vector<DB::Granule, std::__1::allocator<DB::Granule> > const&) @ 0x158d682e in /usr/bin/clickhouse
4. DB::MergeTreeDataPartWriterCompact::fillDataChecksums(DB::MergeTreeDataPartChecksums&) @ 0x158d7bc2 in /usr/bin/clickhouse
5. DB::MergeTreeDataPartWriterCompact::fillChecksums(DB::MergeTreeDataPartChecksums&) @ 0x158d847c in /usr/bin/clickhouse
6. DB::MergedBlockOutputStream::finalizePartAsync(std::__1::shared_ptr<DB::IMergeTreeDataPart>&, bool, DB::NamesAndTypesList const*, DB::MergeTreeDataPartChecksums*) @ 0x159c9396 in /usr/bin/clickhouse
7. DB::MutateAllPartColumnsTask::finalize() @ 0x159ee9c5 in /usr/bin/clickhouse
8. ? @ 0x159ecfec in /usr/bin/clickhouse
9. DB::MutatePlainMergeTreeTask::executeStep() @ 0x159d562e in /usr/bin/clickhouse
10. DB::MergeTreeBackgroundExecutor<DB::MergeMutateRuntimeQueue>::routine(std::__1::shared_ptr<DB::TaskRuntimeData>) @ 0xa3b9f1b in /usr/bin/clickhouse
11. DB::MergeTreeBackgroundExecutor<DB::MergeMutateRuntimeQueue>::threadFunction() @ 0xa3b9950 in /usr/bin/clickhouse
12. ThreadPoolImpl<ThreadFromGlobalPool>::worker(std::__1::__list_iterator<ThreadFromGlobalPool, void*>) @ 0xa4b38a6 in /usr/bin/clickhouse
13. void std::__1::__function::__policy_invoker<void ()>::__call_impl<std::__1::__function::__default_alloc_func<ThreadFromGlobalPool::ThreadFromGlobalPool<void ThreadPoolImpl<ThreadFromGlobalPool>::scheduleImpl<void>(std::__1::function<void ()>, int, std::__1::optional<unsigned long>)::'lambda0'()>(void&&)::'lambda'(), void ()> >(std::__1::__function::__policy_storage const*) @ 0xa4b51f7 in /usr/bin/clickhouse
14. ThreadPoolImpl<std::__1::thread>::worker(std::__1::__list_iterator<std::__1::thread, void*>) @ 0xa4b11c8 in /usr/bin/clickhouse
15. ? @ 0xa4b43dd in /usr/bin/clickhouse
16. ? @ 0x7fdc728ef609 in ?
17. __clone @ 0x7fdc72814133 in ?
 (version 22.8.8.3 (official build))

This CPU load is present even if the SigNoz frontend is not used by anybody. How to reproduce I am really not sure what is specific to the environment in order to create a reproduction. But I will try to give as much information as you request from me. Your Environment ☑︎ Linux ☐ Mac ☐ Windows Please provide details of OS version etc. Ubuntu 22.04.1 SigNoz/signoz

#2552 bug: resource attribute query params is not picked when navigated from sidebar Issue created by palashgdev Bug description Please describe. If this affects the front-end, screenshots would be of great help. SigNoz/signoz

#2553 feat: resource attribute query is shared in the app navigation from sidebar Pull request opened by palashgdev Close #2552 SigNoz/signoz GitHub Actions: playwright GitHub Actions: Ensure Pull Request has a linked issue. GitHub Actions: lint-commits ✅ 7 other checks have passed 7/10 successful checks

#202 k8s-infra chart does not collect logs in Oracle OKE Issue created by patrijua We have installed SigNoz Helm chart (0.12.1) and also k8s-infra chart as well. K8s-infra chart is with default values (Oracle OKE 1.23.4). Problem is that kubernetes pod logs are not visible in SigNoz. In otel agent logs I can see that it detects the file to watch in node:

2023-03-20T11:57:39.619Z info fileconsumer/file.go:171 Started watching file {"kind": "receiver", "name": "filelog/k8s", "pipeline": "logs", "component": "fileconsumer", "path": "/var/log/pods/*********/configuration/0.log"}

I have verified that file contains all the logs for the container. There are no errors visible in agent logs, signoz-otel-collector logs or clickhouse logs, but the logs are not visible in SigNoz. signoz-k8s-infra-otel-agent-nz7rk.log It's hard to debug since one can not exec into agent container to check can it access the files on node: kubectl exec -i -t -n platform signoz-k8s-infra-otel-agent-nz7rk -c signoz-k8s-infra-otel-agent -- sh -c "clear; (bash || ash || sh)" ERRO[0000] exec failed: unable to start container process: exec: "sh": executable file not found in $PATH command terminated with exit code 255 In nodes /var/log/messages there's log entries related to this:

Apr 5 07:24:19 oke-cul2jmprnmq-nr6xzjb6w6q-su3ppd6zdfa-0 setroubleshoot[1714595]: SELinux is preventing otelcol-contrib from read access on the directory /var/log/pods.#012#012***** Plugin catchall (100. confidence) suggests **************************#012#012If you believe that otelcol-contrib should be allowed read access on the pods directory by default.#012Then you should report this as a bug.#012You can generate a local policy module to allow this access.#012Do#012allow this access for now by executing:#012# ausearch -c 'otelcol-contrib' --raw | audit2allow -M my-otelcolcontrib#012# semodule -X 300 -i my-otelcolcontrib.pp#012

SigNoz/charts

1 new commit pushed to

<https://github.com/SigNoz/signoz-otel-collector/tree/main|main>

by srikanthccv

<https://github.com/SigNoz/signoz-otel-collector/commit/7338768fa6b2c61aa8c46f45c9c7de700e2795b8|7338768f>

- feat: push tag attributes to a new table (#103) SigNoz/signoz-otel-collector

#2254 (logs): materialized table for tag key-values suggestions Issue created by srikanthccv Table that has the key/values/types for the last 24 hours for the autocomplete APIs. SigNoz/signoz