image.png
r
image.png
n
can you check your sqlite db and share the status of
select * from feature_status;
oh you have already shared
r
i have found the reason , i was build the image from pkg not ee. after re build the image with ee path, it can work
n
Oh got it. So you are building your own image.
r
we want to improve the query performance
n
Can you share more details ?
r
yeah,Cause we have 100 million a day log, after insert the data. The query for Dashboard & Alert will be very slow. We want to add external index for 'app' or 'event' name
n
By external indexes you mean clickhouse skip index right ? If thats the case then you can do it in the old explorer page which will materialize the column.
We have a new perf improvements coming up for logs. ( check these two pr’s below) https://github.com/SigNoz/signoz/pull/5528 https://github.com/SigNoz/signoz-otel-collector/pull/348 It will take sometime to be released for everyone, but you can build the images from those branches and try out locally. It has some major changes for filtering on resource attributes without indexing and will make it fast.
🙂 1
r
By external indexes you mean clickhouse skip index right ? If thats the case then you can do it in the old explorer page which will materialize the column.
if new explorer page will build materialize column? like OpenTelemetry resource service.name, or other attribute with our want to custom setting
n
So all the resource attributes like
service.name
will be stored in such a way that you can query over them in a very efficient way without materialize, (materialize will only be required if you wan’t to group by)