How can i clean logs / traces history in signoz ?
# supportc
C H
09/06/2022, 8:30 AMHow can i clean logs / traces history in signoz ?
v
Vishal Sharma
09/06/2022, 8:59 AMHey @C H you can update retention period in settings: https://signoz.io/docs/userguide/retention-period/
c
C H
09/06/2022, 9:12 AMyes already done that
C H
09/06/2022, 9:13 AMbut my clickhouse dir is huge
24G ./clickhouse
C H
09/06/2022, 9:13 AMwith history set to one day and very very few traffic
v
Vishal Sharma
09/06/2022, 9:15 AMAfter setting retention period the old data clean up happens slowly.
Can you check if you can see old data by sorting trace table by timestamp in descending order?
c
C H
09/06/2022, 9:18 AMno after cleanup i cannot see old traces / logs
C H
09/06/2022, 9:18 AMbut store dir is always huge
24G ./clickhouse/store
C H
09/06/2022, 9:18 AMmaybe an upgrade or a bad migration between signoz version or a bug ?
v
Vishal Sharma
09/06/2022, 9:19 AMWhat’s total number of traces?
Check on trace page by setting datetime to last 7 days/ 1 week
c
C H
09/06/2022, 9:20 AM65k traces
v
Vishal Sharma
09/06/2022, 9:21 AMWhich version are you running? and did you upgrade to any new version?
Vishal Sharma
09/06/2022, 9:21 AMCan you also if check logs are being stored?
c
C H
09/06/2022, 9:22 AMyes but i set logs retention period to 1 day
C H
09/06/2022, 9:23 AM Copy code
24G ./clickhouse/store
4.0K ./clickhouse/metadata_dropped
76K ./clickhouse/preprocessed_configs
4.0K ./clickhouse/user_defined
33M ./clickhouse/rocksdb
4.0K ./clickhouse/metadata/information_schema
4.0K ./clickhouse/metadata/INFORMATION_SCHEMA
60K ./clickhouse/metadata
24K ./clickhouse/access
4.0K ./clickhouse/tmp
4.0K ./clickhouse/user_scripts
16K ./clickhouse/data/default
20K ./clickhouse/data/signoz_metrics
36K ./clickhouse/data/system
20K ./clickhouse/data/signoz_logs
36K ./clickhouse/data/signoz_traces
132K ./clickhouse/data
24G ./clickhousev
Vishal Sharma
09/06/2022, 9:23 AMWhich version are you running? and did you upgrade to latest version recently?
c
C H
09/06/2022, 9:24 AMyes : v0.11.0
C H
09/06/2022, 9:25 AMwhat is a best way to reset alll, i can loose my traces / logs / history
v
Vishal Sharma
09/06/2022, 9:27 AMIf you want to reset signoz completely then you need to first uninstall signoz and then delete signoz folder.
This will delete all the data,
You can do a fresh install now.
c
C H
09/06/2022, 9:31 AMok but i don't want to loose my configs dashboard & co 🙂 Is there a way to reset only clickhouse bad datas ?
C H
09/06/2022, 9:31 AM Copy code
if i remove dir like : ./clickhouse/store/894/894eef96-289d-42d1-945e-1192b1a9d54f/202208_620497_676942_1793v
Vishal Sharma
09/06/2022, 9:32 AMYes, you can safely remove
./clickhouse/storeVishal Sharma
09/06/2022, 9:33 AMDashboards and configs are stored in sqlite db so they won’t be deleted.
c
C H
09/06/2022, 9:33 AMThks, i'm gonna try that.
C H
09/06/2022, 9:44 AMok, i removed store dir & uninstall / reinstall signoz 🙂
p
Prashant Shahi
09/06/2022, 1:03 PM@C H You can make use Make commands below to remove all persisted data: ClickHouse (traces, metrics, and logs data) and SQLite (dashboard, alerts, users, and org data).
At first bring down SigNoz cluster, run the following commands and bring it back up.
For Standalone:
Copy code
make clear-standalone-data Copy code
make clear-swarm-datac
C H
09/06/2022, 1:27 PMok thks 🙂
466 Views