Hi Team, I'm running Signoz `v.0.88.1` (self-hoste...
# support
r
Hi Team, I'm running Signoz
v.0.88.1
(self-hosted) and we're trying to run the data-migration-job, and getting a ton of errors, wondering if someone could help
s
@Aniket Agarwal please help
n
Hey @Ray Rivero, meanwhile, Aniket will take a look at this. Can you confirm once that you've
signozclickhousemetrics
exporter enabled while you're running the migration job
r
Will look into that and report asap
So no that was not enabled, will update the chart and restart the process
n
Yes, Please try with it being enabled, let us know how it goes
Are you running signoz on Linux?
r
K8s
👍 1
@Nagesh Bansal QQ, the
signozclickhousemetrics
is supposed to be enabled for traces and logs as well? or just metrics?
n
Just metrics @Ray Rivero
🙏 1
If you want to know the exact configuration you can follow this: https://signoz.io/docs/operate/migration/upgrade-0.88#step-0-enable-dual-exporter
r
Just FYI, the documentation seems to be incorrect as the
endpoint
is not a valid key, it was expecting
dsn
Copy code
signozclickhousemetrics:
      endpoint: <tcp://localhost:9000/signoz_metrics?password=password>
1
s
I'm continuing Ray's work here. We have both exporters running and we're still getting that giant error. On both the alert/dashboard as well as the clickhouse migration.
n
@Aniket Agarwal Please take a look at this
s
FYI, these are all metrics we collected previously but stopped collecting. Is there a flag to ignore metrics it can't find a map for?
s
@Shad O'Neil use
NOT_FOUND_METRICS_MAP
, for each missing metric set the same metric as mapped metric, example
ClickHouseProfileEvents_SelectedMarksTotal=ClickHouseProfileEvents_SelectedMarksTotal,mongodb_ss_metrics_operatorCounters_windowAccumulators_sum=mongodb_ss_metrics_operatorCounters_windowAccumulators_sum...
s
How do you know you're mapping them to the right thing? It's fine just to map them to themselves?
s
All of them are already missing so It's fine just to map them to themselves
s
The map is 55475 chars long. I deployed it and it's hanging. I'll let it (try to) run longer to see if it can complete.
Yeah...looks like both the clickhouse and sqllite migrations are just hanging.
e
I am having same issue for both migrations, at this point I just want to migrate alerts and dashboards. How can I run with the
NOT_FOUND_METRICS_MAP
, where should it be added?
I found it👍
s
We ended up abandoning the migration and migrated our alerts/dashboards by hand and orphaned our old metric data. Not a great experience considering we're nearing an enterprise contract. Thanks for helping anyway.