Hi Team, I'm running Signoz

v.0.88.1

(self-hosted) and we're trying to run the data-migration-job, and getting a ton of errors, wondering if someone could help

@Aniket Agarwal please help

Hey @Ray Rivero, meanwhile, Aniket will take a look at this. Can you confirm once that you've

signozclickhousemetrics

exporter enabled while you're running the migration job

Will look into that and report asap

Yes, Please try with it being enabled, let us know how it goes

K8s

Just metrics @Ray Rivero

Just FYI, the documentation seems to be incorrect as the

endpoint

is not a valid key, it was expecting

dsn

signozclickhousemetrics:
      endpoint: <tcp://localhost:9000/signoz_metrics?password=password>

I'm continuing Ray's work here. We have both exporters running and we're still getting that giant error. On both the alert/dashboard as well as the clickhouse migration.

@Aniket Agarwal Please take a look at this

FYI, these are all metrics we collected previously but stopped collecting. Is there a flag to ignore metrics it can't find a map for?

@Shad O'Neil use

NOT_FOUND_METRICS_MAP

, for each missing metric set the same metric as mapped metric, example

ClickHouseProfileEvents_SelectedMarksTotal=ClickHouseProfileEvents_SelectedMarksTotal,mongodb_ss_metrics_operatorCounters_windowAccumulators_sum=mongodb_ss_metrics_operatorCounters_windowAccumulators_sum...

How do you know you're mapping them to the right thing? It's fine just to map them to themselves?

All of them are already missing so It's fine just to map them to themselves

The map is 55475 chars long. I deployed it and it's hanging. I'll let it (try to) run longer to see if it can complete.

I am having same issue for both migrations, at this point I just want to migrate alerts and dashboards. How can I run with the

NOT_FOUND_METRICS_MAP

, where should it be added?

We ended up abandoning the migration and migrated our alerts/dashboards by hand and orphaned our old metric data. Not a great experience considering we're nearing an enterprise contract. Thanks for helping anyway.