I can believe the month timeframe for a cluster with multiple large spinners behind each HBA. I’ve witnessed such personally.
I do have the numbers for this: My original post showed "1167541260/1595506041 objects misplaced (73.177%)". During my last recovery with Ceph 16.2.7, the recovery speed was: * 150 objects/s with osd_max_backfills = 1 * 350 objects/s with osd_max_backfills = 6 Computing: 1167541260 / 350 / 3600 / 24 = 38 days. The hardware is 3 machines * (19 HDDs * 16 TB), with 10 Gbit/s networking. The reason it is slow is that there are many small files == objects, and Ceph does a seek for each object during scrubbing and recovery (see https://tracker.ceph.com/issues/59584). _______________________________________________ ceph-users mailing list -- ceph-users@xxxxxxx To unsubscribe send an email to ceph-users-leave@xxxxxxx
