What kind of commit/apply latency increases have you seen when adding a large numbers of OSDs? I'm nervous how sensitive workloads might react here, esp. with spinners. cheers, peter. On 24.07.19 20:58, Reed Dier wrote: > Just chiming in to say that this too has been my preferred method for > adding [large numbers of] OSDs. > > Set the norebalance nobackfill flags. > Create all the OSDs, and verify everything looks good. > Make sure my max_backfills, recovery_max_active are as expected. > Make sure everything has peered. > Unset flags and let it run. > > One crush map change, one data movement. > > Reed > >> >> That works, but with newer releases I've been doing this: >> >> - Make sure cluster is HEALTH_OK >> - Set the 'norebalance' flag (and usually nobackfill) >> - Add all the OSDs >> - Wait for the PGs to peer. I usually wait a few minutes >> - Remove the norebalance and nobackfill flag >> - Wait for HEALTH_OK >> >> Wido >> >> _______________________________________________ >> ceph-users mailing list >> ceph-users@xxxxxxxxxxxxxx <mailto:ceph-users@xxxxxxxxxxxxxx> >> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com > > > _______________________________________________ > ceph-users mailing list > ceph-users@xxxxxxxxxxxxxx > http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com > _______________________________________________ ceph-users mailing list ceph-users@xxxxxxxxxxxxxx http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com