On 25-03-2024 22:58, Kai Stian Olstad wrote:
On Mon, Mar 25, 2024 at 09:28:01PM +0100, Torkil Svensgaard wrote:
My tally came to 412 out of 539 OSDs showing up in a blocked_by list
and that is about every OSD with data prior to adding ~100 empty OSDs.
How 400 read targets and 100 write targets can only equal ~60
backfills with osd_max_backill set at 3 just makes no sense to me but
alas.
It seems I can just increase osd_max_backfill even further to get the
numbers I want so that will do. Thank you all for taking the time to
look at this.
It's a huge change and 42% of you data need to be moved.
And this move is not only to the new OSD but also between the existing
OSD, but
they are busy with backfilling so they have no free backfill reservation.
If I have 60 backfills going on that would be 60 read reservations and
60 write reservations if I understand it correctly. The only way I can
see that getting stuck at 60 backfills with osd_max_backfill = 3 is for
those 60 reservations to be tied up on 20 OSDs being the only ones
either read from or written to, and all other OSDs waiting on those.
> I do recommend this document by Joshua Baergen at Digital Ocean that
explains
backfilling and the problem with it and there solution, a tool called
pgremapper.
Thanks, I'll take a look at that =)
Mvh.
Torkil
--
Torkil Svensgaard
Systems Administrator
Danish Research Centre for Magnetic Resonance DRCMR, Section 714
Copenhagen University Hospital Amager and Hvidovre
Kettegaard Allé 30, 2650 Hvidovre, Denmark
_______________________________________________
ceph-users mailing list -- ceph-users@xxxxxxx
To unsubscribe send an email to ceph-users-leave@xxxxxxx
