Re: Ceph reef and (slow) backfilling - how to speed it up

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



For our customers we are still disabling mclock and using wpq. Might be worth trying.

Mark


On 4/30/24 09:08, Pierre Riteau wrote:
Hi Götz,

You can change the value of osd_max_backfills (for all OSDs or specific
ones) using `ceph config`, but you need
enable osd_mclock_override_recovery_settings. See
https://docs.ceph.com/en/quincy/rados/configuration/mclock-config-ref/#steps-to-modify-mclock-max-backfills-recovery-limits
for more information.

Best regards,
Pierre Riteau

On Sat, 27 Apr 2024 at 08:32, Götz Reinicke <goetz.reinicke@xxxxxxxxxxxxxxx>
wrote:

Dear ceph community,

I’ve a ceph cluster which got upgraded from nautilus/pacific/…to reef over
time. Now I added two new nodes to an existing EC pool as I did with the
previous versions of ceph.

Now I face the fact, that the previous „backfilling tuning“ I’v used by
increasing injectargs --osd-max-backfills=XX --osd-recovery-max-active=YY
dose not work anymore.

With adjusting thous parameters the backfill was running with up to 2k +-
objects/s.

As I’m not (yet) familiar with the reef opiont the only speed up so far I
found is „ceph config set osd osd_mclock_profile high_recovery_ops“ which
currently runs the backfill with up to 600 opbjects/s.

My question: What is a best (simple) way to speed that backfill up ?

I’v tried to understand the custom profiles (?) but without success - and
did not apply anything other yet.

Thanks for feedback and suggestions ! Best regards . Götz



_______________________________________________
ceph-users mailing list -- ceph-users@xxxxxxx
To unsubscribe send an email to ceph-users-leave@xxxxxxx
_______________________________________________
ceph-users mailing list -- ceph-users@xxxxxxx
To unsubscribe send an email to ceph-users-leave@xxxxxxx

--
Best Regards,
Mark Nelson
Head of Research and Development

Clyso GmbH
p: +49 89 21552391 12 | a: Minnesota, USA
w: https://clyso.com | e: mark.nelson@xxxxxxxxx

We are hiring: https://www.clyso.com/jobs/
_______________________________________________
ceph-users mailing list -- ceph-users@xxxxxxx
To unsubscribe send an email to ceph-users-leave@xxxxxxx




[Index of Archives]     [Information on CEPH]     [Linux Filesystem Development]     [Ceph Development]     [Ceph Large]     [Ceph Dev]     [Linux USB Development]     [Video for Linux]     [Linux Audio Users]     [Yosemite News]     [Linux Kernel]     [Linux SCSI]     [xfs]


  Powered by Linux