It is also worth looking at osd_recovery_sleep option.
From: ceph-users <ceph-users-bounces@xxxxxxxxxxxxxx> on behalf of Josef Zelenka <josef.zelenka@xxxxxxxxxxxxxxxx>
Sent: Thursday, January 11, 2018 12:07:45 AM
To: shadow_lin
Cc: ceph-users@xxxxxxxxxxxxxx
Subject: Re: How to speed up backfill
On 10/01/18 21:53, Josef Zelenka wrote:
Hi, i had the same issue a few days back, i tried playing around with these two:
ceph tell 'osd.*' injectargs '--osd-max-backfills <num>'
ceph tell 'osd.*' injectargs '--osd-recovery-max-active <num> '
and it helped greatly(increased our recovery speed 20x), but be careful to not overload your systems.
On 10/01/18 17:50, shadow_lin wrote:
Hi all,
I am playing with setting for backfill to try to find how to control the speed of backfill.
Now I only find "osd max backfills" can have effect the backfill speed. But after all pg need to be backfilled begin backfilling I can't find any way to speed up backfills.
Especailly when it comes to the last pg to recover, the speed is only a few MB/s(when there are multi pg are backfilled the speed could be more than 600MB/s in my test)
I am a little confused about the setting of backfills and recovery.Though backfilling is a kind of recovery but It seems recovery setting is only about to replay pg logs to do recover pg.
Would change "osd recovery max active" or other recovery setting have any effect on backfilling?
I did tried "osd recovery op priority" and "osd recovery max active" with no luck.
Any advice would be greatly appreciated.Thanks
_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
|
_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
