ceph tell osd.* injectargs '--osd_recovery_delay_start 30'
2018-01-11 10:31 GMT+03:00 shadow_lin <shadow_lin@xxxxxxx>:
Hi ,Mine is purely backfilling(remove a osd from the cluster) and it started at 600Mb/s and ended at about 3MB/s.How is your recovery made up?Is it backfill or log replay pg recovery or both?2018-01-11
shadow_lin
发件人：Josef Zelenka <josef.zelenka@cloudevelops.com >发送时间：2018-01-11 15:26主题：Re: How to speed up backfill收件人："shadow_lin"<shadow_lin@163.com >抄送："ceph-users"<ceph-users@lists.ceph.com >Hi, our recovery slowed down significantly towards the end, however it was still about five times faster than the original speed.We suspected that this is caused somehow by threading (more objects transferred - more threads used), but this is only an assumption.
On 11/01/18 05:02, shadow_lin wrote:Hi,I had tried these two method and for backfilling it seems only osd-max-backfills works.How was your recovery speed when it comes to the last few pgs or objects?2018-01-11
shadow_lin
发件人：Josef Zelenka <josef.zelenka@cloudevelops.com> 发送时间：2018-01-11 04:53主题：Re: How to speed up backfill收件人："shadow_lin"<shadow_lin@163.com> 抄送：Hi, i had the same issue a few days back, i tried playing around with these two:
ceph tell 'osd.*' injectargs '--osd-max-backfills <num>' ceph tell 'osd.*' injectargs '--osd-recovery-max-active <num> ' and it helped greatly(increased our recovery speed 20x), but be careful to not overload your systems.
On 10/01/18 17:50, shadow_lin wrote:Hi all,I am playing with setting for backfill to try to find how to control the speed of backfill.Now I only find "osd max backfills" can have effect the backfill speed. But after all pg need to be backfilled begin backfilling I can't find any way to speed up backfills.Especailly when it comes to the last pg to recover, the speed is only a few MB/s(when there are multi pg are backfilled the speed could be more than 600MB/s in my test)I am a little confused about the setting of backfills and recovery.Though backfilling is a kind of recovery but It seems recovery setting is only about to replay pg logs to do recover pg.Would change "osd recovery max active" or other recovery setting have any effect on backfilling?I did tried "osd recovery op priority" and "osd recovery max active" with no luck.Any advice would be greatly appreciated.Thanks2018-01-11
lin.yunfan
_______________________________________________ ceph-users mailing list ceph-users@xxxxxxxxxxxxxx http://lists.ceph.com/ listinfo.cgi/ceph-users-ceph. com
_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph. com
_______________________________________________ ceph-users mailing list ceph-users@xxxxxxxxxxxxxx http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
