On Fri, May 29, 2015 at 5:47 PM, Samuel Just <sjust@xxxxxxxxxx> wrote: > Many people have reported that they need to lower the osd recovery config options to minimize the impact of recovery on client io. We are talking about changing the defaults as follows: > > osd_max_backfills to 1 (from 10) > osd_recovery_max_active to 3 (from 15) > osd_recovery_op_priority to 1 (from 10) > osd_recovery_max_single_start to 1 (from 5) > > We'd like a bit of feedback first though. Is anyone happy with the current configs? Is anyone using something between these values and the current defaults? What kind of workload? I'd guess that lowering osd_max_backfills to 1 is probably a good idea, but I wonder whether lowering osd_recovery_max_active and osd_recovery_max_single_start will cause small objects to recover unacceptably slowly. > > Thoughts? When we enable explicit rebalancing, we set the parameters as such to reduce the impact on client I/O: osd_recovery_max_active = 1 osd_max_backfills = 1 osd_op_threads = 10 osd_recovery_op_priority = 1 osd_mon_report_interval_min = 30 See https://github.com/bloomberg/chef-bcpc/blob/master/cookbooks/bcpc/templates/default/ceph.conf.erb Cheers. -- justin _______________________________________________ ceph-users mailing list ceph-users@xxxxxxxxxxxxxx http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
 |