On Tue, Apr 30, 2019 at 8:26 PM Igor Podlesny <ceph-user@xxxxxxxx> wrote: > > On Wed, 1 May 2019 at 01:01, Dan van der Ster <dan@xxxxxxxxxxxxxx> wrote: > >> > The upmap balancer in v12.2.12 works really well... Perfectly uniform on our clusters. > >> > >> mode upmap ? > > > > yes, mgr balancer, mode upmap. > > I see. Was it a matter of just: > > 1) ceph balancer mode upmap > 2) ceph balancer on > > or were there any other steps? All of the clients need to be luminous our newer: # ceph osd set-require-min-compat-client luminous You need to enable the module: # ceph mgr module enable balancer You probably don't want to it run 24/7: # ceph config-key set mgr/balancer/begin_time 0800 # ceph config-key set mgr/balancer/end_time 1800 The default rate that it balances things are a bit too high for my taste: # ceph config-key set mgr/balancer/max_misplaced 0.005 # ceph config-key set mgr/balancer/upmap_max_iterations 2 (Those above are optional... YMMV) Now fail the active mgr so that the new one reads those new options above. # ceph mgr fail <the active one> Enable the upmap mode: # ceph balancer mode upmap Test it once to see that it works at all: # ceph balancer optimize myplan # ceph balancer show myplan # ceph balancer reset (any errors, start debugging -- use debug_mgr = 4/5 and check the active mgr's log for the balancer details.) # ceph balancer on Now it'll start moving the PGs around until things are quite well balanced. In our clusters that process takes a week or two... it depends on cluster size, numpgs, etc... Hope that helps! Dan > > -- > End of message. Next message? _______________________________________________ ceph-users mailing list ceph-users@xxxxxxxxxxxxxx http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
 |