1. Multi-root. You should deprecate your 'ssd' root and move your osds of this root to 'default' root.
I would love to deprecate the multi-root, and may try to do just that in my next OSD add, just worried about data shuffling unnecessarily. Would this in theory help my distribution across disparate OSD topologies?
2. Some of your OSD's are reweighted, for example osd.44,osd.50,osd.57,osd.60,osd.102,osd.107. For proper upmap work all osds should be not reweighted.
This was done to reclaim space, due to balancer not finding more optimizations, and also not running, due to some OSDs being marked as nearfull, again, because of poor distribution.
Since running with balancer turned off, I have had very few issues with my MGRs.
Reed On Sep 9, 2019, at 11:19 PM, Konstantin Shalygin < k0ste@xxxxxxxx> wrote:
On 8/29/19 9:56 PM, Reed Dier wrote:
"config/mgr/mgr/balancer/active",
"config/mgr/mgr/balancer/max_misplaced",
"config/mgr/mgr/balancer/mode",
"config/mgr/mgr/balancer/pool_ids",
This is useless keys, you may to remove it.
https://pastebin.com/bXPs28h1
Issues that you have:
1. Multi-root. You should deprecate your 'ssd' root and move your
osds of this root to 'default' root. 2. Some of your OSD's are reweighted, for example
osd.44,osd.50,osd.57,osd.60,osd.102,osd.107. For proper upmap work
all osds should be not reweighted.
$ time ceph balancer optimize
newplan1
Error EALREADY: Unable to
find further optimization, or pool(s)' pg_num is
decreasing, or distribution is already perfect
real 3m10.627s
user 0m0.352s
sys 0m0.055s
Set the key `mgr/balancer/upmap_max_iterations` to '2' should
decrease this time. k
|