Hi, before I activated Ceph balancer I executed this command: ceph osd crush weight-set rm-compat Regards Thomas Am 21.12.2019 um 03:23 schrieb David Zafman: > > Offline optimization is using the same underlying code that the > ceph-mgr does. So it should for the most part produce the same results. > > There is a special weight stored as "weight_set" in crush that is set > by the crush-compat balancer. Not sure of the commands but these > should be removed before testing the upmap balancer. > > David > > On 12/20/19 1:17 AM, Thomas Schneider wrote: >> Hello David, >> >> many thanks for testing the new balancer code with my OSDmap. >> >> I have completed task to set reweight of any OSD to 1.0 and then I >> enable balancer. >> However there's no change to the PG distribution on my critical pool. >> >> Therefore I started offline optimization with osdmaptool following these >> <https://docs.ceph.com/docs/master/rados/operations/upmap/> >> instructions. >> >> I enable debug to see more details and this is the last output; there's >> no optimization possible although the OSDs are heavily unbalanced. >> 2019-12-20 10:05:06.256 7f91a9c86ac0 10 osd.255 target 59.1325 >> deviation -0.132507 -> ratio -0.00224085 < max ratio 0.001 >> 2019-12-20 10:05:06.256 7f91a9c86ac0 10 failed to find any changes for >> overfull osds >> 2019-12-20 10:05:06.256 7f91a9c86ac0 10 will try dropping existing >> remapping pair 400 -> 404 which remapped 11.22ef out from underfull >> osd.400 >> 2019-12-20 10:05:06.256 7f91a9c86ac0 10 existing pg_upmap_items >> [400,404] remapped 11.22ef out from underfull osd.400, will try >> cancelling it entirely >> 2019-12-20 10:05:06.256 7f91a9c86ac0 10 stddev 158655 -> 158731 >> 2019-12-20 10:05:06.256 7f91a9c86ac0 10 hit local_fallback_retries 100 >> 2019-12-20 10:05:06.260 7f91a9c86ac0 10 overfull >> 42,43,44,45,46,47,48,49,50,51,52,53,54,55,56,57,58,76,77,78,79,80,81,82,83,84,85,86,87,88,89,90,91,92,93,94,95,96,97,98,99,101,102,103,104,105,107,108,109,110,111,112,113,114,115,116,117,118,119,120,121,122,123,124,125,126,127,128,129,130,131,132,133,134,135,136,137 >> >> ,138,139,140,141,142,143,144,145,146,147,148,149,150,151,152,153,155,156,157,158,159,160,161,162,163,164,165,166,167,168,169,170,171,189,190,191,192,193,194,195,196,197,198,199,201,202,203,204,206,207,208,209,210,211,212,213,214,215,216,217,218,219,220,221,222,223,224,225,226,227,228,229,230,231,232,233,234,235,236 >> >> ,237,238,239,240,241,242,244,245,246,247,248,249,250,251,252,253,254,256,257,258,259,260,261,263,264,265,266,267 >> >> underfull >> [362,361,352,327,359,356,417,340,403,306,304,309,318,328,334,381,399,401,404,414,280,293,297,383,393,294,312,411,277,355,371,285,300,347,365,394,398,409,412,415,302,342,323,402,278,281,339,351, >> >> 374,379,324,380,273,353,382,392,410,299,335,390,413,384,397,272,275,360,389,282,313,326,363,396,286,385,288,289,290,320,322,391,331,333,305,378,408,316,319,337,387,418,388,317,364,344,376,295,308,386,330,343,367,345,296,298,310,354,373,395,279,329,338,358,366,406,407,314,348,303,375,311,332,341,346,377,301,350,416, >> >> 274,284,321,372,287,292,307,325,336,400] >> 2019-12-20 10:05:06.268 7f91a9c86ac0 10 skipping overfull >> 2019-12-20 10:05:06.268 7f91a9c86ac0 10 failed to find any changes for >> overfull osds >> 2019-12-20 10:05:06.272 7f91a9c86ac0 10 will try dropping existing >> remapping pair 338 -> 359 which remapped 11.1c08 out from underfull >> osd.338 >> 2019-12-20 10:05:06.272 7f91a9c86ac0 10 existing pg_upmap_items >> [338,359] remapped 11.1c08 out from underfull osd.338, will try >> cancelling it entirely >> 2019-12-20 10:05:06.272 7f91a9c86ac0 10 stddev 158655 -> 158729 >> 2019-12-20 10:05:06.276 7f91a9c86ac0 10 skipping overfull >> 2019-12-20 10:05:06.276 7f91a9c86ac0 10 failed to find any changes for >> overfull osds >> 2019-12-20 10:05:06.280 7f91a9c86ac0 10 will try dropping existing >> remapping pair 338 -> 356 which remapped 11.3008 out from underfull >> osd.338 >> 2019-12-20 10:05:06.280 7f91a9c86ac0 10 existing pg_upmap_items >> [338,356] remapped 11.3008 out from underfull osd.338, will try >> cancelling it entirely >> 2019-12-20 10:05:06.280 7f91a9c86ac0 10 stddev 158655 -> 158725 >> 2019-12-20 10:05:06.280 7f91a9c86ac0 10 skipping overfull >> 2019-12-20 10:05:06.280 7f91a9c86ac0 10 failed to find any changes for >> overfull osds >> 2019-12-20 10:05:06.288 7f91a9c86ac0 10 will try dropping existing >> remapping pair 338 -> 352 which remapped 11.2593 out from underfull >> osd.338 >> 2019-12-20 10:05:06.288 7f91a9c86ac0 10 existing pg_upmap_items >> [338,352] remapped 11.2593 out from underfull osd.338, will try >> cancelling it entirely >> 2019-12-20 10:05:06.288 7f91a9c86ac0 10 stddev 158655 -> 158731 >> 2019-12-20 10:05:06.288 7f91a9c86ac0 10 skipping overfull >> 2019-12-20 10:05:06.288 7f91a9c86ac0 10 failed to find any changes for >> overfull osds >> 2019-12-20 10:05:06.292 7f91a9c86ac0 10 will try dropping existing >> remapping pair 338 -> 356 which remapped 11.216 out from underfull >> osd.338 >> 2019-12-20 10:05:06.292 7f91a9c86ac0 10 existing pg_upmap_items >> [338,356] remapped 11.216 out from underfull osd.338, will try >> cancelling it entirely >> 2019-12-20 10:05:06.292 7f91a9c86ac0 10 stddev 158655 -> 158725 >> 2019-12-20 10:05:06.296 7f91a9c86ac0 10 skipping overfull >> 2019-12-20 10:05:06.296 7f91a9c86ac0 10 failed to find any changes for >> overfull osds >> 2019-12-20 10:05:06.300 7f91a9c86ac0 10 will try dropping existing >> remapping pair 332 -> 356 which remapped 11.3cbf out from underfull >> osd.332 >> 2019-12-20 10:05:06.300 7f91a9c86ac0 10 existing pg_upmap_items >> [332,356] remapped 11.3cbf out from underfull osd.332, will try >> cancelling it entirely >> 2019-12-20 10:05:06.300 7f91a9c86ac0 10 stddev 158655 -> 158731 >> 2019-12-20 10:05:06.304 7f91a9c86ac0 10 skipping overfull >> 2019-12-20 10:05:06.304 7f91a9c86ac0 10 failed to find any changes for >> overfull osds >> 2019-12-20 10:05:06.308 7f91a9c86ac0 10 will try dropping existing >> remapping pair 332 -> 327 which remapped 11.1a66 out from underfull >> osd.332 >> 2019-12-20 10:05:06.308 7f91a9c86ac0 10 existing pg_upmap_items >> [332,327] remapped 11.1a66 out from underfull osd.332, will try >> cancelling it entirely >> 2019-12-20 10:05:06.308 7f91a9c86ac0 10 stddev 158655 -> 158735 >> 2019-12-20 10:05:06.312 7f91a9c86ac0 10 skipping overfull >> 2019-12-20 10:05:06.312 7f91a9c86ac0 10 failed to find any changes for >> overfull osds >> 2019-12-20 10:05:06.316 7f91a9c86ac0 10 will try dropping existing >> remapping pair 332 -> 359 which remapped 11.20b9 out from underfull >> osd.332 >> 2019-12-20 10:05:06.316 7f91a9c86ac0 10 existing pg_upmap_items >> [332,359] remapped 11.20b9 out from underfull osd.332, will try >> cancelling it entirely >> 2019-12-20 10:05:06.316 7f91a9c86ac0 10 stddev 158655 -> 158735 >> 2019-12-20 10:05:06.320 7f91a9c86ac0 10 skipping overfull >> 2019-12-20 10:05:06.320 7f91a9c86ac0 10 failed to find any changes for >> overfull osds >> 2019-12-20 10:05:06.324 7f91a9c86ac0 10 will try dropping existing >> remapping pair 332 -> 352 which remapped 11.847 out from underfull >> osd.332 >> 2019-12-20 10:05:06.324 7f91a9c86ac0 10 existing pg_upmap_items >> [332,352] remapped 11.847 out from underfull osd.332, will try >> cancelling it entirely >> 2019-12-20 10:05:06.324 7f91a9c86ac0 10 stddev 158655 -> 158737 >> 2019-12-20 10:05:06.328 7f91a9c86ac0 10 skipping overfull >> 2019-12-20 10:05:06.328 7f91a9c86ac0 10 failed to find any changes for >> overfull osds >> 2019-12-20 10:05:06.332 7f91a9c86ac0 10 will try dropping existing >> remapping pair 332 -> 352 which remapped 11.1847 out from underfull >> osd.332 >> 2019-12-20 10:05:06.332 7f91a9c86ac0 10 existing pg_upmap_items >> [332,352] remapped 11.1847 out from underfull osd.332, will try >> cancelling it entirely >> 2019-12-20 10:05:06.332 7f91a9c86ac0 10 stddev 158655 -> 158737 >> 2019-12-20 10:05:06.336 7f91a9c86ac0 10 skipping overfull >> 2019-12-20 10:05:06.336 7f91a9c86ac0 10 failed to find any changes for >> overfull osds >> 2019-12-20 10:05:06.340 7f91a9c86ac0 10 will try dropping existing >> remapping pair 332 -> 356 which remapped 11.25be out from underfull >> osd.332 >> 2019-12-20 10:05:06.340 7f91a9c86ac0 10 existing pg_upmap_items >> [332,356] remapped 11.25be out from underfull osd.332, will try >> cancelling it entirely >> 2019-12-20 10:05:06.340 7f91a9c86ac0 10 stddev 158655 -> 158731 >> 2019-12-20 10:05:06.344 7f91a9c86ac0 10 skipping overfull >> [...] >> 2019-12-20 10:05:07.032 7f91a9c86ac0 10 skipping overfull >> 2019-12-20 10:05:07.032 7f91a9c86ac0 10 failed to find any changes for >> overfull osds >> 2019-12-20 10:05:07.032 7f91a9c86ac0 10 will try dropping existing >> remapping pair 400 -> 393 which remapped 11.ce6 out from underfull >> osd.400 >> 2019-12-20 10:05:07.032 7f91a9c86ac0 10 existing pg_upmap_items >> [400,393] remapped 11.ce6 out from underfull osd.400, will try >> cancelling it entirely >> 2019-12-20 10:05:07.032 7f91a9c86ac0 10 stddev 158655 -> 158729 >> 2019-12-20 10:05:07.036 7f91a9c86ac0 10 skipping overfull >> 2019-12-20 10:05:07.036 7f91a9c86ac0 10 failed to find any changes for >> overfull osds >> 2019-12-20 10:05:07.040 7f91a9c86ac0 10 will try dropping existing >> remapping pair 400 -> 371 which remapped 11.18b6 out from underfull >> osd.400 >> 2019-12-20 10:05:07.040 7f91a9c86ac0 10 existing pg_upmap_items >> [400,371] remapped 11.18b6 out from underfull osd.400, will try >> cancelling it entirely >> 2019-12-20 10:05:07.040 7f91a9c86ac0 10 stddev 158655 -> 158725 >> 2019-12-20 10:05:07.044 7f91a9c86ac0 10 skipping overfull >> 2019-12-20 10:05:07.044 7f91a9c86ac0 10 failed to find any changes for >> overfull osds >> 2019-12-20 10:05:07.048 7f91a9c86ac0 10 will try dropping existing >> remapping pair 400 -> 371 which remapped 11.1d3e out from underfull >> osd.400 >> 2019-12-20 10:05:07.048 7f91a9c86ac0 10 existing pg_upmap_items >> [400,371] remapped 11.1d3e out from underfull osd.400, will try >> cancelling it entirely >> 2019-12-20 10:05:07.048 7f91a9c86ac0 10 stddev 158655 -> 158725 >> 2019-12-20 10:05:07.052 7f91a9c86ac0 10 skipping overfull >> 2019-12-20 10:05:07.052 7f91a9c86ac0 10 failed to find any changes for >> overfull osds >> 2019-12-20 10:05:07.056 7f91a9c86ac0 10 will try dropping existing >> remapping pair 400 -> 393 which remapped 11.2831 out from underfull >> osd.400 >> 2019-12-20 10:05:07.056 7f91a9c86ac0 10 existing pg_upmap_items >> [400,393] remapped 11.2831 out from underfull osd.400, will try >> cancelling it entirely >> 2019-12-20 10:05:07.056 7f91a9c86ac0 10 stddev 158655 -> 158729 >> 2019-12-20 10:05:07.060 7f91a9c86ac0 10 skipping overfull >> 2019-12-20 10:05:07.060 7f91a9c86ac0 10 failed to find any changes for >> overfull osds >> 2019-12-20 10:05:07.060 7f91a9c86ac0 10 will try dropping existing >> remapping pair 400 -> 371 which remapped 11.2e5e out from underfull >> osd.400 >> 2019-12-20 10:05:07.060 7f91a9c86ac0 10 existing pg_upmap_items >> [400,371] remapped 11.2e5e out from underfull osd.400, will try >> cancelling it entirely >> 2019-12-20 10:05:07.060 7f91a9c86ac0 10 stddev 158655 -> 158725 >> 2019-12-20 10:05:07.060 7f91a9c86ac0 10 hit local_fallback_retries 100 >> 2019-12-20 10:05:07.064 7f91a9c86ac0 10 num_changed = 0 >> no upmaps proposed >> >> Why is offline optimization failing? >> >> Regards >> Thomas >> >> Am 12.12.2019 um 01:34 schrieb David Zafman: >>> Thomas, >>> >>> I have a master branch version of the code to test. The nautilus >>> backport https://github.com/ceph/ceph/pull/31956 should be the same. >>> >>> Using your OSDMap, the code in master branch and some additional >>> changes to osdmaptool I was able to balance your cluster. The >>> osdmaptool changes simulate the mgr active balancer behavior. It >>> took 302 rounds with 10 maximum upmaps per crush rule set of pools per >>> round. With the default 1 minute sleeps inside the mgr it would take >>> about 5 hours. Obviously, recovery/backfill has to finish before the >>> cluster settles into the new configuration. It needed 3402 additional >>> upmaps. >>> >>> Because all pools for a given crush rule are balanced together you can >>> see that this is more balanced than Rich's configuration using >>> Luminous. The pool hdb_backup which has its own rule was the most >>> difficult to balance. >>> >>> This balancer code is subject to change before final release of the >>> next Nautilus point release. >>> >>> >>> Final layout: >>> >>> osd.0 pgs 33 >>> osd.1 pgs 31 >>> osd.2 pgs 34 >>> osd.3 pgs 33 >>> osd.4 pgs 31 >>> osd.5 pgs 31 >>> osd.6 pgs 32 >>> osd.7 pgs 31 >>> osd.8 pgs 264 >>> osd.9 pgs 28 >>> osd.10 pgs 29 >>> osd.11 pgs 28 >>> osd.12 pgs 263 >>> osd.13 pgs 27 >>> osd.14 pgs 27 >>> osd.15 pgs 27 >>> osd.16 pgs 262 >>> osd.17 pgs 27 >>> osd.18 pgs 27 >>> osd.19 pgs 262 >>> osd.20 pgs 28 >>> osd.21 pgs 27 >>> osd.22 pgs 28 >>> osd.23 pgs 29 >>> osd.24 pgs 29 >>> osd.25 pgs 28 >>> osd.26 pgs 263 >>> osd.27 pgs 28 >>> osd.28 pgs 28 >>> osd.29 pgs 27 >>> osd.30 pgs 262 >>> osd.31 pgs 86 >>> osd.32 pgs 86 >>> osd.33 pgs 86 >>> osd.34 pgs 86 >>> osd.35 pgs 87 >>> osd.36 pgs 86 >>> osd.37 pgs 86 >>> osd.38 pgs 86 >>> osd.39 pgs 86 >>> osd.40 pgs 86 >>> osd.41 pgs 86 >>> osd.42 pgs 49 >>> osd.43 pgs 62 >>> osd.44 pgs 62 >>> osd.45 pgs 56 >>> osd.46 pgs 49 >>> osd.47 pgs 56 >>> osd.48 pgs 56 >>> osd.49 pgs 56 >>> osd.50 pgs 49 >>> osd.51 pgs 62 >>> osd.52 pgs 56 >>> osd.53 pgs 43 >>> osd.54 pgs 55 >>> osd.55 pgs 56 >>> osd.56 pgs 49 >>> osd.57 pgs 49 >>> osd.58 pgs 49 >>> osd.59 pgs 86 >>> osd.60 pgs 86 >>> osd.61 pgs 86 >>> osd.62 pgs 86 >>> osd.63 pgs 86 >>> osd.64 pgs 87 >>> osd.65 pgs 86 >>> osd.66 pgs 87 >>> osd.67 pgs 87 >>> osd.68 pgs 87 >>> osd.69 pgs 86 >>> osd.70 pgs 86 >>> osd.71 pgs 86 >>> osd.72 pgs 86 >>> osd.73 pgs 87 >>> osd.74 pgs 87 >>> osd.75 pgs 86 >>> osd.76 pgs 49 >>> osd.77 pgs 49 >>> osd.78 pgs 55 >>> >>> osd.79 pgs 49 >>> osd.80 pgs 62 >>> osd.81 pgs 62 >>> osd.82 pgs 62 >>> osd.83 pgs 49 >>> osd.84 pgs 56 >>> osd.85 pgs 61 >>> osd.86 pgs 49 >>> osd.87 pgs 61 >>> osd.88 pgs 62 >>> osd.89 pgs 43 >>> osd.90 pgs 49 >>> osd.91 pgs 55 >>> osd.92 pgs 62 >>> osd.93 pgs 61 >>> osd.94 pgs 55 >>> osd.95 pgs 56 >>> osd.96 pgs 49 >>> osd.97 pgs 43 >>> osd.98 pgs 49 >>> osd.99 pgs 56 >>> osd.100 pgs 43 >>> osd.101 pgs 49 >>> osd.102 pgs 43 >>> osd.103 pgs 55 >>> osd.104 pgs 43 >>> osd.105 pgs 43 >>> osd.106 pgs 62 >>> osd.107 pgs 49 >>> osd.108 pgs 62 >>> osd.109 pgs 62 >>> osd.110 pgs 62 >>> osd.111 pgs 62 >>> osd.112 pgs 49 >>> osd.113 pgs 49 >>> osd.114 pgs 49 >>> osd.115 pgs 49 >>> osd.116 pgs 62 >>> osd.117 pgs 56 >>> osd.118 pgs 55 >>> osd.119 pgs 49 >>> osd.120 pgs 43 >>> osd.121 pgs 55 >>> osd.122 pgs 31 >>> osd.123 pgs 56 >>> osd.124 pgs 62 >>> osd.125 pgs 62 >>> osd.126 pgs 62 >>> osd.127 pgs 49 >>> osd.128 pgs 49 >>> osd.129 pgs 56 >>> osd.130 pgs 61 >>> osd.131 pgs 55 >>> osd.132 pgs 55 >>> osd.133 pgs 55 >>> osd.134 pgs 49 >>> osd.135 pgs 55 >>> osd.136 pgs 55 >>> osd.137 pgs 43 >>> osd.138 pgs 55 >>> osd.139 pgs 55 >>> osd.140 pgs 49 >>> osd.141 pgs 43 >>> osd.142 pgs 55 >>> osd.143 pgs 55 >>> osd.144 pgs 55 >>> osd.145 pgs 55 >>> osd.146 pgs 55 >>> osd.147 pgs 62 >>> osd.148 pgs 55 >>> osd.149 pgs 62 >>> osd.150 pgs 49 >>> osd.151 pgs 55 >>> osd.152 pgs 55 >>> osd.153 pgs 49 >>> osd.154 pgs 49 >>> osd.155 pgs 55 >>> osd.156 pgs 43 >>> osd.157 pgs 49 >>> >>> osd.157 pgs 49 >>> osd.158 pgs 62 >>> osd.159 pgs 49 >>> osd.160 pgs 55 >>> osd.161 pgs 49 >>> osd.162 pgs 62 >>> osd.163 pgs 49 >>> osd.164 pgs 55 >>> osd.165 pgs 62 >>> osd.166 pgs 49 >>> osd.167 pgs 43 >>> osd.168 pgs 49 >>> osd.169 pgs 61 >>> osd.170 pgs 62 >>> osd.171 pgs 55 >>> osd.172 pgs 87 >>> osd.173 pgs 87 >>> osd.174 pgs 87 >>> osd.175 pgs 87 >>> osd.176 pgs 87 >>> osd.177 pgs 86 >>> osd.178 pgs 86 >>> osd.179 pgs 87 >>> osd.180 pgs 86 >>> osd.181 pgs 86 >>> osd.182 pgs 87 >>> osd.183 pgs 87 >>> osd.184 pgs 86 >>> osd.185 pgs 86 >>> osd.186 pgs 87 >>> osd.187 pgs 86 >>> osd.188 pgs 87 >>> osd.189 pgs 43 >>> osd.190 pgs 49 >>> osd.191 pgs 55 >>> osd.192 pgs 62 >>> osd.193 pgs 55 >>> osd.194 pgs 43 >>> osd.195 pgs 62 >>> osd.196 pgs 43 >>> osd.197 pgs 49 >>> osd.198 pgs 62 >>> osd.199 pgs 55 >>> osd.200 pgs 37 >>> osd.201 pgs 55 >>> osd.202 pgs 49 >>> osd.203 pgs 49 >>> osd.204 pgs 62 >>> osd.205 pgs 62 >>> osd.206 pgs 55 >>> osd.207 pgs 49 >>> osd.208 pgs 43 >>> osd.209 pgs 43 >>> osd.210 pgs 43 >>> osd.211 pgs 49 >>> osd.212 pgs 49 >>> osd.213 pgs 49 >>> osd.214 pgs 55 >>> osd.215 pgs 43 >>> osd.216 pgs 49 >>> osd.217 pgs 49 >>> osd.218 pgs 55 >>> osd.219 pgs 62 >>> osd.220 pgs 49 >>> osd.221 pgs 55 >>> osd.222 pgs 49 >>> osd.223 pgs 55 >>> osd.224 pgs 49 >>> osd.225 pgs 55 >>> osd.226 pgs 49 >>> osd.227 pgs 55 >>> osd.228 pgs 62 >>> osd.229 pgs 62 >>> osd.230 pgs 37 >>> osd.231 pgs 55 >>> osd.232 pgs 62 >>> osd.233 pgs 55 >>> osd.234 pgs 55 >>> osd.235 pgs 62 >>> >>> osd.236 pgs 55 >>> osd.237 pgs 62 >>> osd.238 pgs 61 >>> osd.239 pgs 37 >>> osd.240 pgs 62 >>> osd.241 pgs 62 >>> osd.242 pgs 61 >>> osd.243 pgs 62 >>> osd.244 pgs 62 >>> osd.245 pgs 62 >>> osd.246 pgs 62 >>> osd.247 pgs 55 >>> osd.248 pgs 62 >>> osd.249 pgs 49 >>> osd.250 pgs 61 >>> osd.251 pgs 49 >>> osd.252 pgs 43 >>> osd.253 pgs 55 >>> osd.254 pgs 49 >>> osd.255 pgs 55 >>> osd.256 pgs 43 >>> osd.257 pgs 55 >>> osd.258 pgs 62 >>> osd.259 pgs 61 >>> osd.260 pgs 55 >>> osd.261 pgs 43 >>> osd.262 pgs 43 >>> osd.263 pgs 49 >>> osd.264 pgs 49 >>> osd.265 pgs 62 >>> osd.266 pgs 49 >>> osd.267 pgs 62 >>> osd.268 pgs 87 >>> osd.269 pgs 86 >>> osd.270 pgs 87 >>> osd.271 pgs 86 >>> osd.272 pgs 270 >>> osd.273 pgs 271 >>> osd.274 pgs 270 >>> osd.275 pgs 270 >>> osd.276 pgs 270 >>> osd.277 pgs 270 >>> osd.278 pgs 270 >>> osd.279 pgs 270 >>> osd.280 pgs 270 >>> osd.281 pgs 270 >>> osd.282 pgs 270 >>> osd.283 pgs 271 >>> osd.284 pgs 270 >>> osd.285 pgs 271 >>> osd.286 pgs 270 >>> osd.287 pgs 270 >>> osd.288 pgs 270 >>> osd.289 pgs 270 >>> osd.290 pgs 270 >>> osd.291 pgs 270 >>> osd.292 pgs 270 >>> osd.293 pgs 270 >>> osd.294 pgs 270 >>> osd.295 pgs 270 >>> osd.296 pgs 270 >>> osd.297 pgs 270 >>> osd.298 pgs 270 >>> osd.299 pgs 270 >>> osd.300 pgs 270 >>> osd.301 pgs 270 >>> osd.302 pgs 270 >>> osd.303 pgs 270 >>> osd.304 pgs 270 >>> osd.305 pgs 270 >>> osd.306 pgs 270 >>> osd.307 pgs 270 >>> osd.308 pgs 270 >>> osd.309 pgs 270 >>> osd.310 pgs 270 >>> osd.311 pgs 270 >>> osd.312 pgs 270 >>> osd.313 pgs 270 >>> >>> osd.314 pgs 270 >>> osd.315 pgs 270 >>> osd.316 pgs 270 >>> osd.317 pgs 270 >>> osd.318 pgs 270 >>> osd.319 pgs 270 >>> osd.320 pgs 271 >>> osd.321 pgs 271 >>> osd.322 pgs 271 >>> osd.323 pgs 271 >>> osd.324 pgs 271 >>> osd.325 pgs 270 >>> osd.326 pgs 270 >>> osd.327 pgs 270 >>> osd.328 pgs 270 >>> osd.329 pgs 270 >>> osd.330 pgs 270 >>> osd.331 pgs 270 >>> osd.332 pgs 271 >>> osd.333 pgs 270 >>> osd.334 pgs 271 >>> osd.335 pgs 270 >>> osd.336 pgs 270 >>> osd.337 pgs 271 >>> osd.338 pgs 271 >>> osd.339 pgs 270 >>> osd.340 pgs 270 >>> osd.341 pgs 270 >>> osd.342 pgs 270 >>> osd.343 pgs 270 >>> osd.344 pgs 270 >>> osd.345 pgs 271 >>> osd.346 pgs 270 >>> osd.347 pgs 271 >>> osd.348 pgs 270 >>> osd.349 pgs 270 >>> osd.350 pgs 270 >>> osd.351 pgs 270 >>> osd.352 pgs 270 >>> osd.353 pgs 270 >>> osd.354 pgs 270 >>> osd.355 pgs 270 >>> osd.356 pgs 270 >>> osd.357 pgs 270 >>> osd.358 pgs 270 >>> osd.359 pgs 270 >>> osd.360 pgs 270 >>> osd.361 pgs 270 >>> osd.362 pgs 270 >>> osd.363 pgs 270 >>> osd.364 pgs 270 >>> osd.365 pgs 270 >>> osd.366 pgs 270 >>> osd.367 pgs 270 >>> osd.368 pgs 86 >>> osd.369 pgs 86 >>> osd.370 pgs 87 >>> osd.371 pgs 270 >>> osd.372 pgs 270 >>> osd.373 pgs 270 >>> osd.374 pgs 270 >>> osd.375 pgs 270 >>> osd.376 pgs 270 >>> osd.377 pgs 270 >>> osd.378 pgs 270 >>> osd.379 pgs 270 >>> osd.380 pgs 270 >>> osd.381 pgs 270 >>> osd.382 pgs 270 >>> osd.383 pgs 270 >>> osd.384 pgs 271 >>> osd.385 pgs 270 >>> osd.386 pgs 270 >>> osd.387 pgs 270 >>> osd.388 pgs 270 >>> osd.389 pgs 270 >>> osd.390 pgs 270 >>> osd.391 pgs 270 >>> >>> osd.392 pgs 270 >>> osd.393 pgs 270 >>> osd.394 pgs 270 >>> osd.395 pgs 270 >>> osd.396 pgs 270 >>> osd.397 pgs 270 >>> osd.398 pgs 270 >>> osd.399 pgs 270 >>> osd.400 pgs 270 >>> osd.401 pgs 270 >>> osd.402 pgs 270 >>> osd.403 pgs 270 >>> osd.404 pgs 270 >>> osd.405 pgs 270 >>> osd.406 pgs 271 >>> osd.407 pgs 270 >>> osd.408 pgs 270 >>> osd.409 pgs 270 >>> osd.410 pgs 270 >>> osd.411 pgs 270 >>> osd.412 pgs 270 >>> osd.413 pgs 270 >>> osd.414 pgs 270 >>> osd.415 pgs 270 >>> osd.416 pgs 270 >>> osd.417 pgs 270 >>> osd.418 pgs 270 >>> osd.419 pgs 87 >>> osd.420 pgs 87 >>> osd.421 pgs 86 >>> osd.422 pgs 86 >>> osd.423 pgs 86 >>> osd.424 pgs 86 >>> osd.425 pgs 86 >>> osd.426 pgs 86 >>> osd.427 pgs 86 >>> osd.428 pgs 86 >>> osd.429 pgs 86 >>> osd.430 pgs 86 >>> osd.431 pgs 86 >>> osd.432 pgs 86 >>> osd.433 pgs 86 >>> osd.434 pgs 86 >>> osd.435 pgs 58 >>> osd.436 pgs 58 >>> osd.437 pgs 58 >>> osd.438 pgs 58 >>> osd.439 pgs 58 >>> osd.440 pgs 58 >>> osd.441 pgs 58 >>> >>> >>> David >>> >>> On 12/11/19 6:12 AM, Thomas Schneider wrote: >>>> Hello David, >>>> >>>> I'm experiencing issues with OSD balancing, too. >>>> My ceph cluster is running on release >>>> ceph version 14.2.4.1 (596a387fb278758406deabf997735a1f706660c9) >>>> nautilus (stable) >>>> >>>> Would you be able to test (the latest code) on my OSDmap and verify if >>>> balancing would work? >>>> I have attached it to this email. >>>> >>>> Regards >>>> Thomas >>>> >>>> >> >> >> >> > _______________________________________________ ceph-users mailing list -- ceph-users@xxxxxxx To unsubscribe send an email to ceph-users-leave@xxxxxxx
 |