Hi all, just an update After setting "chooseleaf_vary_r" to 0 _and_ removing an pool with erasure coding, I was able to run rbd map. Thank you all for the help .a. On Fri, Dec 5, 2014 at 5:07 PM, Antonio Messina <antonio.messina@xxxxxxxxxxx> wrote: > On Fri, Dec 5, 2014 at 4:59 PM, Sage Weil <sage@xxxxxxxxxxxx> wrote: >> On Fri, 5 Dec 2014, Antonio Messina wrote: >>> On Fri, Dec 5, 2014 at 2:24 AM, Anthony Alba <ascanio.alba7@xxxxxxxxx> wrote: >>> > Hi Cephers, >>> > >>> > Have anyone of you decided to put Giant into production instead of Firefly? >>> >>> This is very interesting to me too: we are going to deploy a large >>> ceph cluster on Ubuntu 14.04 LTS, and so far what I have found is that >>> the rbd module in Ubuntu Trusty doesn't seem compatible with giant: >>> >>> feature set mismatch, my 4a042a42 < server's 2104a042a42, missing >>> 21000000000 >> >> Can you attach the output of >> > > I modified the crushmap and set: > > tunable chooseleaf_vary_r 0 > > (it was 1 before) > Now the cluster is rebalancing, and since it's on crappy hardware is > taking some time. > > I'm pasting the output of the two commands, but please keep in mind > that this is the output *after* I've updated the "chooseleaf_vary_r" > tunable. > >> ceph osd crush show-tunables -f json-pretty > > { "choose_local_tries": 0, > "choose_local_fallback_tries": 0, > "choose_total_tries": 50, > "chooseleaf_descend_once": 1, > "profile": "bobtail", > "optimal_tunables": 0, > "legacy_tunables": 0, > "require_feature_tunables": 1, > "require_feature_tunables2": 1, > "require_feature_tunables3": 0, > "has_v2_rules": 1, > "has_v3_rules": 0} > >> ceph osd crush dump -f json-pretty > > I'm attaching it as a text file, as it is quite big and unreadable. > However, from the output I see the following tunables: > > "tunables": { "choose_local_tries": 0, > "choose_local_fallback_tries": 0, > "choose_total_tries": 50, > "chooseleaf_descend_once": 1, > "profile": "bobtail", > "optimal_tunables": 0, > "legacy_tunables": 0, > "require_feature_tunables": 1, > "require_feature_tunables2": 1, > "require_feature_tunables3": 0, > "has_v2_rules": 1, > "has_v3_rules": 0}} > > .a. > > -- > antonio.messina@xxxxxxxxxxx +41 (0)44 635 42 22 > antonio.s.messina@xxxxxxxxx > S3IT: Service and Support for Science IT http://www.s3it.uzh.ch/ > University of Zurich > Winterthurerstrasse 190 > CH-8057 Zurich Switzerland -- antonio.messina@xxxxxxxxxxx +41 (0)44 635 42 22 antonio.s.messina@xxxxxxxxx S3IT: Service and Support for Science IT http://www.s3it.uzh.ch/ University of Zurich Winterthurerstrasse 190 CH-8057 Zurich Switzerland _______________________________________________ ceph-users mailing list ceph-users@xxxxxxxxxxxxxx http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com