On Fri, Dec 5, 2014 at 4:59 PM, Sage Weil <sage@xxxxxxxxxxxx> wrote: > On Fri, 5 Dec 2014, Antonio Messina wrote: >> On Fri, Dec 5, 2014 at 2:24 AM, Anthony Alba <ascanio.alba7@xxxxxxxxx> wrote: >> > Hi Cephers, >> > >> > Have anyone of you decided to put Giant into production instead of Firefly? >> >> This is very interesting to me too: we are going to deploy a large >> ceph cluster on Ubuntu 14.04 LTS, and so far what I have found is that >> the rbd module in Ubuntu Trusty doesn't seem compatible with giant: >> >> feature set mismatch, my 4a042a42 < server's 2104a042a42, missing >> 21000000000 > > Can you attach the output of > I modified the crushmap and set: tunable chooseleaf_vary_r 0 (it was 1 before) Now the cluster is rebalancing, and since it's on crappy hardware is taking some time. I'm pasting the output of the two commands, but please keep in mind that this is the output *after* I've updated the "chooseleaf_vary_r" tunable. > ceph osd crush show-tunables -f json-pretty { "choose_local_tries": 0, "choose_local_fallback_tries": 0, "choose_total_tries": 50, "chooseleaf_descend_once": 1, "profile": "bobtail", "optimal_tunables": 0, "legacy_tunables": 0, "require_feature_tunables": 1, "require_feature_tunables2": 1, "require_feature_tunables3": 0, "has_v2_rules": 1, "has_v3_rules": 0} > ceph osd crush dump -f json-pretty I'm attaching it as a text file, as it is quite big and unreadable. However, from the output I see the following tunables: "tunables": { "choose_local_tries": 0, "choose_local_fallback_tries": 0, "choose_total_tries": 50, "chooseleaf_descend_once": 1, "profile": "bobtail", "optimal_tunables": 0, "legacy_tunables": 0, "require_feature_tunables": 1, "require_feature_tunables2": 1, "require_feature_tunables3": 0, "has_v2_rules": 1, "has_v3_rules": 0}} .a. -- antonio.messina@xxxxxxxxxxx +41 (0)44 635 42 22 antonio.s.messina@xxxxxxxxx S3IT: Service and Support for Science IT http://www.s3it.uzh.ch/ University of Zurich Winterthurerstrasse 190 CH-8057 Zurich Switzerland
Attachment:
crushmap.json
Description: application/json
_______________________________________________ ceph-users mailing list ceph-users@xxxxxxxxxxxxxx http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com