On Fri, 5 Dec 2014, Antonio Messina wrote:
> On Fri, Dec 5, 2014 at 4:59 PM, Sage Weil <sage@xxxxxxxxxxxx> wrote:
> > On Fri, 5 Dec 2014, Antonio Messina wrote:
> >> On Fri, Dec 5, 2014 at 2:24 AM, Anthony Alba <ascanio.alba7@xxxxxxxxx> wrote:
> >> > Hi Cephers,
> >> >
> >> > Have anyone of you decided to put Giant into production instead of Firefly?
> >>
> >> This is very interesting to me too: we are going to deploy a large
> >> ceph cluster on Ubuntu 14.04 LTS, and so far what I have found is that
> >> the rbd module in Ubuntu Trusty doesn't seem compatible with giant:
> >>
> >> feature set mismatch, my 4a042a42 < server's 2104a042a42, missing
> >> 21000000000
> >
> > Can you attach the output of
> >
>
> I modified the crushmap and set:
>
> tunable chooseleaf_vary_r 0
>
> (it was 1 before)
> Now the cluster is rebalancing, and since it's on crappy hardware is
> taking some time.
>
> I'm pasting the output of the two commands, but please keep in mind
> that this is the output *after* I've updated the "chooseleaf_vary_r"
> tunable.
>
> > ceph osd crush show-tunables -f json-pretty
>
> { "choose_local_tries": 0,
> "choose_local_fallback_tries": 0,
> "choose_total_tries": 50,
> "chooseleaf_descend_once": 1,
> "profile": "bobtail",
> "optimal_tunables": 0,
> "legacy_tunables": 0,
> "require_feature_tunables": 1,
> "require_feature_tunables2": 1,
> "require_feature_tunables3": 0,
> "has_v2_rules": 1,
> "has_v3_rules": 0}
The v2 rule means you have a crush rule for erasure coding. Do you have
an EC pool in your cluster?
The tunables3 feature bit is set because you set the vary_r parameter.
If you want older kernels to talk to the cluster, you need to avoid the
new tunables and features!
sage
>
> > ceph osd crush dump -f json-pretty
>
> I'm attaching it as a text file, as it is quite big and unreadable.
> However, from the output I see the following tunables:
>
> "tunables": { "choose_local_tries": 0,
> "choose_local_fallback_tries": 0,
> "choose_total_tries": 50,
> "chooseleaf_descend_once": 1,
> "profile": "bobtail",
> "optimal_tunables": 0,
> "legacy_tunables": 0,
> "require_feature_tunables": 1,
> "require_feature_tunables2": 1,
> "require_feature_tunables3": 0,
> "has_v2_rules": 1,
> "has_v3_rules": 0}}
>
> .a.
>
> --
> antonio.messina@xxxxxxxxxxx +41 (0)44 635 42 22
> antonio.s.messina@xxxxxxxxx
> S3IT: Service and Support for Science IT http://www.s3it.uzh.ch/
> University of Zurich
> Winterthurerstrasse 190
> CH-8057 Zurich Switzerland
>
_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
