Hi Greogory Found the solution to my mounting problem today. You where right the error message: libceph: mon0 10.100.214.11:6789 feature set mismatch, my 4008a < server's 4004008a, missing 40000000 Comes from wrong haspspool settings. The correct command to clear this flag is: ceph osd pool set cephPool01 hashpspool false And has to be set an ALL pools, not just the data pool. Many thanks for your help Andi > -----Original Message----- > From: Gregory Farnum [mailto:greg@xxxxxxxxxxx] > Sent: Donnerstag, 7. November 2013 06:24 > To: Fuchs, Andreas (SwissTXT); Joao Luis > Cc: ceph-users@xxxxxxxxxxxxxx > Subject: Re: rbd on ubuntu 12.04 LTS > > How interesting; it looks like that command was added post-dumpling and > not backported. It's probably suitable for backport; I've also created a ticket > to create docs for this (http://tracker.ceph.com/issues/6731). Did you create > this cluster on an older development release? That should be the only way > for the option to have been enabled without you setting it explicitly. > (I'm just following what the release notes at > http://ceph.com/docs/master/release-notes say about hashpspool). > -Greg > > On Tue, Nov 5, 2013 at 1:32 AM, Fuchs, Andreas (SwissTXT) > <Andreas.Fuchs@xxxxxxxxxxx> wrote: > > The command you recomend doesnt work, also I cannot find something in > the command reference how to do it. > > > > How can the settings be verified? > > Ceph osd dump does not show any flags: > > pool 2 'rbd' rep size 2 min_size 1 crush_ruleset 2 object_hash > > rjenkins pg_num 64 pgp_num 64 last_change 1 owner 0 > > > > also I cannot find something in the current running crushmap: > > rule rbd { > > ruleset 2 > > type replicated > > min_size 1 > > max_size 10 > > step take default > > step chooseleaf firstn 0 type host > > step emit > > } > > > > I'm I really looking in the right direction? > > > > > > > >> -----Original Message----- > >> From: Gregory Farnum [mailto:greg@xxxxxxxxxxx] > >> Sent: Montag, 4. November 2013 19:17 > >> To: Fuchs, Andreas (SwissTXT) > >> Cc: Karan Singh; ceph-users@xxxxxxxxxxxxxx > >> Subject: Re: rbd on ubuntu 12.04 LTS > >> > >> On Mon, Nov 4, 2013 at 12:13 AM, Fuchs, Andreas (SwissTXT) > >> <Andreas.Fuchs@xxxxxxxxxxx> wrote: > >> > I tryed with: > >> > ceph osd crush tunables default > >> > ceph osd crush tunables argonaut > >> > > >> > while the command runs without error, I still get the feature set > >> > mismatch error whe I try to mount do I have to restart some service? > >> > >> Ah, looking more closely it seems the feature mismatch you're getting > >> is actually the "HASHPSPOOL" feature bit. I don't think that should > >> have been enabled on Dumpling, but you can unset it on a pool basis > >> ("ceph osd pool unset <foo> hashpspool", I believe). I don't think > >> you'll need to restart anything, but it's possible. > >> -Greg > >> Software Engineer #42 @ http://inktank.com | http://ceph.com _______________________________________________ ceph-users mailing list ceph-users@xxxxxxxxxxxxxx http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com