I tryed with: ceph osd crush tunables default ceph osd crush tunables argonaut while the command runs without error, I still get the feature set mismatch error whe I try to mount do I have to restart some service? Andi > -----Original Message----- > From: Gregory Farnum [mailto:greg@xxxxxxxxxxx] > Sent: Donnerstag, 31. Oktober 2013 18:07 > To: Fuchs, Andreas (SwissTXT) > Cc: Karan Singh; ceph-users@xxxxxxxxxxxxxx > Subject: Re: rbd on ubuntu 12.04 LTS > > Well, looking at that doc page, with kernel 3.8 you can't use the newest set > so you should set your profile to "argonaut" (the old ones). Or if you're > feeling ambitious I believe you can turn on CRUSH_TUNABLES without > CRUSH_TUNABLES2 by manually editing and injecting the CRUSH map (I > haven't done this myself). > Keep in mind that this is changing the data placement algorithm slightly, so > it will result in data movement when you do this. > -Greg > Software Engineer #42 @ http://inktank.com | http://ceph.com > > On Thu, Oct 31, 2013 at 9:35 AM, Fuchs, Andreas (SwissTXT) > <Andreas.Fuchs@xxxxxxxxxxx> wrote: > > Ok i halfway understand this. > > > > > > > > So I can either upgrade to a kernel version v3.9 or later > > > > Or > > > > Change the crushmap with ceph osd crush tunables {PROFILE} > > > > To a new profile. > > > > > > > > But to which profile do I have to change so that my ubuntu client is > > supported? > > > > > > > > Andi > > > > > > > > From: Gregory Farnum [mailto:greg@xxxxxxxxxxx] > > Sent: Donnerstag, 31. Oktober 2013 17:27 > > > > > > To: Fuchs, Andreas (SwissTXT) > > Cc: Karan Singh; ceph-users@xxxxxxxxxxxxxx > > Subject: Re: rbd on ubuntu 12.04 LTS > > > > > > > > Yeah, depending in what version of Ceph you deployed that could be it > > exactly. We were a little more aggressive than we should have been in > > pushing them out. See: > > > > http://ceph.com/docs/master/rados/operations/crush-map/#tunables > > > > -Greg > > > > On Thursday, October 31, 2013, Fuchs, Andreas (SwissTXT) wrote: > > > > Hmm i have a pretty much default install with ceph-deploy, the crusmap > > is untouched. > > Btw I get similar errormessages when trying to mount cephfs > > > > mount -t ceph ceph01:6789:/ /mnt/backupCephfs -o > > name=admin,secretfile=admin.secret > > > > tail syslog > > Oct 31 17:14:27 ceph00 kernel: [103642.162813] libceph: mon0 > > 10.100.214.11:6789 feature set mismatch, my 4008a < server's 4004008a, > > missing 40000000 Oct 31 17:14:27 ceph00 kernel: [103642.162937] > > libceph: mon0 > > 10.100.214.11:6789 socket error on read Oct 31 17:14:36 ceph00 kernel: > > [103651.151655] libceph: mon0 > > 10.100.214.11:6789 feature set mismatch, my 4008a < server's 4004008a, > > missing 40000000 Oct 31 17:14:36 ceph00 kernel: [103651.151761] > > libceph: mon0 > > 10.100.214.11:6789 socket error on read Oct 31 17:14:46 ceph00 kernel: > > [103661.142229] libceph: mon0 > > 10.100.214.11:6789 feature set mismatch, my 4008a < server's 4004008a, > > missing 40000000 Oct 31 17:14:46 ceph00 kernel: [103661.142334] > > libceph: mon0 > > 10.100.214.11:6789 socket error on read > > > > > > The client is Ubuntu 12.04 LTS > > The OSD nodes are CentOS 6.4 kernel 3.8.0-32-generic > > > > Might this be an issue? > > > >> -----Original Message----- > >> From: Gregory Farnum [mailto:greg@xxxxxxxxxxx] > >> Sent: Mittwoch, 30. Oktober 2013 23:57 > >> To: Fuchs, Andreas (SwissTXT) > >> Cc: Karan Singh; ceph-users@xxxxxxxxxxxxxx > >> Subject: Re: rbd on ubuntu 12.04 LTS > >> > >> You've enabled some feature on your cluster which is not supported by > >> that kernel client. It's probably the crush tunables (you can find > >> info on them in the docs). > >> -Greg > >> Software Engineer #42 @ http://inktank.com | http://ceph.com > >> > >> > >> On Wed, Oct 30, 2013 at 3:59 AM, Fuchs, Andreas (SwissTXT) > >> <Andreas.Fuchs@xxxxxxxxxxx> wrote: > >> > I think keyring is fine, as i can run other commands like: > >> > > >> > > >> > > >> > rbd ls --pool rbd --name client.admin > >> > > >> > archiveadmin > >> > > >> > > >> > > >> > and was able to create the image > >> > > >> > > >> > > >> > rbd info archiveadmin --pool rbd --name client.admin > >> > > >> > rbd image 'archiveadmin': > >> > > >> > size 4096 MB in 1024 objects > >> > > >> > order 22 (4096 KB objects) > >> > > >> > block_name_prefix: rb.0.2c68.2ae8944a > >> > > >> > format: 1 > >> > > >> > > >> > > >> > From: Karan Singh [mailto:ksingh@xxxxxx] > >> > Sent: Mittwoch, 30. Oktober 2013 10:57 > >> > To: Fuchs, Andreas (SwissTXT) > >> > Cc: ceph-users@xxxxxxxxxxxxxx > >> > Subject: Re: rbd on ubuntu 12.04 LTS > >> > > >> > > >> > > >> > Andi > >> > > >> > > >> > > >> > Dont know much about but checking on keyrings side will give you > >> > more information. Socket read problem usually caused by keyrings. > >> > > >> > > >> > > >> > Regards > >> > > >> > Karan > >> > > >> > > >> > > >> > > >> > > >> > ________________________________ > >> > > >> > From: "Andreas Fuchs (SwissTXT)" <Andreas.Fuchs@xxxxxxxxxxx> > >> > To: ceph-users@xxxxxxxxxxxxxx > >> > Sent: Wednesday, 30 October, 2013 11:53:23 AM > >> > Subject: rbd on ubuntu 12.04 LTS > >> > > >> > > >> > > >> > Hi > >> > > >> > > >> > > >> > Im trying to mount a ceph rdb on a ubuntu 12.04 LTS with kernel > >> > 3.8.0 > >> > > >> > > >> > > >> > While our ceph cluster is healty running on 0.67.4 I'm not able to > >> > map the rbd device > >> > > >> > > >> > > >> > The command: > >> > > >> > rbd map archiveadmin --pool rbd --name client.admin > >> > --log-to-stderr > >> > > >> > rbd: add failed: (5) Input/output error > >> > > >> > > >> > > >> > In syslog: > >> > > >> > Oct 30 10:48:13 ceph00 kernel: [ 135.945476] Key type ceph > >> > registered > >> > > >> > Oct 30 10:48:13 ceph00 kernel: [ 135.945483] libceph: loaded > >> > (mon/osd proto 15/24, osdmap 5/6 5/6) > >> > > >> > Oct 30 10:48:13 ceph00 kernel: [ 135.954829] rbd: loaded rbd > >> > (rados block > >> > device) > >> > > >> > Oct 30 10:48:13 ceph00 kernel: [ 135.956200] libceph: mon0 > >> > 10.100.214.11:6789 feature set mismatch, my 40002 < server's > >> > 40040002, missing 40000000 > >> > > >> > Oct 30 10:48:13 ceph00 kernel: [ 135.956400] libceph: mon0 > >> > 10.100.214.11:6789 socket error on read > >> > > >> > > >> > > >> > Where does this mismatch come from? I thought I have upgrade all > >> > ceph packets everywhere to 0.67.4, or is the kernel too old? > >> > > >> > > >> > > >> > Regards > >> > > >> > Andi > >> > > >> > > >> > _______________________________________________ > > > > > > > > -- > > Software Engineer #42 @ http://inktank.com | http://ceph.com _______________________________________________ ceph-users mailing list ceph-users@xxxxxxxxxxxxxx http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
 |