Well, looking at that doc page, with kernel 3.8 you can't use the newest set so you should set your profile to "argonaut" (the old ones). Or if you're feeling ambitious I believe you can turn on CRUSH_TUNABLES without CRUSH_TUNABLES2 by manually editing and injecting the CRUSH map (I haven't done this myself). Keep in mind that this is changing the data placement algorithm slightly, so it will result in data movement when you do this. -Greg Software Engineer #42 @ http://inktank.com | http://ceph.com On Thu, Oct 31, 2013 at 9:35 AM, Fuchs, Andreas (SwissTXT) <Andreas.Fuchs@xxxxxxxxxxx> wrote: > Ok i halfway understand this. > > > > So I can either upgrade to a kernel version v3.9 or later > > Or > > Change the crushmap with ceph osd crush tunables {PROFILE} > > To a new profile. > > > > But to which profile do I have to change so that my ubuntu client is > supported? > > > > Andi > > > > From: Gregory Farnum [mailto:greg@xxxxxxxxxxx] > Sent: Donnerstag, 31. Oktober 2013 17:27 > > > To: Fuchs, Andreas (SwissTXT) > Cc: Karan Singh; ceph-users@xxxxxxxxxxxxxx > Subject: Re: rbd on ubuntu 12.04 LTS > > > > Yeah, depending in what version of Ceph you deployed that could be it > exactly. We were a little more aggressive than we should have been in > pushing them out. See: > > http://ceph.com/docs/master/rados/operations/crush-map/#tunables > > -Greg > > On Thursday, October 31, 2013, Fuchs, Andreas (SwissTXT) wrote: > > Hmm i have a pretty much default install with ceph-deploy, the crusmap is > untouched. > Btw I get similar errormessages when trying to mount cephfs > > mount -t ceph ceph01:6789:/ /mnt/backupCephfs -o > name=admin,secretfile=admin.secret > > tail syslog > Oct 31 17:14:27 ceph00 kernel: [103642.162813] libceph: mon0 > 10.100.214.11:6789 feature set mismatch, my 4008a < server's 4004008a, > missing 40000000 > Oct 31 17:14:27 ceph00 kernel: [103642.162937] libceph: mon0 > 10.100.214.11:6789 socket error on read > Oct 31 17:14:36 ceph00 kernel: [103651.151655] libceph: mon0 > 10.100.214.11:6789 feature set mismatch, my 4008a < server's 4004008a, > missing 40000000 > Oct 31 17:14:36 ceph00 kernel: [103651.151761] libceph: mon0 > 10.100.214.11:6789 socket error on read > Oct 31 17:14:46 ceph00 kernel: [103661.142229] libceph: mon0 > 10.100.214.11:6789 feature set mismatch, my 4008a < server's 4004008a, > missing 40000000 > Oct 31 17:14:46 ceph00 kernel: [103661.142334] libceph: mon0 > 10.100.214.11:6789 socket error on read > > > The client is Ubuntu 12.04 LTS > The OSD nodes are CentOS 6.4 kernel 3.8.0-32-generic > > Might this be an issue? > >> -----Original Message----- >> From: Gregory Farnum [mailto:greg@xxxxxxxxxxx] >> Sent: Mittwoch, 30. Oktober 2013 23:57 >> To: Fuchs, Andreas (SwissTXT) >> Cc: Karan Singh; ceph-users@xxxxxxxxxxxxxx >> Subject: Re: rbd on ubuntu 12.04 LTS >> >> You've enabled some feature on your cluster which is not supported by that >> kernel client. It's probably the crush tunables (you can find info on them >> in >> the docs). >> -Greg >> Software Engineer #42 @ http://inktank.com | http://ceph.com >> >> >> On Wed, Oct 30, 2013 at 3:59 AM, Fuchs, Andreas (SwissTXT) >> <Andreas.Fuchs@xxxxxxxxxxx> wrote: >> > I think keyring is fine, as i can run other commands like: >> > >> > >> > >> > rbd ls --pool rbd --name client.admin >> > >> > archiveadmin >> > >> > >> > >> > and was able to create the image >> > >> > >> > >> > rbd info archiveadmin --pool rbd --name client.admin >> > >> > rbd image 'archiveadmin': >> > >> > size 4096 MB in 1024 objects >> > >> > order 22 (4096 KB objects) >> > >> > block_name_prefix: rb.0.2c68.2ae8944a >> > >> > format: 1 >> > >> > >> > >> > From: Karan Singh [mailto:ksingh@xxxxxx] >> > Sent: Mittwoch, 30. Oktober 2013 10:57 >> > To: Fuchs, Andreas (SwissTXT) >> > Cc: ceph-users@xxxxxxxxxxxxxx >> > Subject: Re: rbd on ubuntu 12.04 LTS >> > >> > >> > >> > Andi >> > >> > >> > >> > Dont know much about but checking on keyrings side will give you more >> > information. Socket read problem usually caused by keyrings. >> > >> > >> > >> > Regards >> > >> > Karan >> > >> > >> > >> > >> > >> > ________________________________ >> > >> > From: "Andreas Fuchs (SwissTXT)" <Andreas.Fuchs@xxxxxxxxxxx> >> > To: ceph-users@xxxxxxxxxxxxxx >> > Sent: Wednesday, 30 October, 2013 11:53:23 AM >> > Subject: rbd on ubuntu 12.04 LTS >> > >> > >> > >> > Hi >> > >> > >> > >> > Im trying to mount a ceph rdb on a ubuntu 12.04 LTS with kernel 3.8.0 >> > >> > >> > >> > While our ceph cluster is healty running on 0.67.4 I'm not able to >> > map the rbd device >> > >> > >> > >> > The command: >> > >> > rbd map archiveadmin --pool rbd --name client.admin --log-to-stderr >> > >> > rbd: add failed: (5) Input/output error >> > >> > >> > >> > In syslog: >> > >> > Oct 30 10:48:13 ceph00 kernel: [ 135.945476] Key type ceph registered >> > >> > Oct 30 10:48:13 ceph00 kernel: [ 135.945483] libceph: loaded (mon/osd >> > proto 15/24, osdmap 5/6 5/6) >> > >> > Oct 30 10:48:13 ceph00 kernel: [ 135.954829] rbd: loaded rbd (rados >> > block >> > device) >> > >> > Oct 30 10:48:13 ceph00 kernel: [ 135.956200] libceph: mon0 >> > 10.100.214.11:6789 feature set mismatch, my 40002 < server's 40040002, >> > missing 40000000 >> > >> > Oct 30 10:48:13 ceph00 kernel: [ 135.956400] libceph: mon0 >> > 10.100.214.11:6789 socket error on read >> > >> > >> > >> > Where does this mismatch come from? I thought I have upgrade all ceph >> > packets everywhere to 0.67.4, or is the kernel too old? >> > >> > >> > >> > Regards >> > >> > Andi >> > >> > >> > _______________________________________________ > > > > -- > Software Engineer #42 @ http://inktank.com | http://ceph.com _______________________________________________ ceph-users mailing list ceph-users@xxxxxxxxxxxxxx http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
 |