Re: rbd on ubuntu 12.04 LTS

[Gregory Farnum <greg@xxxxxxxxxxx>]

Yeah, depending in what version of Ceph you deployed that could be it exactly. We were a little more aggressive than we should have been in pushing them out. See:

http://ceph.com/docs/master/rados/operations/crush-map/#tunables

-Greg

On Thursday, October 31, 2013, Fuchs, Andreas (SwissTXT) wrote:

Hmm i have a pretty much default install with ceph-deploy, the crusmap is untouched.
Btw I get similar errormessages when trying to mount cephfs

mount -t ceph ceph01:6789:/ /mnt/backupCephfs -o name=admin,secretfile=admin.secret

tail syslog
Oct 31 17:14:27 ceph00 kernel: [103642.162813] libceph: mon0 10.100.214.11:6789 feature set mismatch, my 4008a < server's 4004008a, missing 40000000
Oct 31 17:14:27 ceph00 kernel: [103642.162937] libceph: mon0 10.100.214.11:6789 socket error on read
Oct 31 17:14:36 ceph00 kernel: [103651.151655] libceph: mon0 10.100.214.11:6789 feature set mismatch, my 4008a < server's 4004008a, missing 40000000
Oct 31 17:14:36 ceph00 kernel: [103651.151761] libceph: mon0 10.100.214.11:6789 socket error on read
Oct 31 17:14:46 ceph00 kernel: [103661.142229] libceph: mon0 10.100.214.11:6789 feature set mismatch, my 4008a < server's 4004008a, missing 40000000
Oct 31 17:14:46 ceph00 kernel: [103661.142334] libceph: mon0 10.100.214.11:6789 socket error on read


The client is Ubuntu 12.04 LTS
The OSD nodes are CentOS 6.4 kernel 3.8.0-32-generic

Might this be an issue?

> -----Original Message-----
> From: Gregory Farnum [mailto:greg@xxxxxxxxxxx]
> Sent: Mittwoch, 30. Oktober 2013 23:57
> To: Fuchs, Andreas (SwissTXT)
> Cc: Karan Singh; ceph-users@xxxxxxxxxxxxxx
> Subject: Re: rbd on ubuntu 12.04 LTS
>
> You've enabled some feature on your cluster which is not supported by that
> kernel client. It's probably the crush tunables (you can find info on them in
> the docs).
> -Greg
> Software Engineer #42 @ http://inktank.com | http://ceph.com
>
>
> On Wed, Oct 30, 2013 at 3:59 AM, Fuchs, Andreas (SwissTXT)
> <Andreas.Fuchs@xxxxxxxxxxx> wrote:
> > I think keyring is fine, as i can run other commands like:
> >
> >
> >
> > rbd ls --pool rbd --name client.admin
> >
> > archiveadmin
> >
> >
> >
> > and was able to create the image
> >
> >
> >
> > rbd info archiveadmin --pool rbd --name client.admin
> >
> > rbd image 'archiveadmin':
> >
> >         size 4096 MB in 1024 objects
> >
> >         order 22 (4096 KB objects)
> >
> >         block_name_prefix: rb.0.2c68.2ae8944a
> >
> >         format: 1
> >
> >
> >
> > From: Karan Singh [mailto:ksingh@xxxxxx]
> > Sent: Mittwoch, 30. Oktober 2013 10:57
> > To: Fuchs, Andreas (SwissTXT)
> > Cc: ceph-users@xxxxxxxxxxxxxx
> > Subject: Re: rbd on ubuntu 12.04 LTS
> >
> >
> >
> > Andi
> >
> >
> >
> > Dont know much about but checking on keyrings side will give you more
> > information. Socket read problem usually caused by keyrings.
> >
> >
> >
> > Regards
> >
> > Karan
> >
> >
> >
> >
> >
> > ________________________________
> >
> > From: "Andreas Fuchs (SwissTXT)" <Andreas.Fuchs@xxxxxxxxxxx>
> > To: ceph-users@xxxxxxxxxxxxxx
> > Sent: Wednesday, 30 October, 2013 11:53:23 AM
> > Subject: rbd on ubuntu 12.04 LTS
> >
> >
> >
> > Hi
> >
> >
> >
> > Im trying to mount a ceph rdb on a ubuntu 12.04 LTS with kernel 3.8.0
> >
> >
> >
> > While our ceph cluster is healty running on  0.67.4 I'm not able to
> > map the rbd device
> >
> >
> >
> > The command:
> >
> > rbd map archiveadmin --pool rbd --name client.admin  --log-to-stderr
> >
> > rbd: add failed: (5) Input/output error
> >
> >
> >
> > In syslog:
> >
> > Oct 30 10:48:13 ceph00 kernel: [  135.945476] Key type ceph registered
> >
> > Oct 30 10:48:13 ceph00 kernel: [  135.945483] libceph: loaded (mon/osd
> > proto 15/24, osdmap 5/6 5/6)
> >
> > Oct 30 10:48:13 ceph00 kernel: [  135.954829] rbd: loaded rbd (rados
> > block
> > device)
> >
> > Oct 30 10:48:13 ceph00 kernel: [  135.956200] libceph: mon0
> > 10.100.214.11:6789 feature set mismatch, my 40002 < server's 40040002,
> > missing 40000000
> >
> > Oct 30 10:48:13 ceph00 kernel: [  135.956400] libceph: mon0
> > 10.100.214.11:6789 socket error on read
> >
> >
> >
> > Where does this mismatch come from? I thought I have upgrade all ceph
> > packets everywhere to 0.67.4, or is the kernel too old?
> >
> >
> >
> > Regards
> >
> > Andi
> >
> >
> > _______________________________________________

-- 
Software Engineer #42 @ http://inktank.com | http://ceph.com
_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com