Hmm, if I only enable layering features I can get it to work. But I’m puzzled why all the (default) features are not working with my system fully up to date. Any ideas? Is this not yet supported? [root@test ~]# rbd create `hostname` --size 102400 --image-feature layering [ root@test ~]# rbd map `hostname` /dev/rbd0 [root@test ~]# rbd info `hostname` rbd image ‘test.np.wc1.example.com': size 102400 MB in 25600 objects order 22 (4096 kB objects) block_name_prefix: rbd_data.13582ae8944a format: 2 features: layering flags: Michael Kuriger Sr. Unix Systems Engineer * mk7193@xxxxxx |( 818-649-7235 On 6/15/16, 9:56 AM, "ceph-users on behalf of Michael Kuriger" <ceph-users-bounces@xxxxxxxxxxxxxx on behalf of mk7193@xxxxxx> wrote: >Still not working with newer client. But I get a different error now. > > > >[root@test ~]# rbd ls > >test1 > > > >[root@test ~]# rbd showmapped > > > >[root@test ~]# rbd map test1 > >rbd: sysfs write failed > >RBD image feature set mismatch. You can disable features unsupported by the kernel with "rbd feature disable". > >In some cases useful info is found in syslog - try "dmesg | tail" or so. > >rbd: map failed: (6) No such device or address > > > >[root@test ~]# dmesg | tail > >[52056.980880] rbd: loaded (major 251) > >[52056.990399] libceph: mon0 10.1.77.165:6789 session established > >[52056.992567] libceph: client4966 fsid f1466aaa-b08b-4103-ba7f-69165d675ba1 > >[52057.024913] rbd: image mk7193.np.wc1.yellowpages.com: image uses unsupported features: 0x3c > >[52085.856605] libceph: mon0 10.1.77.165:6789 session established > >[52085.858696] libceph: client4969 fsid f1466aaa-b08b-4103-ba7f-69165d675ba1 > >[52085.883350] rbd: image test1: image uses unsupported features: 0x3c > >[52167.683868] libceph: mon1 10.1.78.75:6789 session established > >[52167.685990] libceph: client4937 fsid f1466aaa-b08b-4103-ba7f-69165d675ba1 > >[52167.709796] rbd: image test1: image uses unsupported features: 0x3c > > > >[root@test ~]# uname -a > >Linux test.np.4.6.2-1.el7.elrepo.x86_64 #1 SMP Wed Jun 8 14:49:20 EDT 2016 x86_64 x86_64 x86_64 GNU/Linux > > > >[root@test ~]# ceph --version > >ceph version 10.2.1 (3a66dd4f30852819c1bdaa8ec23c795d4ad77269) > > > > > > > > > > > > > > > >Michael Kuriger > >Sr. Unix Systems Engineer > >* mk7193@xxxxxx |( 818-649-7235 > > > > > > > > > > > > > > > > > >On 6/14/16, 12:28 PM, "Ilya Dryomov" <idryomov@xxxxxxxxx> wrote: > > > >>On Mon, Jun 13, 2016 at 8:37 PM, Michael Kuriger <mk7193@xxxxxx> wrote: > >>> I just realized that this issue is probably because I’m running jewel 10.2.1 on the servers side, but accessing from a client running hammer 0.94.7 or infernalis 9.2.1 > >>> > >>> Here is what happens if I run rbd ls from a client on infernalis. I was testing this access since we weren’t planning on building rpms for Jewel on CentOS 6 > >>> > >>> $ rbd ls > >>> 2016-06-13 11:24:06.881591 7fe61e568700 0 -- :/3877046932 >> 10.1.77.165:6789/0 pipe(0x562ed3ea7550 sd=3 :0 s=1 pgs=0 cs=0 l=1 c=0x562ed3ea0ac0).fault > >>> 2016-06-13 11:24:09.882051 7fe61137f700 0 -- :/3877046932 >> 10.1.78.75:6789/0 pipe(0x7fe608000c00 sd=3 :0 s=1 pgs=0 cs=0 l=1 c=0x7fe608004ef0).fault > >>> 2016-06-13 11:24:12.882389 7fe61e568700 0 -- :/3877046932 >> 10.1.77.165:6789/0 pipe(0x7fe608008350 sd=4 :0 s=1 pgs=0 cs=0 l=1 c=0x7fe60800c5f0).fault > >>> 2016-06-13 11:24:18.883642 7fe61e568700 0 -- :/3877046932 >> 10.1.77.165:6789/0 pipe(0x7fe608008350 sd=3 :0 s=1 pgs=0 cs=0 l=1 c=0x7fe6080078e0).fault > >>> 2016-06-13 11:24:21.884259 7fe61137f700 0 -- :/3877046932 >> 10.1.78.75:6789/0 pipe(0x7fe608000c00 sd=4 :0 s=1 pgs=0 cs=0 l=1 c=0x7fe608007110).fault > >> > >>Accessing jewel with older clients should work as long as you don't > >>enable jewel tunables and such; the same goes for older kernels. Can > >>you do > >> > >> rbd --debug-ms=20 ls > >> > >>and attach the output? > >> > >>Thanks, > >> > >> Ilya > >_______________________________________________ >ceph-users mailing list >ceph-users@xxxxxxxxxxxxxx >https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.ceph.com_listinfo.cgi_ceph-2Dusers-2Dceph.com&d=CwIGaQ&c=lXkdEK1PC7UK9oKA-BBSI8p1AamzLOSncm6Vfn0C_UQ&r=CSYA9OS6Qd7fQySI2LDvlQ&m=87up-v2FeckUxAE8N-S9YPgbNa_YWlaYrV8efOsXeEs&s=k9uAOwbxafawJqm096e0GZqUPU2YbN3qm1GBol7ZvN4&e= _______________________________________________ ceph-users mailing list ceph-users@xxxxxxxxxxxxxx http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
 |