Still not working with newer client. But I get a different error now. [root@test ~]# rbd ls test1 [root@test ~]# rbd showmapped [root@test ~]# rbd map test1 rbd: sysfs write failed RBD image feature set mismatch. You can disable features unsupported by the kernel with "rbd feature disable". In some cases useful info is found in syslog - try "dmesg | tail" or so. rbd: map failed: (6) No such device or address [root@test ~]# dmesg | tail [52056.980880] rbd: loaded (major 251) [52056.990399] libceph: mon0 10.1.77.165:6789 session established [52056.992567] libceph: client4966 fsid f1466aaa-b08b-4103-ba7f-69165d675ba1 [52057.024913] rbd: image mk7193.np.wc1.yellowpages.com: image uses unsupported features: 0x3c [52085.856605] libceph: mon0 10.1.77.165:6789 session established [52085.858696] libceph: client4969 fsid f1466aaa-b08b-4103-ba7f-69165d675ba1 [52085.883350] rbd: image test1: image uses unsupported features: 0x3c [52167.683868] libceph: mon1 10.1.78.75:6789 session established [52167.685990] libceph: client4937 fsid f1466aaa-b08b-4103-ba7f-69165d675ba1 [52167.709796] rbd: image test1: image uses unsupported features: 0x3c [root@test ~]# uname -a Linux test.np.4.6.2-1.el7.elrepo.x86_64 #1 SMP Wed Jun 8 14:49:20 EDT 2016 x86_64 x86_64 x86_64 GNU/Linux [root@test ~]# ceph --version ceph version 10.2.1 (3a66dd4f30852819c1bdaa8ec23c795d4ad77269) Michael Kuriger Sr. Unix Systems Engineer * mk7193@xxxxxx |( 818-649-7235 On 6/14/16, 12:28 PM, "Ilya Dryomov" <idryomov@xxxxxxxxx> wrote: >On Mon, Jun 13, 2016 at 8:37 PM, Michael Kuriger <mk7193@xxxxxx> wrote: >> I just realized that this issue is probably because I’m running jewel 10.2.1 on the servers side, but accessing from a client running hammer 0.94.7 or infernalis 9.2.1 >> >> Here is what happens if I run rbd ls from a client on infernalis. I was testing this access since we weren’t planning on building rpms for Jewel on CentOS 6 >> >> $ rbd ls >> 2016-06-13 11:24:06.881591 7fe61e568700 0 -- :/3877046932 >> 10.1.77.165:6789/0 pipe(0x562ed3ea7550 sd=3 :0 s=1 pgs=0 cs=0 l=1 c=0x562ed3ea0ac0).fault >> 2016-06-13 11:24:09.882051 7fe61137f700 0 -- :/3877046932 >> 10.1.78.75:6789/0 pipe(0x7fe608000c00 sd=3 :0 s=1 pgs=0 cs=0 l=1 c=0x7fe608004ef0).fault >> 2016-06-13 11:24:12.882389 7fe61e568700 0 -- :/3877046932 >> 10.1.77.165:6789/0 pipe(0x7fe608008350 sd=4 :0 s=1 pgs=0 cs=0 l=1 c=0x7fe60800c5f0).fault >> 2016-06-13 11:24:18.883642 7fe61e568700 0 -- :/3877046932 >> 10.1.77.165:6789/0 pipe(0x7fe608008350 sd=3 :0 s=1 pgs=0 cs=0 l=1 c=0x7fe6080078e0).fault >> 2016-06-13 11:24:21.884259 7fe61137f700 0 -- :/3877046932 >> 10.1.78.75:6789/0 pipe(0x7fe608000c00 sd=4 :0 s=1 pgs=0 cs=0 l=1 c=0x7fe608007110).fault > >Accessing jewel with older clients should work as long as you don't >enable jewel tunables and such; the same goes for older kernels. Can >you do > > rbd --debug-ms=20 ls > >and attach the output? > >Thanks, > > Ilya _______________________________________________ ceph-users mailing list ceph-users@xxxxxxxxxxxxxx http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com