Has anything changed in v0.92 that would keep a 3.18 Kernel from mapping a RBD image?
I have been using a test script to create RBD images and map them since FireFly and the script has worked fine through Ceph v0.91. It is not working with v0.92, so I minimized it to the following 3 commands which fails on the rbd map command:
# ceph osd pool create SMB01 256 256
pool 'SMB01' created
# rbd create SMB01/smb01_d1 --size 1000 --image-format 2
# rbd map SMB01/smb01_d1
rbd: sysfs write failed
rbd: map failed: (6) No such device or address
Same commands worked fine with 0.80.8, 0.87, and 0.91
# ceph -v
ceph version 0.92 (00a3ac3b67d93860e7f0b6e07319f11b14d0fec0)
# cat /proc/version
Linux version 3.18.0-031800-generic (apw@gomeisa) (gcc version 4.6.3 (Ubuntu/Linaro 4.6.3-1ubuntu5) ) #201412071935 SMP Mon Dec 8 00:36:34 UTC 2014
# rbd -p SMB01 ls -l
NAME SIZE PARENT FMT PROT LOCK
smb01_d1 1000M 2
# ceph -s
cluster 4488a472-e2f0-11e3-9a32-001e0b4843b4
health HEALTH_OK
monmap e1: 1 mons at {t10=172.16.30.10:6789/0}
election epoch 1, quorum 0 t10
osdmap e39: 6 osds: 6 up, 6 in
pgmap v105: 320 pgs, 2 pools, 16 bytes data, 3 objects
219 MB used, 233 GB / 233 GB avail
320 active+clean
# lsmod | grep rbd
rbd 74870 0
libceph 247326 1 rbd
I made sure the permissions were wide open on the /etc/ceph directory:
# ls -la /etc/ceph/
total 20
drwxrwxrwx 2 root root 4096 Feb 7 20:44 .
drwxr-xr-x 90 root root 4096 Feb 7 21:39 ..
-rwxrwxrwx 1 root root 63 Feb 7 20:44 ceph.client.admin.keyring
-rwxrwxrwx 1 root root 1980 Feb 7 20:44 ceph.conf
-rwxrwxrwx 1 root root 92 Feb 2 17:02 rbdmap
Using strace on the rbd map command shows
# strace -s 60 rbd map SMB01/smb01_d1
execve("/usr/bin/rbd", ["rbd", "map", "SMB01/smb01_d1"], [/* 21 vars */]) = 0
brk(0) = 0x40fe000
...
bind(3, {sa_family=AF_NETLINK, pid=0, groups=00000002}, 12) = 0
getsockname(3, {sa_family=AF_NETLINK, pid=2737, groups=00000002}, [12]) = 0
setsockopt(3, SOL_SOCKET, SO_PASSCRED, [1], 4) = 0
open("/sys/bus/rbd/add_single_major", O_WRONLY) = -1 ENOENT (No such file or directory)
open("/sys/bus/rbd/add", O_WRONLY) = 4
write(4, "172.16.30.10:6789 name=admin,key=client.admin SMB01 smb01_d1"..., 62) = -1 ENXIO (No such device or address)
close(4) = 0
write(2, "rbd: sysfs write failed", 23rbd: sysfs write failed) = 23
write(2, "\n", 1
) = 1
close(3) = 0
write(2, "rbd: map failed: ", 17rbd: map failed: ) = 17
write(2, "(6) No such device or address", 29(6) No such device or address) = 29
write(2, "\n", 1
) = 1
exit_group(6) = ?
+++ exited with 6 +++
Thanks
Eric
_______________________________________________ ceph-users mailing list ceph-users@xxxxxxxxxxxxxx http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
