On Fri, Aug 1, 2014 at 8:34 PM, Larry Liu <larryliugml at gmail.com> wrote: > oot at u12ceph02:~# rbd map foo --pool rbd --name client.admin -m u12ceph01 -k /etc/ceph/ceph.client.admin.keyring > rbd: add failed: (5) Input/output error > dmesg shows these right away after the IO error: > [ 461.010895] libceph: mon0 10.190.10.13:6789 feature set mismatch, my 4a042aca < server's 2104a042aca, missing 21000000000 > [ 461.010917] libceph: mon0 10.190.10.13:6789 socket error on read > [ 471.041574] libceph: mon0 10.190.10.13:6789 feature set mismatch, my 4a042aca < server's 2104a042aca, missing 21000000000 > [ 471.041597] libceph: mon0 10.190.10.13:6789 socket error on read This doesn't look like kernel 3.2. Can you send along your crushmap? $ ceph osd getcrushmap -o /tmp/crush and attach the /tmp/crush. Also I need to know which kernel version you are trying now. Thanks, Ilya