On Thu, Oct 29, 2015 at 11:22 AM, Wah Peng <wah_peng@xxxxxxxxxxxx> wrote: > Thanks Gurjar. > Have loaded the rbd module, but got no luck. > what dmesg shows, > > [119192.384770] libceph: mon0 172.17.6.176:6789 feature set mismatch, my 2 < > server's 42040002, missing 42040000 > [119192.388744] libceph: mon0 172.17.6.176:6789 missing required protocol > features > [119202.400782] libceph: mon0 172.17.6.176:6789 feature set mismatch, my 2 < > server's 42040002, missing 42040000 > [119202.404756] libceph: mon0 172.17.6.176:6789 missing required protocol > features > [119212.416758] libceph: mon0 172.17.6.176:6789 feature set mismatch, my 2 < > server's 42040002, missing 42040000 > [119212.420732] libceph: mon0 172.17.6.176:6789 missing required protocol > features > [119222.432783] libceph: mon0 172.17.6.176:6789 feature set mismatch, my 2 < > server's 42040002, missing 42040000 > [119222.436756] libceph: mon0 172.17.6.176:6789 missing required protocol > features > [119232.448780] libceph: mon0 172.17.6.176:6789 feature set mismatch, my 2 < > server's 42040002, missing 42040000 > [119232.452754] libceph: mon0 172.17.6.176:6789 missing required protocol > features Our messages raced - you are missing CRUSH_TUNABLES, CRUSH_TUNABLES2 and, more importantly, OSDHASHPSPOOL: starting with ceph 0.64, pools are created with hashpspool flag set. If you *really* want to try and run 3.2 kernel client, you'll need to clear it with "ceph osd pool set $poolname hashpspool false" and then reset all crush tunables to legacy values [1]. Note that we recommend at least >=3.10 for the kernel client [2]. [1] http://docs.ceph.com/docs/master/rados/operations/crush-map/#tunables [2] http://docs.ceph.com/docs/master/start/os-recommendations/ Thanks, Ilya _______________________________________________ ceph-users mailing list ceph-users@xxxxxxxxxxxxxx http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com