On Sat, Mar 11, 2017 at 10:29 AM, PR PR <prprpr7819@xxxxxxxxx> wrote: > Thanks for the quick reply. I tried it with master as well. Followed > instructions on this link - https://community.mellanox.com/docs/DOC-2721 > > Ceph mon fails to start with error "unrecognized ms_type 'async+rdma'" it must be ceph-mon doesn't compile with rdma support > > Appreciate any pointers. > > On Thu, Mar 9, 2017 at 5:56 PM, Haomai Wang <haomai@xxxxxxxx> wrote: >> >> On Fri, Mar 10, 2017 at 4:28 AM, PR PR <prprpr7819@xxxxxxxxx> wrote: >> > Hi, >> > >> > I am trying to use ceph with RDMA. I have a few questions. >> > >> > 1. Is there a prebuilt package that has rdma support or the only way to >> > try >> > ceph+rdma is to checkout from github and compile from scratch? >> > >> > 2. Looks like there are two ways of using rdma - xio and async+rdma. >> > Which >> > is the recommended approach? Also, any insights on the differences will >> > be >> > useful as well. >> > >> > 3. async+rdma seems to have lot of recent changes. Is 11.2.0 expected to >> > work for async+rdma? As when I compiled 11.2.0 it fails with following >> > error >> > >> >> suggest checkout with master >> >> > [ 81%] Built target rbd >> > /mnt/ceph_compile/ceph/build/lib/libcephfs.so: undefined reference to >> > `ibv_free_device_list' >> > /mnt/ceph_compile/ceph/build/lib/libcephfs.so: undefined reference to >> > `ibv_get_cq_event' >> > /mnt/ceph_compile/ceph/build/lib/libcephfs.so: undefined reference to >> > `ibv_alloc_pd' >> > /mnt/ceph_compile/ceph/build/lib/libcephfs.so: undefined reference to >> > `ibv_close_device' >> > /mnt/ceph_compile/ceph/build/lib/libcephfs.so: undefined reference to >> > `ibv_destroy_qp' >> > /mnt/ceph_compile/ceph/build/lib/libcephfs.so: undefined reference to >> > `ibv_modify_qp' >> > /mnt/ceph_compile/ceph/build/lib/libcephfs.so: undefined reference to >> > `ibv_get_async_event' >> > ***snipped*** >> > Link Error: Ceph FS library not found >> > src/pybind/cephfs/CMakeFiles/cython_cephfs.dir/build.make:57: recipe for >> > target 'src/pybind/cephfs/CMakeFiles/cython_cephfs' failed >> > make[2]: *** [src/pybind/cephfs/CMakeFiles/cython_cephfs] Error 1 >> > CMakeFiles/Makefile2:4015: recipe for target >> > 'src/pybind/cephfs/CMakeFiles/cython_cephfs.dir/all' failed >> > make[1]: *** [src/pybind/cephfs/CMakeFiles/cython_cephfs.dir/all] Error >> > 2 >> > make[1]: *** Waiting for unfinished jobs.... >> > [ 85%] Built target rgw_a >> > >> > Thanks, >> > PR >> > >> > _______________________________________________ >> > ceph-users mailing list >> > ceph-users@xxxxxxxxxxxxxx >> > http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com >> > > > _______________________________________________ ceph-users mailing list ceph-users@xxxxxxxxxxxxxx http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
 |