Thanks for the quick reply. I tried it with master as well. Followed instructions on this link - https://community.mellanox.com/docs/DOC-2721
Ceph mon fails to start with error "unrecognized ms_type 'async+rdma'"
Appreciate any pointers.
On Thu, Mar 9, 2017 at 5:56 PM, Haomai Wang <haomai@xxxxxxxx> wrote:
On Fri, Mar 10, 2017 at 4:28 AM, PR PR <prprpr7819@xxxxxxxxx> wrote:
> Hi,
>
> I am trying to use ceph with RDMA. I have a few questions.
>
> 1. Is there a prebuilt package that has rdma support or the only way to try
> ceph+rdma is to checkout from github and compile from scratch?
>
> 2. Looks like there are two ways of using rdma - xio and async+rdma. Which
> is the recommended approach? Also, any insights on the differences will be
> useful as well.
>
> 3. async+rdma seems to have lot of recent changes. Is 11.2.0 expected to
> work for async+rdma? As when I compiled 11.2.0 it fails with following error
>
suggest checkout with master
> ______________________________
> [ 81%] Built target rbd
> /mnt/ceph_compile/ceph/build/lib/libcephfs.so: undefined reference to
> `ibv_free_device_list'
> /mnt/ceph_compile/ceph/build/lib/libcephfs.so: undefined reference to
> `ibv_get_cq_event'
> /mnt/ceph_compile/ceph/build/lib/libcephfs.so: undefined reference to
> `ibv_alloc_pd'
> /mnt/ceph_compile/ceph/build/lib/libcephfs.so: undefined reference to
> `ibv_close_device'
> /mnt/ceph_compile/ceph/build/lib/libcephfs.so: undefined reference to
> `ibv_destroy_qp'
> /mnt/ceph_compile/ceph/build/lib/libcephfs.so: undefined reference to
> `ibv_modify_qp'
> /mnt/ceph_compile/ceph/build/lib/libcephfs.so: undefined reference to
> `ibv_get_async_event'
> ***snipped***
> Link Error: Ceph FS library not found
> src/pybind/cephfs/CMakeFiles/cython_cephfs.dir/build.make: 57: recipe for
> target 'src/pybind/cephfs/CMakeFiles/cython_cephfs' failed
> make[2]: *** [src/pybind/cephfs/CMakeFiles/cython_cephfs] Error 1
> CMakeFiles/Makefile2:4015: recipe for target
> 'src/pybind/cephfs/CMakeFiles/cython_cephfs.dir/all' failed
> make[1]: *** [src/pybind/cephfs/CMakeFiles/cython_cephfs.dir/all] Error 2
> make[1]: *** Waiting for unfinished jobs....
> [ 85%] Built target rgw_a
>
> Thanks,
> PR
>
_________________
> ceph-users mailing list
> ceph-users@xxxxxxxxxxxxxx
> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph. com
>
_______________________________________________ ceph-users mailing list ceph-users@xxxxxxxxxxxxxx http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
