Re: Ceph with RDMA

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



Thanks Haomai. I am also getting below error when I use ceph-disk. Any pointers?

  File "/usr/bin/ceph-disk", line 5, in <module>
    from pkg_resources import load_entry_point
  File "/usr/lib/python2.7/dist-packages/pkg_resources/__init__.py", line 2927, in <module>
    @_call_aside
  File "/usr/lib/python2.7/dist-packages/pkg_resources/__init__.py", line 2913, in _call_aside
    f(*args, **kwargs)
  File "/usr/lib/python2.7/dist-packages/pkg_resources/__init__.py", line 2940, in _initialize_master_working_set
    working_set = WorkingSet._build_master()
  File "/usr/lib/python2.7/dist-packages/pkg_resources/__init__.py", line 635, in _build_master
    ws.require(__requires__)
  File "/usr/lib/python2.7/dist-packages/pkg_resources/__init__.py", line 943, in require
    needed = self.resolve(parse_requirements(requirements))
  File "/usr/lib/python2.7/dist-packages/pkg_resources/__init__.py", line 829, in resolve
    raise DistributionNotFound(req, requirers)
pkg_resources.DistributionNotFound: The 'ceph-disk==1.0.0' distribution was not found and is required by the application

On Fri, Mar 10, 2017 at 7:10 PM, Haomai Wang <haomai@xxxxxxxx> wrote:
On Sat, Mar 11, 2017 at 10:29 AM, PR PR <prprpr7819@xxxxxxxxx> wrote:
> Thanks for the quick reply. I tried it with master as well. Followed
> instructions on this link - https://community.mellanox.com/docs/DOC-2721
>
> Ceph mon fails to start with error "unrecognized ms_type 'async+rdma'"

it must be ceph-mon doesn't compile with rdma support

>
> Appreciate any pointers.
>
> On Thu, Mar 9, 2017 at 5:56 PM, Haomai Wang <haomai@xxxxxxxx> wrote:
>>
>> On Fri, Mar 10, 2017 at 4:28 AM, PR PR <prprpr7819@xxxxxxxxx> wrote:
>> > Hi,
>> >
>> > I am trying to use ceph with RDMA. I have a few questions.
>> >
>> > 1. Is there a prebuilt package that has rdma support or the only way to
>> > try
>> > ceph+rdma is to checkout from github and compile from scratch?
>> >
>> > 2. Looks like there are two ways of using rdma - xio and async+rdma.
>> > Which
>> > is the recommended approach? Also, any insights on the differences will
>> > be
>> > useful as well.
>> >
>> > 3. async+rdma seems to have lot of recent changes. Is 11.2.0 expected to
>> > work for async+rdma? As when I compiled 11.2.0 it fails with following
>> > error
>> >
>>
>> suggest checkout with master
>>
>> > [ 81%] Built target rbd
>> > /mnt/ceph_compile/ceph/build/lib/libcephfs.so: undefined reference to
>> > `ibv_free_device_list'
>> > /mnt/ceph_compile/ceph/build/lib/libcephfs.so: undefined reference to
>> > `ibv_get_cq_event'
>> > /mnt/ceph_compile/ceph/build/lib/libcephfs.so: undefined reference to
>> > `ibv_alloc_pd'
>> > /mnt/ceph_compile/ceph/build/lib/libcephfs.so: undefined reference to
>> > `ibv_close_device'
>> > /mnt/ceph_compile/ceph/build/lib/libcephfs.so: undefined reference to
>> > `ibv_destroy_qp'
>> > /mnt/ceph_compile/ceph/build/lib/libcephfs.so: undefined reference to
>> > `ibv_modify_qp'
>> > /mnt/ceph_compile/ceph/build/lib/libcephfs.so: undefined reference to
>> > `ibv_get_async_event'
>> > ***snipped***
>> > Link Error: Ceph FS library not found
>> > src/pybind/cephfs/CMakeFiles/cython_cephfs.dir/build.make:57: recipe for
>> > target 'src/pybind/cephfs/CMakeFiles/cython_cephfs' failed
>> > make[2]: *** [src/pybind/cephfs/CMakeFiles/cython_cephfs] Error 1
>> > CMakeFiles/Makefile2:4015: recipe for target
>> > 'src/pybind/cephfs/CMakeFiles/cython_cephfs.dir/all' failed
>> > make[1]: *** [src/pybind/cephfs/CMakeFiles/cython_cephfs.dir/all] Error
>> > 2
>> > make[1]: *** Waiting for unfinished jobs....
>> > [ 85%] Built target rgw_a
>> >
>> > Thanks,
>> > PR
>> >
>> > _______________________________________________
>> > ceph-users mailing list
>> > ceph-users@xxxxxxxxxxxxxx
>> > http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
>> >
>
>

_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

[Index of Archives]     [Information on CEPH]     [Linux Filesystem Development]     [Ceph Development]     [Ceph Large]     [Linux USB Development]     [Video for Linux]     [Linux Audio Users]     [Yosemite News]     [Linux Kernel]     [Linux SCSI]     [xfs]


  Powered by Linux