Hi , I have created a ceph cluster on centos 7 Servers and it is working fine with tcp and able to run all benchmarks.  Now want to check the same with rdma and I followed the below link to deploy the same  https://community.mellanox.com/docs/DOC-2721  After following the above document and when I Restart all cluster processes on the monitor node: using sudo systemctl start ceph-mon.target  The monitors are not coming up. Any help here will be great.  If I manually run the below command instead of using systemctl the server is rebooting sudo /usr/bin/ceph-mon --cluster ceph --id clx-ssp-056 --setuser ceph --setgroup ceph  Below is my ceph.conf configuration file and iam using soft ROCE as my rdma device.  [global] fsid = 74cc4723-7ab9-4cc3-b8c8-182e138da955 mon_initial_members = TestNVMe2 mon_host = 10.38.32.245 auth_cluster_required = cephx auth_service_required = cephx auth_client_required = cephx public network = 10.38.32.0/24 osd pool default size = 2 osd_max_object_name_len = 256 osd_max_object_namespace_len = 64 ms_type = async+rdma ms_cluster_type = async+rdma ms_async_rdma_device_name = rxe0 ms_async_rdma_polling_us = 0 ms_async_rdma_local_gid = 0000:0000:0000:0000:0000:ffff:0a26:20f5 ms_async_rdma_port_num = 1  Regards, Muneendra.   |
_______________________________________________ ceph-users mailing list ceph-users@xxxxxxxxxxxxxx http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com