Hi all, I am running a small Ceph cluster (1 MON and 3OSDs), and it works fine. However, I have a doubt about the two networks (public and cluster) that an OSD uses. There is a reference from Mellanox (https://community.mellanox.com/docs/DOC-2721) how to configure 'ceph.conf'. However, after reading the source code (luminous-stable), I get a feeling that we cannot run Ceph with two NICs/Ports as we only have one 'ms_async_rdma_local_gid' per OSD, and it seems that the source code only uses one option (NIC). I would like to ask how I could communicate with the public network via one RDMA NIC and communicate with the cluster network via another RDMA NIC (apply RoCEV2 to both NICs). Since gids are unique within a machine, how can I use two different gids in 'ceph.conf'? Justin _______________________________________________ ceph-users mailing list ceph-users@xxxxxxxxxxxxxx http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
 |