Hello cephers, I've got a few questions for the community to help us with migrating ceph cluster from Infiniband networking to 10G Ethernet with no or minimal downtime. Please find below the details of the cluster as well as info on what we are trying to achieve. 1. Cluster Info: Ceph version - 15.2.15 Four storage servers running mon + osd + mgr + rgw services Ubuntu 20.04 server Networks: Infiniband (storage network) (ipoib interface and NOT RDMA) 192.168.168.0/24 ; 10G Ethernet (management network) 192.168.169.0/24 each server has an IP in each of the networks, i.e. 192.168.168.201 and 192.168.169.201 and so forth 2. What we would like to do: We are decommissioning our Infiniband infrastructure and moving towards 10G Ethernet. We would like to move ceph cluster from the current 192.168.168.0/24(IB) onto either 192.168.169.0/24(eth) running on 10G ethernet. Alternatively we could create a new ceph vlan on 10G ethernet and shift the IP range 192.168.168.0/24 to the new ceph vlan running on 10G instead of Infiniband. We would like to make the move with no or minimal downtime as we have critical services running on top of ceph, such as VMs, etc. Could someone suggest on the best/safest route to take for such migration? Is it a plausible scenarion, when one server is switched to the 192.168.169 network, while the others run in the original 192.168.168 network? From the networking view point it does not introduce any difficulties, but woud it create problems with the ceph itself? p.s. How would one go about changing an IP of the ceph server, providing the network remains the same? Many thanks Andrei _______________________________________________ ceph-users mailing list -- ceph-users@xxxxxxx To unsubscribe send an email to ceph-users-leave@xxxxxxx
 |