Hi,
we are currently trying to deploy CephFS on 7 storage nodes connected by
two infiniband ports and an ethernet port for external communication.
For various reasons the network interfaces are mapped to the same IP
range e.g. x.x.x.15y (eno1), x.x.x.17y (ib1), x.x.x.18y (ib2) with x
constant for all ports and server and only "y" changing for individual
server.
Most initial networking traffic is send over Ethernet, which then leads
Ceph to choosing this interface for communication. The problem now lies
in the fact that it is not possible to communicate inside of the cluster
over this interface at all. This leads to timeout of all ceph commands
after restart or a failure to setting up the server at all.
Is it possible to deselect or fully ignore the Ethernet port for
deploying and running the infrastructure via cephadm without changing
the code:
https://github.com/ceph/ceph/blob/master/src/cephadm/cephadm
Line 6730++
Cheers
Dominik
_______________________________________________
ceph-users mailing list -- ceph-users@xxxxxxx
To unsubscribe send an email to ceph-users-leave@xxxxxxx
