On 22 January 2013 10:57, John Nielsen <lists@xxxxxxxxxxxx> wrote: > On Jan 19, 2013, at 7:56 PM, Joseph Glanville <joseph.glanville@xxxxxxxxxxxxxx> wrote: > >>>> I assume it is now an EoIB driver. Does it replace the IPoIB driver? >>>> >>> Nope, it is upper-layer thing: https://lwn.net/Articles/509448/ >> >> Aye, its effectively a NAT translation layer that strips Ethernet >> headers and grafts on IPoIB headers, thus using the same wire protocol >> and allowing communication from EoIB to IPoIB. >> >> However this approach is a little dirty and has been nacked by the >> netdev community so we aren't likely to see it in the mainline >> kernel.. basically ever. > > Just to clarify: > > EoIB has been around for a while (at least in the Mellanox software, not sure about mainline). It uses the mlx4_vnic module and is a true Ethernet encapsulation over InfiniBand. Unfortunately the newer Mellanox switches won't support it any more and the ones that to have entered "Limited Support." (Not to be confused with mlx4_en, which just turns a ConnectX card into a 10G Ethernet NIC.) > > IPoIB is IP over InfiniBand without Ethernet (the data link layer is straight InfiniBand). > > eIPoIB is (or will be, maybe) Ethernet over IP over InfiniBand. It is intended to work with both Linux bridging and regular IB switches that support IPoIB. (Allowing e.g. unmodified KVM guests on hypervisors connected to an IPoIB fabric.) Both Joseph's comments and the LWN link above are referring to eIPoIB. Last I heard (from a pretty direct source in the last couple of weeks) Mellanox is still working on this but doesn't have anything generally available yet. Here's hoping.. but the feedback on netdev was quite negative, to put it mildly. > > JN > Apolgies, I misread EoIB as eIPoIB as others were discussing IPoIB appearing as an Ethernet device. Personally I would like to see a pure software implementation of EoIB ala IPoIB, using the subnet manager to manage addressing etc rather than trying to implement a NAT style solution. The usefulness of communicating to IPoIB devices via the same interface as IPoIB doesn't sufficiently offset the dirtiness of NAT IMO. -- CTO | Orion Virtualisation Solutions | www.orionvm.com.au Phone: 1300 56 99 52 | Mobile: 0428 754 846 -- To unsubscribe from this list: send the line "unsubscribe ceph-devel" in the body of a message to majordomo@xxxxxxxxxxxxxxx More majordomo info at http://vger.kernel.org/majordomo-info.html
