> > Thanks for the reply Jason > > > > The RDMA stuff ignores everything in iptables. > > > > Can I ask why this is? > > roce is an incomplete emulation of the netstack with hardware > offload. everything iptables is part of the incompleteness.. OK thanks >> > IMHO, it is also a bug if loopback roce doesn't just work out of the >> > box, fully internally to the NIC. :\ >> >> OK. Note what I am trying to get working is a bit different. It'ss >> not internal to one NIC but across two NICs in the same >> server. Loopback inside one NIC works fine. > > I got that, but it makes no difference to my statement. Out of the box > the kernel should select one of the two NICs and do internal loopback. > > That is consistent with the netstack semantic that the IP address is a > property of the host not the netdev. OK I see what you are saying. I do see this working on my setup in the sense that if I don’t use Parav’s loopback script I see rdma_cm based connections loopback back internally off one of the HCAs. Stephen ��.n��������+%������w��{.n�����{���fk��ܨ}���Ơz�j:+v�����w����ޙ��&�)ߡ�a����z�ޗ���ݢj��w�f