>> Using a NAT approach discussed in [1] I can setup IPv4 addresses on >> both HCAs such that I avoid a local loopback (the addresses I use >> are a little different to the ones in that reference but the >> approach is identical). This allows ping, iperf and other IP based >> applications to work just fine. For example: Thanks for the reply Jason > The RDMA stuff ignores everything in iptables. Can I ask why this is? > IIRC, you need to make 'ip route get blah' not return lo. This is done > with some combination of policy routing and sysfs tweaking. OK I think what Parav sent me aligns to that. I will test it and see if it works. > IMHO, it is also a bug if loopback roce doesn't just work out of the > box, fully internally to the NIC. :\ OK. Note what I am trying to get working is a bit different. It’s not internal to one NIC but across two NICs in the same server. Loopback inside one NIC works fine. ��.n��������+%������w��{.n�����{���fk��ܨ}���Ơz�j:+v�����w����ޙ��&�)ߡ�a����z�ޗ���ݢj��w�f