On Sun, 22 Nov 2020, Håkon Bugge wrote: > > The app that we have runs in user space. Can it use the cache? Is the > > cache only in Mellanox OFED? I heard that it was removed. > > An app in user space can use the ibacm cache. If you use the default > configuration that comes with rdma-core, both address and route > resolution will be from librdmacm directly to ibacm, i.e., no kernel > involved. The ibacm options are by default installed in > /etc/rdma/ibacm_opts.cfg I have been using that. > If you set acme_plus_kernel_only to one in said config file, you app will resolve the address using the kernel neighbour cache and the route resolution will go into the kernel and then "bounce" back to user space and ibacm through NetLink. Have not seen that in the RHEL7.8 version of ibacm. > > This is an an option while building ibacm? > > Nop, runtime config option as depicted above. Must be a newer version then. > The default provided by rdma-core should work, possible requiring the option above. The one in RHEL7 will never resolve anything through the subnet manger. Evey request results here in a leftover kernel thread hanging around. Which version of ibacm do you run?