Idan,
NVMe over Fabrics in its secure "register_always" mode registers and invalidates the user buffer upon each IO. The protocol enables the host to request the susbsystem to use SEND WITH INVALIDATE operation while returning the response capsule and invalidate the local key (remote_invalidation). In some HW implementations, the local network adapter may perform better while using local invalidation operations.
This is a device quirk and if you want to optimize for this you need to expose it via verbs interface. We won't add a module parameter for implementation specific stuff. Note that we currently need to rework the case where we use local invalidates and properly wait for them to complete. -- To unsubscribe from this list: send the line "unsubscribe linux-rdma" in the body of a message to majordomo@xxxxxxxxxxxxxxx More majordomo info at http://vger.kernel.org/majordomo-info.html