On Thu, Sep 09, 2021 at 08:12:23AM -0700, Dave Ertman wrote: > There are two cases where the current PF does not support RDMA > functionality. The first is if the NVM loaded on the device is set > to not support RDMA (common_caps.rdma is false). The second is if > the kernel bonding driver has included the current PF in an active > link aggregate. > > When the driver has determined that this PF does not support RDMA, then > auxiliary devices should not be created on the auxiliary bus. This part is wrong, auxiliary devices should always be created, in your case it will be one eth device only without extra irdma device. Your "bug" is that you mixed auxiliary bus devices with "regular" ones and created eth device not as auxiliary one. This is why you are calling to auxiliary_device_init() for RDMA only and fallback to non-auxiliary mode. I hope that this is simple mistake while Intel folks rushed to merge irdma and not deliberate decision to find a way to support out-of-tree drivers. As a reminder, the whole idea of auxiliary bus is to have small, independent vendor driver core logic that manages capabilities and based on that creates/removes sub-devices (eth, rdma, vdpa ...), so driver core can properly load/unload their respective drivers. Thanks