> I assume that NVMe over fabric users/developers will disagree with > you about such primary/secondary separation. The point both Sagi and Doug are making are valid. The primary users of hardware in the linux-rdma subsystem are user space applications. That's why usNIC doesn't care about kernel users. That's why EFA has no kernel support. The qib and hfi1 drivers consider kernel support secondary and optimize for user space. Neither of these optimize for libibverbs, and I doubt any apps actually use those devices through libibverbs. Requiring support for a specific user space library is basically pointless and unenforceable. Once the kABI is exposed, any software can write to it. - Sean
