On 3/22/23 10:01 PM, Jason Gunthorpe wrote: > On Wed, Mar 22, 2023 at 09:30:41PM +0800, Cheng Xu wrote: >> >> >> On 3/22/23 7:54 PM, Jason Gunthorpe wrote: >>> On Wed, Mar 22, 2023 at 03:05:29PM +0800, Cheng Xu wrote: >>> >>>> The current generation of erdma devices do not have this capability due to >>>> implementation complexity. Without this HW capability, isolating the MMIO >>>> space in software doesn't prevent the attack, because the malicious APPs >>>> can map mmio itself, not through verbs interface. >>> >>> This doesn't meet the security model of Linux, verbs HW is expected to >>> protect one process from another process. >> >> OK, I see. >> >> So the key point is that HW should restrict each process to use its own doorbell >> space. If hardware can do this, share or do not share MMIO pages both will meet >> the security requirement. Do I get it right? > > HW can never do that, HW is supposed to rely on the system MMU to > isolate doorbell registers > > The HW responsibility is to make doorbell MMIO registers safe in the > hands of other processes. > > Simple doorbells that only 'kick' and don't convey any information are > probably safe to share, and don't require HW checks between the > doorbell page and the PD/QP/CQ/etc > > Doorbells that deliver data - eg a head pointer - are not safe because > the wrong head pointer can corrupt the HW state. Process B must not be > able to corrupt the head pointer of a QP/CQ owned by Process A under > any circumstances. Definitely they cannot have access to the MMIO and > also the HW must ensure that writes coming from process B are rejected > if they touch resources owned by process a (eg by PD/QPN/CQN checks in > HW) > > Doorbells that accept entire WQE's are definately not safe as a > hostile process could execute a WQE on a QP it does not own. > It's much clear, thanks for your explanation and patience. Back to erdma context, we have rethought our implementation. For QPs, we have a field *wqe_index* in SQE/RQE, which indicates the validity of the current WQE. Incorrect doorbell value from other processes can not corrupt the QPC in hardware due to PI range and WQE content validation in HW. Unlike SQ/RQ, for CQ doorbell, It seems that we need some more works to protect it. We have started analyzing the details. Thanks, Cheng Xu
