On Mon, Oct 11, 2021 at 4:04 PM Robin Murphy <robin.murphy@xxxxxxx> wrote: > > On 2021-10-09 08:06, Jon Nettleton wrote: > [...] > >>> + if (rmr->flags & IOMMU_RMR_REMAP_PERMITTED) { > >>> + type = IOMMU_RESV_DIRECT_RELAXABLE; > >>> + /* > >>> + * Set IOMMU_CACHE as IOMMU_RESV_DIRECT_RELAXABLE is > >>> + * normally used for allocated system memory that is > >>> + * then used for device specific reserved regions. > >>> + */ > >>> + prot |= IOMMU_CACHE; > >>> + } else { > >>> + type = IOMMU_RESV_DIRECT; > >>> + /* > >>> + * Set IOMMU_MMIO as IOMMU_RESV_DIRECT is normally used > >>> + * for device memory like MSI doorbell. > >>> + */ > >>> + prot |= IOMMU_MMIO; > >>> + } > >> > >> I'm not sure we ever got a definitive answer to this - does DPAA2 > >> actually go wrong if we use IOMMU_MMIO here? I'd still much prefer to > >> make the fewest possible assumptions, since at this point it's basically > >> just a stop-gap until we can fix the spec. It's become clear that we > >> can't reliably rely on guessing attributes, so I'm not too fussed about > >> theoretical cases that currently don't work (due to complete lack of RMR > >> support) continuing to not work for the moment, as long as we can make > >> the real-world cases we actually have work at all. Anything which only > >> affects performance I'd rather leave until firmware can tell us what to do. > > > > Well it isn't DPAA2, it is FSL_MC_BUS that fails with IOMMU_MMIO > > mappings. DPAA2 is just one connected device. > > Apologies if I'm being overly loose with terminology there - my point of > reference for this hardware is documentation for the old LS2080A, where > the "DPAA2 Reference Manual" gives a strong impression that the MC is a > component belonging to the overall DPAA2 architecture. Either way it > technically stands to reason that the other DPAA2 components would only > be usable if the MC itself works (unless I've been holding a major > misconception about that for years as well). > > In the context of this discussion, please consider any reference I may > make to bits of NXP's hardware to be shorthand for "the thing for which > NXP have a vested interest in IORT RMRs". Ultimately the spec doesn't mention what IOMMU properties the regions should have. Even marking them as IOMMU_READ/WRITE is as much of an assumption as using IOMMU_MMIO or IOMMU_CACHE. It just seems IOMMU_MMIO is the most popular since all the examples use it for MSI doorbells in the documentation. I am interested why this concern is only being brought up at this point in a patchset that has been on the mailing list for 8+ months? This is based on a spec that has existed from Arm since 2020 with the most recent revisions published in Feb 2021. The lack of RMR support in the kernel is affecting real world products, and the ability for SystemReady ES certified systems from just fully working with recent distributions. Even worse, is that without this patchset customers are forced to jump through hoops to purposefully re-enable smmu bypass making their systems less secure. How is this a good experience for customers of SystemReady hardware when for any mainline distribution to work the first thing they have to do is make their system less secure? -Jon > > Thanks, > Robin.