On Tue, 22 Mar 2022 14:39:43 +0000, Rob Herring <robh@xxxxxxxxxx> wrote: > > On Tue, Mar 22, 2022 at 01:16:35PM +0000, Robin Murphy wrote: > > On 2022-03-21 20:06, Robin Murphy wrote: > > > On 2022-03-21 19:21, Marc Zyngier wrote: > > > > On Mon, 21 Mar 2022 18:03:27 +0000, > > > > Rob Herring <robh@xxxxxxxxxx> wrote: > > > > > > > > > > On Mon, Mar 21, 2022 at 11:36 AM Marc Zyngier <maz@xxxxxxxxxx> wrote: > > > > > > > > > > > > On Mon, 21 Mar 2022 15:17:34 +0000, > > > > > > Rob Herring <robh@xxxxxxxxxx> wrote: > > > > > > > > > > > > > > On Mon, Mar 21, 2022 at 5:49 AM Marc Zyngier <maz@xxxxxxxxxx> wrote: > > > > > > > > > > > > > > > For XGene-1, I'd still like to understand what the issue is. Reverting > > > > > > > the first fix and fixing 'dma-ranges' should have fixed it. I need a > > > > > > > dump of how the IB registers are initialized in both cases. I'm not > > > > > > > saying changing 'dma-ranges' in the firmware is going to be required > > > > > > > here. There's a couple of other ways we could fix that without a > > > > > > > firmware change, but first I need to understand why it broke. > > > > > > > > > > > > Reverting 6dce5aa59e0b was enough for me, without changing anything > > > > > > else. > > > > > > > > > > Meaning c7a75d07827a didn't matter for you. I'm not sure that it would. > > > > > > > > > > Can you tell me what 'dma-ranges' contains on your system? > > > > > > > > Each pcie node (all 5 of them) has: > > > > > > > > dma-ranges = <0x42000000 0x80 0x00 0x80 0x00 0x00 0x80000000 > > > > 0x42000000 0x00 0x00 0x00 0x00 0x80 0x00>; > > This is the same as what Stéphane has for Merlin. So c7a75d07827a ("PCI: > xgene: Fix IB window setup") should have fixed Mustang. Should, but didn't. The DT also carries additional properties: ib-ranges = <0x42000000 0x40 0x00 0x40 0x00 0x40 0x00 0x00 0x00 0x79000000 0x00 0x79000000 0x00 0x800000>; which the driver ignores, but that could be relevant. FWIW, I've stashed the DT at [1]. M. [1] http://www.loen.fr/tmp/mustang.dts -- Without deviation from the norm, progress is not possible.