> -----Original Message----- > From: Nicolin Chen <nicolinc@xxxxxxxxxx> > Sent: Wednesday, August 28, 2024 6:15 PM > To: Shameerali Kolothum Thodi <shameerali.kolothum.thodi@xxxxxxxxxx> > Cc: Jason Gunthorpe <jgg@xxxxxxxxxx>; acpica-devel@xxxxxxxxxxxxxxx; > Guohanjun (Hanjun Guo) <guohanjun@xxxxxxxxxx>; > iommu@xxxxxxxxxxxxxxx; Joerg Roedel <joro@xxxxxxxxxx>; Kevin Tian > <kevin.tian@xxxxxxxxx>; kvm@xxxxxxxxxxxxxxx; Len Brown > <lenb@xxxxxxxxxx>; linux-acpi@xxxxxxxxxxxxxxx; linux-arm- > kernel@xxxxxxxxxxxxxxxxxxx; Lorenzo Pieralisi <lpieralisi@xxxxxxxxxx>; Rafael J. > Wysocki <rafael@xxxxxxxxxx>; Robert Moore <robert.moore@xxxxxxxxx>; > Robin Murphy <robin.murphy@xxxxxxx>; Sudeep Holla > <sudeep.holla@xxxxxxx>; Will Deacon <will@xxxxxxxxxx>; Alex Williamson > <alex.williamson@xxxxxxxxxx>; Eric Auger <eric.auger@xxxxxxxxxx>; Jean- > Philippe Brucker <jean-philippe@xxxxxxxxxx>; Moritz Fischer > <mdf@xxxxxxxxxx>; Michael Shavit <mshavit@xxxxxxxxxx>; > patches@xxxxxxxxxxxxxxx; Mostafa Saleh <smostafa@xxxxxxxxxx> > Subject: Re: [PATCH v2 0/8] Initial support for SMMUv3 nested translation > > Hi Shameer, > > On Wed, Aug 28, 2024 at 04:31:36PM +0000, Shameerali Kolothum Thodi > wrote: > > Hi Nicolin, > > > > > -----Original Message----- > > > From: Nicolin Chen <nicolinc@xxxxxxxxxx> > > > Sent: Tuesday, August 27, 2024 10:31 PM > > > To: Jason Gunthorpe <jgg@xxxxxxxxxx> > > > Cc: acpica-devel@xxxxxxxxxxxxxxx; Guohanjun (Hanjun Guo) > > > <guohanjun@xxxxxxxxxx>; iommu@xxxxxxxxxxxxxxx; Joerg Roedel > > > <joro@xxxxxxxxxx>; Kevin Tian <kevin.tian@xxxxxxxxx>; > > > kvm@xxxxxxxxxxxxxxx; Len Brown <lenb@xxxxxxxxxx>; linux- > > > acpi@xxxxxxxxxxxxxxx; linux-arm-kernel@xxxxxxxxxxxxxxxxxxx; Lorenzo > > > Pieralisi <lpieralisi@xxxxxxxxxx>; Rafael J. Wysocki > > > <rafael@xxxxxxxxxx>; Robert Moore <robert.moore@xxxxxxxxx>; Robin > > > Murphy <robin.murphy@xxxxxxx>; Sudeep Holla > <sudeep.holla@xxxxxxx>; > > > Will Deacon <will@xxxxxxxxxx>; Alex Williamson > > > <alex.williamson@xxxxxxxxxx>; Eric Auger <eric.auger@xxxxxxxxxx>; > > > Jean-Philippe Brucker <jean- philippe@xxxxxxxxxx>; Moritz Fischer > > > <mdf@xxxxxxxxxx>; Michael Shavit <mshavit@xxxxxxxxxx>; > > > patches@xxxxxxxxxxxxxxx; Shameerali Kolothum Thodi > > > <shameerali.kolothum.thodi@xxxxxxxxxx>; Mostafa Saleh > > > <smostafa@xxxxxxxxxx> > > > Subject: Re: [PATCH v2 0/8] Initial support for SMMUv3 nested > > > translation > > > > > > > > As mentioned above, the VIOMMU series would be required to test the > > > entire nesting feature, which now has a v2 rebasing on this series. > > > I tested it with a paring QEMU branch. Please refer to: > > > https://lore.kernel.org/linux- > > > iommu/cover.1724776335.git.nicolinc@xxxxxxxxxx/ > > > > Thanks for this. I haven't gone through the viommu and its Qemu branch > > yet. The way we present nested-smmuv3/iommufd to the Qemu seems to > > have changed with the above Qemu branch(multiple nested SMMUs). > > The old Qemu command line for nested setup doesn't work anymore. > > > > Could you please share an example Qemu command line to verify this > > series(Sorry, if I missed it in the links/git). > > My bad. I updated those two "for_iommufd_" QEMU branches with a > README commit on top of each for the reference command. Thanks. I did give it a go and this is my command line based on above, ./qemu-system-aarch64-nicolin-viommu -object iommufd,id=iommufd0 \ -machine hmat=on \ -machine virt,accel=kvm,gic-version=3,iommu=nested-smmuv3,ras=on \ -cpu host -smp cpus=61 -m size=16G,slots=4,maxmem=256G -nographic \ -object memory-backend-ram,size=8G,id=m0 \ -object memory-backend-ram,size=8G,id=m1 \ -numa node,memdev=m0,cpus=0-60,nodeid=0 -numa node,memdev=m1,nodeid=1 \ -device vfio-pci-nohotplug,host=0000:75:00.1,iommufd=iommufd0 \ -bios QEMU_EFI.fd \ -drive if=none,file=ubuntu-18.04-old.img,id=fs \ -device virtio-blk-device,drive=fs \ -kernel Image \ -append "rdinit=init console=ttyAMA0 root=/dev/vda rw earlycon=pl011,0x9000000 kpti=off" \ -nographic But it fails to boot very early: root@ubuntu:/home/shameer/qemu-test# ./qemu_run-simple-iommufd-nicolin-2 qemu-system-aarch64-nicolin-viommu: Illegal numa node 2 Any idea what am I missing? Do you any special config enabled while building Qemu? Thanks, Shameer
