> On Jan 19, 2021, at 9:11 PM, Lu Baolu <baolu.lu@xxxxxxxxxxxxxxx> wrote: > > On 1/19/21 10:37 PM, Chuck Lever wrote: >>> On Jan 18, 2021, at 8:22 PM, Lu Baolu <baolu.lu@xxxxxxxxxxxxxxx> wrote: >>> >>> Do you mind posting the cap and ecap of the iommu used by your device? >>> >>> You can get it via sysfs, for example: >>> >>> /sys/bus/pci/devices/0000:00:14.0/iommu/intel-iommu# ls >>> address cap domains_supported domains_used ecap version >> [root@manet intel-iommu]# lspci | grep Mellanox >> 03:00.0 Network controller: Mellanox Technologies MT27520 Family [ConnectX-3 Pro] >> [root@manet intel-iommu]# pwd >> /sys/devices/pci0000:00/0000:00:03.0/0000:03:00.0/iommu/intel-iommu >> [root@manet intel-iommu]# for i in *; do echo -n $i ": "; cat $i; done >> address : c7ffc000 >> cap : d2078c106f0466 > > MGAW: 101111 (supporting 48-bit address width) > SAGAW: 00100 (supporting 48-bit 4-level page table) > > So the calculation of domain->domain.geometry.aperture_end is right. I found the cause of the performance loss with c062db039f40: it was a testing error on my part. I will begin looking at c588072bba6b ("iommu/vt-d: Convert intel iommu driver to the iommu ops"). -- Chuck Lever