With upgrade to kernel 5.9 my VMs stopped working, because some devices
can't be passed through.
This is caused by different IOMMU groups and devices being in the same
group.
For ex. with kernel 5.8 this are IOMMU groups:
IOMMU Group 40:
08:01.0 PCI bridge [0604]: ASMedia Technology Inc. Device
[1b21:118f]
09:00.0 Ethernet controller [0200]: Intel Corporation I211
Gigabit Network Connection [8086:1539] (rev 03)
IOMMU Group 43:
0c:00.0 SATA controller [0106]: ASMedia Technology Inc. ASM1062
Serial ATA Controller [1b21:0612] (rev 02)
IOMMU Group 44:
0d:00.0 USB controller [0c03]: ASMedia Technology Inc. ASM1042A
USB 3.0 Host Controller [1b21:1142]
Ethernet, SATA and USB controller in its own group.
And with 5.9, everything is in one group:
IOMMU Group 29:
00:1c.0 PCI bridge [0604]: Intel Corporation C610/X99 series
chipset PCI Express Root Port #1 [8086:8d10] (rev d5)
00:1c.3 PCI bridge [0604]: Intel Corporation C610/X99 series
chipset PCI Express Root Port #4 [8086:8d16] (rev d5)
00:1c.4 PCI bridge [0604]: Intel Corporation C610/X99 series
chipset PCI Express Root Port #5 [8086:8d18] (rev d5)
00:1c.6 PCI bridge [0604]: Intel Corporation C610/X99 series
chipset PCI Express Root Port #7 [8086:8d1c] (rev d5)
07:00.0 PCI bridge [0604]: ASMedia Technology Inc. Device
[1b21:118f]
08:01.0 PCI bridge [0604]: ASMedia Technology Inc. Device
[1b21:118f]
08:03.0 PCI bridge [0604]: ASMedia Technology Inc. Device
[1b21:118f]
08:04.0 PCI bridge [0604]: ASMedia Technology Inc. Device
[1b21:118f]
09:00.0 Ethernet controller [0200]: Intel Corporation I211
Gigabit Network Connection [8086:1539] (rev 03)
0c:00.0 SATA controller [0106]: ASMedia Technology Inc. ASM1062
Serial ATA Controller [1b21:0612] (rev 02)
0d:00.0 USB controller [0c03]: ASMedia Technology Inc. ASM1042A
USB 3.0 Host Controller [1b21:1142]
This seems to be caused by commit 52fbf5bdeeef415b28b8e6cdade1e48927927f60.
commit 52fbf5bdeeef415b28b8e6cdade1e48927927f60
Author: Rajat Jain <rajatja@xxxxxxxxxx>
Date: Tue Jul 7 15:46:02 2020 -0700
PCI: Cache ACS capability offset in device
Currently the ACS capability is being looked up at a number of
places. Read
and store it once at enumeration so that it can be used by all
later. No
functional change intended.
Link:
https://lore.kernel.org/r/20200707224604.3737893-2-rajatja@xxxxxxxxxx
Signed-off-by: Rajat Jain <rajatja@xxxxxxxxxx>
Signed-off-by: Bjorn Helgaas <bhelgaas@xxxxxxxxxx>
drivers/pci/p2pdma.c | 2 +-
drivers/pci/pci.c | 20 ++++++++++++++++----
drivers/pci/pci.h | 2 +-
drivers/pci/probe.c | 2 +-
drivers/pci/quirks.c | 8 ++++----
include/linux/pci.h | 1 +
6 files changed, 24 insertions(+), 11 deletions(-)
If I revert this commit, I get back old groups.
In commit log there is message 'No functional change intended'. But
there is functional change.
This is Intel Core i7-5930K CPU and X99 chipset. But I see the same
thing on other Intel systems (didn't test on AMD).
Below are full IOMMU groups.
Kernel 5.8 or 5.9 with commit 52fbf5bdeeef415b28b8e6cdade1e48927927f60
reverted:
IOMMU Group 0:
ff:0b.0 System peripheral [0880]: Intel Corporation Xeon E7
v3/Xeon E5 v3/Core i7 R3 QPI Link 0 & 1 Monitoring [8086:2f81] (rev 02)
ff:0b.1 Performance counters [1101]: Intel Corporation Xeon E7
v3/Xeon E5 v3/Core i7 R3 QPI Link 0 & 1 Monitoring [8086:2f36] (rev 02)
ff:0b.2 Performance counters [1101]: Intel Corporation Xeon E7
v3/Xeon E5 v3/Core i7 R3 QPI Link 0 & 1 Monitoring [8086:2f37] (rev 02)
IOMMU Group 1:
ff:0c.0 System peripheral [0880]: Intel Corporation Xeon E7
v3/Xeon E5 v3/Core i7 Unicast Registers [8086:2fe0] (rev 02)
ff:0c.1 System peripheral [0880]: Intel Corporation Xeon E7
v3/Xeon E5 v3/Core i7 Unicast Registers [8086:2fe1] (rev 02)
ff:0c.2 System peripheral [0880]: Intel Corporation Xeon E7
v3/Xeon E5 v3/Core i7 Unicast Registers [8086:2fe2] (rev 02)
ff:0c.3 System peripheral [0880]: Intel Corporation Xeon E7
v3/Xeon E5 v3/Core i7 Unicast Registers [8086:2fe3] (rev 02)
ff:0c.4 System peripheral [0880]: Intel Corporation Xeon E7
v3/Xeon E5 v3/Core i7 Unicast Registers [8086:2fe4] (rev 02)
ff:0c.5 System peripheral [0880]: Intel Corporation Xeon E7
v3/Xeon E5 v3/Core i7 Unicast Registers [8086:2fe5] (rev 02)
IOMMU Group 10:
ff:1e.0 System peripheral [0880]: Intel Corporation Xeon E7
v3/Xeon E5 v3/Core i7 Power Control Unit [8086:2f98] (rev 02)
ff:1e.1 System peripheral [0880]: Intel Corporation Xeon E7
v3/Xeon E5 v3/Core i7 Power Control Unit [8086:2f99] (rev 02)
ff:1e.2 System peripheral [0880]: Intel Corporation Xeon E7
v3/Xeon E5 v3/Core i7 Power Control Unit [8086:2f9a] (rev 02)
ff:1e.3 System peripheral [0880]: Intel Corporation Xeon E7
v3/Xeon E5 v3/Core i7 Power Control Unit [8086:2fc0] (rev 02)
ff:1e.4 System peripheral [0880]: Intel Corporation Xeon E7
v3/Xeon E5 v3/Core i7 Power Control Unit [8086:2f9c] (rev 02)
IOMMU Group 11:
ff:1f.0 System peripheral [0880]: Intel Corporation Xeon E7
v3/Xeon E5 v3/Core i7 VCU [8086:2f88] (rev 02)
ff:1f.2 System peripheral [0880]: Intel Corporation Xeon E7
v3/Xeon E5 v3/Core i7 VCU [8086:2f8a] (rev 02)
IOMMU Group 12:
00:00.0 Host bridge [0600]: Intel Corporation Xeon E7 v3/Xeon
E5 v3/Core i7 DMI2 [8086:2f00] (rev 02)
IOMMU Group 13:
00:01.0 PCI bridge [0604]: Intel Corporation Xeon E7 v3/Xeon E5
v3/Core i7 PCI Express Root Port 1 [8086:2f02] (rev 02)
IOMMU Group 14:
00:01.1 PCI bridge [0604]: Intel Corporation Xeon E7 v3/Xeon E5
v3/Core i7 PCI Express Root Port 1 [8086:2f03] (rev 02)
IOMMU Group 15:
00:02.0 PCI bridge [0604]: Intel Corporation Xeon E7 v3/Xeon E5
v3/Core i7 PCI Express Root Port 2 [8086:2f04] (rev 02)
IOMMU Group 16:
00:03.0 PCI bridge [0604]: Intel Corporation Xeon E7 v3/Xeon E5
v3/Core i7 PCI Express Root Port 3 [8086:2f08] (rev 02)
IOMMU Group 17:
00:03.2 PCI bridge [0604]: Intel Corporation Xeon E7 v3/Xeon E5
v3/Core i7 PCI Express Root Port 3 [8086:2f0a] (rev 02)
IOMMU Group 18:
00:05.0 System peripheral [0880]: Intel Corporation Xeon E7
v3/Xeon E5 v3/Core i7 Address Map, VTd_Misc, System Management
[8086:2f28] (rev 02)
IOMMU Group 19:
00:05.1 System peripheral [0880]: Intel Corporation Xeon E7
v3/Xeon E5 v3/Core i7 Hot Plug [8086:2f29] (rev 02)
IOMMU Group 2:
ff:0f.0 System peripheral [0880]: Intel Corporation Xeon E7
v3/Xeon E5 v3/Core i7 Buffered Ring Agent [8086:2ff8] (rev 02)
ff:0f.1 System peripheral [0880]: Intel Corporation Xeon E7
v3/Xeon E5 v3/Core i7 Buffered Ring Agent [8086:2ff9] (rev 02)
ff:0f.4 System peripheral [0880]: Intel Corporation Xeon E7
v3/Xeon E5 v3/Core i7 System Address Decoder & Broadcast Registers
[8086:2ffc] (rev 02)
ff:0f.5 System peripheral [0880]: Intel Corporation Xeon E7
v3/Xeon E5 v3/Core i7 System Address Decoder & Broadcast Registers
[8086:2ffd] (rev 02)
ff:0f.6 System peripheral [0880]: Intel Corporation Xeon E7
v3/Xeon E5 v3/Core i7 System Address Decoder & Broadcast Registers
[8086:2ffe] (rev 02)
IOMMU Group 20:
00:05.2 System peripheral [0880]: Intel Corporation Xeon E7
v3/Xeon E5 v3/Core i7 RAS, Control Status and Global Errors [8086:2f2a]
(rev 02)
IOMMU Group 21:
00:05.4 PIC [0800]: Intel Corporation Xeon E7 v3/Xeon E5
v3/Core i7 I/O APIC [8086:2f2c] (rev 02)
IOMMU Group 22:
00:11.0 Unassigned class [ff00]: Intel Corporation C610/X99
series chipset SPSR [8086:8d7c] (rev 05)
IOMMU Group 23:
00:11.4 SATA controller [0106]: Intel Corporation C610/X99
series chipset sSATA Controller [AHCI mode] [8086:8d62] (rev 05)
IOMMU Group 24:
00:14.0 USB controller [0c03]: Intel Corporation C610/X99
series chipset USB xHCI Host Controller [8086:8d31] (rev 05)
IOMMU Group 25:
00:16.0 Communication controller [0780]: Intel Corporation
C610/X99 series chipset MEI Controller #1 [8086:8d3a] (rev 05)
IOMMU Group 26:
00:19.0 Ethernet controller [0200]: Intel Corporation Ethernet
Connection (2) I218-V [8086:15a1] (rev 05)
IOMMU Group 27:
00:1a.0 USB controller [0c03]: Intel Corporation C610/X99
series chipset USB Enhanced Host Controller #2 [8086:8d2d] (rev 05)
IOMMU Group 28:
00:1b.0 Audio device [0403]: Intel Corporation C610/X99 series
chipset HD Audio Controller [8086:8d20] (rev 05)
IOMMU Group 29:
00:1c.0 PCI bridge [0604]: Intel Corporation C610/X99 series
chipset PCI Express Root Port #1 [8086:8d10] (rev d5)
IOMMU Group 3:
ff:10.0 System peripheral [0880]: Intel Corporation Xeon E7
v3/Xeon E5 v3/Core i7 PCIe Ring Interface [8086:2f1d] (rev 02)
ff:10.1 Performance counters [1101]: Intel Corporation Xeon E7
v3/Xeon E5 v3/Core i7 PCIe Ring Interface [8086:2f34] (rev 02)
ff:10.5 System peripheral [0880]: Intel Corporation Xeon E7
v3/Xeon E5 v3/Core i7 Scratchpad & Semaphore Registers [8086:2f1e] (rev 02)
ff:10.6 Performance counters [1101]: Intel Corporation Xeon E7
v3/Xeon E5 v3/Core i7 Scratchpad & Semaphore Registers [8086:2f7d] (rev 02)
ff:10.7 System peripheral [0880]: Intel Corporation Xeon E7
v3/Xeon E5 v3/Core i7 Scratchpad & Semaphore Registers [8086:2f1f] (rev 02)
IOMMU Group 30:
00:1c.3 PCI bridge [0604]: Intel Corporation C610/X99 series
chipset PCI Express Root Port #4 [8086:8d16] (rev d5)
IOMMU Group 31:
00:1c.4 PCI bridge [0604]: Intel Corporation C610/X99 series
chipset PCI Express Root Port #5 [8086:8d18] (rev d5)
IOMMU Group 32:
00:1c.6 PCI bridge [0604]: Intel Corporation C610/X99 series
chipset PCI Express Root Port #7 [8086:8d1c] (rev d5)
IOMMU Group 33:
00:1d.0 USB controller [0c03]: Intel Corporation C610/X99
series chipset USB Enhanced Host Controller #1 [8086:8d26] (rev 05)
IOMMU Group 34:
00:1f.0 ISA bridge [0601]: Intel Corporation C610/X99 series
chipset LPC Controller [8086:8d47] (rev 05)
00:1f.2 SATA controller [0106]: Intel Corporation C610/X99
series chipset 6-Port SATA Controller [AHCI mode] [8086:8d02] (rev 05)
00:1f.3 SMBus [0c05]: Intel Corporation C610/X99 series chipset
SMBus Controller [8086:8d22] (rev 05)
IOMMU Group 35:
05:00.0 Non-Volatile memory controller [0108]: Samsung
Electronics Co Ltd NVMe SSD Controller SM981/PM981/PM983 [144d:a808]
IOMMU Group 36:
03:00.0 VGA compatible controller [0300]: NVIDIA Corporation
GM204 [GeForce GTX 980] [10de:13c0] (rev a1)
03:00.1 Audio device [0403]: NVIDIA Corporation GM204 High
Definition Audio Controller [10de:0fbb] (rev a1)
IOMMU Group 37:
02:00.0 Ethernet controller [0200]: Mellanox Technologies
MT27500 Family [ConnectX-3] [15b3:1003]
IOMMU Group 38:
01:00.0 VGA compatible controller [0300]: NVIDIA Corporation
GP107 [GeForce GTX 1050 Ti] [10de:1c82] (rev a1)
01:00.1 Audio device [0403]: NVIDIA Corporation GP107GL High
Definition Audio Controller [10de:0fb9] (rev a1)
IOMMU Group 39:
07:00.0 PCI bridge [0604]: ASMedia Technology Inc. Device
[1b21:118f]
IOMMU Group 4:
ff:12.0 System peripheral [0880]: Intel Corporation Xeon E7
v3/Xeon E5 v3/Core i7 Home Agent 0 [8086:2fa0] (rev 02)
ff:12.1 Performance counters [1101]: Intel Corporation Xeon E7
v3/Xeon E5 v3/Core i7 Home Agent 0 [8086:2f30] (rev 02)
IOMMU Group 40:
08:01.0 PCI bridge [0604]: ASMedia Technology Inc. Device
[1b21:118f]
09:00.0 Ethernet controller [0200]: Intel Corporation I211
Gigabit Network Connection [8086:1539] (rev 03)
IOMMU Group 41:
08:03.0 PCI bridge [0604]: ASMedia Technology Inc. Device
[1b21:118f]
IOMMU Group 42:
08:04.0 PCI bridge [0604]: ASMedia Technology Inc. Device
[1b21:118f]
IOMMU Group 43:
0c:00.0 SATA controller [0106]: ASMedia Technology Inc. ASM1062
Serial ATA Controller [1b21:0612] (rev 02)
IOMMU Group 44:
0d:00.0 USB controller [0c03]: ASMedia Technology Inc. ASM1042A
USB 3.0 Host Controller [1b21:1142]
IOMMU Group 5:
ff:13.0 System peripheral [0880]: Intel Corporation Xeon E7
v3/Xeon E5 v3/Core i7 Integrated Memory Controller 0 Target Address,
Thermal & RAS Registers [8086... (rev 02)
ff:13.1 System peripheral [0880]: Intel Corporation Xeon E7
v3/Xeon E5 v3/Core i7 Integrated Memory Controller 0 Target Address,
Thermal & RAS Registers [8086... (rev 02)
ff:13.2 System peripheral [0880]: Intel Corporation Xeon E7
v3/Xeon E5 v3/Core i7 Integrated Memory Controller 0 Channel Target
Address Decoder [8086:2faa] (rev 02)
ff:13.3 System peripheral [0880]: Intel Corporation Xeon E7
v3/Xeon E5 v3/Core i7 Integrated Memory Controller 0 Channel Target
Address Decoder [8086:2fab] (rev 02)
ff:13.4 System peripheral [0880]: Intel Corporation Xeon E7
v3/Xeon E5 v3/Core i7 Integrated Memory Controller 0 Channel Target
Address Decoder [8086:2fac] (rev 02)
ff:13.5 System peripheral [0880]: Intel Corporation Xeon E7
v3/Xeon E5 v3/Core i7 Integrated Memory Controller 0 Channel Target
Address Decoder [8086:2fad] (rev 02)
ff:13.6 System peripheral [0880]: Intel Corporation Xeon E7
v3/Xeon E5 v3/Core i7 DDRIO Channel 0/1 Broadcast [8086:2fae] (rev 02)
ff:13.7 System peripheral [0880]: Intel Corporation Xeon E7
v3/Xeon E5 v3/Core i7 DDRIO Global Broadcast [8086:2faf] (rev 02)
IOMMU Group 6:
ff:14.0 System peripheral [0880]: Intel Corporation Xeon E7
v3/Xeon E5 v3/Core i7 Integrated Memory Controller 0 Channel 0 Thermal
Control [8086:2fb0] (rev 02)
ff:14.1 System peripheral [0880]: Intel Corporation Xeon E7
v3/Xeon E5 v3/Core i7 Integrated Memory Controller 0 Channel 1 Thermal
Control [8086:2fb1] (rev 02)
ff:14.2 System peripheral [0880]: Intel Corporation Xeon E7
v3/Xeon E5 v3/Core i7 Integrated Memory Controller 0 Channel 0 ERROR
Registers [8086:2fb2] (rev 02)
ff:14.3 System peripheral [0880]: Intel Corporation Xeon E7
v3/Xeon E5 v3/Core i7 Integrated Memory Controller 0 Channel 1 ERROR
Registers [8086:2fb3] (rev 02)
ff:14.4 System peripheral [0880]: Intel Corporation Xeon E7
v3/Xeon E5 v3/Core i7 DDRIO (VMSE) 0 & 1 [8086:2fbc] (rev 02)
ff:14.5 System peripheral [0880]: Intel Corporation Xeon E7
v3/Xeon E5 v3/Core i7 DDRIO (VMSE) 0 & 1 [8086:2fbd] (rev 02)
ff:14.6 System peripheral [0880]: Intel Corporation Xeon E7
v3/Xeon E5 v3/Core i7 DDRIO (VMSE) 0 & 1 [8086:2fbe] (rev 02)
ff:14.7 System peripheral [0880]: Intel Corporation Xeon E7
v3/Xeon E5 v3/Core i7 DDRIO (VMSE) 0 & 1 [8086:2fbf] (rev 02)
IOMMU Group 7:
ff:15.0 System peripheral [0880]: Intel Corporation Xeon E7
v3/Xeon E5 v3/Core i7 Integrated Memory Controller 0 Channel 2 Thermal
Control [8086:2fb4] (rev 02)
ff:15.1 System peripheral [0880]: Intel Corporation Xeon E7
v3/Xeon E5 v3/Core i7 Integrated Memory Controller 0 Channel 3 Thermal
Control [8086:2fb5] (rev 02)
ff:15.2 System peripheral [0880]: Intel Corporation Xeon E7
v3/Xeon E5 v3/Core i7 Integrated Memory Controller 0 Channel 2 ERROR
Registers [8086:2fb6] (rev 02)
ff:15.3 System peripheral [0880]: Intel Corporation Xeon E7
v3/Xeon E5 v3/Core i7 Integrated Memory Controller 0 Channel 3 ERROR
Registers [8086:2fb7] (rev 02)
IOMMU Group 8:
ff:16.0 System peripheral [0880]: Intel Corporation Xeon E7
v3/Xeon E5 v3/Core i7 Integrated Memory Controller 1 Target Address,
Thermal & RAS Registers [8086... (rev 02)
ff:16.6 System peripheral [0880]: Intel Corporation Xeon E7
v3/Xeon E5 v3/Core i7 DDRIO Channel 2/3 Broadcast [8086:2f6e] (rev 02)
ff:16.7 System peripheral [0880]: Intel Corporation Xeon E7
v3/Xeon E5 v3/Core i7 DDRIO Global Broadcast [8086:2f6f] (rev 02)
IOMMU Group 9:
ff:17.0 System peripheral [0880]: Intel Corporation Xeon E7
v3/Xeon E5 v3/Core i7 Integrated Memory Controller 1 Channel 0 Thermal
Control [8086:2fd0] (rev 02)
ff:17.4 System peripheral [0880]: Intel Corporation Xeon E7
v3/Xeon E5 v3/Core i7 DDRIO (VMSE) 2 & 3 [8086:2fb8] (rev 02)
ff:17.5 System peripheral [0880]: Intel Corporation Xeon E7
v3/Xeon E5 v3/Core i7 DDRIO (VMSE) 2 & 3 [8086:2fb9] (rev 02)
ff:17.6 System peripheral [0880]: Intel Corporation Xeon E7
v3/Xeon E5 v3/Core i7 DDRIO (VMSE) 2 & 3 [8086:2fba] (rev 02)
ff:17.7 System peripheral [0880]: Intel Corporation Xeon E7
v3/Xeon E5 v3/Core i7 DDRIO (VMSE) 2 & 3 [8086:2fbb] (rev 02)
Kernel 5.9:
IOMMU Group 0:
ff:0b.0 System peripheral [0880]: Intel Corporation Xeon E7
v3/Xeon E5 v3/Core i7 R3 QPI Link 0 & 1 Monitoring [8086:2f81] (rev 02)
ff:0b.1 Performance counters [1101]: Intel Corporation Xeon E7
v3/Xeon E5 v3/Core i7 R3 QPI Link 0 & 1 Monitoring [8086:2f36] (rev 02)
ff:0b.2 Performance counters [1101]: Intel Corporation Xeon E7
v3/Xeon E5 v3/Core i7 R3 QPI Link 0 & 1 Monitoring [8086:2f37] (rev 02)
IOMMU Group 1:
ff:0c.0 System peripheral [0880]: Intel Corporation Xeon E7
v3/Xeon E5 v3/Core i7 Unicast Registers [8086:2fe0] (rev 02)
ff:0c.1 System peripheral [0880]: Intel Corporation Xeon E7
v3/Xeon E5 v3/Core i7 Unicast Registers [8086:2fe1] (rev 02)
ff:0c.2 System peripheral [0880]: Intel Corporation Xeon E7
v3/Xeon E5 v3/Core i7 Unicast Registers [8086:2fe2] (rev 02)
ff:0c.3 System peripheral [0880]: Intel Corporation Xeon E7
v3/Xeon E5 v3/Core i7 Unicast Registers [8086:2fe3] (rev 02)
ff:0c.4 System peripheral [0880]: Intel Corporation Xeon E7
v3/Xeon E5 v3/Core i7 Unicast Registers [8086:2fe4] (rev 02)
ff:0c.5 System peripheral [0880]: Intel Corporation Xeon E7
v3/Xeon E5 v3/Core i7 Unicast Registers [8086:2fe5] (rev 02)
IOMMU Group 10:
ff:1e.0 System peripheral [0880]: Intel Corporation Xeon E7
v3/Xeon E5 v3/Core i7 Power Control Unit [8086:2f98] (rev 02)
ff:1e.1 System peripheral [0880]: Intel Corporation Xeon E7
v3/Xeon E5 v3/Core i7 Power Control Unit [8086:2f99] (rev 02)
ff:1e.2 System peripheral [0880]: Intel Corporation Xeon E7
v3/Xeon E5 v3/Core i7 Power Control Unit [8086:2f9a] (rev 02)
ff:1e.3 System peripheral [0880]: Intel Corporation Xeon E7
v3/Xeon E5 v3/Core i7 Power Control Unit [8086:2fc0] (rev 02)
ff:1e.4 System peripheral [0880]: Intel Corporation Xeon E7
v3/Xeon E5 v3/Core i7 Power Control Unit [8086:2f9c] (rev 02)
IOMMU Group 11:
ff:1f.0 System peripheral [0880]: Intel Corporation Xeon E7
v3/Xeon E5 v3/Core i7 VCU [8086:2f88] (rev 02)
ff:1f.2 System peripheral [0880]: Intel Corporation Xeon E7
v3/Xeon E5 v3/Core i7 VCU [8086:2f8a] (rev 02)
IOMMU Group 12:
00:00.0 Host bridge [0600]: Intel Corporation Xeon E7 v3/Xeon
E5 v3/Core i7 DMI2 [8086:2f00] (rev 02)
IOMMU Group 13:
00:01.0 PCI bridge [0604]: Intel Corporation Xeon E7 v3/Xeon E5
v3/Core i7 PCI Express Root Port 1 [8086:2f02] (rev 02)
IOMMU Group 14:
00:01.1 PCI bridge [0604]: Intel Corporation Xeon E7 v3/Xeon E5
v3/Core i7 PCI Express Root Port 1 [8086:2f03] (rev 02)
IOMMU Group 15:
00:02.0 PCI bridge [0604]: Intel Corporation Xeon E7 v3/Xeon E5
v3/Core i7 PCI Express Root Port 2 [8086:2f04] (rev 02)
IOMMU Group 16:
00:03.0 PCI bridge [0604]: Intel Corporation Xeon E7 v3/Xeon E5
v3/Core i7 PCI Express Root Port 3 [8086:2f08] (rev 02)
IOMMU Group 17:
00:03.2 PCI bridge [0604]: Intel Corporation Xeon E7 v3/Xeon E5
v3/Core i7 PCI Express Root Port 3 [8086:2f0a] (rev 02)
IOMMU Group 18:
00:05.0 System peripheral [0880]: Intel Corporation Xeon E7
v3/Xeon E5 v3/Core i7 Address Map, VTd_Misc, System Management
[8086:2f28] (rev 02)
IOMMU Group 19:
00:05.1 System peripheral [0880]: Intel Corporation Xeon E7
v3/Xeon E5 v3/Core i7 Hot Plug [8086:2f29] (rev 02)
IOMMU Group 2:
ff:0f.0 System peripheral [0880]: Intel Corporation Xeon E7
v3/Xeon E5 v3/Core i7 Buffered Ring Agent [8086:2ff8] (rev 02)
ff:0f.1 System peripheral [0880]: Intel Corporation Xeon E7
v3/Xeon E5 v3/Core i7 Buffered Ring Agent [8086:2ff9] (rev 02)
ff:0f.4 System peripheral [0880]: Intel Corporation Xeon E7
v3/Xeon E5 v3/Core i7 System Address Decoder & Broadcast Registers
[8086:2ffc] (rev 02)
ff:0f.5 System peripheral [0880]: Intel Corporation Xeon E7
v3/Xeon E5 v3/Core i7 System Address Decoder & Broadcast Registers
[8086:2ffd] (rev 02)
ff:0f.6 System peripheral [0880]: Intel Corporation Xeon E7
v3/Xeon E5 v3/Core i7 System Address Decoder & Broadcast Registers
[8086:2ffe] (rev 02)
IOMMU Group 20:
00:05.2 System peripheral [0880]: Intel Corporation Xeon E7
v3/Xeon E5 v3/Core i7 RAS, Control Status and Global Errors [8086:2f2a]
(rev 02)
IOMMU Group 21:
00:05.4 PIC [0800]: Intel Corporation Xeon E7 v3/Xeon E5
v3/Core i7 I/O APIC [8086:2f2c] (rev 02)
IOMMU Group 22:
00:11.0 Unassigned class [ff00]: Intel Corporation C610/X99
series chipset SPSR [8086:8d7c] (rev 05)
IOMMU Group 23:
00:11.4 SATA controller [0106]: Intel Corporation C610/X99
series chipset sSATA Controller [AHCI mode] [8086:8d62] (rev 05)
IOMMU Group 24:
00:14.0 USB controller [0c03]: Intel Corporation C610/X99
series chipset USB xHCI Host Controller [8086:8d31] (rev 05)
IOMMU Group 25:
00:16.0 Communication controller [0780]: Intel Corporation
C610/X99 series chipset MEI Controller #1 [8086:8d3a] (rev 05)
IOMMU Group 26:
00:19.0 Ethernet controller [0200]: Intel Corporation Ethernet
Connection (2) I218-V [8086:15a1] (rev 05)
IOMMU Group 27:
00:1a.0 USB controller [0c03]: Intel Corporation C610/X99
series chipset USB Enhanced Host Controller #2 [8086:8d2d] (rev 05)
IOMMU Group 28:
00:1b.0 Audio device [0403]: Intel Corporation C610/X99 series
chipset HD Audio Controller [8086:8d20] (rev 05)
IOMMU Group 29:
00:1c.0 PCI bridge [0604]: Intel Corporation C610/X99 series
chipset PCI Express Root Port #1 [8086:8d10] (rev d5)
00:1c.3 PCI bridge [0604]: Intel Corporation C610/X99 series
chipset PCI Express Root Port #4 [8086:8d16] (rev d5)
00:1c.4 PCI bridge [0604]: Intel Corporation C610/X99 series
chipset PCI Express Root Port #5 [8086:8d18] (rev d5)
00:1c.6 PCI bridge [0604]: Intel Corporation C610/X99 series
chipset PCI Express Root Port #7 [8086:8d1c] (rev d5)
07:00.0 PCI bridge [0604]: ASMedia Technology Inc. Device
[1b21:118f]
08:01.0 PCI bridge [0604]: ASMedia Technology Inc. Device
[1b21:118f]
08:03.0 PCI bridge [0604]: ASMedia Technology Inc. Device
[1b21:118f]
08:04.0 PCI bridge [0604]: ASMedia Technology Inc. Device
[1b21:118f]
09:00.0 Ethernet controller [0200]: Intel Corporation I211
Gigabit Network Connection [8086:1539] (rev 03)
0c:00.0 SATA controller [0106]: ASMedia Technology Inc. ASM1062
Serial ATA Controller [1b21:0612] (rev 02)
0d:00.0 USB controller [0c03]: ASMedia Technology Inc. ASM1042A
USB 3.0 Host Controller [1b21:1142]
IOMMU Group 3:
ff:10.0 System peripheral [0880]: Intel Corporation Xeon E7
v3/Xeon E5 v3/Core i7 PCIe Ring Interface [8086:2f1d] (rev 02)
ff:10.1 Performance counters [1101]: Intel Corporation Xeon E7
v3/Xeon E5 v3/Core i7 PCIe Ring Interface [8086:2f34] (rev 02)
ff:10.5 System peripheral [0880]: Intel Corporation Xeon E7
v3/Xeon E5 v3/Core i7 Scratchpad & Semaphore Registers [8086:2f1e] (rev 02)
ff:10.6 Performance counters [1101]: Intel Corporation Xeon E7
v3/Xeon E5 v3/Core i7 Scratchpad & Semaphore Registers [8086:2f7d] (rev 02)
ff:10.7 System peripheral [0880]: Intel Corporation Xeon E7
v3/Xeon E5 v3/Core i7 Scratchpad & Semaphore Registers [8086:2f1f] (rev 02)
IOMMU Group 30:
00:1d.0 USB controller [0c03]: Intel Corporation C610/X99
series chipset USB Enhanced Host Controller #1 [8086:8d26] (rev 05)
IOMMU Group 31:
00:1f.0 ISA bridge [0601]: Intel Corporation C610/X99 series
chipset LPC Controller [8086:8d47] (rev 05)
00:1f.2 SATA controller [0106]: Intel Corporation C610/X99
series chipset 6-Port SATA Controller [AHCI mode] [8086:8d02] (rev 05)
00:1f.3 SMBus [0c05]: Intel Corporation C610/X99 series chipset
SMBus Controller [8086:8d22] (rev 05)
IOMMU Group 32:
05:00.0 Non-Volatile memory controller [0108]: Samsung
Electronics Co Ltd NVMe SSD Controller SM981/PM981/PM983 [144d:a808]
IOMMU Group 33:
03:00.0 VGA compatible controller [0300]: NVIDIA Corporation
GM204 [GeForce GTX 980] [10de:13c0] (rev a1)
03:00.1 Audio device [0403]: NVIDIA Corporation GM204 High
Definition Audio Controller [10de:0fbb] (rev a1)
IOMMU Group 34:
02:00.0 Ethernet controller [0200]: Mellanox Technologies
MT27500 Family [ConnectX-3] [15b3:1003]
IOMMU Group 35:
01:00.0 VGA compatible controller [0300]: NVIDIA Corporation
GP107 [GeForce GTX 1050 Ti] [10de:1c82] (rev a1)
01:00.1 Audio device [0403]: NVIDIA Corporation GP107GL High
Definition Audio Controller [10de:0fb9] (rev a1)
IOMMU Group 4:
ff:12.0 System peripheral [0880]: Intel Corporation Xeon E7
v3/Xeon E5 v3/Core i7 Home Agent 0 [8086:2fa0] (rev 02)
ff:12.1 Performance counters [1101]: Intel Corporation Xeon E7
v3/Xeon E5 v3/Core i7 Home Agent 0 [8086:2f30] (rev 02)
IOMMU Group 5:
ff:13.0 System peripheral [0880]: Intel Corporation Xeon E7
v3/Xeon E5 v3/Core i7 Integrated Memory Controller 0 Target Address,
Thermal & RAS Registers [8086... (rev 02)
ff:13.1 System peripheral [0880]: Intel Corporation Xeon E7
v3/Xeon E5 v3/Core i7 Integrated Memory Controller 0 Target Address,
Thermal & RAS Registers [8086... (rev 02)
ff:13.2 System peripheral [0880]: Intel Corporation Xeon E7
v3/Xeon E5 v3/Core i7 Integrated Memory Controller 0 Channel Target
Address Decoder [8086:2faa] (rev 02)
ff:13.3 System peripheral [0880]: Intel Corporation Xeon E7
v3/Xeon E5 v3/Core i7 Integrated Memory Controller 0 Channel Target
Address Decoder [8086:2fab] (rev 02)
ff:13.4 System peripheral [0880]: Intel Corporation Xeon E7
v3/Xeon E5 v3/Core i7 Integrated Memory Controller 0 Channel Target
Address Decoder [8086:2fac] (rev 02)
ff:13.5 System peripheral [0880]: Intel Corporation Xeon E7
v3/Xeon E5 v3/Core i7 Integrated Memory Controller 0 Channel Target
Address Decoder [8086:2fad] (rev 02)
ff:13.6 System peripheral [0880]: Intel Corporation Xeon E7
v3/Xeon E5 v3/Core i7 DDRIO Channel 0/1 Broadcast [8086:2fae] (rev 02)
ff:13.7 System peripheral [0880]: Intel Corporation Xeon E7
v3/Xeon E5 v3/Core i7 DDRIO Global Broadcast [8086:2faf] (rev 02)
IOMMU Group 6:
ff:14.0 System peripheral [0880]: Intel Corporation Xeon E7
v3/Xeon E5 v3/Core i7 Integrated Memory Controller 0 Channel 0 Thermal
Control [8086:2fb0] (rev 02)
ff:14.1 System peripheral [0880]: Intel Corporation Xeon E7
v3/Xeon E5 v3/Core i7 Integrated Memory Controller 0 Channel 1 Thermal
Control [8086:2fb1] (rev 02)
ff:14.2 System peripheral [0880]: Intel Corporation Xeon E7
v3/Xeon E5 v3/Core i7 Integrated Memory Controller 0 Channel 0 ERROR
Registers [8086:2fb2] (rev 02)
ff:14.3 System peripheral [0880]: Intel Corporation Xeon E7
v3/Xeon E5 v3/Core i7 Integrated Memory Controller 0 Channel 1 ERROR
Registers [8086:2fb3] (rev 02)
ff:14.4 System peripheral [0880]: Intel Corporation Xeon E7
v3/Xeon E5 v3/Core i7 DDRIO (VMSE) 0 & 1 [8086:2fbc] (rev 02)
ff:14.5 System peripheral [0880]: Intel Corporation Xeon E7
v3/Xeon E5 v3/Core i7 DDRIO (VMSE) 0 & 1 [8086:2fbd] (rev 02)
ff:14.6 System peripheral [0880]: Intel Corporation Xeon E7
v3/Xeon E5 v3/Core i7 DDRIO (VMSE) 0 & 1 [8086:2fbe] (rev 02)
ff:14.7 System peripheral [0880]: Intel Corporation Xeon E7
v3/Xeon E5 v3/Core i7 DDRIO (VMSE) 0 & 1 [8086:2fbf] (rev 02)
IOMMU Group 7:
ff:15.0 System peripheral [0880]: Intel Corporation Xeon E7
v3/Xeon E5 v3/Core i7 Integrated Memory Controller 0 Channel 2 Thermal
Control [8086:2fb4] (rev 02)
ff:15.1 System peripheral [0880]: Intel Corporation Xeon E7
v3/Xeon E5 v3/Core i7 Integrated Memory Controller 0 Channel 3 Thermal
Control [8086:2fb5] (rev 02)
ff:15.2 System peripheral [0880]: Intel Corporation Xeon E7
v3/Xeon E5 v3/Core i7 Integrated Memory Controller 0 Channel 2 ERROR
Registers [8086:2fb6] (rev 02)
ff:15.3 System peripheral [0880]: Intel Corporation Xeon E7
v3/Xeon E5 v3/Core i7 Integrated Memory Controller 0 Channel 3 ERROR
Registers [8086:2fb7] (rev 02)
IOMMU Group 8:
ff:16.0 System peripheral [0880]: Intel Corporation Xeon E7
v3/Xeon E5 v3/Core i7 Integrated Memory Controller 1 Target Address,
Thermal & RAS Registers [8086... (rev 02)
ff:16.6 System peripheral [0880]: Intel Corporation Xeon E7
v3/Xeon E5 v3/Core i7 DDRIO Channel 2/3 Broadcast [8086:2f6e] (rev 02)
ff:16.7 System peripheral [0880]: Intel Corporation Xeon E7
v3/Xeon E5 v3/Core i7 DDRIO Global Broadcast [8086:2f6f] (rev 02)
IOMMU Group 9:
ff:17.0 System peripheral [0880]: Intel Corporation Xeon E7
v3/Xeon E5 v3/Core i7 Integrated Memory Controller 1 Channel 0 Thermal
Control [8086:2fd0] (rev 02)
ff:17.4 System peripheral [0880]: Intel Corporation Xeon E7
v3/Xeon E5 v3/Core i7 DDRIO (VMSE) 2 & 3 [8086:2fb8] (rev 02)
ff:17.5 System peripheral [0880]: Intel Corporation Xeon E7
v3/Xeon E5 v3/Core i7 DDRIO (VMSE) 2 & 3 [8086:2fb9] (rev 02)
ff:17.6 System peripheral [0880]: Intel Corporation Xeon E7
v3/Xeon E5 v3/Core i7 DDRIO (VMSE) 2 & 3 [8086:2fba] (rev 02)
ff:17.7 System peripheral [0880]: Intel Corporation Xeon E7
v3/Xeon E5 v3/Core i7 DDRIO (VMSE) 2 & 3 [8086:2fbb] (rev 02)
