On Sat, 2014-01-04 at 11:26 -0800, Dana Goyette wrote: > On 01/03/2014 04:03 PM, Alex Williamson wrote: > > On Mon, 2013-12-30 at 16:13 -0800, Dana Goyette wrote: > >> On 12/29/2013 08:16 PM, Alex Williamson wrote: > >>> On Sat, 2013-12-28 at 23:32 -0800, Dana Goyette wrote: > >>>> On 12/28/2013 7:23 PM, Alex Williamson wrote: > >>>>> On Sat, 2013-12-28 at 18:31 -0800, Dana Goyette wrote: > >>>>>> I have purchased both a SuperMicro X10SAE and an X10SAT, and I need to > >>>>>> soon decide which one to keep. > >>>>>> > >>>>>> The SuperMicro X10SAT has all the PCIe x1 slots hidden behind a PLX > >>>>>> PEX8066 switch, which claims to support ACS. I'd expect the devices > >>>>>> downstream of the PLX switch to be in separate groups. > >>>>>> > >>>>>> With Linux 3.13-rc5 and "enable overrides for missing ACS capabilities" > >>>>>> applied and set for the Intel root ports, the devices behind the switch > >>>>>> remain stuck in the same group. > >>>>>> > >>>>>> In terms of passing devices to different VMs, which is better: all > >>>>>> devices on different root ports, or all devices behind the one > >>>>>> ACS-supporting switch? > >>>>> Can you provide lspci -vvv info? If you're getting that for groups > >>>>> either the switch has ACS capabilities, but doesn't support the features > >>>>> we need or we're doing something wrong. Thanks, > >>>>> > >>>> I initially tried attaching the output as a .txt file, but it's too > >>>> large. Anyway, here's the output of lspci -nnvvv (you may notice that I > >>>> moved the Radeon to a different slot). > >>> Well, something seems amiss since the downstream switch ports all seem > >>> to support and enable the correct set of ACS capabilities. I'm tending > >>> to suspect something wrong with the ACS override patch or how it's being > >>> used since your IOMMU group is still based at the root port. Each root > >>> port is isolated from the other root ports though, so something is > >>> happening with the override patch. Can you provide the kernel command > >>> line you use to enable ACS overrides and the override patch you're > >>> using, as it applies to 3.13-rc5? Thanks, > >>> > >>> Alex > >>> > >>> -- > >>> To unsubscribe from this list: send the line "unsubscribe kvm" in > >>> the body of a message to majordomo@xxxxxxxxxxxxxxx > >>> More majordomo info at http://vger.kernel.org/majordomo-info.html > >>> > >> I'm using the original acs-override patch from this post: > >> https://lkml.org/lkml/2013/5/30/513 > >> > >> Kernel parameter is: > >> pcie_acs_override=id:8086:8c10,id:8086:8c12,id:8086:8c16,id:8086:8c18 Actually, you're not: pcie_acs_override=id:8086:8c10,id:8086:8c16,id:8086:8c18,id:8086:ac1a,id:8086:8c1c,id:8086:8c1e,id:10b5:8606 And we register all of them: [ 0.000000] PCIe ACS bypass added for 8086:8c10 [ 0.000000] PCIe ACS bypass added for 8086:8c16 [ 0.000000] PCIe ACS bypass added for 8086:8c18 [ 0.000000] PCIe ACS bypass added for 8086:ac1a [ 0.000000] PCIe ACS bypass added for 8086:8c1c [ 0.000000] PCIe ACS bypass added for 8086:8c1e [ 0.000000] PCIe ACS bypass added for 10b5:8606 However, note that the root port causing you trouble is 8086:8c12, which isn't provided as an override, therefore the code is doing the right thing and grouping all devices behind that root port together. > >> > >> When booting a kernel without the override patch, the following devices > >> are all in the same group: Intel Root Ports 1, 2, 4, 5; ASMedia SATA > >> controller; PLX PEX8606 switch; Renesas USB controller; TI Firewire > >> controller; Intel I210 Ethernet controller. > > Could you please try the patch below and send dmesg for the system once > > booted. This applies directly to upstream and includes the acs override > > patch. Thanks, > > (removed patch from quote.) > > Here's the complete dmesg, with pcie_acs_override still set: > > http://pastebin.com/YHuKnrTb > > Most relevant section: > > [ 0.524362] DMAR: No ATSR found > [ 0.524386] IOMMU 1 0xfed91000: using Queued invalidation > [ 0.524389] IOMMU: Setting RMRR: > [ 0.524398] IOMMU: Setting identity map for device 0000:00:1d.0 > [0x7bea1000 - 0x7beaffff] > [ 0.524423] IOMMU: Setting identity map for device 0000:00:1a.0 > [0x7bea1000 - 0x7beaffff] > [ 0.524441] IOMMU: Setting identity map for device 0000:00:14.0 > [0x7bea1000 - 0x7beaffff] > [ 0.524454] IOMMU: Prepare 0-16MiB unity mapping for LPC > [ 0.524461] IOMMU: Setting identity map for device 0000:00:1f.0 [0x0 > - 0xffffff] > [ 0.524548] PCI-DMA: Intel(R) Virtualization Technology for Directed I/O > [ 0.524551] intel_iommu_add_device(0000:00:00.0) > [ 0.524552] dma_pdev #1: 0000:00:00.0 > [ 0.524553] dma_pdev #2: 0000:00:00.0 > [ 0.524554] dma_pdev #3: 0000:00:00.0 > [ 0.524554] dma_pdev #4: 0000:00:00.0 > [ 0.524565] intel_iommu_add_device(0000:00:01.0) > [ 0.524566] dma_pdev #1: 0000:00:01.0 > [ 0.524567] dma_pdev #2: 0000:00:01.0 > [ 0.524569] pci_acs_enabled(0000:00:01.0, 001d) > [ 0.524572] pci_acs_flags_enabled no ACS capability on 0000:00:01.0 > [ 0.524573] pci_acs_flags_enabled(0000:00:01.0, 001d) -> false > [ 0.524574] -> false > [ 0.524575] pci_acs_enabled(0000:00:01.0, 001d) > [ 0.524577] pci_acs_flags_enabled no ACS capability on 0000:00:01.0 > [ 0.524578] pci_acs_flags_enabled(0000:00:01.0, 001d) -> false > [ 0.524579] -> false > [ 0.524580] dma_pdev #3: 0000:00:01.0 > [ 0.524581] dma_pdev #4: 0000:00:01.0 > [ 0.524584] intel_iommu_add_device(0000:00:01.1) > [ 0.524586] dma_pdev #1: 0000:00:01.1 > [ 0.524586] dma_pdev #2: 0000:00:01.1 > [ 0.524587] pci_acs_enabled(0000:00:01.1, 001d) > [ 0.524589] pci_acs_flags_enabled no ACS capability on 0000:00:01.1 > [ 0.524590] pci_acs_flags_enabled(0000:00:01.1, 001d) -> false > [ 0.524591] -> false > [ 0.524592] pci_acs_enabled(0000:00:01.0, 001d) > [ 0.524593] pci_acs_flags_enabled no ACS capability on 0000:00:01.0 > [ 0.524595] pci_acs_flags_enabled(0000:00:01.0, 001d) -> false > [ 0.524596] -> false > [ 0.524596] dma_pdev #3: 0000:00:01.0 > [ 0.524597] dma_pdev #4: 0000:00:01.0 > [ 0.524599] intel_iommu_add_device(0000:00:02.0) > [ 0.524601] dma_pdev #1: 0000:00:02.0 > [ 0.524601] dma_pdev #2: 0000:00:02.0 > [ 0.524602] dma_pdev #3: 0000:00:02.0 > [ 0.524603] dma_pdev #4: 0000:00:02.0 > [ 0.524606] intel_iommu_add_device(0000:00:03.0) > [ 0.524607] dma_pdev #1: 0000:00:03.0 > [ 0.524608] dma_pdev #2: 0000:00:03.0 > [ 0.524609] dma_pdev #3: 0000:00:03.0 > [ 0.524610] dma_pdev #4: 0000:00:03.0 > [ 0.524613] intel_iommu_add_device(0000:00:14.0) > [ 0.524614] dma_pdev #1: 0000:00:14.0 > [ 0.524615] dma_pdev #2: 0000:00:14.0 > [ 0.524616] dma_pdev #3: 0000:00:14.0 > [ 0.524617] dma_pdev #4: 0000:00:14.0 > [ 0.524620] intel_iommu_add_device(0000:00:16.0) > [ 0.524621] dma_pdev #1: 0000:00:16.0 > [ 0.524622] dma_pdev #2: 0000:00:16.0 > [ 0.524623] pci_acs_enabled(0000:00:16.0, 001d) > [ 0.524624] -> false > [ 0.524625] pci_acs_enabled(0000:00:16.0, 001d) > [ 0.524626] -> false > [ 0.524626] dma_pdev #3: 0000:00:16.0 > [ 0.524627] dma_pdev #4: 0000:00:16.0 > [ 0.524630] intel_iommu_add_device(0000:00:16.3) > [ 0.524631] dma_pdev #1: 0000:00:16.3 > [ 0.524632] dma_pdev #2: 0000:00:16.3 > [ 0.524633] pci_acs_enabled(0000:00:16.3, 001d) > [ 0.524634] -> false > [ 0.524635] pci_acs_enabled(0000:00:16.0, 001d) > [ 0.524636] -> false > [ 0.524637] dma_pdev #3: 0000:00:16.0 > [ 0.524638] dma_pdev #4: 0000:00:16.0 > [ 0.524640] intel_iommu_add_device(0000:00:19.0) > [ 0.524641] dma_pdev #1: 0000:00:19.0 > [ 0.524642] dma_pdev #2: 0000:00:19.0 > [ 0.524643] dma_pdev #3: 0000:00:19.0 > [ 0.524643] dma_pdev #4: 0000:00:19.0 > [ 0.524646] intel_iommu_add_device(0000:00:1a.0) > [ 0.524647] dma_pdev #1: 0000:00:1a.0 > [ 0.524648] dma_pdev #2: 0000:00:1a.0 > [ 0.524649] dma_pdev #3: 0000:00:1a.0 > [ 0.524650] dma_pdev #4: 0000:00:1a.0 > [ 0.524654] intel_iommu_add_device(0000:00:1b.0) > [ 0.524655] dma_pdev #1: 0000:00:1b.0 > [ 0.524656] dma_pdev #2: 0000:00:1b.0 > [ 0.524657] dma_pdev #3: 0000:00:1b.0 > [ 0.524658] dma_pdev #4: 0000:00:1b.0 > [ 0.524661] intel_iommu_add_device(0000:00:1c.0) > [ 0.524662] dma_pdev #1: 0000:00:1c.0 > [ 0.524663] dma_pdev #2: 0000:00:1c.0 > [ 0.524664] pci_acs_enabled(0000:00:1c.0, 001d) > [ 0.524665] PCIe ACS override match for 0000:00:1c.0 > [ 0.524666] -> true > [ 0.524667] dma_pdev #3: 0000:00:1c.0 > [ 0.524668] dma_pdev #4: 0000:00:1c.0 > [ 0.524671] intel_iommu_add_device(0000:00:1c.1) > [ 0.524672] dma_pdev #1: 0000:00:1c.1 > [ 0.524673] dma_pdev #2: 0000:00:1c.1 > [ 0.524674] pci_acs_enabled(0000:00:1c.1, 001d) > [ 0.524681] pci_acs_flags_enabled no ACS capability on 0000:00:1c.1 > [ 0.524682] pci_acs_flags_enabled(0000:00:1c.1, 001d) -> false > [ 0.524683] -> false > [ 0.524684] pci_acs_enabled(0000:00:1c.0, 001d) > [ 0.524685] PCIe ACS override match for 0000:00:1c.0 > [ 0.524686] -> true > [ 0.524687] pci_acs_enabled(0000:00:1c.1, 001d) > [ 0.524694] pci_acs_flags_enabled no ACS capability on 0000:00:1c.1 > [ 0.524695] pci_acs_flags_enabled(0000:00:1c.1, 001d) -> false > [ 0.524696] -> false > [ 0.524697] dma_pdev #3: 0000:00:1c.1 > [ 0.524698] dma_pdev #4: 0000:00:1c.1 > [ 0.524700] intel_iommu_add_device(0000:00:1c.3) > [ 0.524701] dma_pdev #1: 0000:00:1c.3 > [ 0.524702] dma_pdev #2: 0000:00:1c.3 > [ 0.524703] pci_acs_enabled(0000:00:1c.3, 001d) > [ 0.524704] PCIe ACS override match for 0000:00:1c.3 > [ 0.524705] -> true > [ 0.524706] dma_pdev #3: 0000:00:1c.3 > [ 0.524707] dma_pdev #4: 0000:00:1c.3 > [ 0.524710] intel_iommu_add_device(0000:00:1c.4) > [ 0.524711] dma_pdev #1: 0000:00:1c.4 > [ 0.524712] dma_pdev #2: 0000:00:1c.4 > [ 0.524713] pci_acs_enabled(0000:00:1c.4, 001d) > [ 0.524714] PCIe ACS override match for 0000:00:1c.4 > [ 0.524715] -> true > [ 0.524715] dma_pdev #3: 0000:00:1c.4 > [ 0.524716] dma_pdev #4: 0000:00:1c.4 > [ 0.524719] intel_iommu_add_device(0000:00:1d.0) > [ 0.524720] dma_pdev #1: 0000:00:1d.0 > [ 0.524721] dma_pdev #2: 0000:00:1d.0 > [ 0.524722] dma_pdev #3: 0000:00:1d.0 > [ 0.524723] dma_pdev #4: 0000:00:1d.0 > [ 0.524726] intel_iommu_add_device(0000:00:1f.0) > [ 0.524727] dma_pdev #1: 0000:00:1f.0 > [ 0.524728] dma_pdev #2: 0000:00:1f.0 > [ 0.524728] pci_acs_enabled(0000:00:1f.0, 001d) > [ 0.524729] -> false > [ 0.524730] pci_acs_enabled(0000:00:1f.0, 001d) > [ 0.524731] -> false > [ 0.524732] dma_pdev #3: 0000:00:1f.0 > [ 0.524733] dma_pdev #4: 0000:00:1f.0 > [ 0.524736] intel_iommu_add_device(0000:00:1f.2) > [ 0.524737] dma_pdev #1: 0000:00:1f.2 > [ 0.524738] dma_pdev #2: 0000:00:1f.2 > [ 0.524739] pci_acs_enabled(0000:00:1f.2, 001d) > [ 0.524740] -> false > [ 0.524741] pci_acs_enabled(0000:00:1f.0, 001d) > [ 0.524741] -> false > [ 0.524742] dma_pdev #3: 0000:00:1f.0 > [ 0.524743] dma_pdev #4: 0000:00:1f.0 > [ 0.524745] intel_iommu_add_device(0000:00:1f.3) > [ 0.524746] dma_pdev #1: 0000:00:1f.3 > [ 0.524747] dma_pdev #2: 0000:00:1f.3 > [ 0.524748] pci_acs_enabled(0000:00:1f.3, 001d) > [ 0.524749] -> false > [ 0.524750] pci_acs_enabled(0000:00:1f.0, 001d) > [ 0.524751] -> false > [ 0.524752] dma_pdev #3: 0000:00:1f.0 > [ 0.524752] dma_pdev #4: 0000:00:1f.0 > [ 0.524754] intel_iommu_add_device(0000:00:1f.6) > [ 0.524755] dma_pdev #1: 0000:00:1f.6 > [ 0.524756] dma_pdev #2: 0000:00:1f.6 > [ 0.524757] pci_acs_enabled(0000:00:1f.6, 001d) > [ 0.524758] -> false > [ 0.524759] pci_acs_enabled(0000:00:1f.0, 001d) > [ 0.524760] -> false > [ 0.524761] dma_pdev #3: 0000:00:1f.0 > [ 0.524762] dma_pdev #4: 0000:00:1f.0 > [ 0.524765] intel_iommu_add_device(0000:01:00.0) > [ 0.524766] dma_pdev #1: 0000:01:00.0 > [ 0.524767] dma_pdev #2: 0000:01:00.0 > [ 0.524768] pci_acs_enabled(0000:01:00.0, 001d) > [ 0.524771] pci_acs_flags_enabled no ACS capability on 0000:01:00.0 > [ 0.524772] pci_acs_flags_enabled(0000:01:00.0, 001d) -> false > [ 0.524773] -> false > [ 0.524774] pci_acs_enabled(0000:01:00.0, 001d) > [ 0.524776] pci_acs_flags_enabled no ACS capability on 0000:01:00.0 > [ 0.524777] pci_acs_flags_enabled(0000:01:00.0, 001d) -> false > [ 0.524778] -> false > [ 0.524779] dma_pdev #3: 0000:01:00.0 > [ 0.524780] pci_acs_path_enabled(0000:00:01.0, NULL, 001d) > [ 0.524781] pci_acs_enabled(0000:00:01.0, 001d) > [ 0.524783] pci_acs_flags_enabled no ACS capability on 0000:00:01.0 > [ 0.524784] pci_acs_flags_enabled(0000:00:01.0, 001d) -> false > [ 0.524785] -> false > [ 0.524786] -> false > [ 0.524787] dma_pdev #4: 0000:00:01.0 > [ 0.524789] intel_iommu_add_device(0000:01:00.1) > [ 0.524790] dma_pdev #1: 0000:01:00.1 > [ 0.524791] dma_pdev #2: 0000:01:00.1 > [ 0.524792] pci_acs_enabled(0000:01:00.1, 001d) > [ 0.524794] pci_acs_flags_enabled no ACS capability on 0000:01:00.1 > [ 0.524795] pci_acs_flags_enabled(0000:01:00.1, 001d) -> false > [ 0.524796] -> false > [ 0.524797] pci_acs_enabled(0000:01:00.0, 001d) > [ 0.524799] pci_acs_flags_enabled no ACS capability on 0000:01:00.0 > [ 0.524800] pci_acs_flags_enabled(0000:01:00.0, 001d) -> false > [ 0.524801] -> false > [ 0.524802] dma_pdev #3: 0000:01:00.0 > [ 0.524803] pci_acs_path_enabled(0000:00:01.0, NULL, 001d) > [ 0.524804] pci_acs_enabled(0000:00:01.0, 001d) > [ 0.524806] pci_acs_flags_enabled no ACS capability on 0000:00:01.0 > [ 0.524807] pci_acs_flags_enabled(0000:00:01.0, 001d) -> false > [ 0.524808] -> false > [ 0.524809] -> false > [ 0.524809] dma_pdev #4: 0000:00:01.0 > [ 0.524811] intel_iommu_add_device(0000:02:00.0) > [ 0.524813] dma_pdev #1: 0000:02:00.0 > [ 0.524813] dma_pdev #2: 0000:02:00.0 > [ 0.524814] dma_pdev #3: 0000:02:00.0 > [ 0.524815] pci_acs_path_enabled(0000:00:01.1, NULL, 001d) > [ 0.524816] pci_acs_enabled(0000:00:01.1, 001d) > [ 0.524818] pci_acs_flags_enabled no ACS capability on 0000:00:01.1 > [ 0.524819] pci_acs_flags_enabled(0000:00:01.1, 001d) -> false > [ 0.524820] -> false > [ 0.524821] -> false > [ 0.524822] dma_pdev #4: 0000:00:01.1 > [ 0.524824] intel_iommu_add_device(0000:03:04.0) > [ 0.524825] Upstream bridge 0000:02:00.0 > [ 0.524830] dma_pdev #1: 0000:02:00.0 > [ 0.524831] dma_pdev #2: 0000:02:00.0 > [ 0.524832] dma_pdev #3: 0000:02:00.0 > [ 0.524833] pci_acs_path_enabled(0000:00:01.1, NULL, 001d) > [ 0.524834] pci_acs_enabled(0000:00:01.1, 001d) > [ 0.524835] pci_acs_flags_enabled no ACS capability on 0000:00:01.1 > [ 0.524837] pci_acs_flags_enabled(0000:00:01.1, 001d) -> false > [ 0.524837] -> false > [ 0.524838] -> false > [ 0.524839] dma_pdev #4: 0000:00:01.1 > [ 0.524841] intel_iommu_add_device(0000:04:00.0) > [ 0.524842] dma_pdev #1: 0000:04:00.0 > [ 0.524843] dma_pdev #2: 0000:04:00.0 > [ 0.524844] dma_pdev #3: 0000:04:00.0 > [ 0.524845] pci_acs_path_enabled(0000:00:1c.0, NULL, 001d) > [ 0.524846] pci_acs_enabled(0000:00:1c.0, 001d) > [ 0.524847] PCIe ACS override match for 0000:00:1c.0 > [ 0.524848] -> true > [ 0.524849] -> true > [ 0.524849] dma_pdev #4: 0000:04:00.0 > [ 0.524852] intel_iommu_add_device(0000:05:00.0) > [ 0.524853] dma_pdev #1: 0000:05:00.0 > [ 0.524854] dma_pdev #2: 0000:05:00.0 > [ 0.524855] dma_pdev #3: 0000:05:00.0 > [ 0.524856] pci_acs_path_enabled(0000:00:1c.1, NULL, 001d) > [ 0.524857] pci_acs_enabled(0000:00:1c.1, 001d) > [ 0.524865] pci_acs_flags_enabled no ACS capability on 0000:00:1c.1 > [ 0.524866] pci_acs_flags_enabled(0000:00:1c.1, 001d) -> false > [ 0.524867] -> false > [ 0.524868] -> false > [ 0.524869] dma_pdev #4: 0000:00:1c.1 > [ 0.524871] intel_iommu_add_device(0000:06:01.0) > [ 0.524872] dma_pdev #1: 0000:06:01.0 > [ 0.524872] dma_pdev #2: 0000:06:01.0 > [ 0.524873] dma_pdev #3: 0000:06:01.0 > [ 0.524874] pci_acs_path_enabled(0000:05:00.0, NULL, 001d) > [ 0.524875] pci_acs_enabled(0000:05:00.0, 001d) > [ 0.524876] PCIe ACS override match for 0000:05:00.0 > [ 0.524877] -> true > [ 0.524878] pci_acs_enabled(0000:00:1c.1, 001d) > [ 0.524886] pci_acs_flags_enabled no ACS capability on 0000:00:1c.1 > [ 0.524887] pci_acs_flags_enabled(0000:00:1c.1, 001d) -> false > [ 0.524888] -> false > [ 0.524888] -> false > [ 0.524889] pci_acs_path_enabled(0000:00:1c.1, NULL, 001d) > [ 0.524891] pci_acs_enabled(0000:00:1c.1, 001d) > [ 0.524898] pci_acs_flags_enabled no ACS capability on 0000:00:1c.1 > [ 0.524899] pci_acs_flags_enabled(0000:00:1c.1, 001d) -> false > [ 0.524900] -> false > [ 0.524901] -> false > [ 0.524901] dma_pdev #4: 0000:00:1c.1 > [ 0.524903] intel_iommu_add_device(0000:06:04.0) > [ 0.524904] dma_pdev #1: 0000:06:04.0 > [ 0.524905] dma_pdev #2: 0000:06:04.0 > [ 0.524906] dma_pdev #3: 0000:06:04.0 > [ 0.524907] pci_acs_path_enabled(0000:05:00.0, NULL, 001d) > [ 0.524908] pci_acs_enabled(0000:05:00.0, 001d) > [ 0.524909] PCIe ACS override match for 0000:05:00.0 > [ 0.524910] -> true > [ 0.524911] pci_acs_enabled(0000:00:1c.1, 001d) > [ 0.524913] pci_acs_flags_enabled no ACS capability on 0000:00:1c.1 > [ 0.524914] pci_acs_flags_enabled(0000:00:1c.1, 001d) -> false > [ 0.524915] -> false > [ 0.524916] -> false > [ 0.524917] pci_acs_path_enabled(0000:00:1c.1, NULL, 001d) > [ 0.524918] pci_acs_enabled(0000:00:1c.1, 001d) > [ 0.524925] pci_acs_flags_enabled no ACS capability on 0000:00:1c.1 > [ 0.524926] pci_acs_flags_enabled(0000:00:1c.1, 001d) -> false > [ 0.524927] -> false > [ 0.524928] -> false > [ 0.524929] dma_pdev #4: 0000:00:1c.1 > [ 0.524949] intel_iommu_add_device(0000:06:05.0) > [ 0.524951] dma_pdev #1: 0000:06:05.0 > [ 0.524951] dma_pdev #2: 0000:06:05.0 > [ 0.524952] dma_pdev #3: 0000:06:05.0 > [ 0.524953] pci_acs_path_enabled(0000:05:00.0, NULL, 001d) > [ 0.524954] pci_acs_enabled(0000:05:00.0, 001d) > [ 0.524955] PCIe ACS override match for 0000:05:00.0 > [ 0.524957] -> true > [ 0.524958] pci_acs_enabled(0000:00:1c.1, 001d) > [ 0.524964] pci_acs_flags_enabled no ACS capability on 0000:00:1c.1 > [ 0.524965] pci_acs_flags_enabled(0000:00:1c.1, 001d) -> false > [ 0.524966] -> false > [ 0.524967] -> false > [ 0.524968] pci_acs_path_enabled(0000:00:1c.1, NULL, 001d) > [ 0.524969] pci_acs_enabled(0000:00:1c.1, 001d) > [ 0.524976] pci_acs_flags_enabled no ACS capability on 0000:00:1c.1 > [ 0.524977] pci_acs_flags_enabled(0000:00:1c.1, 001d) -> false > [ 0.524978] -> false > [ 0.524979] -> false > [ 0.524979] dma_pdev #4: 0000:00:1c.1 > [ 0.524983] intel_iommu_add_device(0000:06:07.0) > [ 0.524984] dma_pdev #1: 0000:06:07.0 > [ 0.524985] dma_pdev #2: 0000:06:07.0 > [ 0.524986] dma_pdev #3: 0000:06:07.0 > [ 0.524987] pci_acs_path_enabled(0000:05:00.0, NULL, 001d) > [ 0.524988] pci_acs_enabled(0000:05:00.0, 001d) > [ 0.524989] PCIe ACS override match for 0000:05:00.0 > [ 0.524990] -> true > [ 0.524991] pci_acs_enabled(0000:00:1c.1, 001d) > [ 0.524997] pci_acs_flags_enabled no ACS capability on 0000:00:1c.1 > [ 0.524998] pci_acs_flags_enabled(0000:00:1c.1, 001d) -> false > [ 0.524999] -> false > [ 0.525000] -> false > [ 0.525001] pci_acs_path_enabled(0000:00:1c.1, NULL, 001d) > [ 0.525002] pci_acs_enabled(0000:00:1c.1, 001d) > [ 0.525004] pci_acs_flags_enabled no ACS capability on 0000:00:1c.1 > [ 0.525006] pci_acs_flags_enabled(0000:00:1c.1, 001d) -> false > [ 0.525007] -> false > [ 0.525007] -> false > [ 0.525008] dma_pdev #4: 0000:00:1c.1 > [ 0.525010] intel_iommu_add_device(0000:06:09.0) > [ 0.525011] dma_pdev #1: 0000:06:09.0 > [ 0.525012] dma_pdev #2: 0000:06:09.0 > [ 0.525013] dma_pdev #3: 0000:06:09.0 > [ 0.525014] pci_acs_path_enabled(0000:05:00.0, NULL, 001d) > [ 0.525015] pci_acs_enabled(0000:05:00.0, 001d) > [ 0.525016] PCIe ACS override match for 0000:05:00.0 > [ 0.525017] -> true > [ 0.525018] pci_acs_enabled(0000:00:1c.1, 001d) > [ 0.525025] pci_acs_flags_enabled no ACS capability on 0000:00:1c.1 > [ 0.525026] pci_acs_flags_enabled(0000:00:1c.1, 001d) -> false > [ 0.525027] -> false > [ 0.525028] -> false > [ 0.525029] pci_acs_path_enabled(0000:00:1c.1, NULL, 001d) > [ 0.525030] pci_acs_enabled(0000:00:1c.1, 001d) > [ 0.525037] pci_acs_flags_enabled no ACS capability on 0000:00:1c.1 > [ 0.525038] pci_acs_flags_enabled(0000:00:1c.1, 001d) -> false > [ 0.525039] -> false > [ 0.525040] -> false > [ 0.525041] dma_pdev #4: 0000:00:1c.1 > [ 0.525043] intel_iommu_add_device(0000:0a:00.0) > [ 0.525044] dma_pdev #1: 0000:0a:00.0 > [ 0.525044] dma_pdev #2: 0000:0a:00.0 > [ 0.525045] dma_pdev #3: 0000:0a:00.0 > [ 0.525046] pci_acs_path_enabled(0000:06:07.0, NULL, 001d) > [ 0.525048] pci_acs_enabled(0000:06:07.0, 001d) > [ 0.525048] PCIe ACS override match for 0000:06:07.0 > [ 0.525049] -> true > [ 0.525050] pci_acs_enabled(0000:05:00.0, 001d) > [ 0.525051] PCIe ACS override match for 0000:05:00.0 > [ 0.525052] -> true > [ 0.525053] pci_acs_enabled(0000:00:1c.1, 001d) > [ 0.525060] pci_acs_flags_enabled no ACS capability on 0000:00:1c.1 > [ 0.525062] pci_acs_flags_enabled(0000:00:1c.1, 001d) -> false > [ 0.525062] -> false > [ 0.525063] -> false > [ 0.525064] pci_acs_path_enabled(0000:05:00.0, NULL, 001d) > [ 0.525065] pci_acs_enabled(0000:05:00.0, 001d) > [ 0.525066] PCIe ACS override match for 0000:05:00.0 > [ 0.525067] -> true > [ 0.525068] pci_acs_enabled(0000:00:1c.1, 001d) > [ 0.525075] pci_acs_flags_enabled no ACS capability on 0000:00:1c.1 > [ 0.525076] pci_acs_flags_enabled(0000:00:1c.1, 001d) -> false > [ 0.525077] -> false > [ 0.525078] -> false > [ 0.525079] pci_acs_path_enabled(0000:00:1c.1, NULL, 001d) > [ 0.525080] pci_acs_enabled(0000:00:1c.1, 001d) > [ 0.525087] pci_acs_flags_enabled no ACS capability on 0000:00:1c.1 > [ 0.525088] pci_acs_flags_enabled(0000:00:1c.1, 001d) -> false > [ 0.525089] -> false > [ 0.525090] -> false > [ 0.525091] dma_pdev #4: 0000:00:1c.1 > [ 0.525093] intel_iommu_add_device(0000:0b:00.0) > [ 0.525094] dma_pdev #1: 0000:0b:00.0 > [ 0.525095] dma_pdev #2: 0000:0b:00.0 > [ 0.525096] dma_pdev #3: 0000:0b:00.0 > [ 0.525097] pci_acs_path_enabled(0000:06:09.0, NULL, 001d) > [ 0.525098] pci_acs_enabled(0000:06:09.0, 001d) > [ 0.525099] PCIe ACS override match for 0000:06:09.0 > [ 0.525100] -> true > [ 0.525101] pci_acs_enabled(0000:05:00.0, 001d) > [ 0.525102] PCIe ACS override match for 0000:05:00.0 > [ 0.525103] -> true > [ 0.525103] pci_acs_enabled(0000:00:1c.1, 001d) > [ 0.525111] pci_acs_flags_enabled no ACS capability on 0000:00:1c.1 > [ 0.525112] pci_acs_flags_enabled(0000:00:1c.1, 001d) -> false > [ 0.525113] -> false > [ 0.525114] -> false > [ 0.525115] pci_acs_path_enabled(0000:05:00.0, NULL, 001d) > [ 0.525116] pci_acs_enabled(0000:05:00.0, 001d) > [ 0.525117] PCIe ACS override match for 0000:05:00.0 > [ 0.525118] -> true > [ 0.525118] pci_acs_enabled(0000:00:1c.1, 001d) > [ 0.525125] pci_acs_flags_enabled no ACS capability on 0000:00:1c.1 > [ 0.525126] pci_acs_flags_enabled(0000:00:1c.1, 001d) -> false > [ 0.525127] -> false > [ 0.525128] -> false > [ 0.525129] pci_acs_path_enabled(0000:00:1c.1, NULL, 001d) > [ 0.525130] pci_acs_enabled(0000:00:1c.1, 001d) > [ 0.525137] pci_acs_flags_enabled no ACS capability on 0000:00:1c.1 > [ 0.525138] pci_acs_flags_enabled(0000:00:1c.1, 001d) -> false > [ 0.525139] -> false > [ 0.525140] -> false > [ 0.525141] dma_pdev #4: 0000:00:1c.1 > [ 0.525143] intel_iommu_add_device(0000:0c:00.0) > [ 0.525144] Upstream bridge 0000:0b:00.0 > [ 0.525148] dma_pdev #1: 0000:0c:00.0 > [ 0.525149] dma_pdev #2: 0000:0c:00.0 > [ 0.525150] dma_pdev #3: 0000:0c:00.0 > [ 0.525151] pci_acs_path_enabled(0000:0b:00.0, NULL, 001d) > [ 0.525152] pci_acs_enabled(0000:0b:00.0, 001d) > [ 0.525153] -> false > [ 0.525154] -> false > [ 0.525155] pci_acs_path_enabled(0000:06:09.0, NULL, 001d) > [ 0.525156] pci_acs_enabled(0000:06:09.0, 001d) > [ 0.525157] PCIe ACS override match for 0000:06:09.0 > [ 0.525158] -> true > [ 0.525158] pci_acs_enabled(0000:05:00.0, 001d) > [ 0.525159] PCIe ACS override match for 0000:05:00.0 > [ 0.525160] -> true > [ 0.525161] pci_acs_enabled(0000:00:1c.1, 001d) > [ 0.525168] pci_acs_flags_enabled no ACS capability on 0000:00:1c.1 > [ 0.525169] pci_acs_flags_enabled(0000:00:1c.1, 001d) -> false > [ 0.525170] -> false > [ 0.525171] -> false > [ 0.525172] pci_acs_path_enabled(0000:05:00.0, NULL, 001d) > [ 0.525173] pci_acs_enabled(0000:05:00.0, 001d) > [ 0.525174] PCIe ACS override match for 0000:05:00.0 > [ 0.525175] -> true > [ 0.525175] pci_acs_enabled(0000:00:1c.1, 001d) > [ 0.525178] pci_acs_flags_enabled no ACS capability on 0000:00:1c.1 > [ 0.525179] pci_acs_flags_enabled(0000:00:1c.1, 001d) -> false > [ 0.525180] -> false > [ 0.525181] -> false > [ 0.525182] pci_acs_path_enabled(0000:00:1c.1, NULL, 001d) > [ 0.525183] pci_acs_enabled(0000:00:1c.1, 001d) > [ 0.525190] pci_acs_flags_enabled no ACS capability on 0000:00:1c.1 > [ 0.525191] pci_acs_flags_enabled(0000:00:1c.1, 001d) -> false > [ 0.525192] -> false > [ 0.525193] -> false > [ 0.525193] dma_pdev #4: 0000:00:1c.1 > [ 0.525195] intel_iommu_add_device(0000:0d:00.0) > [ 0.525196] dma_pdev #1: 0000:0d:00.0 > [ 0.525197] dma_pdev #2: 0000:0d:00.0 > [ 0.525198] dma_pdev #3: 0000:0d:00.0 > [ 0.525199] pci_acs_path_enabled(0000:00:1c.3, NULL, 001d) > [ 0.525200] pci_acs_enabled(0000:00:1c.3, 001d) > [ 0.525201] PCIe ACS override match for 0000:00:1c.3 > [ 0.525202] -> true > [ 0.525203] -> true > [ 0.525204] dma_pdev #4: 0000:0d:00.0 > > lspci as slots are now (since Radeon is back in first x16 slot): > > 00:00.0 Host bridge [0600]: Intel Corporation Xeon E3-1200 v3 Processor > DRAM Controller [8086:0c08] (rev 06) > 00:01.0 PCI bridge [0604]: Intel Corporation Xeon E3-1200 v3/4th Gen > Core Processor PCI Express x16 Controller [8086:0c01] (rev 06) > 00:01.1 PCI bridge [0604]: Intel Corporation Xeon E3-1200 v3/4th Gen > Core Processor PCI Express x8 Controller [8086:0c05] (rev 06) > 00:02.0 VGA compatible controller [0300]: Intel Corporation Xeon E3-1200 > v3 Processor Integrated Graphics Controller [8086:041a] (rev 06) > 00:03.0 Audio device [0403]: Intel Corporation Xeon E3-1200 v3/4th Gen > Core Processor HD Audio Controller [8086:0c0c] (rev 06) > 00:14.0 USB controller [0c03]: Intel Corporation 8 Series/C220 Series > Chipset Family USB xHCI [8086:8c31] (rev 05) > 00:16.0 Communication controller [0780]: Intel Corporation 8 Series/C220 > Series Chipset Family MEI Controller #1 [8086:8c3a] (rev 04) > 00:16.3 Serial controller [0700]: Intel Corporation 8 Series/C220 Series > Chipset Family KT Controller [8086:8c3d] (rev 04) > 00:19.0 Ethernet controller [0200]: Intel Corporation Ethernet > Connection I217-LM [8086:153a] (rev 05) > 00:1b.0 Audio device [0403]: Intel Corporation 8 Series/C220 Series > Chipset High Definition Audio Controller [8086:8c20] (rev 05) > 00:1c.0 PCI bridge [0604]: Intel Corporation 8 Series/C220 Series > Chipset Family PCI Express Root Port #1 [8086:8c10] (rev d5) > 00:1c.1 PCI bridge [0604]: Intel Corporation 8 Series/C220 Series > Chipset Family PCI Express Root Port #2 [8086:8c12] (rev d5) > 00:1c.3 PCI bridge [0604]: Intel Corporation 8 Series/C220 Series > Chipset Family PCI Express Root Port #4 [8086:8c16] (rev d5) > 00:1c.4 PCI bridge [0604]: Intel Corporation 8 Series/C220 Series > Chipset Family PCI Express Root Port #5 [8086:8c18] (rev d5) > 00:1d.0 USB controller [0c03]: Intel Corporation 8 Series/C220 Series > Chipset Family USB EHCI #1 [8086:8c26] (rev 05) > 00:1f.0 ISA bridge [0601]: Intel Corporation C226 Series Chipset Family > Server Advanced SKU LPC Controller [8086:8c56] (rev 05) > 00:1f.2 SATA controller [0106]: Intel Corporation 8 Series/C220 Series > Chipset Family 6-port SATA Controller 1 [AHCI mode] [8086:8c02] (rev 05) > 00:1f.3 SMBus [0c05]: Intel Corporation 8 Series/C220 Series Chipset > Family SMBus Controller [8086:8c22] (rev 05) > 00:1f.6 Signal processing controller [1180]: Intel Corporation 8 Series > Chipset Family Thermal Management Controller [8086:8c24] (rev 05) > 01:00.0 VGA compatible controller [0300]: Advanced Micro Devices, Inc. > [AMD/ATI] Juniper PRO [Radeon HD 5750] [1002:68be] > 01:00.1 Audio device [0403]: Advanced Micro Devices, Inc. [AMD/ATI] > Juniper HDMI Audio [Radeon HD 5700 Series] [1002:aa58] > 02:00.0 PCI bridge [0604]: PLX Technology, Inc. PEX8112 x1 Lane PCI > Express-to-PCI Bridge [10b5:8112] (rev aa) > 03:04.0 Multimedia audio controller [0401]: C-Media Electronics Inc > CMI8788 [Oxygen HD Audio] [13f6:8788] > 04:00.0 SATA controller [0106]: ASMedia Technology Inc. ASM1062 Serial > ATA Controller [1b21:0612] (rev 01) > 05:00.0 PCI bridge [0604]: PLX Technology, Inc. PEX 8606 6 Lane, 6 Port > PCI Express Gen 2 (5.0 GT/s) Switch [10b5:8606] (rev ba) > 06:01.0 PCI bridge [0604]: PLX Technology, Inc. PEX 8606 6 Lane, 6 Port > PCI Express Gen 2 (5.0 GT/s) Switch [10b5:8606] (rev ba) > 06:04.0 PCI bridge [0604]: PLX Technology, Inc. PEX 8606 6 Lane, 6 Port > PCI Express Gen 2 (5.0 GT/s) Switch [10b5:8606] (rev ba) > 06:05.0 PCI bridge [0604]: PLX Technology, Inc. PEX 8606 6 Lane, 6 Port > PCI Express Gen 2 (5.0 GT/s) Switch [10b5:8606] (rev ba) > 06:07.0 PCI bridge [0604]: PLX Technology, Inc. PEX 8606 6 Lane, 6 Port > PCI Express Gen 2 (5.0 GT/s) Switch [10b5:8606] (rev ba) > 06:09.0 PCI bridge [0604]: PLX Technology, Inc. PEX 8606 6 Lane, 6 Port > PCI Express Gen 2 (5.0 GT/s) Switch [10b5:8606] (rev ba) > 0a:00.0 USB controller [0c03]: Renesas Technology Corp. uPD720201 USB > 3.0 Host Controller [1912:0014] (rev 03) > 0b:00.0 PCI bridge [0604]: Texas Instruments XIO2213A/B/XIO2221 PCI > Express to PCI Bridge [Cheetah Express] [104c:823e] (rev 01) > 0c:00.0 FireWire (IEEE 1394) [0c00]: Texas Instruments > XIO2213A/B/XIO2221 IEEE-1394b OHCI Controller [Cheetah Express] > [104c:823f] (rev 01) > 0d:00.0 Ethernet controller [0200]: Intel Corporation I210 Gigabit > Network Connection [8086:1533] (rev 03) > > > -- > To unsubscribe from this list: send the line "unsubscribe kvm" in > the body of a message to majordomo@xxxxxxxxxxxxxxx > More majordomo info at http://vger.kernel.org/majordomo-info.html -- To unsubscribe from this list: send the line "unsubscribe kvm" in the body of a message to majordomo@xxxxxxxxxxxxxxx More majordomo info at http://vger.kernel.org/majordomo-info.html
