On Wed, 2015-02-18 at 08:30 -0600, Bjorn Helgaas wrote: > > So the hypervisor call that removes the device from the partition will > fail if there are any translations that reference the memory of the > device. > > Let me go through this in excruciating detail to see if I understand > what's going on: > > - PCI core enumerates device D1 > - PCI core sets device D1 BAR 0 = 0x1000 > - driver claims D1 > - driver ioremaps 0x1000 at virtual address V > - translation V -> 0x1000 is in TLB > - driver iounmaps V (but V -> 0x1000 translation may remain in TLB) > - driver releases D1 > - hot-remove D1 (without vm_unmap_aliases(), hypervisor would fail > this) > - it would be a bug to reference V here, but if we did, the > virt-to-phys translation would succeed and we'd have a Master Abort or > Unsupported Request on PCI/PCIe > - hot-add D2 > - PCI core enumerates device D2 > - PCI core sets device D2 BAR 0 = 0x1000 > - it would be a bug to reference V here (before ioremapping), but if > we did, the reference would reach D2 > > I don't see anything hypervisor-specific here except for the fact that > the hypervisor checks for existing translations and most other > platforms don't. But it seems like the unexpected PCI aborts could > happen on any platform. Well, only if we incorrectly dereferenced an ioremap'ed address for which the driver who owns it is long gone so fairly unlikely. I'm not saying you shouldn't put the vm_unmap_aliases() in the generic unplug code, I wouldn't mind that, but I don't think we have a nasty bug to squash here :) > Are we saying that those PCI aborts are OK, since it's a bug to make > those references in the first place? Or would we rather take a TLB > miss fault instead so the references never make it to PCI? I think a miss fault which is basically a page fault -> oops is preferable for debugging (after all that MMIO might hvae been reassigned to another device, so that abort might actually instead turn into writing to the wrong device... bad). However I also think the scenario is very unlikely. > I would think there would be similar issues when unmapping and > re-mapping plain old physical memory. But I don't see > vm_unmap_aliases() calls there, so those issues must be handled > differently. Should we handle this PCI hotplug issue the same way we > handle RAM? If we don't have a vm_unmap_aliases() in the memory unplug path we probably have a bug on those HVs too :-) Cheers, Ben. -- To unsubscribe, send a message with 'unsubscribe linux-mm' in the body to majordomo@xxxxxxxxx. For more info on Linux MM, see: http://www.linux-mm.org/ . Don't email: <a href=mailto:"dont@xxxxxxxxx";> email@xxxxxxxxx </a>