The series of patches intends to support EEH for PCI devices, which have been passed through to PowerKVM based guest via VFIO. The implementation is straightforward based on the issues or problems we have to resolve to support EEH for PowerKVM based guest. - Emulation for EEH RTAS requests. Thanksfully, we already have infrastructure to emulate XICS. Without introducing new mechanism, we just extend that existing infrastructure to support EEH RTAS emulation. EEH RTAS requests initiated from guest are posted to host where the requests get handled or delivered to underly firmware for further handling. For that, the host kerenl has to maintain the PCI address (host domain/bus/slot/function to guest's PHB BUID/bus/slot/function) mapping via KVM VFIO device. The address mapping will be built when initializing VFIO device in QEMU and destroied when the VFIO device in QEMU is going to offline, or VM is destroy. - The infrastructure for error injection is introduced. The emulation for the related RTAS services is similar to what we do for EEH/XICS RTAS requests. For now, we just support PCI error injection. We need extend it for injecting other types of errors in future. The series of patches requires corresponding firmware changes from Mike Qiu to support error injection and QEMU changes to support EEH for guest. It also needs QEMU changes to support it. QEMU patchset will be sent separately. I usually use command line (not virsh) to start PowerKVM based guests on Firebird-L machine with different types of PCI devices assigend (passed through) to guest. Following cases have been tested. The EEH error can be injected by utility "errinjct" running on guest successfully and we can recover from the EEH error successfully. Testing on P7 ============= - Emulex adapter - USB (OHCI) PCI adapter Testing on P8 ============= - MLX4 adapter (Partially) - USB (xHCI) PCI adapter ----- arch/powerpc/include/asm/book3s_errinjct.h | 97 ++++++++++++++++++++++++ arch/powerpc/include/asm/eeh.h | 78 ++++++++++++++++++++ arch/powerpc/include/asm/kvm_ppc.h | 7 ++ arch/powerpc/include/asm/opal.h | 65 ++++++++++++++++ arch/powerpc/kernel/eeh.c | 8 ++ arch/powerpc/kernel/eeh_pe.c | 297 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ arch/powerpc/kvm/Kconfig | 17 +++++ arch/powerpc/kvm/Makefile | 6 ++ arch/powerpc/kvm/book3s_errinjct.c | 329 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ arch/powerpc/kvm/book3s_hv.c | 2 + arch/powerpc/kvm/book3s_rtas.c | 67 +++++++++++++++++ arch/powerpc/platforms/powernv/Makefile | 2 + arch/powerpc/platforms/powernv/eeh-ioda.c | 3 +- arch/powerpc/platforms/powernv/eeh-rtas.c | 551 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ arch/powerpc/platforms/powernv/errinjct.c | 215 +++++++++++++++++++++++++++++++++++++++++++++++++++++ arch/powerpc/platforms/powernv/opal-wrappers.S | 1 + include/linux/kvm_host.h | 21 ++++++ include/uapi/linux/kvm.h | 10 +++ virt/kvm/vfio.c | 60 ++++++++++++++- 19 files changed, 1834 insertions(+), 2 deletions(-) create mode 100644 arch/powerpc/include/asm/book3s_errinjct.h create mode 100644 arch/powerpc/kvm/book3s_errinjct.c create mode 100644 arch/powerpc/platforms/powernv/eeh-rtas.c create mode 100644 arch/powerpc/platforms/powernv/errinjct.c Thanks, Gavin -- To unsubscribe from this list: send the line "unsubscribe kvm" in the body of a message to majordomo@xxxxxxxxxxxxxxx More majordomo info at http://vger.kernel.org/majordomo-info.html
