The following series implements KVM support for ARM processors, specifically on the Cortex A-15 platform. Work is done in collaboration between Columbia University, Virtual Open Systems and ARM/Linaro. The patch series applies to kvm/next, specifically commit: dbcb4e798072d114fe68813f39a9efd239ab99c0 This is Version 10 of the patch series, but the first two versions were reviewed outside of the KVM mailing list. Changes can also be pulled from: git://github.com/virtualopensystems/linux-kvm-arm.git kvm-a15-v10 A non-flattened edition of the patch series can be found at: git://github.com/virtualopensystems/linux-kvm-arm.git kvm-a15-v10-stage WARNING: This patch series release breaks compatibility with QEMU as it worked with kvm-a15-v9 due to the new reset and set target API. Please use the latest Linaro master branch (or the mirror from here): git://github.com/virtualopensystems/qemu.git kvm-a15-v10 The implementation is broken up into a logical set of patches, the first are preparatory patches: 1. ARM: Add mem_type prot_pte accessor 2. ARM: ARM_VIRT_EXT config option 3. ARM: Section based HYP idmaps 4. ARM: Expose PMNC bitfields for KVM use KVM guys, please consider pulling the KVM generic patches as early as possible. Thanks. The main implementation is broken up into separate patches, the first containing a skeleton of files, makefile changes, the basic user space interface and KVM architecture specific stubs. Subsequent patches implement parts of the system as listed: 5. Skeleton and reset hooks 6. Hypervisor initialization 7. Memory virtualization setup (hyp mode mappings and 2nd stage) 8. Inject IRQs and FIQs from userspace 9. World-switch implementation and Hyp exception vectors 10. Emulation framework and coproc emulation 11. Coproc user space API 12. Handle guest user memory aborts 13. Handle guest MMIO aborts 14. Support guest wait-for-interrupt instructions Testing: Limited testing, but have run GCC inside guest, which compiled a small hello-world program, which was successfully run. For v10 both ARM/Thumb-2 kernels were tested as both host/guest and both a compiled-in version and a kernel module version of KVM was tested. Hardware still unavailable to me, so all testing has been done on ARM Fast Models. For a guide on how to set up a testing environment and try out these patches, see: http://www.virtualopensystems.com/media/pdf/kvm-arm-guide.pdf Additionally a few major milestones are coming up shortly: - Support Thumb MMIO emulation and test MMIO emulation code (under way) - Merge Marc Zyngier's patch series for VGIC and timers (review in progress) - Change from SMC based install to relying on booting the kernel in Hyp mode. (review of patches from Marc Zyngier underway) Changes since v9: - Addressed reviewer comments (see mailing list archive) - Limit the user of .arch_extensiion sec/virt for compilers that need them - VFP/Neon Support (Antonios Motakis) - Run exit handling under preemption and still handle guest cache ops - Add support for IO mapping at Hyp level (VGIC prep) - Add support for IO mapping at Guest level (VGIC prep) - Remove backdoor call to irq_svc - Complete rework of CP15 handling and register reset (Rusty Russell) - Don't use HSTR for anything else than CR 15 - New ioctl to set emulation target core (only A15 supported for now) - Support KVM_GET_MSRS / KVM_SET_MSRS - Add page accounting and page table eviction - Change pgd lock to spinlock and fix sleeping in atomic bugs - Check kvm_condition_valid for HVC traps of undefs - Added a naive implementation of kvm_unmap_hva_range Changes since v8: - Support cache maintenance on SMP through set/way - Hyp mode idmaps are now section based and happen at kernel init - Handle aborts in Hyp mode - Inject undefined exceptions into the guest on error - Kernel-side reset of all crucial registers - Specifically state which target CPU is being virtualized - Exit statistics in debugfs - Some L2CTLR cp15 emulation cleanups - Support spte_hva for MMU notifiers and take write faults - FIX: Race condition in VMID generation - BUG: Run exit handling code with disabled preemption - Save/Restore abort fault register during world switch Changes since v7: - Traps accesses to ACTLR - Do not trap WFE execution - Upgrade barriers and TLB operations to inner-shareable domain - Restrucure hyp_pgd related code to be more opaque - Random SMP fixes - Random BUG fixes - Improve commenting - Support module loading/unloading of KVM/ARM - Thumb-2 support for host kernel and KVM - Unaligned cross-page wide guest Thumb instruction fetching - Support ITSTATE fields in CPSR for Thumb guests - Document HCR settings Changes since v6: - Support for MMU notifiers to not pin user pages in memory - Suport build with log debugging - Bugfix: v6 clobbered r7 in init code - Simplify hyp code mapping - Cleanup of register access code - Table-based CP15 emulation from Rusty Russell - Various other bug fixes and cleanups Changes since v5: - General bugfixes and nit fixes from reviews - Implemented re-use of VMIDs - Cleaned up the Hyp-mapping code to be readable by non-mm hackers (including myself) - Integrated preliminary SMP support in base patches - Lock-less interrupt injection and WFI support - Fixed signal-handling in while in guest (increases overall stability) Changes since v4: - Addressed reviewer comments from v4 * cleanup debug and trace code * remove printks * fixup kvm_arch_vcpu_ioctl_run * add trace details to mmio emulation - Fix from Marc Zyngier: Move kvm_guest_enter/exit into non-preemptible section (squashed into world-switch patch) - Cleanup create_hyp_mappings/remove_hyp_mappings from Marc Zyngier (squashed into hypervisor initialization patch) - Removed the remove_hyp_mappings feature. Removing hypervisor mappings could potentially unmap other important data shared in the same page. - Removed the arm_ prefix from the arch-specific files. - Initial SMP host/guest support Changes since v3: - v4 actually works, fully boots a guest - Support compiling as a module - Use static inlines instead of macros for vcpu_reg and friends - Optimize kvm_vcpu_reg function - Use Ftrace for trace capabilities - Updated documentation and commenting - Use KVM_IRQ_LINE instead of KVM_INTERRUPT - Emulates load/store instructions not supported through HSR syndrome information. - Frees 2nd stage translation tables on VM teardown - Handles IRQ/FIQ instructions - Handles more CP15 accesses - Support guest WFI calls - Uses debugfs instead of /proc - Support compiling in Thumb mode Changes since v2: - Performs world-switch code - Maps guest memory using 2nd stage translation - Emulates co-processor 15 instructions - Forwards I/O faults to QEMU. --- Christoffer Dall (12): ARM: Add config option ARM_VIRT_EXT ARM: Section based HYP idmap KVM: ARM: Initial skeleton to compile KVM support KVM: ARM: Hypervisor inititalization KVM: ARM: Memory virtualization setup KVM: ARM: Inject IRQs and FIQs from userspace KVM: ARM: World-switch implementation KVM: ARM: Emulation framework and CP15 emulation KVM: ARM: User space API for getting/setting co-proc registers KVM: ARM: Handle guest faults in KVM KVM: ARM: Handle I/O aborts KVM: ARM: Guest wait-for-interrupts (WFI) support Marc Zyngier (1): ARM: add mem_type prot_pte accessor Rusty Russell (1): ARM: Expose PMNC bitfields for KVM use Documentation/virtual/kvm/api.txt | 85 ++ arch/arm/Kconfig | 2 arch/arm/Makefile | 1 arch/arm/include/asm/idmap.h | 7 arch/arm/include/asm/kvm.h | 119 +++ arch/arm/include/asm/kvm_arm.h | 197 +++++ arch/arm/include/asm/kvm_asm.h | 59 ++ arch/arm/include/asm/kvm_coproc.h | 38 + arch/arm/include/asm/kvm_emulate.h | 115 +++ arch/arm/include/asm/kvm_host.h | 193 +++++ arch/arm/include/asm/kvm_mmu.h | 46 + arch/arm/include/asm/mach/map.h | 1 arch/arm/include/asm/perf_bits.h | 56 ++ arch/arm/include/asm/pgtable-3level-hwdef.h | 5 arch/arm/include/asm/pgtable-3level.h | 13 arch/arm/include/asm/pgtable.h | 5 arch/arm/kernel/asm-offsets.c | 45 + arch/arm/kernel/perf_event_v7.c | 51 - arch/arm/kernel/vmlinux.lds.S | 6 arch/arm/kvm/Kconfig | 45 + arch/arm/kvm/Makefile | 23 + arch/arm/kvm/arm.c | 991 +++++++++++++++++++++++++++ arch/arm/kvm/coproc.c | 962 ++++++++++++++++++++++++++ arch/arm/kvm/emulate.c | 531 ++++++++++++++ arch/arm/kvm/exports.c | 38 + arch/arm/kvm/guest.c | 163 ++++ arch/arm/kvm/init.S | 149 ++++ arch/arm/kvm/interrupts.S | 782 +++++++++++++++++++++ arch/arm/kvm/mmu.c | 837 +++++++++++++++++++++++ arch/arm/kvm/reset.c | 74 ++ arch/arm/kvm/trace.h | 117 +++ arch/arm/mm/Kconfig | 10 arch/arm/mm/idmap.c | 88 ++ arch/arm/mm/mmu.c | 9 include/linux/kvm.h | 3 mm/memory.c | 2 36 files changed, 5798 insertions(+), 70 deletions(-) create mode 100644 arch/arm/include/asm/kvm.h create mode 100644 arch/arm/include/asm/kvm_arm.h create mode 100644 arch/arm/include/asm/kvm_asm.h create mode 100644 arch/arm/include/asm/kvm_coproc.h create mode 100644 arch/arm/include/asm/kvm_emulate.h create mode 100644 arch/arm/include/asm/kvm_host.h create mode 100644 arch/arm/include/asm/kvm_mmu.h create mode 100644 arch/arm/include/asm/perf_bits.h create mode 100644 arch/arm/kvm/Kconfig create mode 100644 arch/arm/kvm/Makefile create mode 100644 arch/arm/kvm/arm.c create mode 100644 arch/arm/kvm/coproc.c create mode 100644 arch/arm/kvm/emulate.c create mode 100644 arch/arm/kvm/exports.c create mode 100644 arch/arm/kvm/guest.c create mode 100644 arch/arm/kvm/init.S create mode 100644 arch/arm/kvm/interrupts.S create mode 100644 arch/arm/kvm/mmu.c create mode 100644 arch/arm/kvm/reset.c create mode 100644 arch/arm/kvm/trace.h -- _______________________________________________ kvmarm mailing list kvmarm@xxxxxxxxxxxxxxxxxxxxx https://lists.cs.columbia.edu/cucslists/listinfo/kvmarm
