This patch series adds an ARM KVM interface for platform specific stage-2 page tracking devices and makes use of this interface for dirty tracking. The page_tracking_device interface will be implemented by a device driver and used by KVM. A device driver will register/deregister its implementation via page_tracking_device_register()/page_tracking_device_unregister() functions; KVM can use the device when page_tracking_device_registered() is true. The page_tracking_device interface provides the following functionality: - enabling\disabling dirty tracking for a VMID (+ optionally for a CPU id), - reading GPAs dirtied by either any CPU (to populate dirty bitmaps) or by a specific CPU (to populate dirty rings) - flushing not yet logged data. KVM support for the page tracking device is added as a new extension and a capability with the same name - KVM_CAP_ARM_PAGE_TRACKING_DEVICE. The capability is available when extension is supported (page_tracking_device_registered() is true). When a device is available, new capability toggles device use for dirty tracking. The capability is currently not compatible with the dirty ring interface. At this moment only dirty bitmaps are supported as they allow userspace to sync dirty pages from the hardware (e.g. PML) via kvm_arch_sync_dirty_log() function. We have yet to add support for the dirty ring interface; which can sync dirty pages into dirty rings either from userspace via a new ioctl or from KVM on timer events. For the page tracking device to be able to log guest write accesses this patch series enables hardware management of the dirty state for stage-2 translations by 1) setting VTCR_EL2.HD flag and 2) setting DBM (51) flag for the tracked stage-2 descriptors. Currently KVM sets the DBM flag only when faulting in pages, thus the first write to a page is logged by KVM as usual - on write fault, subsequent writes to the same page will be logged by a page tracking device. We will optimize this by setting DBM flag when eagerly splitting huge pages. An example of a device that tracks accesses to stage-2 translations and will implement page_tracking_device interface is AWS Graviton Page Tracking Agent (PTA). We'll be posting code for the Graviton PTA device driver in a separate series of patches. When ARM architectural solution (FEAT_HDBSS feature) is available, we intend to use it via the same interface most likely with adaptations. Lilit Janpoladyan (8): arm64: add an interface for stage-2 page tracking KVM: arm64: add page tracking device as a capability KVM: arm64: use page tracking interface to enable dirty logging KVM: return value from kvm_arch_sync_dirty_log KVM: arm64: get dirty pages from the page tracking device KVM: arm64: flush dirty logging data KVM: arm64: enable hardware dirty state management for stage-2 KVM: arm64: make hardware manage dirty state after write faults Documentation/virt/kvm/api.rst | 17 +++ arch/arm64/include/asm/kvm_host.h | 8 ++ arch/arm64/include/asm/kvm_pgtable.h | 1 + arch/arm64/include/asm/page_tracking.h | 79 +++++++++++++ arch/arm64/kvm/Kconfig | 12 ++ arch/arm64/kvm/Makefile | 1 + arch/arm64/kvm/arm.c | 121 ++++++++++++++++++- arch/arm64/kvm/hyp/pgtable.c | 29 ++++- arch/arm64/kvm/mmu.c | 8 ++ arch/arm64/kvm/page_tracking.c | 158 +++++++++++++++++++++++++ arch/loongarch/kvm/mmu.c | 3 +- arch/mips/kvm/mips.c | 12 +- arch/powerpc/kvm/book3s.c | 12 +- arch/powerpc/kvm/booke.c | 12 +- arch/riscv/kvm/mmu.c | 3 +- arch/s390/kvm/kvm-s390.c | 13 +- arch/x86/kvm/x86.c | 21 +++- include/linux/kvm_host.h | 4 +- include/uapi/linux/kvm.h | 1 + virt/kvm/kvm_main.c | 34 ++++-- 20 files changed, 521 insertions(+), 28 deletions(-) create mode 100644 arch/arm64/include/asm/page_tracking.h create mode 100644 arch/arm64/kvm/page_tracking.c -- 2.40.1
