KVM's guest-memfd memory backend currently lacks support for NUMA policy
enforcement, causing guest memory allocations to be distributed arbitrarily
across host NUMA nodes regardless of the policy specified by the VMM. This
occurs because conventional userspace NUMA control mechanisms like mbind()
are ineffective with guest-memfd, as the memory isn't directly mapped to
userspace when allocations occur.
For SEV-SNP guests, which use the guest-memfd memory backend, NUMA-aware
memory placement is essential for optimal performance, particularly for
memory-intensive workloads.
This series implements proper NUMA policy support for guest-memfd by:
1. Adding mempolicy-aware allocation APIs to the filemap layer.
2. Implementing get/set_policy vm_ops in the guest_memfd to support the
shared policy.
With these changes, VMMs can now control guest memory placement by
specifying:
- Policy modes: default, bind, interleave, or preferred
- Host NUMA nodes: List of target nodes for memory allocation
This series builds on the existing guest-memfd support in KVM and provides
a clean integration path for NUMA-aware memory management in confidential
computing environments. The work is primarily focused on supporting SEV-SNP
requirements, though the benefits extend to any VMM using the guest-memfd
backend that needs control over guest memory placement.
This approach suggested by David [1] and also discussed in bi-weekly
guest_memfd upstream call on 2024-11-14 [2].
== Example usage with QEMU (requires patched QEMU from [3]) ==
The QEMU changes[3] needed to support this feature are available at:
/* Create and map guest-memfd region */
new_block->guest_memfd = kvm_create_guest_memfd(
new_block->max_length, 0, errp);
...
void *ptr_memfd = mmap(NULL, new_block->max_length,
PROT_READ | PROT_WRITE, MAP_SHARED,
new_block->guest_memfd, 0);
...
/* Apply NUMA policy */
int ret = mbind(ptr_memfd, new_block->max_length,
backend->policy, backend->host_nodes,
maxnode+1, 0);
...
QEMU Command to run SEV-SNP guest with interleaved memory across
nodes 0 and 1 of the host:
$ qemu-system-x86_64 \
-enable-kvm \
...
-machine memory-encryption=sev0,vmport=off \
-object sev-snp-guest,id=sev0,cbitpos=51,reduced-phys-bits=1 \
-numa node,nodeid=0,memdev=ram0,cpus=0-15 \
-object memory-backend-memfd,id=ram0,host-nodes=0-1,policy=interleave,size=1024M,share=true,prealloc=false
== Experiment and Analysis ==
SEV-SNP enabled host, 6.14.0-rc1, AMD Zen 3, 2 socket 2 NUMA node system
NUMA for Policy Guest Node 0: policy=interleave, host-node=0-1
Test: Allocate and touch 50GB inside guest on node=0.
Generic Kernel (without NUMA supported guest-memfd):
Node 0 Node 1 Total
Before running Test:
MemUsed 9981.60 3312.00 13293.60
After running Test:
MemUsed 61451.72 3201.62 64653.34
Arbitrary allocations: all ~50GB allocated on node 0.
With NUMA supported guest-memfd:
Node 0 Node 1 Total
Before running Test:
MemUsed 5003.88 3963.07 8966.94
After running Test:
MemUsed 30607.55 29670.00 60277.55
Balanced memory distribution: Equal increase (~25GB) on both nodes.
== Conclusion ==
Adding the NUMA-aware memory management to guest_memfd will make a lot of
sense. Improving performance of memory-intensive and locality-sensitive
workloads with fine-grained control over guest memory allocations, as
pointed out in the analysis.
[1] https://lore.kernel.org/linux-mm/6fbef654-36e2-4be5-906e-2a648a845278@xxxxxxxxxx
[2] https://lore.kernel.org/linux-mm/82c53460-a550-4236-a65a-78f292814edb@xxxxxxxxxx
[3] https://github.com/shivankgarg98/qemu/tree/guest_memfd_mbind_NUMA
== Earlier postings and changelogs ==
v4:
- Dropped fbind() approach in favor of shared policy support
v3:
- https://lore.kernel.org/linux-mm/20241105164549.154700-1-shivankg@xxxxxxx
- Introduce fbind() syscall and drop the IOCTL-based approach
v2:
- https://lore.kernel.org/linux-mm/20240919094438.10987-1-shivankg@xxxxxxx
- Add fixes suggested by Matthew Wilcox
v1:
- https://lore.kernel.org/linux-mm/20240916165743.201087-1-shivankg@xxxxxxx
- Proposed IOCTL based approach to pass NUMA mempolicy
Shivank Garg (2):
mm/mempolicy: export memory policy symbols
KVM: guest_memfd: Enforce NUMA mempolicy using shared policy
Shivansh Dhiman (1):
mm/filemap: add mempolicy support to the filemap layer
include/linux/pagemap.h | 40 ++++++++++++++++++++
mm/filemap.c | 30 ++++++++++++---
mm/mempolicy.c | 6 +++
virt/kvm/guest_memfd.c | 84 ++++++++++++++++++++++++++++++++++++++---
4 files changed, 149 insertions(+), 11 deletions(-)
--
2.34.1
