On Tue, 25 Jan 2022 03:47:04 +0000, Raghavendra Rao Ananta <rananta@xxxxxxxxxx> wrote: > > Hello all, > > Based on the recent discussion on the patch '[RFC PATCH v3 01/11] KVM: > Capture VM start' [1], Reiji, I (and others in the team) were > wondering, since the hypercall feature-map is technically per-VM and > not per-vCPU, would it make more sense to present it as a kvm_device, > rather than vCPU psuedo-registers to the userspace? I really don't think so. > If I understand correctly, the original motivation for going with > pseudo-registers was to comply with QEMU, which uses KVM_GET_REG_LIST > and KVM_[GET|SET]_ONE_REG interface, but I'm guessing the VMMs doing > save/restore across migration might write the same values for every > vCPU. KVM currently restricts the vcpu features to be unified across vcpus, but that's only an implementation choice. The ARM architecture doesn't mandate that these registers are all the same, and it isn't impossible that we'd allow for the feature set to become per-vcpu at some point in time. So this argument doesn't really hold. Furthermore, compatibility with QEMU's save/restore model is essential, and AFAICT, there is no open source alternative. > Granted that we would be diverging from the existing implementation > (psci versioning and spectre WA registers), but this can be a cleaner > way forward for extending hypercall support. Cleaner? Why? How? You'd have the exact same constraints, plus the disadvantages of having to maintain a new interface concurrently with the existing ones. > The kvm_device interface > can be made backward compatible with the way hypercalls are exposed > today, it can have the same registers/features discovery mechanisms > that we discussed above, and majorly the userspace has to configure it > only once per-VM. We can probably make the feature selection immutable > just before any vCPU is created. What is the problem with immutability on first run? Or even with a 'finalize' ioctl (we already have one)? > > Please let me know your thoughts or any disadvantages that I'm overlooking. A device means yet another configuration and migration API. Don't you think we have enough of those? The complexity of KVM/arm64 userspace API is already insane, and extremely fragile. Adding to it will be a validation nightmare (it already is, and I don't see anyone actively helping with it). So no, I have no plan to consider anything but the GET/SET_ONE_REG interface, and until someone writes another open source VMM that has the same save/restore capabilities and proves that this interface isn't fit for purpose, I see no incentive in deviating from a model that is known to work. Thanks, M. -- Without deviation from the norm, progress is not possible.
