This one is correct; I overlooked this comment which can be obsolete. I
can either refine this patch or add one patch on top to refine the comment
at least.
Probably best if you use what you consider reasonable in your patch.
+ if (IS_ENABLED(CONFIG_ARCH_HAS_PMD_SPECIAL)) {
We don't yet have CONFIG_ARCH_HAS_PMD_SPECIAL, but I get your point.
+ if (likely(!pmd_special(pmd)))
+ goto check_pfn;
+ if (vma->vm_ops && vma->vm_ops->find_special_page)
+ return vma->vm_ops->find_special_page(vma, addr);
Why do we ever need this? This is so far destined to be totally a waste of
cycles. I think it's better we leave that until either xen/gntdev.c or any
new driver start to use it, rather than keeping dead code around.
I just copy-pasted what we had in vm_normal_page() to showcase. If not
required, good, we can add a comment we this is not required.
+ if (vma->vm_flags & (VM_PFNMAP | VM_MIXEDMAP))
+ return NULL;
+ if (is_huge_zero_pmd(pmd))
+ return NULL;
This is meaningless too until we make huge zero pmd apply special bit
first, which does sound like to be outside the scope of this series.
Again, copy-paste, but ...
+ if (pmd_devmap(pmd))
+ /* See vm_normal_page() */
+ return NULL;
When will it be pmd_devmap() if it's already pmd_special()?
+ return NULL;
And see this one.. it's after:
if (xxx)
return NULL;
if (yyy)
return NULL;
if (zzz)
return NULL;
return NULL;
Hmm?? If so, what's the difference if we simply check pmd_special and
return NULL..
Yes, they all return NULL. The compiler likely optimizes it all out.
Maybe we have it like that for pure documentation purposes. But yeah, we
should simply return NULL and think about cleaning up vm_normal_page()
as well, it does look strange.
+ }
+
+ /* !CONFIG_ARCH_HAS_PMD_SPECIAL case follows: */
+
if (unlikely(vma->vm_flags & (VM_PFNMAP|VM_MIXEDMAP))) {
if (vma->vm_flags & VM_MIXEDMAP) {
if (!pfn_valid(pfn))
return NULL;
+ if (is_huge_zero_pmd(pmd))
+ return NULL;
I'd rather not touch here as this series doesn't change anything for
MIXEDMAP yet..
Yes, that can be a separate change.
goto out;
} else {
unsigned long off;
@@ -692,6 +706,11 @@ struct page *vm_normal_page_pmd(struct vm_area_struct *vma, unsigned long addr,
}
}
+ /*
+ * For historical reasons, these might not have pmd_special() set,
+ * so we'll check them manually, in contrast to vm_normal_page().
+ */
+check_pfn:
if (pmd_devmap(pmd))
return NULL;
if (is_huge_zero_pmd(pmd))
We should then look into mapping huge zeropages also with pmd_special.
pmd_devmap we'll leave alone until removed. But that's indeoendent of your series.
This does look reasonable to match what we do with pte zeropage. Could you
remind me what might be the benefit when we switch to using special bit for
pmd zero pages?
See below. It's the way to tell the VM that a page is special, so you
can avoid a separate check at relevant places, like GUP-fast or in
vm_normal_*.
I wonder if CONFIG_ARCH_HAS_PTE_SPECIAL is sufficient and we don't need additional
CONFIG_ARCH_HAS_PMD_SPECIAL.
The hope is we can always reuse the bit in the pte to work the same for
pmd/pud.
Now we require arch to select ARCH_SUPPORTS_HUGE_PFNMAP to say "pmd/pud has
the same special bit defined".
Note that pte_special() is the way to signalize to the VM that a PTE
does not reference a refcounted page, or is similarly special and shall
mostly be ignored. It doesn't imply that it is a PFNAMP pte, not at all.
The shared zeropage is usually not refcounted (except during GUP
FOLL_GET ... but not FOLL_PIN) and the huge zeropage is usually also not
refcounted (but FOLL_PIN still does it). Both are special.
If you take a look at the history pte_special(), it was introduced for
VM_MIXEDMAP handling on s390x, because pfn_valid() to identify "special"
pages did not work:
commit 7e675137a8e1a4d45822746456dd389b65745bf6
Author: Nicholas Piggin <npiggin@xxxxxxxxx>
Date: Mon Apr 28 02:13:00 2008 -0700
mm: introduce pte_special pte bit
In the meantime, it's required for architectures that wants to support
GUP-fast I think, to make GUP-fast bail out and fallback to the slow
path where we do a vm_normal_page() -- or fail right at the VMA check
for now (VM_PFNMAP).
An architecture that doesn't implement pte_special() can support pfnmaps
but not GUP-fast. Similarly, an architecture that doesn't implement
pmd_special() can support huge pfnmaps, but not GUP-fast.
If you take a closer look, really the only two code paths that look at
pte_special() are GUP-fast and vm_normal_page().
If we use pmd_special/pud_special in other code than that, we are
diverging from the pte_special() model, and are likely doing something
wrong.
I see how you arrived at the current approach, focusing exclusively on
x86. But I think this just adds inconsistency.
So my point is that we use the same model, where we limit
* pmd_special() to GUP-fast and vm_normal_page_pmd()
* pud_special() to GUP-fast and vm_normal_page_pud()
And simply do the exact same thing as we do for pte_special().
If an arch supports pmd_special() and pud_special() we can support both
types of hugepfn mappings. If not, an architecture *might* support it,
depending on support for GUP-fast and maybe depending on MIXEDMAP
support (again, just like pte_special()). Not your task to worry about,
you will only "unlock" x86.
So maybe we do want CONFIG_ARCH_HAS_PMD_SPECIAL as well, maybe it can be
glued to CONFIG_ARCH_HAS_PTE_SPECIAL (but I'm afraid it can't unless all
archs support both). I'll leave that up to you.
As I said, if you need someone to add vm_normal_page_pud(), I can handle that.
I'm pretty confused why we need that for this series alone.
See above.
If you prefer vm_normal_page_pud() to be defined and check pud_special()
there, I can do that. But again, I don't yet see how that can make a
functional difference considering the so far very limited usage of the
special bit, and wonder whether we can do that on top when it became
necessary (and when we start to have functional requirement of such).
I hope my explanation why pte_special() even exists and how it is used
makes it clearer.
It's not that much code to handle it like pte_special(), really. I don't
expect you to teach GUP-slow about vm_normal_page() etc.
If you want me to just takeover some stuff, let me know.
--
Cheers,
David / dhildenb
