hugepage_vma_check is called during khugepaged_scan_mm_slot to ensure that khugepaged doesn't try to allocate THPs in vmas where they are disallowed, either due to THPs being disabled system-wide, or through MADV_NOHUGEPAGE. The logic that hugepage_vma_check uses doesn't seem to cover all cases, in my opinion. Looking at the original code: if ((!(vma->vm_flags & VM_HUGEPAGE) && !khugepaged_always()) || (vma->vm_flags & VM_NOHUGEPAGE)) We can see that it's possible to have THP disabled system-wide, but still receive THPs in this vma. It seems that it's assumed that just because khugepaged_always == false, TRANSPARENT_HUGEPAGE_REQ_MADV_FLAG must be set, which is not the case. We could have VM_HUGEPAGE set, but have THP set to "never" system-wide, in which case, the condition presented in the if will evaluate to false, and (provided the other checks pass) we can end up giving out a THP even though the behavior is set to "never." While we do properly check these flags in khugepaged_has_work, it looks like it's possible to sleep after we check khugepaged_hask_work, but before hugepage_vma_check, during which time, hugepages could have been disabled system-wide, in which case, we could hand out THPs when we shouldn't be. This small fix makes hugepage_vma_check work more like transparent_hugepage_enabled, checking if THPs are set to "always" system-wide, then checking if THPs are set to "madvise," as well as making sure that VM_HUGEPAGE is set for this vma. Signed-off-by: Alex Thorlton <athorlton@xxxxxxx> Reported-by: Alex Thorlton <athorlton@xxxxxxx> Cc: Andrew Morton <akpm@xxxxxxxxxxxxxxxxxxxx> Cc: Mel Gorman <mgorman@xxxxxxx> Cc: Rik van Riel <riel@xxxxxxxxxx> Cc: Ingo Molnar <mingo@xxxxxxxxxx> Cc: Peter Zijlstra <peterz@xxxxxxxxxxxxx> Cc: linux-mm@xxxxxxxxx Cc: linux-kernel@xxxxxxxxxxxxxxx --- mm/huge_memory.c | 3 ++- 1 file changed, 2 insertions(+), 1 deletion(-) diff --git a/mm/huge_memory.c b/mm/huge_memory.c index 95d1acb..f62fba9 100644 --- a/mm/huge_memory.c +++ b/mm/huge_memory.c @@ -2394,7 +2394,8 @@ static struct page static bool hugepage_vma_check(struct vm_area_struct *vma) { - if ((!(vma->vm_flags & VM_HUGEPAGE) && !khugepaged_always()) || + if ((!khugepaged_always() || + (!(vma->vm_flags & VM_HUGEPAGE) && !khugepaged_req_madv())) || (vma->vm_flags & VM_NOHUGEPAGE)) return false; -- 1.7.12.4 -- To unsubscribe, send a message with 'unsubscribe linux-mm' in the body to majordomo@xxxxxxxxx. For more info on Linux MM, see: http://www.linux-mm.org/ . Don't email: <a href=mailto:"dont@xxxxxxxxx"> email@xxxxxxxxx </a>