Re: PROBLEM: Remapping hugepages mappings causes kernel to return EINVAL

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



On 23-10-17 18:13, Michal Hocko wrote:
On Mon 23-10-17 16:00:13, C.Wehrmeyer wrote:
And just to be very sure I've added:

if (madvise(buf1,ALLOC_SIZE_1,MADV_HUGEPAGE)) {
         errno_tmp = errno;
         fprintf(stderr,"madvise: %u\n",errno_tmp);
         goto out;
}

/*Make sure the mapping is actually used*/
memset(buf1,'!',ALLOC_SIZE_1);

Is the buffer aligned to 2MB?

When I omit MAP_HUGETLB for the flags that mmap receives - no.

#define ALLOC_SIZE_1 (2 * 1024 * 1024)
[...]
buf1 = mmap (
        NULL,
        ALLOC_SIZE_1,
        prot, /*PROT_READ | PROT_WRITE*/
        flags /*MAP_PRIVATE | MAP_ANONYMOUS*/,
        -1,
        0
);

In such a case buf1 usually contains addresses which are aligned to 4 KiBs, such as 0x7f07d76e9000. 2-MiB-aligned addresses, such as 0x7f89f5e00000, are only produced with MAP_HUGETLB - which, if I understood the documentation correctly, is not the point of THPs as they are supposed to be transparent.

I'm not exactly sure how I'm supposed to force mmap to give me any other kind of address, if that is going to be your suggestion - unless I'd read the mapping configuration for the current process and find myself a spot where I can tell mmap to create a mapping for me using MAP_FIXED. But that wouldn't be transparent, either.

/*Give me time for monitoring*/
sleep(2000);

right after the mmap call. I've also made sure that nothing is being
optimised away by the compiler. With a 2MiB mapping being requested this
should be a good opportunity for the kernel, and yet when I try to figure
out how many THPs my processes uses:

$ cat /proc/21986/smaps  | grep 'AnonHuge'

I just end up with lots of:

AnonHugePages:         0 kB

And cat /proc/meminfo | grep 'Huge' doesn't change significantly as well. Am
I just doing something wrong here, or shouldn't I trust the THP mechanisms
to actually allocate hugepages for me?

If the mapping is aligned properly then the rest is up to system and
availability of large physically contiguous memory blocks.

I have about 5 GiBs of free memory right now, and while I can not guarantee that memory fragmentation prevents the kernel from using THP, manually reserving 256 2-MiB pages through nr_hugepages and then freeing them works just fine. Yes, after allocating them I checked if nr_hugepages actually was 256. And yet, after immediately running my program, there would be no change any of the AnonHugePages elements that smaps exports. Also (while omitting MAP_HUGETLB) buf1 remains to be aligned to 4 KiB.

--
To unsubscribe, send a message with 'unsubscribe linux-mm' in
the body to majordomo@xxxxxxxxx.  For more info on Linux MM,
see: http://www.linux-mm.org/ .
Don't email: <a href=mailto:"dont@xxxxxxxxx";> email@xxxxxxxxx </a>



[Index of Archives]     [Linux ARM Kernel]     [Linux ARM]     [Linux Omap]     [Fedora ARM]     [IETF Annouce]     [Bugtraq]     [Linux OMAP]     [Linux MIPS]     [eCos]     [Asterisk Internet PBX]     [Linux API]
  Powered by Linux