On Tue, Jul 11, 2017 at 11:23:19AM -0700, Mike Kravetz wrote: > I was surprised as well when a JVM developer pointed this out. > > From the old e-mail thread, here is original use case: > shmget(IPC_PRIVATE, 31498240, 0x1c0|0600) = 11337732 > shmat(11337732, 0, 0) = 0x40299000 > shmctl(11337732, IPC_RMID, 0) = 0 > mremap(0x402a9000, 0, 65536, MREMAP_MAYMOVE|MREMAP_FIXED, 0) = 0 > mremap(0x402a9000, 0, 65536, MREMAP_MAYMOVE|MREMAP_FIXED, 0x100000) = 0x100000 > > The JVM team wants to do something similar. They are using > mmap(MAP_ANONYMOUS|MAP_SHARED) to create the initial mapping instead > of shmget/shmat. As Vlastimil mentioned previously, one would not > expect a shared mapping for parts of the JVM heap. I am working > to get clarification from the JVM team. Why don't they use memfd_create instead? That's made so that the fd is born anon unlinked so when the last reference is dropped all memory associated with it is automatically freed. No need of IC_RMID and then they can use mmap instead of mremap(len=0) to get a double map of it. If they use mmap(MAP_ANONYMOUS|MAP_SHARED) it's not hugetlbfs, that would have been the only issue. Using hugetlbfs for JVM wouldn't be really flexible, better they try to leverage THP on SHM or the hugetlbfs reservation gets in the way of efficient use of the unused memory for memory allocations that don't have a definitive size (i.e. JVM forks or more JVM are run in parallel). > Yes. I think this should be a separate patch. As mentioned earlier, > mremap today creates a new/additional private mapping if called in this > way with old_size == 0. To me, this is a bug. Kernel by sheer luck should stay stable, but the result is weird and it's unlikely intentional. memfd_create doesn't have such issue, the new mmap MAP_PRIVATE will get the file pages correctly after a new mmap (even if there were cows in the old MAP_PRIVATE mmap). > One reason for the RFC was to determine if people thought we should: > 1) Just document the existing old_size == 0 functionality > 2) Create a more explicit interface such as a new mremap flag for this > functionality > > I am waiting to see what direction people prefer before making any > man page updates. I guess old_size == 0 would better be dropped if possible, if memfd_create fits perfectly your needs as I supposed above. If it's not dropped then it's not very far from allowing mmap of /proc/self/mm again (removed around so far as 2.3.x?). Thanks, Andrea -- To unsubscribe from this list: send the line "unsubscribe linux-api" in the body of a message to majordomo@xxxxxxxxxxxxxxx More majordomo info at http://vger.kernel.org/majordomo-info.html
