On Wed 16-01-19 21:25:05, John Hubbard wrote: > On 1/15/19 12:07 AM, Jan Kara wrote: > >>>>> [...] > >>> Also there is one more idea I had how to record number of pins in the page: > >>> > >>> #define PAGE_PIN_BIAS 1024 > >>> > >>> get_page_pin() > >>> atomic_add(&page->_refcount, PAGE_PIN_BIAS); > >>> > >>> put_page_pin(); > >>> atomic_add(&page->_refcount, -PAGE_PIN_BIAS); > >>> > >>> page_pinned(page) > >>> (atomic_read(&page->_refcount) - page_mapcount(page)) > PAGE_PIN_BIAS > >>> > >>> This is pretty trivial scheme. It still gives us 22-bits for page pins > >>> which should be plenty (but we should check for that and bail with error if > >>> it would overflow). Also there will be no false negatives and false > >>> positives only if there are more than 1024 non-page-table references to the > >>> page which I expect to be rare (we might want to also subtract > >>> hpage_nr_pages() for radix tree references to avoid excessive false > >>> positives for huge pages although at this point I don't think they would > >>> matter). Thoughts? > > Some details, sorry I'm not fully grasping your plan without more > explanation: > > Do I read it correctly that this uses the lower 10 bits for the original > page->_refcount, and the upper 22 bits for gup-pinned counts? If so, I'm > surprised, because gup-pinned is going to be less than or equal to the > normal (get_page-based) pin count. And 1024 seems like it might be > reached in a large system with lots of processes and IPC. > > Are you just allowing the lower 10 bits to overflow, and that's why the > subtraction of mapcount? Wouldn't it be better to allow more than 10 bits, > instead? I'm not really dividing the page->_refcount counter, that's a wrong way how to think about it I believe. Normal get_page() simply increments the _refcount by 1, get_page_pin() will increment by 1024 (or 999 or whatever - that's PAGE_PIN_BIAS). The choice of value of PAGE_PIN_BIAS is essentially a tradeoff between how many page pins you allow and how likely page_pinned() is to return false positive. Large PAGE_PIN_BIAS means lower amount of false positives but also less page pins allowed for the page before _refcount would overflow. Now the trick with subtracting of page_mapcount() is following: We know that certain places hold references to the page. Common holders of page references are page table entries. So if we subtract page_mapcount() from _refcount, we'll get more accurate view how many other references (including pins) are there and thus reduce the number of false positives. > Another question: do we just allow other kernel code to observe this biased > _refcount, or do we attempt to filter it out? In other words, do you expect > problems due to some kernel code checking the _refcount and finding a large > number there, when it expected, say, 3? I recall some code tries to do > that...in fact, ZONE_DEVICE is 1-based, instead of zero-based, with respect > to _refcount, right? I would just allow other places to observe biased refcount. Sure there are places that do comparions on exact refcount value but if such place does not exclude page pins, it cannot really depend on whether there's just one or thousand of them. Generally such places try to detect whether they are the only owner of the page (besides page cache radix tree, LRU, etc.). So they want to bail if any page pin exists and that check remains the same regardless whether we increment _refcount by 1 or by 1024 when pinning the page. Honza -- Jan Kara <jack@xxxxxxxx> SUSE Labs, CR
