On 07/10/2013 06:02 PM, Joonsoo Kim wrote:
> On Wed, Jul 10, 2013 at 03:52:42PM -0700, Dave Hansen wrote:
>> On 07/03/2013 01:34 AM, Joonsoo Kim wrote:
>>> - if (page)
>>> + do {
>>> + page = buffered_rmqueue(preferred_zone, zone, order,
>>> + gfp_mask, migratetype);
>>> + if (!page)
>>> + break;
>>> +
>>> + if (!nr_pages) {
>>> + count++;
>>> + break;
>>> + }
>>> +
>>> + pages[count++] = page;
>>> + if (count >= *nr_pages)
>>> + break;
>>> +
>>> + mark = zone->watermark[alloc_flags & ALLOC_WMARK_MASK];
>>> + if (!zone_watermark_ok(zone, order, mark,
>>> + classzone_idx, alloc_flags))
>>> + break;
>>> + } while (1);
>>
>> I'm really surprised this works as well as it does. Calling
>> buffered_rmqueue() a bunch of times enables/disables interrupts a bunch
>> of times, and mucks with the percpu pages lists a whole bunch.
>> buffered_rmqueue() is really meant for _single_ pages, not to be called
>> a bunch of times in a row.
>>
>> Why not just do a single rmqueue_bulk() call?
>
> rmqueue_bulk() needs a zone lock. If we allocate not so many pages,
> for example, 2 or 3 pages, it can have much more overhead rather than
> allocationg 1 page multiple times. So, IMHO, it is better that
> multiple pages allocation is supported on top of percpu pages list.
It makes _zero_ sense to be doing a number of buffered_rmqueue() calls
that are approaching the size of the percpu pages batches. If you end
up doing that, you pay both the overhead in manipulating both the percpu
page data _and_ the buddy lists.
You're probably right for small numbers of pages. But, if we're talking
about things that are more than, say, 100 pages (isn't the pcp batch
size clamped to 128 4k pages?) you surely don't want to be doing
buffered_rmqueue().
I'd also like to see some scalability numbers on this. How do your
tests look when all the CPUs on the system are hammering away?
> And I think that enables/disables interrupts a bunch of times help
> to avoid a latency problem. If we disable interrupts until the whole works
> is finished, interrupts can be handled too lately.
> free_hot_cold_page_list() already do enables/disalbed interrupts a bunch of
> times.
I don't think interrupt latency is going to be a problem on the scale
we're talking about here. There are much, much, much worse offenders in
the kernel.
--
To unsubscribe, send a message with 'unsubscribe linux-mm' in
the body to majordomo@xxxxxxxxx. For more info on Linux MM,
see: http://www.linux-mm.org/ .
Don't email: <a href=mailto:"dont@xxxxxxxxx";> email@xxxxxxxxx </a>