Wu Fengguang <fengguang.wu@xxxxxxxxx> writes: > Hi Greg, > > On Fri, Oct 29, 2010 at 03:09:05PM +0800, Greg Thelen wrote: > >> Document cgroup dirty memory interfaces and statistics. >> >> Signed-off-by: Andrea Righi <arighi@xxxxxxxxxxx> >> Signed-off-by: Greg Thelen <gthelen@xxxxxxxxxx> >> --- > >> +Limiting dirty memory is like fixing the max amount of dirty (hard to reclaim) >> +page cache used by a cgroup. So, in case of multiple cgroup writers, they will >> +not be able to consume more than their designated share of dirty pages and will >> +be forced to perform write-out if they cross that limit. > > It's more pertinent to say "will be throttled", as "perform write-out" > is some implementation behavior that will change soon. Good point. I will update reword the docs to be less specific about where the write-out occurs. The important point is that the writer is throttled. >> +- memory.dirty_limit_in_bytes: the amount of dirty memory (expressed in bytes) >> + in the cgroup at which a process generating dirty pages will start itself >> + writing out dirty data. Suffix (k, K, m, M, g, or G) can be used to indicate >> + that value is kilo, mega or gigabytes. > > The suffix feature is handy, thanks! It makes sense to also add this > for the global interfaces, perhaps in a standalone patch. I agree that this would also be useful for the global interfaces. I will submit an independent patch for the global interfaces. >> +A cgroup may contain more dirty memory than its dirty limit. This is possible >> +because of the principle that the first cgroup to touch a page is charged for >> +it. Subsequent page counting events (dirty, writeback, nfs_unstable) are also >> +counted to the originally charged cgroup. >> + >> +Example: If page is allocated by a cgroup A task, then the page is charged to >> +cgroup A. If the page is later dirtied by a task in cgroup B, then the cgroup A >> +dirty count will be incremented. If cgroup A is over its dirty limit but cgroup >> +B is not, then dirtying a cgroup A page from a cgroup B task may push cgroup A >> +over its dirty limit without throttling the dirtying cgroup B task. > > It's good to document the above "misbehavior". But why not throttling > the dirtying cgroup B task? Is it simply not implemented or makes no > sense to do so at all? Ideally cgroup B would be throttled. Note, even with this misbehavior, the system dirty limit will keep cgroup B from exceeding system-wide limits. The challenge here is that when the current system increments dirty counters using account_page_dirtied() which does not immediately check against dirty limits. Later balance_dirty_pages() checks to see if any limits were exceeded, but only after a batch of pages may have been dirtied. The task may have written many pages in many different memcg. So checking all possible memcg that may have been written in the mapping may be a large set. I do not like this approach. memcontrol.c can easily detect when memcg other than the current task's memcg is charged for a dirty page. It does not record this today, but it could. When such a foreign page dirty event occurs the associated memcg could be linked into the dirtying address_space so that balance_dirty_pages() could check the limits of all foreign memcg. In the common case I think the task is dirtying pages that have been charged to the task's cgroup, so the address_space's foreign_memcg list would be empty. But when such foreign memcg are dirtied balance_dirty_pages() would have access to references to all memcg that need dirty limits checking. This approach might work. Comments? > Thanks, > Fengguang -- To unsubscribe, send a message with 'unsubscribe linux-mm' in the body to majordomo@xxxxxxxxxx For more info on Linux MM, see: http://www.linux-mm.org/ . Don't email: <a href=mailto:"dont@xxxxxxxxx";> email@xxxxxxxxx </a>