On Wed 01-07-15 22:37:06, Tejun Heo wrote: > Hello, > > On Wed, Jul 01, 2015 at 10:15:28AM +0200, Jan Kara wrote: > > I was looking at who uses wakeup_flusher_threads(). There are two usecases: > > > > 1) sync() - we want to writeback everything > > 2) We want to relieve memory pressure by cleaning and subsequently > > reclaiming pages. > > > > Neither of these cares about number of pages too much if you write enough. > > What's enough tho? Saying "yeah let's try about 1000 pages" is one > thing and "let's try about 1000 pages on each of 100 cgroups" is a > quite different operation. Given the nature of "let's try to write > some", I'd venture to say that writing somewhat less is an a lot > better behavior than possibly trying to write out possibly huge amount > given that the amount of fluctuation such behaviors may cause > system-wide and how non-obvious the reasons for such fluctuations > would be. > > > So similarly as we don't split the passed nr_pages argument among bdis, I > > bdi's are bound by actual hardware. wb's aren't. This is a purely > logical construct and there can be a lot of them. Again, trying to > write 1024 pages on each of 100 devices and trying to write 1024 * 100 > pages to single device are quite different. OK, I agree with your device vs logical construct argument. However when splitting pages based on avg throughput each cgroup generates, we know nothing about actual amount of dirty pages in each cgroup so we may end up writing much fewer pages than we originally wanted since a cgroup which was assigned a big chunk needn't have many pages available. So your algorithm is basically bound to undershoot the requested number of pages in some cases... Another concern is that if we have two cgroups with same amount of dirty pages but cgroup A has them randomly scattered (and thus have much lower bandwidth) and cgroup B has them in a sequential fashion (thus with higher bandwidth), you end up cleaning (and subsequently reclaiming) more from cgroup B. That may be good for immediate memory pressure but could be considered unfair by the cgroup owner. Maybe it would be better to split number of pages to write based on fraction of dirty pages each cgroup has in the bdi? Honza -- Jan Kara <jack@xxxxxxx> SUSE Labs, CR -- To unsubscribe from this list: send the line "unsubscribe linux-fsdevel" in the body of a message to majordomo@xxxxxxxxxxxxxxx More majordomo info at http://vger.kernel.org/majordomo-info.html
