On Fri, Jun 7, 2024 at 2:43 AM Ryan Roberts <ryan.roberts@xxxxxxx> wrote: > > Sorry I'm late to the discussion - I've been out for the last 3.5 weeks and just > getting through my mail now... No problem at all, please take it easy. > > > On 24/05/2024 18:17, Chris Li wrote: > > This is the short term solutiolns "swap cluster order" listed > > in my "Swap Abstraction" discussion slice 8 in the recent > > LSF/MM conference. > > I've read the article on lwn and look forward to watching the video once > available. The longer term plans look interesting. > > > > > When commit 845982eb264bc "mm: swap: allow storage of all mTHP > > orders" is introduced, it only allocates the mTHP swap entries > > from new empty cluster list. That works well for PMD size THP, > > but it has a serius fragmentation issue reported by Barry. > > Yes, that was a deliberate initial approach to be conservative, just like the > original PMD-size THP support. I'm glad to see work to improve the situation! > > > > > https://lore.kernel.org/all/CAGsJ_4zAcJkuW016Cfi6wicRr8N9X+GJJhgMQdSMp+Ah+NSgNQ@xxxxxxxxxxxxxx/ > > > > The mTHP allocation failure rate raises to almost 100% after a few > > hours in Barry's test run. > > > > The reason is that all the empty cluster has been exhausted while > > there are planty of free swap entries to in the cluster that is > > not 100% free. > > > > Address this by remember the swap allocation order in the cluster. > > Keep track of the per order non full cluster list for later allocation. > > I don't immediately see how this helps because memory is swapped back in > per-page (currently), so just because a given cluster was initially filled with That is not the case for Barry's setup, he has some other patch series to swap in mTHP as a whole. Especially in for the mTHP store in the zsmalloc as bigger than 4K pages. https://lore.kernel.org/linux-mm/20240327214816.31191-1-21cnbao@xxxxxxxxx/ > entries of a given order, doesn't mean that those entries are freed in atomic > units; only specific pages could have been swapped back in, meaning the holes > are not of the required order. Additionally, scanning could lead to order-0 > pages being populated in random places. Yes, that is a problem we need to address. The proposed short term solution is to have an isolation scheme preventing the high order swap entry mix with the lower order one inside one cluster. That is easy to do and has some test results confirming the reservation/isolation effect. > > My naive assumption was that the obvious way to solve this problem in the short > term would be to extend the scanning logic to be able to scan for an arbitrary > order. That way you could find an allocation of the required order in any of the > clusters, even a cluster that was not originally allocated for the required order. > > I guess I should read your patches to understand exactly what you are doing > rather than making assumptions... Scanning is not enough. We need to have some way to prevent the fragmentation from happening. Once the fragmentation has happened, it can't be easily reversed. Scanning does not help the fragmentation aspect. Chris > > Thanks, > Ryan > > > > > This greatly improve the sucess rate of the mTHP swap allocation. > > While I am still waiting for Barry's test result. I paste Kairui's test > > result here: > > > > I'm able to reproduce such an issue with a simple script (enabling all order of mthp): > > > > modprobe brd rd_nr=1 rd_size=$(( 10 * 1024 * 1024)) > > swapoff -a > > mkswap /dev/ram0 > > swapon /dev/ram0 > > > > rmdir /sys/fs/cgroup/benchmark > > mkdir -p /sys/fs/cgroup/benchmark > > cd /sys/fs/cgroup/benchmark > > echo 8G > memory.max > > echo $$ > cgroup.procs > > > > memcached -u nobody -m 16384 -s /tmp/memcached.socket -a 0766 -t 32 -B binary & > > > > /usr/local/bin/memtier_benchmark -S /tmp/memcached.socket \ > > -P memcache_binary -n allkeys --key-minimum=1 \ > > --key-maximum=18000000 --key-pattern=P:P -c 1 -t 32 \ > > --ratio 1:0 --pipeline 8 -d 1024 > > > > Before: > > Totals 48805.63 0.00 0.00 5.26045 1.19100 38.91100 59.64700 51063.98 > > After: > > Totals 71098.84 0.00 0.00 3.60585 0.71100 26.36700 39.16700 74388.74 > > > > And the fallback ratio dropped by a lot: > > Before: > > hugepages-32kB/stats/anon_swpout_fallback:15997 > > hugepages-32kB/stats/anon_swpout:18712 > > hugepages-512kB/stats/anon_swpout_fallback:192 > > hugepages-512kB/stats/anon_swpout:0 > > hugepages-2048kB/stats/anon_swpout_fallback:2 > > hugepages-2048kB/stats/anon_swpout:0 > > hugepages-1024kB/stats/anon_swpout_fallback:0 > > hugepages-1024kB/stats/anon_swpout:0 > > hugepages-64kB/stats/anon_swpout_fallback:18246 > > hugepages-64kB/stats/anon_swpout:17644 > > hugepages-16kB/stats/anon_swpout_fallback:13701 > > hugepages-16kB/stats/anon_swpout:18234 > > hugepages-256kB/stats/anon_swpout_fallback:8642 > > hugepages-256kB/stats/anon_swpout:93 > > hugepages-128kB/stats/anon_swpout_fallback:21497 > > hugepages-128kB/stats/anon_swpout:7596 > > > > (Still collecting more data, the success swpout was mostly done early, then the fallback began to increase, nearly 100% failure rate) > > > > After: > > hugepages-32kB/stats/swpout:34445 > > hugepages-32kB/stats/swpout_fallback:0 > > hugepages-512kB/stats/swpout:1 > > hugepages-512kB/stats/swpout_fallback:134 > > hugepages-2048kB/stats/swpout:1 > > hugepages-2048kB/stats/swpout_fallback:1 > > hugepages-1024kB/stats/swpout:6 > > hugepages-1024kB/stats/swpout_fallback:0 > > hugepages-64kB/stats/swpout:35495 > > hugepages-64kB/stats/swpout_fallback:0 > > hugepages-16kB/stats/swpout:32441 > > hugepages-16kB/stats/swpout_fallback:0 > > hugepages-256kB/stats/swpout:2223 > > hugepages-256kB/stats/swpout_fallback:6278 > > hugepages-128kB/stats/swpout:29136 > > hugepages-128kB/stats/swpout_fallback:52 > > > > Reported-by: Barry Song <21cnbao@xxxxxxxxx> > > Tested-by: Kairui Song <kasong@xxxxxxxxxxx> > > Signed-off-by: Chris Li <chrisl@xxxxxxxxxx> > > --- > > Chris Li (2): > > mm: swap: swap cluster switch to double link list > > mm: swap: mTHP allocate swap entries from nonfull list > > > > include/linux/swap.h | 18 ++-- > > mm/swapfile.c | 252 +++++++++++++++++---------------------------------- > > 2 files changed, 93 insertions(+), 177 deletions(-) > > --- > > base-commit: c65920c76a977c2b73c3a8b03b4c0c00cc1285ed > > change-id: 20240523-swap-allocator-1534c480ece4 > > > > Best regards, >
