Re: [PATCH v2 0/3] page stealing tweaks

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



On Mon, Dec 15, 2014 at 10:05:22AM +0100, Vlastimil Babka wrote:
> On 12/15/2014 08:50 AM, Joonsoo Kim wrote:
> > On Fri, Dec 12, 2014 at 05:01:22PM +0100, Vlastimil Babka wrote:
> >> Changes since v1:
> >> o Reorder patch 2 and 3, Cc stable for patch 1
> >> o Fix tracepoint in patch 1 (Joonsoo Kim)
> >> o Cleanup in patch 2 (suggested by Minchan Kim)
> >> o Improved comments and changelogs per Minchan and Mel.
> >> o Considered /proc/pagetypeinfo in evaluation with 3.18 as baseline
> >> 
> >> When studying page stealing, I noticed some weird looking decisions in
> >> try_to_steal_freepages(). The first I assume is a bug (Patch 1), the following
> >> two patches were driven by evaluation.
> >> 
> >> Testing was done with stress-highalloc of mmtests, using the
> >> mm_page_alloc_extfrag tracepoint and postprocessing to get counts of how often
> >> page stealing occurs for individual migratetypes, and what migratetypes are
> >> used for fallbacks. Arguably, the worst case of page stealing is when
> >> UNMOVABLE allocation steals from MOVABLE pageblock. RECLAIMABLE allocation
> >> stealing from MOVABLE allocation is also not ideal, so the goal is to minimize
> >> these two cases.
> >> 
> >> For some reason, the first patch increased the number of page stealing events
> >> for MOVABLE allocations in the former evaluation with 3.17-rc7 + compaction
> >> patches. In theory these events are not as bad, and the second patch does more
> >> than just to correct this. In v2 evaluation based on 3.18, the weird result
> >> was gone completely.
> >> 
> >> In v2 I also checked if /proc/pagetypeinfo has shown an increase of the number
> >> of unmovable/reclaimable pageblocks during and after the test, and it didn't.
> >> The test was repeated 25 times with reboot only after each 5 to show
> >> longer-term differences in the state of the system, which also wasn't the case.
> >> 
> >> Extfrag events summed over first iteration after reboot (5 repeats)
> >>                                                         3.18            3.18            3.18            3.18
> >>                                                    0-nothp-1       1-nothp-1       2-nothp-1       3-nothp-1
> >> Page alloc extfrag event                                4547160     4593415     2343438     2198189
> >> Extfrag fragmenting                                     4546361     4592610     2342595     2196611
> >> Extfrag fragmenting for unmovable                          5725        9196        5720        1093
> >> Extfrag fragmenting unmovable placed with movable          3877        4091        1330         859
> >> Extfrag fragmenting for reclaimable                         770         628         511         616
> >> Extfrag fragmenting reclaimable placed with movable         679         520         407         492
> >> Extfrag fragmenting for movable                         4539866     4582786     2336364     2194902
> >> 
> >> Compared to v1 this looks like a regression for patch 1 wrt unmovable events,
> >> but I blame noise and less repeats (it was 10 in v1). On the other hand, the
> >> the mysterious increase in movable allocation events in v1 is gone (due to
> >> different baseline?)
> > 
> > Hmm... the result on patch 2 looks odd.
> > Because you reorder patches, patch 2 have some effects on unmovable
> > stealing and I expect that 'Extfrag fragmenting for unmovable' decreases.
> > But, the result looks not. Is there any reason you think?
> 
> Hm, I don't see any obvious reason. 
> 
> > And, could you share compaction success rate and allocation success
> > rate on each iteration? In fact, reducing Extfrag event isn't our goal.
> > It is natural result of this patchset because we steal pages more
> > aggressively. Our utimate goal is to make the system less fragmented
> > and to get more high order freepage, so I'd like to know this results.
> 
> I don't think there's much significant difference. Could be a limitation
> of the benchmark. But even if there's no difference, it means the reduction
> of fragmenting events at least saves time on allocations.

Hmm... Allocation success rate of 3-nothp-N on phase 1,2 shows minor degradation
from 2-nothp-N and compaction success rate also decreases. Isn't it?
I think that allocation success rate on phase 1 is important because
workload in phase 1 mostly resemble real world scenario. Do you have
any idea why this happens?

Thanks.

> But you'll see that for the long-term fragmentation damage, we still have
> long way to go...
> 
> Iteration 1 after reboot:
> 
>                                  3.18                  3.18                  3.18                  3.18
>                             0-nothp-1             1-nothp-1             2-nothp-1             3-nothp-1
> Success 1 Min         30.00 (  0.00%)       33.00 (-10.00%)       37.00 (-23.33%)       35.00 (-16.67%)
> Success 1 Mean        38.60 (  0.00%)       37.60 (  2.59%)       41.00 ( -6.22%)       38.40 (  0.52%)
> Success 1 Max         44.00 (  0.00%)       48.00 ( -9.09%)       48.00 ( -9.09%)       41.00 (  6.82%)
> Success 2 Min         29.00 (  0.00%)       34.00 (-17.24%)       36.00 (-24.14%)       36.00 (-24.14%)
> Success 2 Mean        40.40 (  0.00%)       38.20 (  5.45%)       41.40 ( -2.48%)       39.20 (  2.97%)
> Success 2 Max         46.00 (  0.00%)       49.00 ( -6.52%)       49.00 ( -6.52%)       43.00 (  6.52%)
> Success 3 Min         83.00 (  0.00%)       85.00 ( -2.41%)       84.00 ( -1.20%)       84.00 ( -1.20%)
> Success 3 Mean        84.80 (  0.00%)       85.60 ( -0.94%)       84.80 (  0.00%)       84.60 (  0.24%)
> Success 3 Max         86.00 (  0.00%)       86.00 (  0.00%)       86.00 (  0.00%)       86.00 (  0.00%)
> 
>                 3.18        3.18        3.18        3.18
>            0-nothp-1   1-nothp-1   2-nothp-1   3-nothp-1
> User         6791.07     6777.88     6751.22     6746.16
> System       1060.23     1062.19     1059.84     1056.64
> Elapsed      2185.24     2228.84     2199.19     2191.76
> 
>                                   3.18        3.18        3.18        3.18
>                              0-nothp-1   1-nothp-1   2-nothp-1   3-nothp-1
> Minor Faults                 198068318   197804720   198505004   198482880
> Major Faults                       501         498         496         494
> Swap Ins                            46          48          11          11
> Swap Outs                         2634        2651        2086        1823
> Allocation stalls                 7323        7117        5970        6309
> DMA allocs                          97         100         134         149
> DMA32 allocs                 124755567   124289054   124952178   125027538
> Normal allocs                 59002004    59130550    59196697    59072554
> Movable allocs                       0           0           0           0
> Direct pages scanned            392695      414090      328733      378168
> Kswapd pages scanned           2214189     2207526     2311158     2262640
> Kswapd pages reclaimed         2208768     2202066     2305968     2257781
> Direct pages reclaimed          391894      413055      328084      377401
> Kswapd efficiency                  99%         99%         99%         99%
> Kswapd velocity               1002.608    1000.655    1052.761    1017.141
> Direct efficiency                  99%         99%         99%         99%
> Direct velocity                177.816     187.704     149.742     170.001
> Percentage direct scans            15%         15%         12%         14%
> Zone normal velocity           387.887     388.497     387.885     376.085
> Zone dma32 velocity            792.526     799.852     814.604     811.042
> Zone dma velocity                0.011       0.011       0.014       0.014
> Page writes by reclaim        2809.200    2858.800    2275.200    2011.600
> Page writes file                   174         207         188         188
> Page writes anon                  2634        2651        2086        1823
> Page reclaim immediate            1324        1426        1392        1323
> Sector Reads                   4742548     4728116     4804282     4801711
> Sector Writes                 12763776    12706886    12803965    12789351
> Page rescued immediate               0           0           0           0
> Slabs scanned                  1830284     1842439     1863519     1859570
> Direct inode steals              15479       14389       15666       14788
> Kswapd inode steals              40155       40175       41128       42042
> Kswapd skipped wait                  0           0           0           0
> THP fault alloc                    264         204         254         232
> THP collapse alloc                 505         466         458         530
> THP splits                          15          11          15          13
> THP fault fallback                   5          43          28          45
> THP collapse fail                   17          20          18          16
> Compaction stalls                 2390        2333        2258        2276
> Compaction success                 562         538         563         551
> Compaction failures               1827        1794        1694        1724
> Page migrate success           4263304     4045115     3862467     4028949
> Page migrate failure             24367       16795       16593       17187
> Compaction pages isolated      8732910     8286990     7906654     8249551
> Compaction migrate scanned   132231829   123280022   130556442   132772831
> Compaction free scanned      352820881   350707097   321784049   332591031
> Compaction cost                   5517        5219        5073        5268
> NUMA alloc hit               181237842   180977135   181620892   181590876
> NUMA alloc miss                      0           0           0           0
> NUMA interleave hit                  0           0           0           0
> NUMA alloc local             181237842   180977135   181620892   181590876
> NUMA base PTE updates                0           0           0           0
> NUMA huge PMD updates                0           0           0           0
> NUMA page range updates              0           0           0           0
> NUMA hint faults                     0           0           0           0
> NUMA hint local faults               0           0           0           0
> NUMA hint local percent            100         100         100         100
> NUMA pages migrated                  0           0           0           0
> AutoNUMA cost                       0%          0%          0%          0%
> 
>                                                                3.18            3.18            3.18            3.18
>                                                           0-nothp-1       1-nothp-1       2-nothp-1       3-nothp-1
> Page alloc extfrag event                                4547160     4593415     2343438     2198189
> Extfrag fragmenting                                     4546361     4592610     2342595     2196611
> Extfrag fragmenting for unmovable                          5725        9196        5720        1093
> Extfrag fragmenting unmovable placed with movable          3877        4091        1330         859
> Extfrag fragmenting for reclaimable                         770         628         511         616
> Extfrag fragmenting reclaimable placed with movable         679         520         407         492
> Extfrag fragmenting for movable                         4539866     4582786     2336364     2194902
> 
> 
> 
> Iteration 2 after reboot:
> Yup, those success rates suck. Wonder why. Could it be that there's still
> long-term pollution by unmovable allocations? That wouldn't show on pagetypeinfo.
> 
>                                  3.18                  3.18                  3.18                  3.18
>                             0-nothp-2             1-nothp-2             2-nothp-2             3-nothp-2
> Success 1 Min          9.00 (  0.00%)       13.00 (-44.44%)       16.00 (-77.78%)       14.00 (-55.56%)
> Success 1 Mean        14.80 (  0.00%)       18.80 (-27.03%)       20.80 (-40.54%)       18.00 (-21.62%)
> Success 1 Max         20.00 (  0.00%)       25.00 (-25.00%)       28.00 (-40.00%)       23.00 (-15.00%)
> Success 2 Min         12.00 (  0.00%)       20.00 (-66.67%)       23.00 (-91.67%)       19.00 (-58.33%)
> Success 2 Mean        19.00 (  0.00%)       22.60 (-18.95%)       26.00 (-36.84%)       22.40 (-17.89%)
> Success 2 Max         25.00 (  0.00%)       25.00 (  0.00%)       31.00 (-24.00%)       29.00 (-16.00%)
> Success 3 Min         80.00 (  0.00%)       82.00 ( -2.50%)       80.00 (  0.00%)       81.00 ( -1.25%)
> Success 3 Mean        82.20 (  0.00%)       82.40 ( -0.24%)       81.00 (  1.46%)       81.60 (  0.73%)
> Success 3 Max         84.00 (  0.00%)       83.00 (  1.19%)       82.00 (  2.38%)       83.00 (  1.19%)
> 
>                 3.18        3.18        3.18        3.18
>            0-nothp-2   1-nothp-2   2-nothp-2   3-nothp-2
> User         7004.37     6967.43     6956.83     6963.24
> System       1055.53     1059.64     1057.10     1051.08
> Elapsed      2055.20     2221.28     2083.53     2064.32
> 
>                                   3.18        3.18        3.18        3.18
>                              0-nothp-2   1-nothp-2   2-nothp-2   3-nothp-2
> Minor Faults                 197246131   197529492   197805972   197409194
> Major Faults                       398         466         445         384
> Swap Ins                            23          59          21          13
> Swap Outs                          929         891        1046        1168
> Allocation stalls                 4968        4816        4601        4524
> DMA allocs                         100         102         168         141
> DMA32 allocs                 123655788   124150784   124204923   124032735
> Normal allocs                 58759141    58579320    58833935    58598639
> Movable allocs                       0           0           0           0
> Direct pages scanned            225672      232579      201836      196913
> Kswapd pages scanned           2026634     2073933     2064589     2076511
> Kswapd pages reclaimed         2022720     2070878     2061164     2072427
> Direct pages reclaimed          224845      231656      201126      195774
> Kswapd efficiency                  99%         99%         99%         99%
> Kswapd velocity               1003.135    1018.907     983.086    1005.648
> Direct efficiency                  99%         99%         99%         99%
> Direct velocity                111.702     114.265      96.108      95.365
> Percentage direct scans            10%         10%          8%          8%
> Zone normal velocity           363.005     361.000     351.299     353.425
> Zone dma32 velocity            751.821     772.159     727.879     747.573
> Zone dma velocity                0.012       0.012       0.016       0.015
> Page writes by reclaim        1026.800    1018.600    1189.000    1389.600
> Page writes file                    97         126         142         221
> Page writes anon                   929         891        1046        1168
> Page reclaim immediate            2368        1680        1750        2717
> Sector Reads                   4459287     4515880     4549344     4521904
> Sector Writes                 12631248    12678313    12707720    12655388
> Page rescued immediate               0           0           0           0
> Slabs scanned                  1955590     1889819     2091926     1975239
> Direct inode steals              19201       17306       21977       17822
> Kswapd inode steals             172857      145147      205146      174587
> Kswapd skipped wait                  0           0           0           0
> THP fault alloc                    232         244         260         243
> THP collapse alloc                 340         302         332         364
> THP splits                          12          13          12          12
> THP fault fallback                   6           5           0           1
> THP collapse fail                   24          25          23          23
> Compaction stalls                 1795        1812        1891        1719
> Compaction success                 287         315         348         303
> Compaction failures               1508        1497        1543        1415
> Page migrate success           3660128     3527715     3695452     3482429
> Page migrate failure             10746       10903        9716        9459
> Compaction pages isolated      7468799     7198253     7541268     7113943
> Compaction migrate scanned    69039767    76820644    86198799    76076461
> Compaction free scanned      296178645   293352136   292601706   264948833
> Compaction cost                   4424        4336        4582        4282
> NUMA alloc hit               180446569   180703255   180947345   180593203
> NUMA alloc miss                      0           0           0           0
> NUMA interleave hit                  0           0           0           0
> NUMA alloc local             180446569   180703255   180947345   180593203
> NUMA base PTE updates                0           0           0           0
> NUMA huge PMD updates                0           0           0           0
> NUMA page range updates              0           0           0           0
> NUMA hint faults                     0           0           0           0
> NUMA hint local faults               0           0           0           0
> NUMA hint local percent            100         100         100         100
> NUMA pages migrated                  0           0           0           0
> AutoNUMA cost                       0%          0%          0%          0%
> 
>                                                                3.18            3.18            3.18            3.18
>                                                           0-nothp-2       1-nothp-2       2-nothp-2       3-nothp-2
> Page alloc extfrag event                                1960806     1682705      868136      602097
> Extfrag fragmenting                                     1960268     1682153      867624      601608
> Extfrag fragmenting for unmovable                         14373       13973       12275        2158
> Extfrag fragmenting unmovable placed with movable         10465        7233        8814        1821
> Extfrag fragmenting for reclaimable                        2268        1244        1122        1284
> Extfrag fragmenting reclaimable placed with movable        2092        1010         940        1033
> Extfrag fragmenting for movable                         1943627     1666936      854227      598166
> 
> 
> Iteration 3 after reboot. Again a bit worse.
> 
>                                  3.18                  3.18                  3.18                  3.18
>                             0-nothp-3             1-nothp-3             2-nothp-3             3-nothp-3
> Success 1 Min         12.00 (  0.00%)       12.00 (  0.00%)       16.00 (-33.33%)       13.00 ( -8.33%)
> Success 1 Mean        17.20 (  0.00%)       18.00 ( -4.65%)       18.40 ( -6.98%)       17.20 (  0.00%)
> Success 1 Max         25.00 (  0.00%)       23.00 (  8.00%)       22.00 ( 12.00%)       21.00 ( 16.00%)
> Success 2 Min         17.00 (  0.00%)       17.00 (  0.00%)       21.00 (-23.53%)       18.00 ( -5.88%)
> Success 2 Mean        21.20 (  0.00%)       22.60 ( -6.60%)       24.00 (-13.21%)       22.40 ( -5.66%)
> Success 2 Max         28.00 (  0.00%)       28.00 (  0.00%)       27.00 (  3.57%)       25.00 ( 10.71%)
> Success 3 Min         77.00 (  0.00%)       78.00 ( -1.30%)       78.00 ( -1.30%)       79.00 ( -2.60%)
> Success 3 Mean        78.60 (  0.00%)       79.40 ( -1.02%)       79.40 ( -1.02%)       79.60 ( -1.27%)
> Success 3 Max         80.00 (  0.00%)       81.00 ( -1.25%)       81.00 ( -1.25%)       81.00 ( -1.25%)
> 
>                 3.18        3.18        3.18        3.18
>            0-nothp-3   1-nothp-3   2-nothp-3   3-nothp-3
> User         6969.43     6943.72     6971.01     6957.16
> System       1052.91     1057.03     1056.81     1051.51
> Elapsed      2075.96     2137.93     2066.80     2050.85
> 
>                                   3.18        3.18        3.18        3.18
>                              0-nothp-3   1-nothp-3   2-nothp-3   3-nothp-3
> Minor Faults                 198002094   197799251   197671808   197131275
> Major Faults                       481         452         430         440
> Swap Ins                            84          75          58          69
> Swap Outs                          485         512         617         797
> Allocation stalls                 5130        4895        4369        4198
> DMA allocs                         131         112         168         147
> DMA32 allocs                 124297093   124088280   124075970   123837281
> Normal allocs                 58843460    58836194    58764835    58477182
> Movable allocs                       0           0           0           0
> Direct pages scanned            215029      207548      161207      156133
> Kswapd pages scanned           2063367     2056503     2083316     2064295
> Kswapd pages reclaimed         2060617     2053632     2080418     2061267
> Direct pages reclaimed          214064      206675      160724      155420
> Kswapd efficiency                  99%         99%         99%         99%
> Kswapd velocity               1016.447    1001.068    1000.844     994.439
> Direct efficiency                  99%         99%         99%         99%
> Direct velocity                105.927     101.031      77.446      75.214
> Percentage direct scans             9%          9%          7%          7%
> Zone normal velocity           362.943     352.065     341.152     336.018
> Zone dma32 velocity            759.419     750.021     737.124     733.616
> Zone dma velocity                0.013       0.013       0.014       0.020
> Page writes by reclaim         593.000     648.200     718.200    1011.600
> Page writes file                   107         135         101         214
> Page writes anon                   485         512         617         797
> Page reclaim immediate            1496        1554        1226        1362
> Sector Reads                   4509982     4470464     4521328     4490060
> Sector Writes                 12730210    12693418    12678674    12570993
> Page rescued immediate               0           0           0           0
> Slabs scanned                  2004683     1996351     2093517     2070616
> Direct inode steals              22399       22594       21935       19771
> Kswapd inode steals             177424      186779      221443      220300
> Kswapd skipped wait                  0           0           0           0
> THP fault alloc                    249         253         249         227
> THP collapse alloc                 401         309         276         326
> THP splits                          13          14          12          13
> THP fault fallback                  14           5           0           0
> THP collapse fail                   20          24          26          24
> Compaction stalls                 1864        1896        1882        1804
> Compaction success                 326         332         321         294
> Compaction failures               1537        1564        1560        1510
> Page migrate success           3779905     3591736     3710886     3603691
> Page migrate failure             10248       12087        9537        9811
> Compaction pages isolated      7725248     7336155     7570704     7354030
> Compaction migrate scanned    81291471    81714847    82830202    79307459
> Compaction free scanned      285896115   288986961   286083443   276906989
> Compaction cost                   4639        4439        4575        4435
> NUMA alloc hit               181116213   180919428   180842690   180328118
> NUMA alloc miss                      0           0           0           0
> NUMA interleave hit                  0           0           0           0
> NUMA alloc local             181116213   180919428   180842690   180328118
> NUMA base PTE updates                0           0           0           0
> NUMA huge PMD updates                0           0           0           0
> NUMA page range updates              0           0           0           0
> NUMA hint faults                     0           0           0           0
> NUMA hint local faults               0           0           0           0
> NUMA hint local percent            100         100         100         100
> NUMA pages migrated                  0           0           0           0
> AutoNUMA cost                       0%          0%          0%          0%
> 
>                                                                3.18            3.18            3.18            3.18
>                                                           0-nothp-3       1-nothp-3       2-nothp-3       3-nothp-3
> Page alloc extfrag event                                1485930     1858687      831967      777544
> Extfrag fragmenting                                     1485545     1858248      831574      777153
> Extfrag fragmenting for unmovable                         14710       15110       10055        3106
> Extfrag fragmenting unmovable placed with movable          8294        8117        7059        2709
> Extfrag fragmenting for reclaimable                        2253        1292        1258        1239
> Extfrag fragmenting reclaimable placed with movable        2070        1050        1050         972
> Extfrag fragmenting for movable                         1468582     1841846      820261      772808
> 
> 
> Iteration 4:
> 
>                                  3.18                  3.18                  3.18                  3.18
>                             0-nothp-4             1-nothp-4             2-nothp-4             3-nothp-4
> Success 1 Min         11.00 (  0.00%)       15.00 (-36.36%)       15.00 (-36.36%)       11.00 (  0.00%)
> Success 1 Mean        14.60 (  0.00%)       17.20 (-17.81%)       18.80 (-28.77%)       16.80 (-15.07%)
> Success 1 Max         19.00 (  0.00%)       18.00 (  5.26%)       25.00 (-31.58%)       28.00 (-47.37%)
> Success 2 Min         16.00 (  0.00%)       16.00 (  0.00%)       22.00 (-37.50%)       17.00 ( -6.25%)
> Success 2 Mean        18.80 (  0.00%)       22.40 (-19.15%)       24.20 (-28.72%)       22.40 (-19.15%)
> Success 2 Max         21.00 (  0.00%)       28.00 (-33.33%)       27.00 (-28.57%)       31.00 (-47.62%)
> Success 3 Min         76.00 (  0.00%)       77.00 ( -1.32%)       78.00 ( -2.63%)       77.00 ( -1.32%)
> Success 3 Mean        77.60 (  0.00%)       77.80 ( -0.26%)       78.80 ( -1.55%)       78.40 ( -1.03%)
> Success 3 Max         80.00 (  0.00%)       80.00 (  0.00%)       80.00 (  0.00%)       80.00 (  0.00%)
> 
>                 3.18        3.18        3.18        3.18
>            0-nothp-4   1-nothp-4   2-nothp-4   3-nothp-4
> User         7014.11     6945.27     6957.40     6963.31
> System       1055.82     1054.82     1053.90     1055.12
> Elapsed      2058.53     2058.56     2075.28     2048.52
> 
>                                   3.18        3.18        3.18        3.18
>                              0-nothp-4   1-nothp-4   2-nothp-4   3-nothp-4
> Minor Faults                 197873509   198398469   197895081   197535790
> Major Faults                       407         419         427         402
> Swap Ins                            37          50          37          30
> Swap Outs                          338         371         439         388
> Allocation stalls                 5195        4652        4513        4325
> DMA allocs                          99         107         145         133
> DMA32 allocs                 124092064   124319488   124167239   123944556
> Normal allocs                 58773824    59100526    58883054    58700006
> Movable allocs                       0           0           0           0
> Direct pages scanned            216998      190534      174921      155459
> Kswapd pages scanned           2040693     2087853     2082845     2077534
> Kswapd pages reclaimed         2037419     2085208     2080120     2074709
> Direct pages reclaimed          216518      189914      174192      154957
> Kswapd efficiency                  99%         99%         99%         99%
> Kswapd velocity               1000.384     996.128     991.642    1026.049
> Direct efficiency                  99%         99%         99%         99%
> Direct velocity                106.377      90.905      83.280      76.778
> Percentage direct scans             9%          8%          7%          6%
> Zone normal velocity           347.776     345.668     342.893     350.841
> Zone dma32 velocity            758.972     741.345     732.009     751.972
> Zone dma velocity                0.013       0.020       0.020       0.015
> Page writes by reclaim         399.800     452.800     631.400     568.000
> Page writes file                    61          81         191         179
> Page writes anon                   338         371         439         388
> Page reclaim immediate            1704        1090        1217        1245
> Sector Reads                   4461358     4478920     4516170     4505277
> Sector Writes                 12698146    12785845    12720364    12645422
> Page rescued immediate               0           0           0           0
> Slabs scanned                  1976614     1994349     2077089     2081061
> Direct inode steals              22948       15954       17649       20023
> Kswapd inode steals             175854      186992      208169      216263
> Kswapd skipped wait                  0           0           0           0
> THP fault alloc                    246         262         264         240
> THP collapse alloc                 255         265         327         310
> THP splits                          14          13          13          13
> THP fault fallback                   5          15           0           2
> THP collapse fail                   27          27          25          25
> Compaction stalls                 1778        1873        1859        1824
> Compaction success                 275         318         319         299
> Compaction failures               1502        1555        1540        1524
> Page migrate success           3633014     3657877     3634074     3598224
> Page migrate failure              9804        8803        9796        9708
> Compaction pages isolated      7420349     7474113     7419569     7342056
> Compaction migrate scanned    72131019    83649881    82656970    81781759
> Compaction free scanned      285190682   294019483   273748735   275195864
> Compaction cost                   4417        4524        4491        4447
> NUMA alloc hit               180976412   181453188   181021959   180675563
> NUMA alloc miss                      0           0           0           0
> NUMA interleave hit                  0           0           0           0
> NUMA alloc local             180976412   181453188   181021959   180675563
> NUMA base PTE updates                0           0           0           0
> NUMA huge PMD updates                0           0           0           0
> NUMA page range updates              0           0           0           0
> NUMA hint faults                     0           0           0           0
> NUMA hint local faults               0           0           0           0
> NUMA hint local percent            100         100         100         100
> NUMA pages migrated                  0           0           0           0
> AutoNUMA cost                       0%          0%          0%          0%
> 
>                                                                3.18            3.18            3.18            3.18
>                                                           0-nothp-4       1-nothp-4       2-nothp-4       3-nothp-4
> Page alloc extfrag event                                1952436     1661151      738877      773695
> Extfrag fragmenting                                     1952086     1660760      738488      773341
> Extfrag fragmenting for unmovable                         20531       14360        7780        8540
> Extfrag fragmenting unmovable placed with movable         14937        7515        4644        7982
> Extfrag fragmenting for reclaimable                        2372        1458        1559        1349
> Extfrag fragmenting reclaimable placed with movable        2163        1184        1229        1084
> Extfrag fragmenting for movable                         1929183     1644942      729149      763452
> 
> 
> Iteration 5:
> 
>                                  3.18                  3.18                  3.18                  3.18
>                             0-nothp-5             1-nothp-5             2-nothp-5             3-nothp-5
> Success 1 Min         11.00 (  0.00%)       12.00 ( -9.09%)       12.00 ( -9.09%)       13.00 (-18.18%)
> Success 1 Mean        14.80 (  0.00%)       14.80 (  0.00%)       17.60 (-18.92%)       15.00 ( -1.35%)
> Success 1 Max         19.00 (  0.00%)       17.00 ( 10.53%)       24.00 (-26.32%)       18.00 (  5.26%)
> Success 2 Min         14.00 (  0.00%)       17.00 (-21.43%)       18.00 (-28.57%)       19.00 (-35.71%)
> Success 2 Mean        18.80 (  0.00%)       19.80 ( -5.32%)       23.20 (-23.40%)       21.20 (-12.77%)
> Success 2 Max         24.00 (  0.00%)       22.00 (  8.33%)       29.00 (-20.83%)       24.00 (  0.00%)
> Success 3 Min         75.00 (  0.00%)       76.00 ( -1.33%)       76.00 ( -1.33%)       75.00 (  0.00%)
> Success 3 Mean        76.80 (  0.00%)       77.20 ( -0.52%)       77.20 ( -0.52%)       77.00 ( -0.26%)
> Success 3 Max         78.00 (  0.00%)       79.00 ( -1.28%)       79.00 ( -1.28%)       78.00 (  0.00%)
> 
>                 3.18        3.18        3.18        3.18
>            0-nothp-5   1-nothp-5   2-nothp-5   3-nothp-5
> User         7010.91     6975.75     6915.14     6970.45
> System       1055.83     1056.19     1053.80     1052.33
> Elapsed      2052.31     2048.28     2050.12     2053.89
> 
>                                   3.18        3.18        3.18        3.18
>                              0-nothp-5   1-nothp-5   2-nothp-5   3-nothp-5
> Minor Faults                 197030140   197319524   197489685   197695270
> Major Faults                       429         411         415         390
> Swap Ins                            49          55          36          30
> Swap Outs                          305         228         332         381
> Allocation stalls                 5108        4659        4490        4328
> DMA allocs                          99         134         141         122
> DMA32 allocs                 123508440   123843605   123873130   124099102
> Normal allocs                 58622667    58573504    58761770    58652867
> Movable allocs                       0           0           0           0
> Direct pages scanned            220984      190063      158418      149760
> Kswapd pages scanned           2043404     2049188     2073308     2067291
> Kswapd pages reclaimed         2031444     2046517     2067186     2064528
> Direct pages reclaimed          218557      189225      157980      149287
> Kswapd efficiency                  99%         99%         99%         99%
> Kswapd velocity               1012.674    1015.123    1022.432    1008.494
> Direct efficiency                  98%         99%         99%         99%
> Direct velocity                109.516      94.153      78.122      73.058
> Percentage direct scans             9%          8%          7%          6%
> Zone normal velocity           354.483     355.563     345.106     347.632
> Zone dma32 velocity            767.696     753.701     755.430     733.904
> Zone dma velocity                0.011       0.013       0.018       0.016
> Page writes by reclaim         431.000     315.200     527.200     540.000
> Page writes file                   125          87         194         158
> Page writes anon                   305         228         332         381
> Page reclaim immediate           12115        1719        4469        1280
> Sector Reads                   4487948     4453748     4502543     4490908
> Sector Writes                 12621033    12653866    12659975    12687881
> Page rescued immediate               0           0           0           0
> Slabs scanned                  1956286     1958388     2088099     2073000
> Direct inode steals              15390       20539       24285       29811
> Kswapd inode steals             185143      183428      219000      210892
> Kswapd skipped wait                  0           0           0           0
> THP fault alloc                    230         248         243         253
> THP collapse alloc                 278         335         340         280
> THP splits                          12          13          12          12
> THP fault fallback                   5           2           2           1
> THP collapse fail                   25          25          23          26
> Compaction stalls                 1780        1797        1877        1859
> Compaction success                 283         281         324         305
> Compaction failures               1497        1516        1553        1554
> Page migrate success           3670577     3519806     3645951     3783349
> Page migrate failure              8559        9771       11186        9559
> Compaction pages isolated      7495004     7189748     7444082     7722521
> Compaction migrate scanned    75257058    74119179    84933954    80371020
> Compaction free scanned      282720327   290434359   282089729   300987492
> Compaction cost                   4479        4309        4520        4636
> NUMA alloc hit               180250566   180484746   180642086   180827624
> NUMA alloc miss                      0           0           0           0
> NUMA interleave hit                  0           0           0           0
> NUMA alloc local             180250566   180484746   180642086   180827624
> NUMA base PTE updates                0           0           0           0
> NUMA huge PMD updates                0           0           0           0
> NUMA page range updates              0           0           0           0
> NUMA hint faults                     0           0           0           0
> NUMA hint local faults               0           0           0           0
> NUMA hint local percent            100         100         100         100
> NUMA pages migrated                  0           0           0           0
> AutoNUMA cost                       0%          0%          0%          0%
> 
> WARNING: CPU:3 [LOST 7268 EVENTS]
> WARNING: CPU:2 [LOST 10396 EVENTS]
> - those were in 0-nothp-5, that's why it looks so good
> - on the other hand, events for 1-nothp-5 look absurdly high
>                                                                3.18            3.18            3.18            3.18
>                                                           0-nothp-5       1-nothp-5       2-nothp-5       3-nothp-5
> Page alloc extfrag event                                1532339     2043456      659360      824401
> Extfrag fragmenting                                     1532007     2043095      658942      824041
> Extfrag fragmenting for unmovable                         12148      143580        8546        3232
> Extfrag fragmenting unmovable placed with movable          9266      139803        5350        2915
> Extfrag fragmenting for reclaimable                        2159        1374        1319        1298
> Extfrag fragmenting reclaimable placed with movable        1988        1165        1047        1096
> Extfrag fragmenting for movable                         1517700     1898141      649077      819511
> 
> --
> To unsubscribe, send a message with 'unsubscribe linux-mm' in
> the body to majordomo@xxxxxxxxx.  For more info on Linux MM,
> see: http://www.linux-mm.org/ .
> Don't email: <a href=mailto:"dont@xxxxxxxxx";> email@xxxxxxxxx </a>

--
To unsubscribe, send a message with 'unsubscribe linux-mm' in
the body to majordomo@xxxxxxxxx.  For more info on Linux MM,
see: http://www.linux-mm.org/ .
Don't email: <a href=mailto:"dont@xxxxxxxxx";> email@xxxxxxxxx </a>




[Index of Archives]     [Linux ARM Kernel]     [Linux ARM]     [Linux Omap]     [Fedora ARM]     [IETF Annouce]     [Bugtraq]     [Linux]     [Linux OMAP]     [Linux MIPS]     [ECOS]     [Asterisk Internet PBX]     [Linux API]