Am 09.09.19 um 14:21 schrieb Vlastimil Babka: > On 9/9/19 2:09 PM, Stefan Priebe - Profihost AG wrote: >> >> Am 09.09.19 um 13:49 schrieb Vlastimil Babka: >>> On 9/9/19 10:54 AM, Stefan Priebe - Profihost AG wrote: >>>>> Do you have more snapshots of /proc/vmstat as suggested by >>>>> Vlastimil and >>>>> me earlier in this thread? Seeing the overall progress would tell us >>>>> much more than before and after. Or have I missed this data? >>>> >>>> I needed to wait until today to grab again such a situation but from >>>> what i know it is very clear that MemFree is low and than the kernel >>>> starts to drop the chaches. >>>> >>>> Attached you'll find two log files. >>> >>> Thanks, what about my other requests/suggestions from earlier? >> >> Sorry i missed your email. >> >>> 1. How does /proc/pagetypeinfo look like? >> >> # cat /proc/pagetypeinfo >> Page block order: 9 >> Pages per block: 512 > > Looks like it might be fragmented, but was that snapshot taken in the > situation where there's free memory and the system still drops cache? No this one is from "now" where no pressure is recorded and where mem free is at 3G and cache is also at 3G. >>> 2. Could you also try if the bad trend stops after you execute: >>> echo never > /sys/kernel/mm/transparent_hugepage/defrag >>> and report the result? >> >> it's pretty difficult to catch those moments. Is it OK so set the value >> now and monitor if it happens again? > > Well if it doesn't happen again after changing that setting, it would > definitely point at THP interactions. OK i set it to never. >> Just to let you know: >> I've now also some more servers where memfree show 10-20Gb but cache >> drops suddently and memory PSI raises. > > You mean those are in that state right now? So how does > /proc/pagetypeinfo look there, and would changing the defrag setting help? Yes i've a system which constantly triggers PSI (just 1-3%) but Mem Free is at 29GB. 1402: # cat /proc/pagetypeinfo Page block order: 9 Pages per block: 512 Free pages count per migrate type at order 0 1 2 3 4 5 6 7 8 9 10 Node 0, zone DMA, type Unmovable 0 0 0 1 2 1 1 0 1 0 0 Node 0, zone DMA, type Movable 0 0 0 0 0 0 0 0 0 1 3 Node 0, zone DMA, type Reclaimable 0 0 0 0 0 0 0 0 0 0 0 Node 0, zone DMA, type HighAtomic 0 0 0 0 0 0 0 0 0 0 0 Node 0, zone DMA, type Isolate 0 0 0 0 0 0 0 0 0 0 0 Node 0, zone DMA32, type Unmovable 0 1 0 1 0 1 0 1 1 0 3 Node 0, zone DMA32, type Movable 42 29 60 52 56 52 47 46 24 3 48 Node 0, zone DMA32, type Reclaimable 0 0 3 1 0 1 1 1 1 0 0 Node 0, zone DMA32, type HighAtomic 0 0 0 0 0 0 0 0 0 0 0 Node 0, zone DMA32, type Isolate 0 0 0 0 0 0 0 0 0 0 0 Node 0, zone Normal, type Unmovable 189 7690 24737 14314 7620 5362 3458 1607 165 0 0 Node 0, zone Normal, type Movable 29269 31003 70251 73957 54776 37134 21084 10547 2307 35 4 Node 0, zone Normal, type Reclaimable 1431 3837 1821 2137 2475 978 386 112 2 0 0 Node 0, zone Normal, type HighAtomic 0 0 1 3 3 3 1 0 1 0 0 Node 0, zone Normal, type Isolate 0 0 0 0 0 0 0 0 0 0 0 Number of blocks type Unmovable Movable Reclaimable HighAtomic Isolate Node 0, zone DMA 1 7 0 0 0 Node 0, zone DMA32 10 1005 1 0 0 Node 0, zone Normal 3407 27184 1152 1 0 Stefan