Hello,
Below are the logs from oom-kller. I am not able to interpret/decode the logs as well as not able to find root cause of oom-killer.
Note: CPU Arch: Arm 32-bit , Kernel - 4.14.65
[ 727.941258] kworker/u8:2 invoked oom-killer: gfp_mask=0x15080c0(GFP_KERNEL_ACCOUNT|__GFP_ZERO), nodemask=(null), order=1, oom_score_adj=0
[ 727.954355] CPU: 0 PID: 56 Comm: kworker/u8:2 Tainted: P O 4.14.65 #606
[ 727.962450] Hardware name: Android (Flattened Device Tree)
[ 727.968812] Workqueue: events_unbound call_usermodehelper_exec_work
[ 727.975076] Backtrace:
[ 727.977528] [<c020dbec>] (dump_backtrace) from [<c020ded4>] (show_stack+0x18/0x1c)
[ 727.985096] r6:600f0113 r5:c141c0dc r4:00000000 r3:cf08b34d
[ 727.990755] [<c020debc>] (show_stack) from [<c0ba8cf0>] (dump_stack+0x94/0xa8)
[ 727.997979] [<c0ba8c5c>] (dump_stack) from [<c034b284>] (dump_header+0xa0/0x20c)
[ 728.005372] r6:dd347d7c r5:dd347d7c r4:d5737080 r3:cf08b34d
[ 728.011030] [<c034b1e4>] (dump_header) from [<c034a4b8>] (oom_kill_process+0x424/0x534)
[ 728.019033] r10:00000001 r9:c12169bc r8:00000392 r7:c0e08d5c r6:dd347d7c r5:d5737080
[ 728.026856] r4:d57375f8
[ 728.029390] [<c034a094>] (oom_kill_process) from [<c034af24>] (out_of_memory+0x140/0x368)
[ 728.037569] r10:00000001 r9:c12169bc r8:00000041 r7:c121e680 r6:c1216588 r5:dd347d7c
[ 728.045392] r4:d5737080
[ 728.047929] [<c034ade4>] (out_of_memory) from [<c03519ac>] (__alloc_pages_nodemask+0x1178/0x124c)
[ 728.056798] r7:c141e7d0 r6:c12166a4 r5:00000000 r4:00001155
[ 728.062460] [<c0350834>] (__alloc_pages_nodemask) from [<c021e9d4>] (copy_process.part.5+0x114/0x1a28)
[ 728.071764] r10:00000000 r9:dd358000 r8:00000000 r7:c1447e08 r6:c1216588 r5:00808111
[ 728.079587] r4:d1063c00
[ 728.082119] [<c021e8c0>] (copy_process.part.5) from [<c0220470>] (_do_fork+0xd0/0x464)
[ 728.090034] r10:00000000 r9:00000000 r8:dd008400 r7:00000000 r6:c1216588 r5:d2d58ac0
[ 728.097857] r4:00808111
[ 728.100388] [<c02203a0>] (_do_fork) from [<c0220864>] (kernel_thread+0x38/0x40)
[ 728.107696] r10:00000000 r9:c1422594 r8:dd008400 r7:00000000 r6:dd004500 r5:d2d58ac0
[ 728.115519] r4:c1216588
[ 728.118055] [<c022082c>] (kernel_thread) from [<c0239a74>] (call_usermodehelper_exec_work+0x44/0xe0)
[ 728.127188] [<c0239a30>] (call_usermodehelper_exec_work) from [<c023d088>] (process_one_work+0x154/0x518)
[ 728.136756] r5:d2d58ac0 r4:dd234100
[ 728.140335] [<c023cf34>] (process_one_work) from [<c023d4a4>] (worker_thread+0x58/0x56c)
[ 728.148424] r10:00000088 r9:dd234100 r8:dd234118 r7:c120f900 r6:dd346038 r5:dd008424
[ 728.156247] r4:dd008400
[ 728.158780] [<c023d44c>] (worker_thread) from [<c0244198>] (kthread+0x134/0x164)
[ 728.166174] r10:dd233e68 r9:dd2341a8 r8:c023d44c r7:dd234100 r6:dd236280 r5:00000000
[ 728.173997] r4:dd234180
[ 728.176531] [<c0244064>] (kthread) from [<c0209258>] (ret_from_fork+0x14/0x3c)
[ 728.183752] r10:00000000 r9:00000000 r8:00000000 r7:00000000 r6:00000000 r5:c0244064
[ 728.191575] r4:dd236280 r3:00000000
[ 728.199092] Mem-Info:
[ 728.201407] active_anon:97307 inactive_anon:124 isolated_anon:0
[ 728.201407] active_file:583 inactive_file:575 isolated_file:64
[ 728.201407] unevictable:638 dirty:0 writeback:0 unstable:0
[ 728.201407] slab_reclaimable:4681 slab_unreclaimable:7808
[ 728.201407] mapped:1656 shmem:182 pagetables:4482 bounce:0
[ 728.201407] free:143605 free_pcp:230 free_cma:139244
[ 728.235525] Node 0 active_anon:389228kB inactive_anon:496kB active_file:2072kB inactive_file:2456kB unevictable:2552kB isolated(anon):0kB isolated(file):0kB mapped:5984kB dirty:0kB writeback:0kB shmem:728kB writeback_tmp:0kB unstable:0kB all_unreclaimable? no
[ 728.260031] DMA free:17960kB min:16384kB low:25664kB high:29760kB active_anon:3556kB inactive_anon:0kB active_file:280kB inactive_file:28kB unevictable:0kB writepending:0kB present:458752kB managed:422896kB mlocked:0kB kernel_stack:6496kB pagetables:9904kB bounce:0kB free_pcp:348kB local_pcp:0kB free_cma:0kB
[ 728.287402] lowmem_reserve[]: 0 0 579 579
[ 728.292470] HighMem free:553472kB min:512kB low:34024kB high:48808kB active_anon:385672kB inactive_anon:496kB active_file:1820kB inactive_file:5284kB unevictable:2552kB writepending:0kB present:1526784kB managed:1526784kB mlocked:2552kB kernel_stack:0kB pagetables:7272kB bounce:0kB free_pcp:324kB local_pcp:0kB free_cma:553588kB
[ 728.322946] lowmem_reserve[]: 0 0 0 0
[ 728.326634] DMA: 71*4kB (EH) 113*8kB (UH) 207*16kB (UMH) 103*32kB (UMH) 70*64kB (UMH) 27*128kB (UMH) 5*256kB (UMH) 1*512kB (H) 0*1024kB 0*2048kB 0*4096kB 0*8192kB 0*16384kB = 17524kB
[ 728.344398] HighMem: 8121*4kB (C) 7772*8kB (C) 4391*16kB (C) 2354*32kB (C) 1335*64kB (C) 514*128kB (C) 162*256kB (C) 76*512kB (C) 27*1024kB (C) 12*2048kB (C) 2*4096kB (C) 2*8192kB (C) 0*16384kB = 548660kB
[ 728.364376] 3561 total pagecache pages
[ 728.368825] 0 pages in swap cache
[ 728.372226] Swap cache stats: add 0, delete 0, find 0/0
[ 728.379273] Free swap = 0kB
[ 728.382256] Total swap = 0kB
[ 728.385418] 496384 pages RAM
[ 728.388337] 381696 pages HighMem/MovableOnly
[ 728.393901] 8964 pages reserved
[ 728.397087] 233472 pages cma reserved
I have sufficient memory is available as per logs, and in logs it requires order = 1 ?
Then why oom-killer triggered ?
What is 71*4kB (EH) , (UMH) , (UH) and (C) ?
Below are the logs from oom-kller. I am not able to interpret/decode the logs as well as not able to find root cause of oom-killer.
Note: CPU Arch: Arm 32-bit , Kernel - 4.14.65
[ 727.941258] kworker/u8:2 invoked oom-killer: gfp_mask=0x15080c0(GFP_KERNEL_ACCOUNT|__GFP_ZERO), nodemask=(null), order=1, oom_score_adj=0
[ 727.954355] CPU: 0 PID: 56 Comm: kworker/u8:2 Tainted: P O 4.14.65 #606
[ 727.962450] Hardware name: Android (Flattened Device Tree)
[ 727.968812] Workqueue: events_unbound call_usermodehelper_exec_work
[ 727.975076] Backtrace:
[ 727.977528] [<c020dbec>] (dump_backtrace) from [<c020ded4>] (show_stack+0x18/0x1c)
[ 727.985096] r6:600f0113 r5:c141c0dc r4:00000000 r3:cf08b34d
[ 727.990755] [<c020debc>] (show_stack) from [<c0ba8cf0>] (dump_stack+0x94/0xa8)
[ 727.997979] [<c0ba8c5c>] (dump_stack) from [<c034b284>] (dump_header+0xa0/0x20c)
[ 728.005372] r6:dd347d7c r5:dd347d7c r4:d5737080 r3:cf08b34d
[ 728.011030] [<c034b1e4>] (dump_header) from [<c034a4b8>] (oom_kill_process+0x424/0x534)
[ 728.019033] r10:00000001 r9:c12169bc r8:00000392 r7:c0e08d5c r6:dd347d7c r5:d5737080
[ 728.026856] r4:d57375f8
[ 728.029390] [<c034a094>] (oom_kill_process) from [<c034af24>] (out_of_memory+0x140/0x368)
[ 728.037569] r10:00000001 r9:c12169bc r8:00000041 r7:c121e680 r6:c1216588 r5:dd347d7c
[ 728.045392] r4:d5737080
[ 728.047929] [<c034ade4>] (out_of_memory) from [<c03519ac>] (__alloc_pages_nodemask+0x1178/0x124c)
[ 728.056798] r7:c141e7d0 r6:c12166a4 r5:00000000 r4:00001155
[ 728.062460] [<c0350834>] (__alloc_pages_nodemask) from [<c021e9d4>] (copy_process.part.5+0x114/0x1a28)
[ 728.071764] r10:00000000 r9:dd358000 r8:00000000 r7:c1447e08 r6:c1216588 r5:00808111
[ 728.079587] r4:d1063c00
[ 728.082119] [<c021e8c0>] (copy_process.part.5) from [<c0220470>] (_do_fork+0xd0/0x464)
[ 728.090034] r10:00000000 r9:00000000 r8:dd008400 r7:00000000 r6:c1216588 r5:d2d58ac0
[ 728.097857] r4:00808111
[ 728.100388] [<c02203a0>] (_do_fork) from [<c0220864>] (kernel_thread+0x38/0x40)
[ 728.107696] r10:00000000 r9:c1422594 r8:dd008400 r7:00000000 r6:dd004500 r5:d2d58ac0
[ 728.115519] r4:c1216588
[ 728.118055] [<c022082c>] (kernel_thread) from [<c0239a74>] (call_usermodehelper_exec_work+0x44/0xe0)
[ 728.127188] [<c0239a30>] (call_usermodehelper_exec_work) from [<c023d088>] (process_one_work+0x154/0x518)
[ 728.136756] r5:d2d58ac0 r4:dd234100
[ 728.140335] [<c023cf34>] (process_one_work) from [<c023d4a4>] (worker_thread+0x58/0x56c)
[ 728.148424] r10:00000088 r9:dd234100 r8:dd234118 r7:c120f900 r6:dd346038 r5:dd008424
[ 728.156247] r4:dd008400
[ 728.158780] [<c023d44c>] (worker_thread) from [<c0244198>] (kthread+0x134/0x164)
[ 728.166174] r10:dd233e68 r9:dd2341a8 r8:c023d44c r7:dd234100 r6:dd236280 r5:00000000
[ 728.173997] r4:dd234180
[ 728.176531] [<c0244064>] (kthread) from [<c0209258>] (ret_from_fork+0x14/0x3c)
[ 728.183752] r10:00000000 r9:00000000 r8:00000000 r7:00000000 r6:00000000 r5:c0244064
[ 728.191575] r4:dd236280 r3:00000000
[ 728.199092] Mem-Info:
[ 728.201407] active_anon:97307 inactive_anon:124 isolated_anon:0
[ 728.201407] active_file:583 inactive_file:575 isolated_file:64
[ 728.201407] unevictable:638 dirty:0 writeback:0 unstable:0
[ 728.201407] slab_reclaimable:4681 slab_unreclaimable:7808
[ 728.201407] mapped:1656 shmem:182 pagetables:4482 bounce:0
[ 728.201407] free:143605 free_pcp:230 free_cma:139244
[ 728.235525] Node 0 active_anon:389228kB inactive_anon:496kB active_file:2072kB inactive_file:2456kB unevictable:2552kB isolated(anon):0kB isolated(file):0kB mapped:5984kB dirty:0kB writeback:0kB shmem:728kB writeback_tmp:0kB unstable:0kB all_unreclaimable? no
[ 728.260031] DMA free:17960kB min:16384kB low:25664kB high:29760kB active_anon:3556kB inactive_anon:0kB active_file:280kB inactive_file:28kB unevictable:0kB writepending:0kB present:458752kB managed:422896kB mlocked:0kB kernel_stack:6496kB pagetables:9904kB bounce:0kB free_pcp:348kB local_pcp:0kB free_cma:0kB
[ 728.287402] lowmem_reserve[]: 0 0 579 579
[ 728.292470] HighMem free:553472kB min:512kB low:34024kB high:48808kB active_anon:385672kB inactive_anon:496kB active_file:1820kB inactive_file:5284kB unevictable:2552kB writepending:0kB present:1526784kB managed:1526784kB mlocked:2552kB kernel_stack:0kB pagetables:7272kB bounce:0kB free_pcp:324kB local_pcp:0kB free_cma:553588kB
[ 728.322946] lowmem_reserve[]: 0 0 0 0
[ 728.326634] DMA: 71*4kB (EH) 113*8kB (UH) 207*16kB (UMH) 103*32kB (UMH) 70*64kB (UMH) 27*128kB (UMH) 5*256kB (UMH) 1*512kB (H) 0*1024kB 0*2048kB 0*4096kB 0*8192kB 0*16384kB = 17524kB
[ 728.344398] HighMem: 8121*4kB (C) 7772*8kB (C) 4391*16kB (C) 2354*32kB (C) 1335*64kB (C) 514*128kB (C) 162*256kB (C) 76*512kB (C) 27*1024kB (C) 12*2048kB (C) 2*4096kB (C) 2*8192kB (C) 0*16384kB = 548660kB
[ 728.364376] 3561 total pagecache pages
[ 728.368825] 0 pages in swap cache
[ 728.372226] Swap cache stats: add 0, delete 0, find 0/0
[ 728.379273] Free swap = 0kB
[ 728.382256] Total swap = 0kB
[ 728.385418] 496384 pages RAM
[ 728.388337] 381696 pages HighMem/MovableOnly
[ 728.393901] 8964 pages reserved
[ 728.397087] 233472 pages cma reserved
I have sufficient memory is available as per logs, and in logs it requires order = 1 ?
Then why oom-killer triggered ?
What is 71*4kB (EH) , (UMH) , (UH) and (C) ?
Regards,
Pankaj
