On Wed, 2019-07-10 at 17:43 -0400, Qian Cai wrote: > Running LTP oom01 test case with swap triggers a crash below. Revert the > series > "Make deferred split shrinker memcg aware" [1] seems fix the issue. You might want to look harder on this commit, as reverted it alone on the top of 5.2.0-next-20190711 fixed the issue. aefde94195ca mm: thp: make deferred split shrinker memcg aware [1] [1] https://lore.kernel.org/linux-mm/1561507361-59349-5-git-send-email-yang.shi@ linux.alibaba.com/ There are all console output while running LTP oom01 before the crash that might be useful. [ 656.302886][ T3384] WARNING: CPU: 79 PID: 3384 at mm/page_alloc.c:4608 __alloc_pages_nodemask+0x1a8a/0x1bc0 [ 656.304395][ T3409] kmemleak: Cannot allocate a kmemleak_object structure [ 656.312714][ T3384] Modules linked in: nls_iso8859_1 nls_cp437 vfat fat kvm_amd kvm ses enclosure dax_pmem irqbypass dax_pmem_core efivars ip_tables x_tables xfs sd_mod smartpqi scsi_transport_sas mlx5_core tg3 libphy firmware_class dm_mirror dm_region_hash dm_log dm_mod efivarfs [ 656.320916][ T3409] kmemleak: Kernel memory leak detector disabled [ 656.344509][ T3384] CPU: 79 PID: 3384 Comm: oom01 Not tainted 5.2.0-next- 20190711+ #3 [ 656.344523][ T3384] Hardware name: HPE ProLiant DL385 Gen10/ProLiant DL385 Gen10, BIOS A40 06/24/2019 [ 656.352100][ T829] kmemleak: Automatic memory scanning thread ended [ 656.358648][ T3384] RIP: 0010:__alloc_pages_nodemask+0x1a8a/0x1bc0 [ 656.358658][ T3384] Code: 00 85 d2 0f 85 a1 00 00 00 48 c7 c7 e0 29 c3 a3 e8 3b 98 62 00 65 48 8b 1c 25 80 ee 01 00 e9 85 fa ff ff 0f 0b e9 3e fb ff ff <0f> 0b 48 8b b5 00 ff ff ff 8b 8d 84 fe ff ff 48 c7 c2 00 1d 6c a3 [ 656.358675][ T3384] RSP: 0000:ffff888efa4a6210 EFLAGS: 00010046 [ 656.406140][ T3384] RAX: 0000000000000000 RBX: 0000000000000000 RCX: ffffffffa2b28be2 [ 656.414033][ T3384] RDX: 0000000000000000 RSI: dffffc0000000000 RDI: ffffffffa4d15d60 [ 656.421926][ T3384] RBP: ffff888efa4a6420 R08: fffffbfff49a2bad R09: fffffbfff49a2bac [ 656.429818][ T3384] R10: fffffbfff49a2bac R11: 0000000000000003 R12: ffffffffa4d15d60 [ 656.437711][ T3384] R13: 0000000000000000 R14: 0000000000000800 R15: 0000000000000000 [ 656.445605][ T3384] FS: 00007ff44adfc700(0000) GS:ffff889032f80000(0000) knlGS:0000000000000000 [ 656.454459][ T3384] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 656.460952][ T3384] CR2: 00007ff2f05e1000 CR3: 0000001012e44000 CR4: 00000000001406a0 [ 656.468843][ T3384] Call Trace: [ 656.472026][ T3384] ? gfp_pfmemalloc_allowed+0xc0/0xc0 [ 656.477303][ T3384] ? stack_depot_save+0x215/0x58b [ 656.482228][ T3384] ? lock_downgrade+0x390/0x390 [ 656.486976][ T3384] ? stack_depot_save+0x183/0x58b [ 656.491900][ T3384] ? kasan_check_read+0x11/0x20 [ 656.496647][ T3384] ? do_raw_spin_unlock+0xa8/0x140 [ 656.501658][ T3384] ? stack_depot_save+0x215/0x58b [ 656.506582][ T3384] alloc_pages_current+0x9c/0x110 [ 656.511505][ T3384] allocate_slab+0x351/0x11f0 [ 656.516077][ T3384] ? kasan_slab_alloc+0x11/0x20 [ 656.520824][ T3384] new_slab+0x46/0x70 [ 656.524702][ T3384] ? pageout.isra.4+0x3e5/0xa00 [ 656.529449][ T3384] ___slab_alloc+0x5d4/0x9c0 [ 656.533933][ T3384] ? try_to_free_pages+0x242/0x4d0 [ 656.538941][ T3384] ? __alloc_pages_nodemask+0x9ce/0x1bc0 [ 656.544476][ T3384] ? alloc_pages_vma+0x89/0x2c0 [ 656.549226][ T3384] ? __do_page_fault+0x25b/0x5d0 [ 656.554064][ T3384] ? create_object+0x3a/0x3e0 [ 656.558637][ T3384] ? init_object+0x7e/0x90 [ 656.562947][ T3384] ? create_object+0x3a/0x3e0 [ 656.567520][ T3384] __slab_alloc+0x12/0x20 [ 656.571742][ T3384] ? __slab_alloc+0x12/0x20 [ 656.576142][ T3384] kmem_cache_alloc+0x32a/0x400 [ 656.580890][ T3384] create_object+0x3a/0x3e0 [ 656.585291][ T3384] ? stack_depot_save+0x183/0x58b [ 656.590215][ T3384] kmemleak_alloc+0x71/0xa0 [ 656.594611][ T3384] kmem_cache_alloc+0x272/0x400 [ 656.599361][ T3384] ? ___might_sleep+0xab/0xc0 [ 656.603934][ T3384] ? mempool_free+0x170/0x170 [ 656.608507][ T3384] mempool_alloc_slab+0x2d/0x40 [ 656.613254][ T3384] mempool_alloc+0x10a/0x29e [ 656.617739][ T3384] ? alloc_pages_vma+0x89/0x2c0 [ 656.622485][ T3384] ? mempool_resize+0x390/0x390 [ 656.627233][ T3384] ? __read_once_size_nocheck.constprop.2+0x10/0x10 [ 656.633730][ T3384] bio_alloc_bioset+0x150/0x330 [ 656.638477][ T3384] ? bvec_alloc+0x1b0/0x1b0 [ 656.642892][ T3384] alloc_io+0x2f/0x230 [dm_mod] [ 656.647654][ T3384] __split_and_process_bio+0x99/0x630 [dm_mod] [ 656.653714][ T3384] ? blk_rq_map_sg+0x9f0/0x9f0 [ 656.658388][ T3384] ? __send_empty_flush.constprop.11+0x1f0/0x1f0 [dm_mod] [ 656.665407][ T3384] ? check_chain_key+0x1df/0x2e0 [ 656.670244][ T3384] ? kasan_check_read+0x11/0x20 [ 656.674992][ T3384] ? blk_queue_split+0x60/0x90 [ 656.679654][ T3384] ? __blk_queue_split+0x970/0x970 [ 656.684679][ T3384] dm_process_bio+0x33f/0x520 [dm_mod] [ 656.690054][ T3384] ? __process_bio+0x230/0x230 [dm_mod] [ 656.695515][ T3384] dm_make_request+0xbd/0x150 [dm_mod] [ 656.700888][ T3384] ? dm_wq_work+0x1b0/0x1b0 [dm_mod] [ 656.706073][ T3384] ? lock_downgrade+0x390/0x390 [ 656.710821][ T3384] generic_make_request+0x179/0x4a0 [ 656.715917][ T3384] ? blk_queue_exit+0xc0/0xc0 [ 656.720489][ T3384] ? __unlock_page_memcg+0x4f/0x90 [ 656.725495][ T3384] ? unlock_page_memcg+0x1f/0x30 [ 656.730329][ T3384] submit_bio+0xaa/0x270 [ 656.734466][ T3384] ? generic_make_request+0x4a0/0x4a0 [ 656.739739][ T3384] __swap_writepage+0x8f5/0xba0 [ 656.744484][ T3384] ? __x64_sys_madvise.cold.0+0x22/0x22 [ 656.749931][ T3384] ? generic_swapfile_activate+0x2a0/0x2a0 [ 656.755638][ T3384] ? do_raw_spin_lock+0x118/0x1d0 [ 656.760559][ T3384] ? rwlock_bug.part.0+0x60/0x60 [ 656.765393][ T3384] ? page_swapcount+0x68/0xc0 [ 656.769967][ T3384] ? kasan_check_read+0x11/0x20 [ 656.774713][ T3384] ? do_raw_spin_unlock+0xa8/0x140 [ 656.779724][ T3384] ? __frontswap_store+0x103/0x2b0 [ 656.784735][ T3384] swap_writepage+0x65/0xb0 [ 656.789134][ T3384] pageout.isra.4+0x3e5/0xa00 [ 656.793707][ T3384] ? shrink_slab+0x440/0x440 [ 656.798192][ T3384] ? kasan_check_read+0x11/0x20 [ 656.802939][ T3384] shrink_page_list+0x159f/0x2650 [ 656.807860][ T3384] ? page_evictable+0x150/0x150 [ 656.812606][ T3384] ? kasan_check_read+0x11/0x20 [ 656.817352][ T3384] ? check_chain_key+0x1df/0x2e0 [ 656.822185][ T3384] ? shrink_inactive_list+0x2ea/0x770 [ 656.827456][ T3384] ? lock_downgrade+0x390/0x390 [ 656.832202][ T3384] ? do_raw_spin_lock+0x118/0x1d0 [ 656.837126][ T3384] ? rwlock_bug.part.0+0x60/0x60 [ 656.841959][ T3384] ? kasan_check_read+0x11/0x20 [ 656.846706][ T3384] ? do_raw_spin_unlock+0xa8/0x140 [ 656.851715][ T3384] shrink_inactive_list+0x373/0x770 [ 656.856812][ T3384] ? move_pages_to_lru+0xb60/0xb60 [ 656.861820][ T3384] ? shrink_node_memcg+0xcfa/0x1560 [ 656.866917][ T3384] ? lock_downgrade+0x390/0x390 [ 656.871665][ T3384] ? find_next_bit+0x2c/0xa0 [ 656.876151][ T3384] shrink_node_memcg+0x4ff/0x1560 [ 656.881075][ T3384] ? shrink_active_list+0xa10/0xa10 [ 656.886173][ T3384] ? dev_ifsioc+0xb0/0x4d0 [ 656.890485][ T3384] ? mem_cgroup_iter+0x18e/0x840 [ 656.895319][ T3384] ? kasan_check_read+0x11/0x20 [ 656.900066][ T3384] ? mem_cgroup_protected+0x20f/0x260 [ 656.905334][ T3384] shrink_node+0x1d3/0xa30 [ 656.909644][ T3384] ? shrink_node_memcg+0x1560/0x1560 [ 656.914828][ T3384] ? ktime_get+0x93/0x110 [ 656.919050][ T3384] do_try_to_free_pages+0x22f/0x820 [ 656.924146][ T3384] ? shrink_node+0xa30/0xa30 [ 656.928632][ T3384] ? kasan_check_read+0x11/0x20 [ 656.933379][ T3384] ? check_chain_key+0x1df/0x2e0 [ 656.938212][ T3384] try_to_free_pages+0x242/0x4d0 [ 656.943046][ T3384] ? do_try_to_free_pages+0x820/0x820 [ 656.948318][ T3384] __alloc_pages_nodemask+0x9ce/0x1bc0 [ 656.953677][ T3384] ? kasan_check_read+0x11/0x20 [ 656.958424][ T3384] ? gfp_pfmemalloc_allowed+0xc0/0xc0 [ 656.963697][ T3384] ? kasan_check_read+0x11/0x20 [ 656.968443][ T3384] ? check_chain_key+0x1df/0x2e0 [ 656.973277][ T3384] ? do_anonymous_page+0x343/0xe30 [ 656.978288][ T3384] ? lock_downgrade+0x390/0x390 [ 656.983035][ T3384] ? __count_memcg_events+0x8b/0x1c0 [ 656.988218][ T3384] ? kasan_check_read+0x11/0x20 [ 656.992966][ T3384] ? __lru_cache_add+0x122/0x160 [ 656.997802][ T3384] alloc_pages_vma+0x89/0x2c0 [ 657.002375][ T3384] do_anonymous_page+0x3e1/0xe30 [ 657.007211][ T3384] ? __update_load_avg_cfs_rq+0x2c/0x490 [ 657.012743][ T3384] ? finish_fault+0x120/0x120 [ 657.017314][ T3384] ? alloc_pages_vma+0x21e/0x2c0 [ 657.022148][ T3384] handle_pte_fault+0x457/0x12c0 [ 657.026984][ T3384] __handle_mm_fault+0x79a/0xa50 [ 657.031819][ T3384] ? vmf_insert_mixed_mkwrite+0x20/0x20 [ 657.037267][ T3384] ? kasan_check_read+0x11/0x20 [ 657.042013][ T3384] ? __count_memcg_events+0x8b/0x1c0 [ 657.047199][ T3384] handle_mm_fault+0x17f/0x370 [ 657.051863][ T3384] __do_page_fault+0x25b/0x5d0 [ 657.056521][ T3384] do_page_fault+0x4c/0x2cf [ 657.060922][ T3384] ? page_[ 659.105948][ T3124] kworker/2:1H: page allocation failure: order:0, mode:0xa20(GFP_ATOMIC), nodemask=(null),cpuset=/,mems_allowed=0,4 [ 659.106045][ T1598] kworker/10:1H: page allocation failure: order:0, mode:0xa20(GFP_ATOMIC), nodemask=(null),cpuset=/,mems_allowed=0,4 [ 659.118049][ T3124] CPU: 2 PID: 3124 Comm: kworker/2:1H Tainted: G W 5.2.0-next-20190711+ #3 [ 659.137325][ T762] ODEBUG: Out of memory. ODEBUG disabled [ 659.140015][ T3124] Hardware name: HPE ProLiant DL385 Gen10/ProLiant DL385 Gen10, BIOS A40 06/24/2019 [ 659.140032][ T3124] Workqueue: kblockd blk_mq_run_work_fn [ 659.160266][ T3124] Call Trace: [ 659.163442][ T3124] dump_stack+0x62/0x9a [ 659.167487][ T3124] warn_alloc.cold.45+0x8a/0x12a [ 659.172315][ T3124] ? zone_watermark_ok_safe+0x1a0/0x1a0 [ 659.177756][ T3124] ? __read_once_size_nocheck.constprop.2+0x10/0x10 [ 659.184252][ T3124] ? pqi_scsi_queue_command+0x791/0xdd0 [smartpqi] [ 659.190658][ T3124] ? pqi_scsi_queue_command+0x791/0xdd0 [smartpqi] [ 659.197060][ T3124] ? __isolate_free_page+0x390/0x390 [ 659.202239][ T3124] __alloc_pages_nodemask+0x1aab/0x1bc0 [ 659.207680][ T3124] ? gfp_pfmemalloc_allowed+0xc0/0xc0 [ 659.212949][ T3124] ? stack_trace_save+0x87/0xb0 [ 659.217689][ T3124] ? freezing_slow_path.cold.1+0x35/0x35 [ 659.223219][ T3124] ? __kasan_kmalloc.part.0+0x81/0xc0 [ 659.228485][ T3124] ? __kasan_kmalloc.part.0+0x44/0xc0 [ 659.233750][ T3124] ? __kasan_kmalloc.constprop.1+0xac/0xc0 [ 659.239451][ T3124] ? kasan_slab_alloc+0x11/0x20 [ 659.244196][ T3124] ? kmem_cache_alloc+0x17a/0x400 [ 659.249113][ T3124] ? alloc_iova+0x33/0x210 [ 659.253418][ T3124] ? alloc_iova_fast+0x47/0xba [ 659.258073][ T3124] ? dma_ops_alloc_iova.isra.5+0x86/0xa0 [ 659.263603][ T3124] ? map_sg+0x99/0x2f0 [ 659.267558][ T3124] ? scsi_dma_map+0xc6/0x160 [ 659.272042][ T3124] ? pqi_raid_submit_scsi_cmd_with_io_request+0x1c3/0x470 [smartpqi] [ 659.280020][ T3124] ? pqi_scsi_queue_command+0x791/0xdd0 [smartpqi] [ 659.286421][ T3124] ? scsi_queue_rq+0x7c6/0x1280 [ 659.291163][ T3124] ? ftrace_graph_ret_addr+0x2a/0xb0 [ 659.296340][ T3124] ? stack_trace_save+0x87/0xb0 [ 659.301081][ T3124] alloc_pages_current+0x9c/0x110 [ 659.305998][ T3124] allocate_slab+0x351/0x11f0 [ 659.310564][ T3124] new_slab+0x46/0x70 [ 659.314433][ T3124] ___slab_alloc+0x5d4/0x9c0 [ 659.318913][ T3124] ? should_fail+0x107/0x3bc [ 659.323393][ T3124] ? alloc_iova+0x33/0x210 [ 659.327700][ T3124] ? lock_downgrade+0x390/0x390 [ 659.332441][ T3124] ? lock_downgrade+0x390/0x390 [ 659.337183][ T3124] ? alloc_iova+0x33/0x210 [ 659.341487][ T3124] __slab_alloc+0x12/0x20 [ 659.345704][ T3124] ? __slab_alloc+0x12/0x20 [ 659.350096][ T3124] kmem_cache_alloc+0x32a/0x400 [ 659.354838][ T3124] ? kasan_check_read+0x11/0x20 [ 659.359580][ T3124] ? do_raw_spin_unlock+0xa8/0x140 [ 659.364585][ T3124] alloc_iova+0x33/0x210 [ 659.368714][ T3124] ? iova_rcache_get+0x1a1/0x300 [ 659.373545][ T3124] alloc_iova_fast+0x47/0xba [ 659.378026][ T3124] dma_ops_alloc_iova.isra.5+0x86/0xa0 [ 659.383381][ T3124] map_sg+0x99/0x2f0 [ 659.387161][ T3124] scsi_dma_map+0xc6/0x160 [ 659.391470][ T3124] pqi_raid_submit_scsi_cmd_with_io_request+0x1c3/0x470 [smartpqi] [ 659.399274][ T3124] ? pqi_alloc_io_request+0x11e/0x140 [smartpqi] [ 659.405507][ T3124] pqi_scsi_queue_command+0x791/0xdd0 [smartpqi] [ 659.411733][ T3124] ? scsi_init_io+0x102/0x150 [ 659.416306][ T3124] ? sd_setup_read_write_cmnd+0x6e9/0xa90 [sd_mod] [ 659.422713][ T3124] ? pqi_event_worker+0xdf0/0xdf0 [smartpqi] [ 659.428593][ T3124] ? sd_init_command+0x88b/0x930 [sd_mod] [ 659.434211][ T3124] ? blk_add_timer+0xd7/0x110 [ 659.438780][ T3124] scsi_queue_rq+0x7c6/0x1280 [ 659.443350][ T3124] blk_mq_dispatch_rq_list+0x9d3/0xba0 [ 659.448702][ T3124] ? blk_mq_flush_busy_ctxs+0x1c5/0x450 [ 659.454145][ T3124] ? blk_mq_get_driver_tag+0x290/0x290 [ 659.459498][ T3124] ? __lock_acquire.isra.13+0x430/0x830 [ 659.464938][ T3124] blk_mq_sched_dispatch_requests+0x2f4/0x300 [ 659.470903][ T3124] ? blk_mq_sched_restart+0x60/0x60 [ 659.475993][ T3124] __blk_mq_run_hw_queue+0x156/0x230 [ 659.481172][ T3124] ? hctx_lock+0xc0/0xc0 [ 659.485301][ T3124] ? process_one_work+0x426/0xa70 [ 659.490217][ T3124] blk_mq_run_work_fn+0x3b/0x40 [ 659.494959][ T3124] process_one_work+0x53b/0xa70 [ 659.499703][ T3124] ? pwq_dec_nr_in_flight+0x170/0x170 [ 659.504967][ T3124] worker_thread+0x63/0x5b0 [ 659.509361][ T3124] kthread+0x1df/0x200 [ 659.513316][ T3124] ? process_one_work+0xa70/0xa70 [ 659.518231][ T3124] ? kthread_park+0xc0/0xc0 [ 659.522625][ T3124] ret_from_fork+0x22/0x40 [ 659.526937][ T1598] CPU: 10 PID: 1598 Comm: kworker/10:1H Tainted: G W 5.2.0-next-20190711+ #3 [ 659.526991][ T3124] Mem-Info: [ 659.536921][ T1598] Hardware name: HPE ProLiant DL385 Gen10/ProLiant DL385 Gen10, BIOS A40 06/24/2019 [ 659.536934][ T1598] Workqueue: kblockd blk_mq_run_work_fn [ 659.540067][ T3124] active_anon:4662210 inactive_anon:359358 isolated_anon:2005 [ 659.540067][ T3124] active_file:10032 inactive_file:12947 isolated_file:0 [ 659.540067][ T3124] unevictable:0 dirty:12 writeback:0 unstable:0 [ 659.540067][ T3124] slab_reclaimable:71207 slab_unreclaimable:1252996 [ 659.540067][ T3124] mapped:17530 shmem:1850 pagetables:11491 bounce:0 [ 659.540067][ T3124] free:54096 free_pcp:5994 free_cma:84 [ 659.549192][ T1598] Call Trace: [ 659.549203][ T1598] dump_stack+0x62/0x9a [ 659.554639][ T3124] Node 0 active_anon:2246440kB inactive_anon:572540kB active_file:19500kB inactive_file:19016kB unevictable:0kB isolated(anon):7708kB isolated(file):0kB mapped:24840kB dirty:8kB writeback:0kB shmem:1372kB shmem_thp: 0kB shmem_pmdmapped: 0kB anon_thp: 1689600kB writeback_tmp:0kB unstable:0kB all_unreclaimable? no [ 659.593619][ T1598] warn_alloc.cold.45+0x8a/0x12a [ 659.596785][ T3124] Node 1 active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB isolated(anon):0kB isolated(file):0kB mapped:0kB dirty:0kB writeback:0kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 0kB anon_thp: 0kB writeback_tmp:0kB unstable:0kB all_unreclaimable? no [ 659.600821][ T1598] ? zone_watermark_ok_safe+0x1a0/0x1a0 [ 659.630195][ T3124] Node 2 active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB isolated(anon):0kB isolated(file):0kB mapped:0kB dirty:0kB writeback:0kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 0kB anon_thp: 0kB writeback_tmp:0kB unstable:0kB all_unreclaimable? no [ 659.635021][ T1598] ? __read_once_size_nocheck.constprop.2+0x10/0x10 [ 659.661328][ T3124] Node 3 active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB isolated(anon):0kB isolated(file):0kB mapped:0kB dirty:0kB writeback:0kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 0kB anon_thp: 0kB writeback_tmp:0kB unstable:0kB all_unreclaimable? no [ 659.661337][ T3124] Node 4 active_anon:16402112kB inactive_anon:865180kB active_file:20600kB inactive_file:32712kB unevictable:0kB isolated(anon):304kB isolated(file):0kB mapped:45216kB dirty:40kB writeback:12kB shmem:6028kB shmem_thp: 0kB shmem_pmdmapped: 0kB anon_thp: 15167488kB writeback_tmp:0kB unstable:0kB all_unreclaimable? no [ 659.666778][ T1598] ? pqi_scsi_queue_command+0x791/0xdd0 [smartpqi] [ 659.693086][ T3124] Node 5 active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB isolated(anon):0kB isolated(file):0kB mapped:0kB dirty:0kB writeback:0kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 0kB anon_thp: 0kB writeback_tmp:0kB unstable:0kB all_unreclaimable? no [ 659.693096][ T3124] Node 6 active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB isolated(anon):0kB isolated(file):0kB mapped:0kB dirty:0kB writeback:0kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 0kB anon_thp: 0kB writeback_tmp:0kB unstable:0kB all_unreclaimable? no [ 659.699583][ T1598] ? pqi_scsi_queue_command+0x791/0xdd0 [smartpqi] [ 659.725894][ T3124] Node 7 active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB isolated(anon):0kB isolated(file):0kB mapped:0kB dirty:0kB writeback:0kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 0kB anon_thp: 0kB writeback_tmp:0kB unstable:0kB all_unreclaimable? no [ 659.755524][ T1598] ? __isolate_free_page+0x390/0x390 [ 659.761953][ T3124] Node 0 DMA free:15908kB min:24kB low:36kB high:48kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15996kB managed:15908kB mlocked:0kB kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB [ 659.788234][ T1598] __alloc_pages_nodemask+0x1aab/0x1bc0 [ 659.814544][ T3124] lowmem_reserve[]: 0 1532 19982 19982 19982 [ 659.820945][ T1598] ? gfp_pfmemalloc_allowed+0xc0/0xc0 [ 659.847287][ T3124] Node 0 DMA32 free:73504kB min:2676kB low:4244kB high:5812kB active_anon:1190128kB inactive_anon:362496kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:1923080kB managed:1634348kB mlocked:0kB kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:1432kB local_pcp:0kB free_cma:0kB [ 659.852428][ T1598] ? stack_trace_save+0x87/0xb0 [ 659.852435][ T1598] ? freezing_slow_path.cold.1+0x35/0x35 [ 659.879003][ T3124] lowmem_reserve[]: 0 0 18450 18450 18450 [ 659.884446][ T1598] ? __kasan_kmalloc.part.0+0x81/0xc0 [ 659.890346][ T3124] Node 0 Normal free:47760kB min:137264kB low:156156kB high:175048kB active_anon:1056208kB inactive_anon:209672kB active_file:19456kB inactive_file:18996kB unevictable:0kB writepending:0kB present:27262976kB managed:18893712kB mlocked:0kB kernel_stack:22240kB pagetables:10064kB bounce:0kB free_pcp:9340kB local_pcp:164kB free_cma:0kB [ 659.895574][ T1598] ? __kasan_kmalloc.part.0+0x44/0xc0 [ 659.895581][ T1598] ? __kasan_kmalloc.constprop.1+0xac/0xc0 [ 659.924420][ T3124] lowmem_reserve[]: 0 0 0 0 0 [ 659.929163][ T1598] ? kasan_slab_alloc+0x11/0x20 [ 659.929170][ T1598] ? kmem_cache_alloc+0x17a/0x400 [ 659.934724][ T3124] Node 4 Normal free:72728kB min:234904kB low:267232kB high:299560kB active_anon:16401776kB inactive_anon:865580kB active_file:20596kB inactive_file:32692kB unevictable:0kB writepending:40kB present:33538048kB managed:32332156kB mlocked:0kB kernel_stack:23040kB pagetables:35900kB bounce:0kB free_pcp:12956kB local_pcp:24kB free_cma:336kB [ 659.940301][ T1598] ? alloc_iova+0x33/0x210 [ 659.940307][ T1598] ? alloc_iova_fast+0x47/0xba [ 659.945563][ T3124] lowmem_reserve[]: 0 0 0 0 0 [ 659.976773][ T1598] ? dma_ops_alloc_iova.isra.5+0x86/0xa0 [ 659.976780][ T1598] ? map_sg+0x99/0x2f0 [ 659.982039][ T3124] Node 0 DMA: 1*4kB (U) 0*8kB 0*16kB 1*32kB (U) 2*64kB (U) 1*128kB (U) 1*256kB (U) 0*512kB 1*1024kB (U) 1*2048kB (M) 3*4096kB (M) = 15908kB [ 659.987736][ T1598] ? scsi_dma_map+0xc6/0x160 [ 659.987747][ T1598] ? pqi_raid_submit_scsi_cmd_with_io_request+0x1c3/0x470 [smartpqi] [ 659.992300][ T3124] Node 0 DMA32: 0*4kB 0*8kB 2*16kB (M) 5*32kB (UM) 17*64kB (UM) 8*128kB (UM) 12*256kB (UM) 11*512kB (UM) 10*1024kB (UM) 2*2048kB (UM) 12*4096kB (M) = 74496kB [ 659.997045][ T1598] ? pqi_scsi_queue_command+0x791/0xdd0 [smartpqi] [ 659.997051][ T1598] ? scsi_queue_rq+0x7c6/0x1280 [ 660.001958][ T3124] Node 0 Normal: 0*4kB 0*8kB 198*16kB (MEH) 356*32kB (ME) 83*64kB (UME) 15*128kB (UME) 101*256kB (U) 0*512kB 0*1024kB 0*2048kB 0*4096kB = 47648kB [ 660.033521][ T1598] ? ftrace_graph_ret_addr+0x2a/0xb0 [ 660.033528][ T1598] ? stack_trace_save+0x87/0xb0 [ 660.037828][ T3124] Node 4 Normal: 0*4kB 0*8kB 211*16kB (UME) 441*32kB (UME) 449*64kB (UME) 71*128kB (ME) 62*256kB (M) 0*512kB 0*1024kB 0*2048kB 0*4096kB = 71184kB [ 660.042481][ T1598] alloc_pages_current+0x9c/0x110 [ 660.047042][ T3124] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB [ 660.052569][ T1598] allocate_slab+0x351/0x11f0 [ 660.056516][ T3124] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB [ 660.056521][ T3124] Node 4 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB [ 660.070694][ T1598] new_slab+0x46/0x70 [ 660.075169][ T3124] Node 4 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB [ 660.083141][ T1598] ___slab_alloc+0x5d4/0x9c0 [ 660.098879][ T3124] 26058 total pagecache pages [ 660.098894][ T3124] 1298 pages in swap cache [ 660.105279][ T1598] ? should_fail+0x107/0x3bc [ 660.105285][ T1598] ? alloc_iova+0x33/0x210 [ 660.110020][ T3124] Swap cache stats: add 2607, delete 1311, find 0/1 [ 660.110024][ T3124] Free swap = 32919548kB [ 660.124719][ T1598] ? lock_downgrade+0x390/0x390 [ 660.124725][ T1598] ? lock_downgrade+0x390/0x390 [ 660.129894][ T3124] Total swap = 32952316kB [ 660.129899][ T3124] 15685025 pages RAM [ 660.134637][ T1598] ? alloc_iova+0x33/0x210 [ 660.149328][ T3124] 0 pages HighMem/MovableOnly [ 660.149332][ T3124] 2465994 pages reserved [ 660.154245][ T1598] __slab_alloc+0x12/0x20 [ 660.154252][ T1598] ? __slab_alloc+0x12/0x20 [ 660.163701][ T3124] 16384 pages cma reserved [ 660.163763][ T3124] SLUB: Unable to allocate memory on node -1, gfp=0xa20(GFP_ATOMIC) [ 660.168269][ T1598] kmem_cache_alloc+0x32a/0x400 [ 660.168276][ T1598] ? kasan_check_read+0x11/0x20 [ 660.177465][ T3124] cache: iommu_iova, object size: 40, buffer size: 448, default order: 0, min order: 0 [ 660.177470][ T3124] node 0: slabs: 10580, objs: 95220, free: 0 [ 660.186924][ T1598] ? do_raw_spin_unlock+0xa8/0x140 [ 660.186930][ T1598] alloc_iova+0x33/0x210 [ 660.190792][ T3124] node 4: slabs: 2292, objs: 20628, free: 25 [ 660.199982][ T1598] ? iova_rcache_get+0x1a1/0x300 [ 660.199989][ T1598] alloc_iova_fast+0x47/0xba [ 660.204513][ T3124] kworker/2:1H: page allocation failure: order:0, mode:0xa20(GFP_ATOMIC), nodemask=(null),cpuset=/,mems_allowed=0,4 [ 660.209026][ T1598] dma_ops_alloc_iova.isra.5+0x86/0xa0 [ 660.351109][ T1598] map_sg+0x99/0x2f0 [ 660.354891][ T1598] ? __debug_object_init+0x412/0x7a0 [ 660.360070][ T1598] scsi_dma_map+0xc6/0x160 [ 660.364381][ T1598] pqi_raid_submit_scsi_cmd_with_io_request+0x1c3/0x470 [smartpqi] [ 660.372184][ T1598] ? pqi_alloc_io_request+0x11e/0x140 [smartpqi] [ 660.378415][ T1598] pqi_scsi_queue_command+0x791/0xdd0 [smartpqi] [ 660.384644][ T1598] ? scsi_init_io+0x102/0x150 [ 660.389217][ T1598] ? sd_setup_read_write_cmnd+0x6e9/0xa90 [sd_mod] [ 660.395622][ T1598] ? pqi_event_worker+0xdf0/0xdf0 [smartpqi] [ 660.401503][ T1598] ? sd_init_command+0x88b/0x930 [sd_mod] [ 660.407119][ T1598] ? blk_add_timer+0xd7/0x110 [ 660.411686][ T1598] scsi_queue_rq+0x7c6/0x1280 [ 660.416252][ T1598] blk_mq_dispatch_rq_list+0x9d3/0xba0 [ 660.421604][ T1598] ? blk_mq_flush_busy_ctxs+0x1c5/0x450 [ 660.427045][ T1598] ? blk_mq_get_driver_tag+0x290/0x290 [ 660.432396][ T1598] ? __lock_acquire.isra.13+0xT3124] __blk_mq_run_hw_queue+0x156/0x230 [ 660.822569][ T3124] ? hctx_lock+0xc0/0xc0 [ 660.826700][ T3124] ? process_one_work+0x426/0xa70 [ 660.831617][ T3124] blk_mq_run_work_fn+0x3b/0x40 [ 660.836358][ T3124] process_one_work+0x53b/0xa70 [ 660.841100][ T3124] ? pwq_dec_nr_in_flight+0x170/0x170 [ 660.846365][ T3124] worker_thread+0x63/0x5b0 [ 660.850756][ T3124] kthread+0x1df/0x200 [ 660.854712][ T3124] ? process_one_work+0xa70/0xa70 [ 660.859626][ T3124] ? kthread_park+0xc0/0xc0 [ 660.864021][ T3124] ret_from_fork+0x22/0x40 [ 660.868328][ T3124] warn_alloc_show_mem: 1 callbacks suppressed [ 660.868332][ T1598] CPU: 10 PID: 1598 Comm: kworker/10:1H Tainted: G W 5.2.0-next-20190711+ #3 [ 660.868335][ T3124] Mem-Info: [ 660.868485][ T3124] active_anon:4662011 inactive_anon:359383 isolated_anon:2155 [ 660.868485][ T3124] active_file:10012 inactive_file:12922 isolated_file:0 [ 660.868485][ T3124] unevictable:0 dirty:12 writeback:0 unstable:0 [ 660.868485][ T3h:175048kB active_anon:1056208kB inactive_anon:209448kB active_file:19452kB inactive_file:18996kB unevictable:0kB writepending:0kB present:27262976kB managed:18893712kB mlocked:0kB kernel_stack:22240kB pagetables:10064kB bounce:0kB free_pcp:8784kB local_pcp:164kB free_cma:0kB [ 661.222532][ T1598] ? kernel_poison_pages.cold.2+0x8c/0x8c [ 661.228397][ T3124] lowmem_reserve[]: 0 0 0 0 0 [ 661.233138][ T1598] ? vprintk_default+0x1f/0x30 [ 661.233146][ T1598] alloc_pages_current+0x9c/0x110 [ 661.238174][ T3124] Node 4 Normal free:71384kB min:234904kB low:267232kB high:299560kB active_anon:16401776kB inactive_anon:865588kB active_file:20596kB inactive_file:32692kB unevictable:0kB writepending:40kB present:33538048kB managed:32332156kB mlocked:0kB kernel_stack:23040kB pagetables:35900kB bounce:0kB free_pcp:12872kB local_pcp:24kB free_cma:336kB [ 661.266900][ T1598] allocate_slab+0x351/0x11f0 [ 661.266905][ T1598] new_slab+0x46/0x70 [ 661.271461][ T3124] lowmem_reserve[]: 0 0 0 0 0 [ 661.275941][ T1598] ___slab_alloc+0x5d4/0x9c0 [ 661.275948][ T1598] ? should0 [ 661.543007][ T3132] cache: iommu_iova, object size: 40, buffer size: 448, default order: 0, min order: 0 [ 661.543011][ T3203] node 0: slabs: 10582, objs: 95238, free: 7 [ 661.543016][ T3132] node 0: slabs: 10582, objs: 95238, free: 7 [ 661.543020][ T3203] node 4: slabs: 2293, objs: 20637, free: 30 [ 661.543026][ T3132] node 4: slabs: 2293, objs: 20637, free: 30 [ 661.543040][ T3203] SLUB: Unable to allocate memory on node -1, gfp=0xa20(GFP_ATOMIC) [ 661.543046][ T3203] cache: iommu_iova, object size: 40, buffer size: 448, default order: 0, min order: 0 [ 661.543052][ T3203] node 0: slabs: 10582, objs: 95238, free: 7 [ 661.543057][ T3132] SLUB: Unable to allocate memory on node -1, gfp=0xa20(GFP_ATOMIC) [ 661.543061][ T3203] node 4: slabs: 2293, objs: 20637, free: 30 [ 661.543066][ T3132] cache: iommu_iova, object size: 40, buffer size: 448, default order: 0, min order: 0 [ 661.543072][ T3132] node 0: slabs: 10582, objs: 95238, free: 7 [ 661.543078][ T3132] node 4: slabs: 2293, objs: 20637, free: 30 [ 661.543544][ T3205] SLUB: Unable to allocnevictable:0kB isolated(anon):352kB isolated(file):0kB mapped:45056kB dirty:40kB writeback:52kB shmem:6028kB shmem_thp: 0kB shmem_pmdmapped: 0kB anon_thp: 15167488kB writeback_tmp:0kB unstable:0kB all_unreclaimable? no [ 662.181289][ T1598] Node 5 active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB isolated(anon):0kB isolated(file):0kB mapped:0kB dirty:0kB writeback:0kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 0kB anon_thp: 0kB writeback_tmp:0kB unstable:0kB all_unreclaimable? no [ 662.207607][ T3209] ? __read_once_size_nocheck.constprop.2+0x10/0x10 [ 662.212434][ T1598] Node 6 active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB isolated(anon):0kB isolated(file):0kB mapped:0kB dirty:0kB writeback:0kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 0kB anon_thp: 0kB writeback_tmp:0kB unstable:0kB all_unreclaimable? no [ 662.238751][ T3209] ? pqi_scsi_queue_command+0x791/0xdd0 [smartpqi] [ 662.244187][ T1598] Node 7 active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB isolated(ano alloc_iova_fast+0x47/0xba [ 662.835750][ T3209] dma_ops_alloc_iova.isra.5+0x86/0xa0 [ 662.841103][ T3209] map_sg+0x99/0x2f0 [ 662.844886][ T3209] ? kasan_check_read+0x11/0x20 [ 662.849627][ T3209] scsi_dma_map+0xc6/0x160 [ 662.853938][ T3209] pqi_raid_submit_scsi_cmd_with_io_request+0x1c3/0x470 [smartpqi] [ 662.861740][ T3209] ? pqi_alloc_io_request+0x11e/0x140 [smartpqi] [ 662.867971][ T3209] pqi_scsi_queue_command+0x791/0xdd0 [smartpqi] [ 662.874198][ T3209] ? scsi_init_io+0x102/0x150 [ 662.878768][ T3209] ? sd_setup_read_write_cmnd+0x6e9/0xa90 [sd_mod] [ 662.885176][ T3209] ? pqi_event_worker+0xdf0/0xdf0 [smartpqi] [ 662.891055][ T3209] ? sd_init_command+0x88b/0x930 [sd_mod] [ 662.896672][ T3209] ? blk_add_timer+0xd7/0x110 [ 662.901240][ T3209] scsi_queue_rq+0x7c6/0x1280 [ 662.905807][ T3209] blk_mq_dispatch_rq_list+0x9d3/0xba0 [ 662.911159][ T3209] ? blk_mq_flush_busy_ctxs+0x1c5/0x450 [ 662.916601][ T3209] ? blk_mq_get_driver_tag+0x290/0x290 [ 662.921953][ T3209] ? __lock_acquire.isra.13+0x430/0x830 [ 662.927394][ T3209] blk_mq_sched_diag+0x290/0x290 [ 663.313403][ T3146] ? __lock_acquire.isra.13+0x430/0x830 [ 663.318844][ T3146] blk_mq_sched_dispatch_requests+0x2f4/0x300 [ 663.324807][ T3146] ? blk_mq_sched_restart+0x60/0x60 [ 663.329898][ T3146] __blk_mq_run_hw_queue+0x156/0x230 [ 663.335076][ T3146] ? hctx_lock+0xc0/0xc0 [ 663.339211][ T3146] ? process_one_work+0x426/0xa70 [ 663.344128][ T3146] blk_mq_run_work_fn+0x3b/0x40 [ 663.348870][ T3146] process_one_work+0x53b/0xa70 [ 663.353613][ T3146] ? pwq_dec_nr_in_flight+0x170/0x170 [ 663.358880][ T3146] worker_thread+0x63/0x5b0 [ 663.363277][ T3146] kthread+0x1df/0x200 [ 663.367233][ T3146] ? process_one_work+0xa70/0xa70 [ 663.372148][ T3146] ? kthread_park+0xc0/0xc0 [ 663.376543][ T3146] ret_from_fork+0x22/0x40 [ 663.380848][ T3146] warn_alloc_show_mem: 1 callbacks suppressed [ 663.380855][ T3123] CPU: 1 PID: 3123 Comm: kworker/1:1H Tainted: G W 5.2.0-next-20190711+ #3 [ 663.380857][ T3146] Mem-Info: [ 663.381000][ T3146] active_anon:4654271 inactive_anon:367023 isolated_anon:2263 [ 663.381000T3123] ? gfp_pfmemalloc_allowed+0xc0/0xc0 [ 663.744691][ T3146] Node 0 Normal free:74264kB min:137264kB low:156156kB high:175048kB active_anon:1055816kB inactive_anon:209292kB active_file:19416kB inactive_file:18964kB unevictable:0kB writepending:248kB present:27262976kB managed:18893712kB mlocked:0kB kernel_stack:22240kB pagetables:10064kB bounce:0kB free_pcp:9356kB local_pcp:124kB free_cma:0kB [ 663.750101][ T3123] ? lock_downgrade+0x390/0x390 [ 663.778942][ T3146] lowmem_reserve[]: 0 0 0 0 0 [ 663.783688][ T3123] ? do_raw_spin_lock+0x118/0x1d0 [ 663.789326][ T3146] Node 4 Normal free:81632kB min:234904kB low:267232kB high:299560kB active_anon:16368972kB inactive_anon:898504kB active_file:20548kB inactive_file:32468kB unevictable:0kB writepending:104kB present:33538048kB managed:32332156kB mlocked:0kB kernel_stack:23040kB pagetables:35900kB bounce:0kB free_pcp:11372kB local_pcp:160kB free_cma:0kB [ 663.794556][ T3123] ? rwlock_bug.part.0+0x60/0x60 [ 663.794563][ T3123] ? get_partial_node+0x48/0x540 [ 663.825936][ T3146] lowmem_reserve[]: 0 0 0 0 0 [ 663.830678][ T3123] #3 [ 664.269661][ T3202] Hardware name: HPE ProLiant DL385 Gen10/ProLiant DL385 Gen10, BIOS A40 06/24/2019 [ 664.278993][ T3202] Workqueue: kblockd blk_mq_run_work_fn [ 664.284453][ T3202] Call Trace: [ 664.287655][ T3202] dump_stack+0x62/0x9a [ 664.291721][ T3202] warn_alloc.cold.45+0x8a/0x12a [ 664.296577][ T3202] ? zone_watermark_ok_safe+0x1a0/0x1a0 [ 664.302044][ T3202] ? __read_once_size_nocheck.constprop.2+0x10/0x10 [ 664.308564][ T3202] ? pqi_scsi_queue_command+0x791/0xdd0 [smartpqi] [ 664.314996][ T3202] ? pqi_scsi_queue_command+0x791/0xdd0 [smartpqi] [ 664.321420][ T3202] ? __isolate_free_page+0x390/0x390 [ 664.326613][ T3202] __alloc_pages_nodemask+0x1aab/0x1bc0 [ 664.332062][ T3202] ? gfp_pfmemalloc_allowed+0xc0/0xc0 [ 664.337345][ T3202] ? stack_trace_save+0x87/0xb0 [ 664.342103][ T3202] ? freezing_slow_path.cold.1+0x35/0x35 [ 664.347647][ T3202] ? __kasan_kmalloc.part.0+0x81/0xc0 [ 664.352925][ T3202] ? __kasan_kmalloc.part.0+0x44/0xc0 [ 664.358204][ T3202] ? __kasan_kmalloc.constprop.1+0xac/0xc0 [ 664.363922][ hmem_pmdmapped: 0kB anon_thp: 0kB writeback_tmp:0kB unstable:0kB all_unreclaimable? no [ 664.759472][ T3127] ? __read_once_size_nocheck.constprop.2+0x10/0x10 [ 664.759508][ T3127] ? pqi_scsi_queue_command+0x791/0xdd0 [smartpqi] [ 664.785836][ T3202] Node 4 active_anon:15362196kB inactive_anon:1296156kB active_file:15052kB inactive_file:17752kB unevictable:0kB isolated(anon):66644kB isolated(file):112kB mapped:30596kB dirty:0kB writeback:3968kB shmem:1080kB shmem_thp: 0kB shmem_pmdmapped: 0kB anon_thp: 14735360kB writeback_tmp:0kB unstable:0kB all_unreclaimable? no [ 664.789031][ T3127] ? pqi_scsi_queue_command+0x791/0xdd0 [smartpqi] [ 664.793056][ T3202] Node 5 active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB isolated(anon):0kB isolated(file):0kB mapped:0kB dirty:0kB writeback:0kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 0kB anon_thp: 0kB writeback_tmp:0kB unstable:0kB all_unreclaimable? no [ 664.819386][ T3127] ? __isolate_free_page+0x390/0x390 [ 664.819401][ T3127] __alloc_pages_nodemask+0x1aab/0x1bc0 [ 664.824245][ T3202] Node 6 active_anon7] map_sg+0x99/0x2f0 [ 665.159320][ T3202] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB [ 665.191157][ T3127] ? kasan_check_read+0x11/0x20 [ 665.191176][ T3127] scsi_dma_map+0xc6/0x160 [ 665.195480][ T3202] Node 4 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB [ 665.195490][ T3202] Node 4 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB [ 665.200248][ T3127] pqi_raid_submit_scsi_cmd_with_io_request+0x1c3/0x470 [smartpqi] [ 665.204805][ T3202] 69668 total pagecache pages [ 665.209566][ T3127] ? pqi_alloc_io_request+0x11e/0x140 [smartpqi] [ 665.213886][ T3202] 65404 pages in swap cache [ 665.228054][ T3127] pqi_scsi_queue_command+0x791/0xdd0 [smartpqi] [ 665.228074][ T3127] ? scsi_init_io+0x102/0x150 [ 665.232285][ T3202] Swap cache stats: add 486050, delete 428240, find 59/149 [ 665.232294][ T3202] Free swap = 30975484kB [ 665.236832][ T3127] ? sd_setup_read_write_cmnd+0x6e9/0xa90 [sd_mod] [ 665.236858][ T3127] ? pqi_event_worker+0xdf0/0xdf0 [smar390 [ 665.806891][ T3141] ? lock_downgrade+0x390/0x390 [ 665.811664][ T3141] ? alloc_iova+0x33/0x210 [ 665.815987][ T3141] __slab_alloc+0x12/0x20 [ 665.820232][ T3141] ? __slab_alloc+0x12/0x20 [ 665.824654][ T3141] kmem_cache_alloc+0x32a/0x400 [ 665.829413][ T3141] ? kasan_check_read+0x11/0x20 [ 665.834179][ T3141] ? do_raw_spin_unlock+0xa8/0x140 [ 665.839221][ T3141] alloc_iova+0x33/0x210 [ 665.843369][ T3141] ? iova_rcache_get+0x1a1/0x300 [ 665.848225][ T3141] alloc_iova_fast+0x47/0xba [ 665.852736][ T3141] dma_ops_alloc_iova.isra.5+0x86/0xa0 [ 665.858122][ T3141] map_sg+0x99/0x2f0 [ 665.861957][ T3141] ? kasan_check_read+0x11/0x20 [ 665.866759][ T3141] scsi_dma_map+0xc6/0x160 [ 665.871098][ T3141] pqi_raid_submit_scsi_cmd_with_io_request+0x1c3/0x470 [smartpqi] [ 665.878918][ T3141] ? pqi_alloc_io_request+0x11e/0x140 [smartpqi] [ 665.885172][ T3141] pqi_scsi_queue_command+0x791/0xdd0 [smartpqi] [ 665.891435][ T3141] ? scsi_init_io+0x102/0x150 [ 665.896103][ T3141] ? sd_setup_read_write_cmnd+0x6e9/0xa90 [sd_mod] [ 665.902619][ T3141] ? pqie:0kB unevictable:0kB writepending:0kB present:15996kB managed:15908kB mlocked:0kB kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB [ 666.300385][ T3141] lowmem_reserve[]: 0 1532 19982 19982 19982 [ 666.306395][ T3141] Node 0 DMA32 free:75568kB min:2676kB low:4244kB high:5812kB active_anon:749752kB inactive_anon:395332kB active_file:128kB inactive_file:168kB unevictable:0kB writepending:0kB present:1923080kB managed:1634348kB mlocked:0kB kernel_stack:0kB pagetables:28kB bounce:0kB free_pcp:55484kB local_pcp:248kB free_cma:0kB [ 666.335894][ T3141] lowmem_reserve[]: 0 0 18450 18450 18450 [ 666.341762][ T3141] Node 0 Normal free:52856kB min:52716kB low:71608kB high:90500kB active_anon:1127696kB inactive_anon:80184kB active_file:492kB inactive_file:656kB unevictable:0kB writepending:2208kB present:27262976kB managed:18893712kB mlocked:0kB kernel_stack:22240kB pagetables:10372kB bounce:0kB free_pcp:12848kB local_pcp:36kB free_cma:0kB [ 666.372602][ T3141] lowmem_reserve[]: 0 0 0 0 0 [ 666.377419][ T3141] Node 4 Normal free:234488kB m[ 685.274656][ T3456] list_del corruption. prev->next should be ffffea0022b10098, but was 0000000000000000 [ 685.284254][ T3456] ------------[ cut here ]------------ [ 685.289616][ T3456] kernel BUG at lib/list_debug.c:53! [ 685.294808][ T3456] invalid opcode: 0000 [#1] SMP DEBUG_PAGEALLOC KASAN NOPTI [ 685.301998][ T3456] CPU: 5 PID: 3456 Comm: oom01 Tainted: G W 5.2.0-next-20190711+ #3 [ 685.311193][ T3456] Hardware name: HPE ProLiant DL385 Gen10/ProLiant DL385 Gen10, BIOS A40 06/24/2019 [ 685.320485][ T3456] RIP: 0010:__list_del_entry_valid+0x8b/0xb6 [ 685.326364][ T3456] Code: f1 e0 ff 49 8b 55 08 4c 39 e2 75 2c 5b b8 01 00 00 00 41 5c 41 5d 5d c3 4c 89 e2 48 89 de 48 c7 c7 c0 5a 73 a3 e8 d9 fa bc ff <0f> 0b 48 c7 c7 60 a0 e1 a3 e8 13 52 01 00 4c 89 e6 48 c7 c7 20 5b [ 685.345956][ T3456] RSP: 0018:ffff888e0c8a73c0 EFLAGS: 00010082 [ 685.351920][ T3456] RAX: 0000000000000054 RBX: ffffea0022b10098 RCX: ffffffffa2d5d708 [ 685.359807][ T3456] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffff8888442bd380 [ 685.367693][ T3456] RBP: ffff888e0c8a73d8 R08: ffffed1108857a71 R09: ffffed1108857a70 [ 685.375577][ T3456] R10: ffffed1108857a70 R11: ffff8888442bd387 R12: 0000000000000000 [ 685.383462][ T3456] R13: 0000000000000000 R14: ffffea0022b10034 R15: ffffea0022b10098 [ 685.391348][ T3456] FS: 00007fbe26db4700(0000) GS:ffff888844280000(0000) knlGS:0000000000000000 [ 685.400194][ T3456] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 685.406681][ T3456] CR2: 00007fbcabb3f000 CR3: 0000001012e44000 CR4: 00000000001406a0 [ 685.414563][ T3456] Call Trace: [ 685.417736][ T3456] deferred_split_scan+0x337/0x740 [ 685.422741][ T3456] ? split_huge_page_to_list+0xe10/0xe10 [ 685.428272][ T3456] ? __radix_tree_lookup+0x12d/0x1e0 [ 685.433453][ T3456] ? node_tag_get.part.0.constprop.6+0x40/0x40 [ 685.439505][ T3456] do_shrink_slab+0x244/0x5a0 [ 685.444071][ T3456] shrink_slab+0x253/0x440 [ 685.448375][ T3456] ? unregister_shrinker+0x110/0x110 [ 685.453551][ T3456] ? kasan_check_read+0x11/0x20 [ 685.458291][ T3456] ? mem_cgroup_protected+0x20f/0x260 [ 685.463555][ T3456] shrink_node+0x31e/0xa30 [ 685.467858][ T3456] ? shrink_node_memcg+0x1560/0x1560 [ 685.473036][ T3456] ? ktime_get+0x93/0x110 [ 685.477250][ T3456] do_try_to_free_pages+0x22f/0x820 [ 685.482338][ T3456] ? shrink_node+0xa30/0xa30 [ 685.486815][ T3456] ? kasan_check_read+0x11/0x20 [ 685.491556][ T3456] ? check_chain_key+0x1df/0x2e0 [ 685.496383][ T3456] try_to_free_pages+0x242/0x4d0 [ 685.501209][ T3456] ? do_try_to_free_pages+0x820/0x820 [ 685.506476][ T3456] __alloc_pages_nodemask+0x9ce/0x1bc0 [ 685.511826][ T3456] ? gfp_pfmemalloc_allowed+0xc0/0xc0 [ 685.517089][ T3456] ? kasan_check_read+0x11/0x20 [ 685.521826][ T3456] ? check_chain_key+0x1df/0x2e0 [ 685.526657][ T3456] ? do_anonymous_page+0x343/0xe30 [ 685.531658][ T3456] ? lock_downgrade+0x390/0x390 [ 685.536399][ T3456] ? get_kernel_page+0xa0/0xa0 [ 685.541050][ T3456] ? __lru_cache_add+0x108/0x160 [ 685.545879][ T3456] alloc_pages_vma+0x89/0x2c0 [ 685.550444][ T3456] do_anonymous_page+0x3e1/0xe30 [ 685.555271][ T3456] ? __update_load_avg_cfs_rq+0x2c/0x490 [ 685.560796][ T3456] ? finish_fault+0x120/0x120 [ 685.565361][ T3456] ? alloc_pages_vma+0x21e/0x2c0 [ 685.570187][ T3456] handle_pte_fault+0x457/0x12c0 [ 685.575014][ T3456] __handle_mm_fault+0x79a/0xa50 [ 685.579841][ T3456] ? vmf_insert_mixed_mkwrite+0x20/0x20 [ 685.585280][ T3456] ? kasan_check_read+0x11/0x20 [ 685.590021][ T3456] ? __count_memcg_events+0x8b/0x1c0 [ 685.595196][ T3456] handle_mm_fault+0x17f/0x370 [ 685.599850][ T3456] __do_page_fault+0x25b/0x5d0 [ 685.604501][ T3456] do_page_fault+0x4c/0x2cf [ 685.608892][ T3456] ? page_fault+0x5/0x20 [ 685.613019][ T3456] page_fault+0x1b/0x20 [ 685.617058][ T3456] RIP: 0033:0x410be0 [ 685.620840][ T3456] Code: 89 de e8 e3 23 ff ff 48 83 f8 ff 0f 84 86 00 00 00 48 89 c5 41 83 fc 02 74 28 41 83 fc 03 74 62 e8 95 29 ff ff 31 d2 48 98 90 <c6> 44 15 00 07 48 01 c2 48 39 d3 7f f3 31 c0 5b 5d 41 5c c3 0f 1f [ 68[ 687.120156][ T3456] Shutting down cpus with NMI [ 687.124731][ T3456] Kernel Offset: 0x21800000 from 0xffffffff81000000 (relocation range: 0xffffffff80000000-0xffffffffbfffffff) [ 687.136389][ T3456] ---[ end Kernel panic - not syncing: Fatal exception ]---