I have applied your patch against vanilla v5.3-rc5. There was no config changes. So far I've gotten couple of these GPF. I guess this is different issue. It will take several hours to get full view. I've attached one full console log as: console-1566235171.001993084.log [ 13.821223] general protection fault: 0000 [#1] SMP PTI [ 13.821882] CPU: 0 PID: 151 Comm: kswapd0 Tainted: G W 5.3.0-rc5+ #71 [ 13.822755] Hardware name: QEMU Standard PC (Q35 + ICH9, 2009), BIOS 1.12.0-2.fc30 04/01/2014 [ 13.824272] RIP: 0010:handle_to_buddy+0x20/0x30 [ 13.824786] Code: 84 00 00 00 00 00 0f 1f 40 00 0f 1f 44 00 00 53 48 89 fb 83 e7 01 0f 85 31 26 00 00 48 8b 03 5b 48 89 c2 48 81 e2 00 f0 ff ff <0f> b6 92 ca 00 00 00 29 d0 83 e0 03 c3 0f 1f 00 0f 1f 44 00 00 55 [ 13.826854] RSP: 0000:ffffb18cc01977f0 EFLAGS: 00010206 [ 13.827452] RAX: 00ffff97dd890fd0 RBX: fffff63080243f40 RCX: 0000000000000000 [ 13.828256] RDX: 00ffff97dd890000 RSI: ffff97ddbe5d89c8 RDI: ffff97ddbe5d89c8 [ 13.829056] RBP: ffff97dd890fd000 R08: ffff97ddbe5d89c8 R09: 0000000000000000 [ 13.829860] R10: 0000000000000000 R11: 0000000000000000 R12: ffff97dd890fd001 [ 13.830660] R13: ffff97dd890fd010 R14: ffff97ddb5f96408 R15: ffffb18cc0197838 [ 13.831468] FS: 0000000000000000(0000) GS:ffff97ddbe400000(0000) knlGS:0000000000000000 [ 13.832673] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 13.833593] CR2: 00007fec8745f010 CR3: 0000000006212004 CR4: 0000000000160ef0 [ 13.834508] Call Trace: [ 13.834828] z3fold_zpool_map+0x76/0x110 [ 13.835332] zswap_writeback_entry+0x50/0x410 [ 13.835888] z3fold_zpool_shrink+0x3d1/0x570 [ 13.836434] ? sched_clock_cpu+0xc/0xc0 [ 13.836919] zswap_frontswap_store+0x424/0x7c1 [ 13.837484] __frontswap_store+0xc4/0x162 [ 13.837992] swap_writepage+0x39/0x70 [ 13.838460] pageout.isra.0+0x12c/0x5d0 [ 13.838950] shrink_page_list+0x1124/0x1830 [ 13.839484] shrink_inactive_list+0x1da/0x460 [ 13.840036] shrink_node_memcg+0x202/0x770 [ 13.840746] shrink_node+0xdf/0x490 [ 13.841931] balance_pgdat+0x2db/0x580 [ 13.842396] kswapd+0x239/0x500 [ 13.842772] ? finish_wait+0x90/0x90 [ 13.847323] kthread+0x108/0x140 [ 13.848358] ? balance_pgdat+0x580/0x580 [ 13.849626] ? kthread_park+0x80/0x80 [ 13.850352] ret_from_fork+0x3a/0x50 [ 13.851086] Modules linked in: ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ip6table_nat ip6table_mangle ip6table_raw ip6table_security iptable_nat nf_nat iptable_mangle iptable_raw iptable_security nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 libcrc32c ip_set nfnetlink ip6table_filter ip6_tables iptable_filter ip_tables crct10dif_pclmul crc32_pclmul ghash_clmulni_intel virtio_net virtio_balloon net_failover failover intel_agp intel_gtt qxl drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm crc32c_intel virtio_blk virtio_console serio_raw agpgart qemu_fw_cfg [ 13.857818] ---[ end trace 4517028df5e476fe ]--- [ 13.858400] RIP: 0010:handle_to_buddy+0x20/0x30 [ 13.859761] Code: 84 00 00 00 00 00 0f 1f 40 00 0f 1f 44 00 00 53 48 89 fb 83 e7 01 0f 85 31 26 00 00 48 8b 03 5b 48 89 c2 48 81 e2 00 f0 ff ff <0f> b6 92 ca 00 00 00 29 d0 83 e0 03 c3 0f 1f 00 0f 1f 44 00 00 55 [ 13.862703] RSP: 0000:ffffb18cc01977f0 EFLAGS: 00010206 [ 13.864232] RAX: 00ffff97dd890fd0 RBX: fffff63080243f40 RCX: 0000000000000000 [ 13.865834] RDX: 00ffff97dd890000 RSI: ffff97ddbe5d89c8 RDI: ffff97ddbe5d89c8 [ 13.867362] RBP: ffff97dd890fd000 R08: ffff97ddbe5d89c8 R09: 0000000000000000 [ 13.869121] R10: 0000000000000000 R11: 0000000000000000 R12: ffff97dd890fd001 [ 13.871091] R13: ffff97dd890fd010 R14: ffff97ddb5f96408 R15: ffffb18cc0197838 [ 13.872742] FS: 0000000000000000(0000) GS:ffff97ddbe400000(0000) knlGS:0000000000000000 [ 13.874448] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 13.876382] CR2: 00007fec8745f010 CR3: 0000000006212004 CR4: 0000000000160ef0 [ 13.878007] ------------[ cut here ]------------ (gdb) l *handle_to_buddy+0x20 0xffffffff813376b0 is in handle_to_buddy (/src/linux/mm/z3fold.c:429). 424 unsigned long addr; 425 426 WARN_ON(handle & (1 << PAGE_HEADLESS)); 427 addr = *(unsigned long *)handle; 428 zhdr = (struct z3fold_header *)(addr & PAGE_MASK); 429 return (addr - zhdr->first_num) & BUDDY_MASK; 430 } 431 432 static inline struct z3fold_pool *zhdr_to_pool(struct z3fold_header *zhdr) 433 { (gdb) l *z3fold_zpool_map+0x76 0xffffffff81337cb6 is in z3fold_zpool_map (/src/linux/mm/z3fold.c:1257). 1252 if (test_bit(PAGE_HEADLESS, &page->private)) 1253 goto out; 1254 1255 z3fold_page_lock(zhdr); 1256 buddy = handle_to_buddy(handle); 1257 switch (buddy) { 1258 case FIRST: 1259 addr += ZHDR_SIZE_ALIGNED; 1260 break; 1261 case MIDDLE: (gdb) l *zswap_writeback_entry+0x50 0xffffffff812e8260 is in zswap_writeback_entry (/src/linux/mm/zswap.c:858). 853 .sync_mode = WB_SYNC_NONE, 854 }; 855 856 /* extract swpentry from data */ 857 zhdr = zpool_map_handle(pool, handle, ZPOOL_MM_RO); 858 swpentry = zhdr->swpentry; /* here */ 859 zpool_unmap_handle(pool, handle); 860 tree = zswap_trees[swp_type(swpentry)]; 861 offset = swp_offset(swpentry); (gdb) l *z3fold_zpool_shrink+0x3d1 0xffffffff81338821 is in z3fold_zpool_shrink (/src/linux/mm/z3fold.c:1186). 1181 ret = pool->ops->evict(pool, middle_handle); 1182 if (ret) 1183 goto next; 1184 } 1185 if (first_handle) { 1186 ret = pool->ops->evict(pool, first_handle); 1187 if (ret) 1188 goto next; 1189 } 1190 if (last_handle) { To compare, I got following Call Trace "signatures" against vanilla v5.3-rc5. Some of them might not be related to zswap at all. [ 15.469831] Call Trace: [ 15.470171] migrate_pages+0x20c/0xfb0 [ 15.470678] ? isolate_freepages_block+0x410/0x410 [ 15.471344] ? __ClearPageMovable+0x90/0x90 [ 15.471914] compact_zone+0x74c/0xef0 -- [ 105.611480] Call Trace: [ 105.611817] zswap_writeback_entry+0x50/0x410 [ 105.612417] z3fold_zpool_shrink+0x29d/0x540 [ 105.612947] zswap_frontswap_store+0x424/0x7c1 [ 105.613494] __frontswap_store+0xc4/0x162 -- [ 15.103942] Call Trace: [ 15.104280] z3fold_zpool_map+0x76/0x110 [ 15.104824] zswap_writeback_entry+0x50/0x410 [ 15.105398] z3fold_zpool_shrink+0x3c4/0x540 [ 15.105960] zswap_frontswap_store+0x424/0x7c1 -- [ 632.066122] Call Trace: [ 632.066124] z3fold_zpool_map+0x76/0x110 [ 632.066128] zswap_writeback_entry+0x50/0x410 [ 632.069101] do_user_addr_fault+0x1fe/0x480 [ 632.069650] z3fold_zpool_shrink+0x3c4/0x540 -- [ 133.419601] Call Trace: [ 133.420199] zswap_writeback_entry+0x50/0x410 [ 133.421244] z3fold_zpool_shrink+0x4a6/0x540 [ 133.422266] zswap_frontswap_store+0x424/0x7c1 [ 133.423386] __frontswap_store+0xc4/0x162 -- [ 155.374773] Call Trace: [ 155.375122] get_page_from_freelist+0x57d/0x1a40 [ 155.375725] __alloc_pages_nodemask+0x19d/0x400 [ 155.376354] alloc_pages_vma+0xcc/0x170 [ 155.376854] __read_swap_cache_async+0x1e9/0x3e0 -- [ 23.849834] Call Trace: [ 23.851038] get_page_from_freelist+0x57d/0x1a40 [ 23.853300] ? wake_all_kswapds+0x54/0xb0 [ 23.855280] __alloc_pages_slowpath+0x1ae/0x1000 [ 23.857512] ? __lock_acquire+0x247/0x1900 -- [ 197.206331] Call Trace: [ 197.207923] __release_z3fold_page.constprop.0+0x7e/0x130 [ 197.211387] do_compact_page+0x2c9/0x430 [ 197.213830] process_one_work+0x272/0x5a0 [ 197.216392] worker_thread+0x50/0x3b0
Fedora 30 (Thirty) Kernel 5.3.0-rc5+ on an x86_64 (ttyS0) localhost login: [ 13.821223] general protection fault: 0000 [#1] SMP PTI [ 13.821882] CPU: 0 PID: 151 Comm: kswapd0 Tainted: G W 5.3.0-rc5+ #71 [ 13.822755] Hardware name: QEMU Standard PC (Q35 + ICH9, 2009), BIOS 1.12.0-2.fc30 04/01/2014 [ 13.824272] RIP: 0010:handle_to_buddy+0x20/0x30 [ 13.824786] Code: 84 00 00 00 00 00 0f 1f 40 00 0f 1f 44 00 00 53 48 89 fb 83 e7 01 0f 85 31 26 00 00 48 8b 03 5b 48 89 c2 48 81 e2 00 f0 ff ff <0f> b6 92 ca 00 00 00 29 d0 83 e0 03 c3 0f 1f 00 0f 1f 44 00 00 55 [ 13.826854] RSP: 0000:ffffb18cc01977f0 EFLAGS: 00010206 [ 13.827452] RAX: 00ffff97dd890fd0 RBX: fffff63080243f40 RCX: 0000000000000000 [ 13.828256] RDX: 00ffff97dd890000 RSI: ffff97ddbe5d89c8 RDI: ffff97ddbe5d89c8 [ 13.829056] RBP: ffff97dd890fd000 R08: ffff97ddbe5d89c8 R09: 0000000000000000 [ 13.829860] R10: 0000000000000000 R11: 0000000000000000 R12: ffff97dd890fd001 [ 13.830660] R13: ffff97dd890fd010 R14: ffff97ddb5f96408 R15: ffffb18cc0197838 [ 13.831468] FS: 0000000000000000(0000) GS:ffff97ddbe400000(0000) knlGS:0000000000000000 [ 13.832673] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 13.833593] CR2: 00007fec8745f010 CR3: 0000000006212004 CR4: 0000000000160ef0 [ 13.834508] Call Trace: [ 13.834828] z3fold_zpool_map+0x76/0x110 [ 13.835332] zswap_writeback_entry+0x50/0x410 [ 13.835888] z3fold_zpool_shrink+0x3d1/0x570 [ 13.836434] ? sched_clock_cpu+0xc/0xc0 [ 13.836919] zswap_frontswap_store+0x424/0x7c1 [ 13.837484] __frontswap_store+0xc4/0x162 [ 13.837992] swap_writepage+0x39/0x70 [ 13.838460] pageout.isra.0+0x12c/0x5d0 [ 13.838950] shrink_page_list+0x1124/0x1830 [ 13.839484] shrink_inactive_list+0x1da/0x460 [ 13.840036] shrink_node_memcg+0x202/0x770 [ 13.840746] shrink_node+0xdf/0x490 [ 13.841931] balance_pgdat+0x2db/0x580 [ 13.842396] kswapd+0x239/0x500 [ 13.842772] ? finish_wait+0x90/0x90 [ 13.847323] kthread+0x108/0x140 [ 13.848358] ? balance_pgdat+0x580/0x580 [ 13.849626] ? kthread_park+0x80/0x80 [ 13.850352] ret_from_fork+0x3a/0x50 [ 13.851086] Modules linked in: ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ip6table_nat ip6table_mangle ip6table_raw ip6table_security iptable_nat nf_nat iptable_mangle iptable_raw iptable_security nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 libcrc32c ip_set nfnetlink ip6table_filter ip6_tables iptable_filter ip_tables crct10dif_pclmul crc32_pclmul ghash_clmulni_intel virtio_net virtio_balloon net_failover failover intel_agp intel_gtt qxl drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm crc32c_intel virtio_blk virtio_console serio_raw agpgart qemu_fw_cfg [ 13.857818] ---[ end trace 4517028df5e476fe ]--- [ 13.858400] RIP: 0010:handle_to_buddy+0x20/0x30 [ 13.859761] Code: 84 00 00 00 00 00 0f 1f 40 00 0f 1f 44 00 00 53 48 89 fb 83 e7 01 0f 85 31 26 00 00 48 8b 03 5b 48 89 c2 48 81 e2 00 f0 ff ff <0f> b6 92 ca 00 00 00 29 d0 83 e0 03 c3 0f 1f 00 0f 1f 44 00 00 55 [ 13.862703] RSP: 0000:ffffb18cc01977f0 EFLAGS: 00010206 [ 13.864232] RAX: 00ffff97dd890fd0 RBX: fffff63080243f40 RCX: 0000000000000000 [ 13.865834] RDX: 00ffff97dd890000 RSI: ffff97ddbe5d89c8 RDI: ffff97ddbe5d89c8 [ 13.867362] RBP: ffff97dd890fd000 R08: ffff97ddbe5d89c8 R09: 0000000000000000 [ 13.869121] R10: 0000000000000000 R11: 0000000000000000 R12: ffff97dd890fd001 [ 13.871091] R13: ffff97dd890fd010 R14: ffff97ddb5f96408 R15: ffffb18cc0197838 [ 13.872742] FS: 0000000000000000(0000) GS:ffff97ddbe400000(0000) knlGS:0000000000000000 [ 13.874448] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 13.876382] CR2: 00007fec8745f010 CR3: 0000000006212004 CR4: 0000000000160ef0 [ 13.878007] ------------[ cut here ]------------ [ 13.879461] WARNING: CPU: 0 PID: 151 at kernel/exit.c:785 do_exit.cold+0xc/0x121 [ 13.884527] Modules linked in: ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ip6table_nat ip6table_mangle ip6table_raw ip6table_security iptable_nat nf_nat iptable_mangle iptable_raw iptable_security nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 libcrc32c ip_set nfnetlink ip6table_filter ip6_tables iptable_filter ip_tables crct10dif_pclmul crc32_pclmul ghash_clmulni_intel virtio_net virtio_balloon net_failover failover intel_agp intel_gtt qxl drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm crc32c_intel virtio_blk virtio_console serio_raw agpgart qemu_fw_cfg [ 13.900857] CPU: 0 PID: 151 Comm: kswapd0 Tainted: G D W 5.3.0-rc5+ #71 [ 13.902523] Hardware name: QEMU Standard PC (Q35 + ICH9, 2009), BIOS 1.12.0-2.fc30 04/01/2014 [ 13.904271] RIP: 0010:do_exit.cold+0xc/0x121 [ 13.905553] Code: 1f 44 00 00 8b 4f 68 48 8b 57 60 8b 77 58 48 8b 7f 28 e9 58 ff ff ff 0f 1f 44 00 00 0f 0b 48 c7 c7 88 99 0a 82 e8 f3 14 08 00 <0f> 0b e9 ee ee ff ff 65 48 8b 04 25 80 7f 01 00 8b 90 a8 08 00 00 [ 13.909957] RSP: 0000:ffffb18cc0197ee0 EFLAGS: 00010246 [ 13.912244] RAX: 0000000000000024 RBX: ffff97ddbd2f0000 RCX: 0000000000000000 [ 13.915089] RDX: 0000000000000000 RSI: ffff97ddbe5d89c8 RDI: ffff97ddbe5d89c8 [ 13.918037] RBP: 000000000000000b R08: ffff97ddbe5d89c8 R09: 0000000000000000 [ 13.921112] R10: 0000000000000001 R11: 0000000000000000 R12: 000000000000000b [ 13.924160] R13: 0000000000000000 R14: 0000000000000000 R15: 0000000000000000 [ 13.927281] FS: 0000000000000000(0000) GS:ffff97ddbe400000(0000) knlGS:0000000000000000 [ 13.930392] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 13.932966] CR2: 00007fec8745f010 CR3: 0000000006212004 CR4: 0000000000160ef0 [ 13.936525] Call Trace: [ 13.938596] ? kthread+0x108/0x140 [ 13.940822] rewind_stack_do_exit+0x17/0x20 [ 13.942956] irq event stamp: 3551181 [ 13.945637] hardirqs last enabled at (3551181): [<ffffffff81015efc>] do_general_protection+0x16c/0x1b0 [ 13.949055] hardirqs last disabled at (3551180): [<ffffffff81001c8a>] trace_hardirqs_off_thunk+0x1a/0x20 [ 13.952476] softirqs last enabled at (3551068): [<ffffffff81c00351>] __do_softirq+0x351/0x451 [ 13.956466] softirqs last disabled at (3551059): [<ffffffff810c9821>] irq_exit+0xf1/0x100 [ 13.958555] ---[ end trace 4517028df5e476ff ]--- [ 13.960141] BUG: sleeping function called from invalid context at include/linux/percpu-rwsem.h:38 [ 13.962300] in_atomic(): 1, irqs_disabled(): 0, pid: 151, name: kswapd0 [ 13.964036] INFO: lockdep is turned off. [ 13.966004] CPU: 0 PID: 151 Comm: kswapd0 Tainted: G D W 5.3.0-rc5+ #71 [ 13.969117] Hardware name: QEMU Standard PC (Q35 + ICH9, 2009), BIOS 1.12.0-2.fc30 04/01/2014 [ 13.972588] Call Trace: [ 13.973947] dump_stack+0x67/0x90 [ 13.978326] ___might_sleep.cold+0x9f/0xaf [ 13.979587] exit_signals+0x30/0x330 [ 13.980769] do_exit+0xcb/0xcd0 [ 13.981897] ? kthread+0x108/0x140 [ 13.983028] rewind_stack_do_exit+0x17/0x20 [ 13.984342] note: kswapd0[151] exited with preempt_count 1 [ 13.985818] kswapd0 (151) used greatest stack depth: 11312 bytes left [ 38.004343] watchdog: BUG: soft lockup - CPU#0 stuck for 21s! [stress:1038] [ 38.009667] Modules linked in: ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ip6table_nat ip6table_mangle ip6table_raw ip6table_security iptable_nat nf_nat iptable_mangle iptable_raw iptable_security nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 libcrc32c ip_set nfnetlink ip6table_filter ip6_tables iptable_filter ip_tables crct10dif_pclmul crc32_pclmul ghash_clmulni_intel virtio_net virtio_balloon net_failover failover intel_agp intel_gtt qxl drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm crc32c_intel virtio_blk virtio_console serio_raw agpgart qemu_fw_cfg [ 38.047774] irq event stamp: 2018249 [ 38.050827] hardirqs last enabled at (2018249): [<ffffffff812d5c78>] free_unref_page_list+0x218/0x260 [ 38.057520] hardirqs last disabled at (2018248): [<ffffffff812d5b17>] free_unref_page_list+0xb7/0x260 [ 38.061572] watchdog: BUG: soft lockup - CPU#1 stuck for 21s! [stress:1042] [ 38.064133] softirqs last enabled at (2018234): [<ffffffff81c00351>] __do_softirq+0x351/0x451 [ 38.065638] Modules linked in: ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ip6table_nat ip6table_mangle ip6table_raw ip6table_security iptable_nat nf_nat iptable_mangle iptable_raw iptable_security nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 libcrc32c ip_set nfnetlink ip6table_filter ip6_tables iptable_filter ip_tables crct10dif_pclmul crc32_pclmul ghash_clmulni_intel virtio_net virtio_balloon net_failover failover intel_agp intel_gtt qxl drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm crc32c_intel virtio_blk virtio_console serio_raw agpgart qemu_fw_cfg [ 38.071863] softirqs last disabled at (2018187): [<ffffffff810c9821>] irq_exit+0xf1/0x100 [ 38.081453] irq event stamp: 2150670 [ 38.081457] hardirqs last enabled at (2150669): [<ffffffff819d6b09>] _raw_spin_unlock_irq+0x29/0x40 [ 38.087420] CPU: 0 PID: 1038 Comm: stress Tainted: G D W 5.3.0-rc5+ #71 [ 38.088576] hardirqs last disabled at (2150670): [<ffffffff819cef64>] __schedule+0xc4/0x8a0 [ 38.088578] softirqs last enabled at (2150624): [<ffffffff81c00351>] __do_softirq+0x351/0x451 [ 38.095164] Hardware name: QEMU Standard PC (Q35 + ICH9, 2009), BIOS 1.12.0-2.fc30 04/01/2014 [ 38.096809] softirqs last disabled at (2150565): [<ffffffff810c9821>] irq_exit+0xf1/0x100 [ 38.096811] CPU: 1 PID: 1042 Comm: stress Tainted: G D W 5.3.0-rc5+ #71 [ 38.102911] RIP: 0010:queued_spin_lock_slowpath+0x42/0x1e0 [ 38.104659] Hardware name: QEMU Standard PC (Q35 + ICH9, 2009), BIOS 1.12.0-2.fc30 04/01/2014 [ 38.104662] RIP: 0010:queued_spin_lock_slowpath+0x124/0x1e0 [ 38.110884] Code: 49 f0 0f ba 2f 08 0f 92 c0 0f b6 c0 c1 e0 08 89 c2 8b 07 30 e4 09 d0 a9 00 01 ff ff 75 23 85 c0 74 0e 8b 07 84 c0 74 08 f3 90 <8b> 07 84 c0 75 f8 b8 01 00 00 00 66 89 07 65 48 ff 05 e8 f7 09 7f [ 38.112603] Code: 00 89 1d 00 eb a1 41 83 c0 01 c1 e1 10 41 c1 e0 12 44 09 c1 89 c8 c1 e8 10 66 87 47 02 89 c6 c1 e6 10 75 3c 31 f6 eb 02 f3 90 <8b> 07 66 85 c0 75 f7 41 89 c0 66 45 31 c0 41 39 c8 74 64 c6 07 01 [ 38.117880] watchdog: BUG: soft lockup - CPU#2 stuck for 21s! [stress:1040] [ 38.117881] Modules linked in: ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ip6table_nat ip6table_mangle ip6table_raw ip6table_security iptable_nat nf_nat iptable_mangle iptable_raw iptable_security nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 libcrc32c ip_set nfnetlink ip6table_filter ip6_tables iptable_filter ip_tables crct10dif_pclmul crc32_pclmul ghash_clmulni_intel virtio_net virtio_balloon net_failover failover intel_agp intel_gtt qxl drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm crc32c_intel virtio_blk virtio_console serio_raw agpgart qemu_fw_cfg [ 38.117896] irq event stamp: 2140518 [ 38.117899] hardirqs last enabled at (2140517): [<ffffffff819d6b09>] _raw_spin_unlock_irq+0x29/0x40 [ 38.117900] hardirqs last disabled at (2140518): [<ffffffff819cef64>] __schedule+0xc4/0x8a0 [ 38.117902] softirqs last enabled at (2139650): [<ffffffff81c00351>] __do_softirq+0x351/0x451 [ 38.117903] softirqs last disabled at (2139629): [<ffffffff810c9821>] irq_exit+0xf1/0x100 [ 38.117904] CPU: 2 PID: 1040 Comm: stress Tainted: G D W 5.3.0-rc5+ #71 [ 38.117905] Hardware name: QEMU Standard PC (Q35 + ICH9, 2009), BIOS 1.12.0-2.fc30 04/01/2014 [ 38.117907] RIP: 0010:queued_spin_lock_slowpath+0x42/0x1e0 [ 38.117908] Code: 49 f0 0f ba 2f 08 0f 92 c0 0f b6 c0 c1 e0 08 89 c2 8b 07 30 e4 09 d0 a9 00 01 ff ff 75 23 85 c0 74 0e 8b 07 84 c0 74 08 f3 90 <8b> 07 84 c0 75 f8 b8 01 00 00 00 66 89 07 65 48 ff 05 e8 f7 09 7f [ 38.117909] RSP: 0000:ffffb18cc0a876c8 EFLAGS: 00000202 ORIG_RAX: ffffffffffffff13 [ 38.117910] RAX: 0000000000000101 RBX: ffff97ddb303bd80 RCX: 0000000000000000 [ 38.117911] RDX: 0000000000000000 RSI: 0000000000000000 RDI: ffff97ddb303bd80 [ 38.117911] RBP: ffff97ddb303bd80 R08: 0000000000000001 R09: 0000000000000000 [ 38.117912] R10: 0000000000000000 R11: 0000000000000000 R12: ffff97ddb303bd98 [ 38.117912] R13: 0000000000000000 R14: 00000007fec8809f R15: 00000007fec8809f [ 38.117915] FS: 00007fec8d21f740(0000) GS:ffff97ddbe800000(0000) knlGS:0000000000000000 [ 38.117916] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 38.117916] CR2: 00007fec889f4010 CR3: 0000000039072001 CR4: 0000000000160ee0 [ 38.117917] Call Trace: [ 38.117920] do_raw_spin_lock+0xab/0xb0 [ 38.117923] _raw_spin_lock+0x63/0x80 [ 38.117925] page_vma_mapped_walk+0x4ac/0x7b0 [ 38.117927] page_referenced_one+0x9b/0x170 [ 38.117930] rmap_walk_anon+0x173/0x390 [ 38.117932] page_referenced+0x149/0x170 [ 38.117934] ? page_mapcount_is_zero+0x20/0x20 [ 38.117935] ? page_get_anon_vma+0x1c0/0x1c0 [ 38.117938] shrink_page_list+0x8fd/0x1830 [ 38.117942] shrink_inactive_list+0x1da/0x460 [ 38.117946] shrink_node_memcg+0x202/0x770 [ 38.117951] shrink_node+0xdf/0x490 [ 38.117954] do_try_to_free_pages+0xdb/0x3c0 [ 38.117957] try_to_free_pages+0x112/0x2e0 [ 38.117960] __alloc_pages_slowpath+0x422/0x1000 [ 38.117966] __alloc_pages_nodemask+0x37f/0x400 [ 38.117970] alloc_pages_vma+0xcc/0x170 [ 38.117973] __handle_mm_fault+0x996/0x1900 [ 38.117977] handle_mm_fault+0x159/0x340 [ 38.117980] do_user_addr_fault+0x1fe/0x480 [ 38.117982] do_page_fault+0x31/0x210 [ 38.117984] page_fault+0x3e/0x50 [ 38.117986] RIP: 0033:0x55e537b6e250 [ 38.117987] Code: 0f 84 88 02 00 00 8b 54 24 0c 31 c0 85 d2 0f 94 c0 89 04 24 41 83 fd 02 0f 8f f1 00 00 00 31 c0 4d 85 ff 7e 12 0f 1f 44 00 00 <c6> 44 05 00 5a 4c 01 f0 49 39 c7 7f f3 48 85 db 0f 84 dd 01 00 00 [ 38.117988] RSP: 002b:00007ffce0648e50 EFLAGS: 00010206 [ 38.117989] RAX: 00000000056ce000 RBX: ffffffffffffffff RCX: 00007fec8d318156 [ 38.117989] RDX: 0000000000000000 RSI: 0000000009ef9000 RDI: 0000000000000000 [ 38.117990] RBP: 00007fec83326010 R08: 00007fec83326010 R09: 0000000000000000 [ 38.117990] R10: 0000000000000022 R11: 0000000000000246 R12: 000055e537b70004 [ 38.117991] R13: 0000000000000002 R14: 0000000000001000 R15: 0000000009ef8000 [ 38.118333] RSP: 0000:ffffb18cc0a0bd30 EFLAGS: 00000202 ORIG_RAX: ffffffffffffff13 [ 38.119753] RSP: 0000:ffffb18cc0a97678 EFLAGS: 00000202 ORIG_RAX: ffffffffffffff13 [ 38.126017] RAX: 0000000000080101 RBX: ffff97ddb5307940 RCX: 0000000000000000 [ 38.127469] RAX: 0000000000080101 RBX: ffff97ddb5307940 RCX: 0000000000080000 [ 38.127470] RDX: ffff97ddbe7ec400 RSI: 0000000000000000 RDI: ffff97ddb5307940 [ 38.141047] RDX: 0000000000000000 RSI: 0000000000000000 RDI: ffff97ddb5307940 [ 38.144860] RBP: ffff97ddb5307940 R08: 0000000000080000 R09: 0000000000000000 [ 38.144861] R10: 0000000000000000 R11: 0000000000000000 R12: ffff97ddb5307958 [ 38.150164] RBP: ffff97ddb5307940 R08: 0000000000000001 R09: 0000000000000000 [ 38.160618] R13: ffff97ddbb934898 R14: 0000000000000001 R15: 00000007fec88000 [ 38.160621] FS: 00007fec8d21f740(0000) GS:ffff97ddbe600000(0000) knlGS:0000000000000000 [ 38.163844] R10: 0000000000000000 R11: 0000000000000000 R12: ffff97ddb5307958 [ 38.165805] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 38.165806] CR2: 00007fec8c7dc010 CR3: 000000003b260003 CR4: 0000000000160ee0 [ 38.172076] R13: 000000000003bca5 R14: 000000000003bca5 R15: fffff63080927d40 [ 38.172079] FS: 00007fec8d21f740(0000) GS:ffff97ddbe400000(0000) knlGS:0000000000000000 [ 38.173982] Call Trace: [ 38.180197] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 38.182152] do_raw_spin_lock+0xab/0xb0 [ 38.188614] CR2: 00007fec84677010 CR3: 000000003706e003 CR4: 0000000000160ef0 [ 38.188616] Call Trace: [ 38.190875] _raw_spin_lock+0x63/0x80 [ 38.204981] do_raw_spin_lock+0xab/0xb0 [ 38.207734] __swap_duplicate+0x163/0x220 [ 38.213331] _raw_spin_lock+0x63/0x80 [ 38.215958] swap_duplicate+0x16/0x40 [ 38.221506] __swap_entry_free.constprop.0+0x82/0xa0 [ 38.224095] try_to_unmap_one+0x81c/0xe20 [ 38.229612] do_swap_page+0x608/0xc20 [ 38.232405] rmap_walk_anon+0x173/0x390 [ 38.237023] __handle_mm_fault+0x8da/0x1900 [ 38.239593] try_to_unmap+0xfe/0x150 [ 38.242085] handle_mm_fault+0x159/0x340 [ 38.243871] ? page_remove_rmap+0x490/0x490 [ 38.247107] do_user_addr_fault+0x1fe/0x480 [ 38.248975] ? page_not_mapped+0x20/0x20 [ 38.248976] ? page_get_anon_vma+0x1c0/0x1c0 [ 38.252521] do_page_fault+0x31/0x210 [ 38.254224] shrink_page_list+0xf2f/0x1830 [ 38.257562] page_fault+0x3e/0x50 [ 38.259385] shrink_inactive_list+0x1da/0x460 [ 38.262925] RIP: 0033:0x55e537b6e298 [ 38.264648] shrink_node_memcg+0x202/0x770 [ 38.268216] Code: 7e 01 00 00 89 df e8 47 e1 ff ff 44 8b 2d 84 4d 00 00 4d 85 ff 7e 40 31 c0 eb 0f 0f 1f 80 00 00 00 00 4c 01 f0 49 39 c7 7e 2d <80> 7c 05 00 5a 4c 8d 54 05 00 74 ec 4c 89 14 24 45 85 ed 0f 89 de [ 38.269926] shrink_node+0xdf/0x490 [ 38.272912] RSP: 002b:00007ffce0648e50 EFLAGS: 00010206 [ 38.274636] do_try_to_free_pages+0xdb/0x3c0 [ 38.277997] RAX: 000000000990b000 RBX: ffffffffffffffff RCX: 00007fec8d318156 [ 38.279781] try_to_free_pages+0x112/0x2e0 [ 38.283405] RDX: 0000000000000000 RSI: 0000000009ef9000 RDI: 0000000000000000 [ 38.283406] RBP: 00007fec83326010 R08: 00007fec83326010 R09: 0000000000000000 [ 38.284983] __alloc_pages_slowpath+0x422/0x1000 [ 38.288355] R10: 00007fec8cc30010 R11: 0000000000000246 R12: 000055e537b70004 [ 38.288356] R13: 0000000000000002 R14: 0000000000001000 R15: 0000000009ef8000 [ 38.289924] __alloc_pages_nodemask+0x37f/0x400 [ 38.414501] alloc_pages_vma+0xcc/0x170 [ 38.415945] __handle_mm_fault+0x996/0x1900 [ 38.417465] handle_mm_fault+0x159/0x340 [ 38.418915] do_user_addr_fault+0x1fe/0x480 [ 38.420422] do_page_fault+0x31/0x210 [ 38.421797] page_fault+0x3e/0x50 [ 38.423084] RIP: 0033:0x55e537b6e250 [ 38.424426] Code: 0f 84 88 02 00 00 8b 54 24 0c 31 c0 85 d2 0f 94 c0 89 04 24 41 83 fd 02 0f 8f f1 00 00 00 31 c0 4d 85 ff 7e 12 0f 1f 44 00 00 <c6> 44 05 00 5a 4c 01 f0 49 39 c7 7f f3 48 85 db 0f 84 dd 01 00 00 [ 38.429795] RSP: 002b:00007ffce0648e50 EFLAGS: 00010206 [ 38.431549] RAX: 00000000094b6000 RBX: ffffffffffffffff RCX: 00007fec8d318156 [ 38.433747] RDX: 0000000000000000 RSI: 0000000009ef9000 RDI: 0000000000000000 [ 38.435938] RBP: 00007fec83326010 R08: 00007fec83326010 R09: 0000000000000000 [ 38.438122] R10: 0000000000000022 R11: 0000000000000246 R12: 000055e537b70004 [ 38.440324] R13: 0000000000000002 R14: 0000000000001000 R15: 0000000009ef8000