identical error with 5.6.13 and 5.7.11 https://bugzilla.kernel.org/show_bug.cgi?id=207773 [358180.895238] kernel BUG at lib/list_debug.c:45! [358180.896166] invalid opcode: 0000 [#1] SMP NOPTI [358180.897026] CPU: 0 PID: 0 Comm: swapper/0 Not tainted 5.7.11-100.fc31.x86_64 #1 [358180.898282] Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 12/12/2018 [358180.900098] RIP: 0010:__list_del_entry_valid.cold+0xf/0x55 [358180.901057] Code: c3 ff 0f 0b 48 89 d1 4c 89 c6 4c 89 ca 48 c7 c7 a8 28 3e 8e e8 75 43 c3 ff 0f 0b 48 89 fe 48 c7 c7 38 29 3e 8e e8 64 43 c3 ff <0f> 0b 48 c7 c7 e8 29 3e 8e e8 56 43 c3 ff 0f 0b 48 89 f2 48 89 fe [358180.904219] RSP: 0018:ffffae26400037d8 EFLAGS: 00010286 [358180.905129] RAX: 000000000000004e RBX: ffff9f7fbfad9000 RCX: 0000000000000000 [358180.906352] RDX: ffff9f7fdd427cc0 RSI: ffff9f7fdd419cc8 RDI: 0000000000000300 [358180.907575] RBP: ffff9f7fd6800000 R08: 0000000000000460 R09: 0000000000000003 [358180.908801] R10: 0000000000000000 R11: 0000000000000001 R12: ffff9f7fbfad9010 [358180.910047] R13: ffff9f7fda34d500 R14: ffff9f7fd68000f8 R15: ffff9f7fd6800000 [358180.911270] FS: 0000000000000000(0000) GS:ffff9f7fdd400000(0000) knlGS:0000000000000000 [358180.912651] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [358180.913724] CR2: 00007fb66e7f17c8 CR3: 0000000036d40004 CR4: 00000000003606f0 [358180.915004] Call Trace: [358180.915482] <IRQ> [358180.915883] recent_entry_update+0x52/0xa0 [xt_recent] [358180.916791] recent_mt+0x167/0x31d [xt_recent] [358180.917592] __nft_match_eval.isra.0+0x30/0x60 [nft_compat] [358180.918593] nft_do_chain+0x149/0x4e0 [nf_tables] [358180.919436] ? nft_update_chain_stats.isra.0+0x40/0x50 [nf_tables] [358180.920512] ? ip_route_input_slow+0x3c5/0xa50 [358180.921311] ? l4proto_manip_pkt+0xde/0x440 [nf_nat] [358180.922189] nft_do_chain_ipv4+0x56/0x60 [nf_tables] [358180.923070] ? nf_tables_netdev_event+0x150/0x1c0 [nf_tables] [358180.924078] nf_hook_slow+0x40/0xb0 [358180.924710] ip_forward+0x424/0x450 [358180.925342] ? ip_defrag.cold+0x37/0x37 [358180.926029] ip_rcv+0x9c/0xb0 [358180.926584] ? ip_rcv_finish_core.isra.0+0x410/0x410 [358180.927490] __netif_receive_skb_one_core+0x67/0x70 [358180.928353] netif_receive_skb+0x36/0x130 [358180.929108] br_pass_frame_up+0x113/0x140 [bridge] [358180.929964] ? fdb_find_rcu+0xe2/0x140 [bridge] [358180.930770] br_handle_frame_finish+0x179/0x440 [bridge] [358180.931704] br_handle_frame+0x227/0x350 [bridge] [358180.932536] __netif_receive_skb_core+0x2ca/0x1020 [358180.933384] ? __build_skb+0x1f/0x50 [358180.934031] __netif_receive_skb_list_core+0x12f/0x2b0 [358180.934934] netif_receive_skb_list_internal+0x1bc/0x2d0 [358180.935875] ? vmxnet3_rq_rx_complete+0xa29/0xef0 [vmxnet3] [358180.936850] gro_normal_list.part.0+0x19/0x40 [358180.937625] napi_complete_done+0x86/0x130 [358180.938369] vmxnet3_poll_rx_only+0x7b/0xa0 [vmxnet3] [358180.939264] net_rx_action+0x138/0x390 [358180.939941] __do_softirq+0xee/0x2ff [358180.940589] irq_exit+0xe9/0xf0 [358180.941163] do_IRQ+0x55/0xe0 [358180.941710] common_interrupt+0xf/0xf [358180.942370] </IRQ> [358180.942774] RIP: 0010:native_safe_halt+0xe/0x10 [358180.943576] Code: cc cc cc cc cc cc cc cc cc cc cc cc e9 07 00 00 00 0f 00 2d b6 0c 5b 00 f4 c3 66 90 e9 07 00 00 00 0f 00 2d a6 0c 5b 00 fb f4 <c3> cc 0f 1f 44 00 00 41 54 55 53 e8 32 4d 70 ff 65 8b 2d cb a4 5b [358180.946737] RSP: 0018:ffffffff8ea03e90 EFLAGS: 00000246 ORIG_RAX: ffffffffffffffdb [358180.948052] RAX: ffffffff8da57aa0 RBX: 0000000000000000 RCX: 7fffffffffffffff [358180.949290] RDX: 0000000000000000 RSI: 0000000000000000 RDI: ffff9f7fdd41ea20 [358180.950537] RBP: 0000000000000000 R08: 00000066a1715ded R09: 0000000000000000 [358180.951776] R10: 000000000000000f R11: 000000000000000d R12: ffffffff8ea14840 [358180.953019] R13: 0000000000000000 R14: 0000000000000000 R15: ffffffff8ea14840 [358180.954259] ? __cpuidle_text_start+0x8/0x8 [358180.955015] default_idle+0x1a/0x140 [358180.955660] do_idle+0x1de/0x260 [358180.956248] cpu_startup_entry+0x19/0x20 [358180.956952] start_kernel+0x7f6/0x806 [358180.957615] secondary_startup_64+0xb6/0xc0 [358180.958363] Modules linked in: vfat fat sch_hfsc nf_nat_ftp wireguard curve25519_x86_64 libchacha20poly1305 chacha_x86_64 poly1305_x86_64 ip6_udp_tunnel udp_tunnel libblake2s blake2s_x86_64 libcurve25519_generic libchacha libblake2s_generic bridge stp llc nft_chain_nat xt_NETMAP xt_nat nf_nat nf_conntrack_ftp xt_CT xt_tcpmss xt_TCPMSS nfnetlink_log nft_limit nft_counter xt_recent xt_connlimit nf_conncount xt_time xt_multiport xt_NFLOG xt_iprange ipt_REJECT nf_reject_ipv4 xt_set xt_limit xt_conntrack nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 libcrc32c nft_compat nf_tables ip_set_list_set ip_set_hash_ip ip_set_hash_net ip_set_bitmap_port ip_set nfnetlink crct10dif_pclmul crc32_pclmul ghash_clmulni_intel vmxnet3 ip_tables crc32c_intel vmw_pvscsi [358180.969408] ---[ end trace b5263e7bae37375f ]--- [358180.970228] RIP: 0010:__list_del_entry_valid.cold+0xf/0x55 [358180.971188] Code: c3 ff 0f 0b 48 89 d1 4c 89 c6 4c 89 ca 48 c7 c7 a8 28 3e 8e e8 75 43 c3 ff 0f 0b 48 89 fe 48 c7 c7 38 29 3e 8e e8 64 43 c3 ff <0f> 0b 48 c7 c7 e8 29 3e 8e e8 56 43 c3 ff 0f 0b 48 89 f2 48 89 fe [358180.974396] RSP: 0018:ffffae26400037d8 EFLAGS: 00010286 [358180.975316] RAX: 000000000000004e RBX: ffff9f7fbfad9000 RCX: 0000000000000000 [358180.976559] RDX: ffff9f7fdd427cc0 RSI: ffff9f7fdd419cc8 RDI: 0000000000000300 [358180.977806] RBP: ffff9f7fd6800000 R08: 0000000000000460 R09: 0000000000000003 [358180.979048] R10: 0000000000000000 R11: 0000000000000001 R12: ffff9f7fbfad9010 [358180.980290] R13: ffff9f7fda34d500 R14: ffff9f7fd68000f8 R15: ffff9f7fd6800000 [358180.981540] FS: 0000000000000000(0000) GS:ffff9f7fdd400000(0000) knlGS:0000000000000000 [358180.982941] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [358180.983947] CR2: 00007fb66e7f17c8 CR3: 0000000036d40004 CR4: 00000000003606f0 [358180.985217] Kernel panic - not syncing: Fatal exception in interrupt [358180.986382] Kernel Offset: 0xc000000 from 0xffffffff81000000 (relocation range: 0xffffffff80000000-0xffffffffbfffffff) [358180.988218] Rebooting in 1 seconds.. Am 18.05.20 um 17:24 schrieb Reindl Harald: > the first kernel crash for a year or so > > for now i disabled "gro" again on wan1, wan2 and the bridge device which > i had enabled in the past few weeks after add wiregaurd to the mix > > xt_recent and xt_set can only be chains limited to the interface "wan" > doing ratelimits in "-t mangle" > > thanks to vmware serial console this time there are infos > > https://bugzilla.kernel.org/show_bug.cgi?id=207773 > > [226832.456068] kernel BUG at lib/list_debug.c:45! > [226832.510172] invalid opcode: 0000 [#1] SMP NOPTI > [226832.512592] CPU: 0 PID: 0 Comm: swapper/0 Not tainted > 5.6.13-200.fc31.x86_64 #1 > [226832.516351] Hardware name: VMware, Inc. VMware Virtual > Platform/440BX Desktop Reference Platform, BIOS 6.00 12/12/2018 > [226832.518891] RIP: 0010:__list_del_entry_valid.cold+0xf/0x55 > [226832.519859] Code: c3 ff 0f 0b 48 89 d1 4c 89 c6 4c 89 ca 48 c7 c7 c0 > 2a 3d 92 e8 15 c2 c3 ff 0f 0b 48 89 fe 48 c7 c7 50 2b 3d 92 e8 04 c2 c3 > ff <0f> 0b 48 c7 c7 00 2c 3d 92 e8 f6 c1 c3 ff 0f 0b 48 89 f2 48 89 fe > [226832.523046] RSP: 0018:ffffaad240003918 EFLAGS: 00010286 > [226832.523968] RAX: 000000000000004e RBX: ffff9d4a0b19a000 RCX: > 0000000000000000 > [226832.525205] RDX: ffff9d4a1d427c80 RSI: ffff9d4a1d419cc8 RDI: > 0000000000000300 > [226832.526444] RBP: ffff9d4a03b00000 R08: 0000000000000464 R09: > 0000000000000003 > [226832.527689] R10: 0000000000000000 R11: 0000000000000001 R12: > ffff9d4a0b19a010 > [226832.528927] R13: ffff9d4a08c8c000 R14: ffff9d4a03b000f8 R15: > ffff9d4a03b00000 > [226832.530165] FS: 0000000000000000(0000) GS:ffff9d4a1d400000(0000) > knlGS:0000000000000000 > [226832.531560] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 > [226832.532589] CR2: 000055d7057581a8 CR3: 0000000098fe0003 CR4: > 00000000003606f0 > [226832.533889] Call Trace: > [226832.534377] <IRQ> > [226832.534776] recent_entry_update+0x52/0xa0 [xt_recent] > [226832.535690] recent_mt+0x167/0x328 [xt_recent] > [226832.536488] ? set_match_v4+0x96/0xb0 [xt_set] > [226832.537407] ipt_do_table+0x24f/0x610 [ip_tables] > [226832.538277] ? ipt_do_table+0x33e/0x610 [ip_tables] > [226832.539146] ? l4proto_manip_pkt+0xde/0x440 [nf_nat] > [226832.540049] ? ip_route_input_rcu+0x40/0x280 > [226832.540831] nf_hook_slow+0x40/0xb0 > [226832.541477] ip_forward+0x424/0x450 > [226832.542116] ? ip_defrag.cold+0x37/0x37 > [226832.542814] ip_rcv+0x9c/0xb0 > [226832.543367] ? ip_rcv_finish_core.isra.0+0x410/0x410 > [226832.544251] __netif_receive_skb_one_core+0x60/0x70 > [226832.545123] netif_receive_skb+0x36/0x130 > [226832.545851] br_pass_frame_up+0x113/0x140 [bridge] > [226832.546708] ? fdb_find_rcu+0xe2/0x140 [bridge] > [226832.547522] br_handle_frame_finish+0x179/0x440 [bridge] > [226832.548460] ? ip_forward+0x348/0x450 > [226832.549126] ? br_handle_frame_finish+0x440/0x440 [bridge] > [226832.550094] br_handle_frame+0x227/0x350 [bridge] > [226832.550931] ? ip_sublist_rcv_finish+0x57/0x70 > [226832.551733] ? ip_sublist_rcv+0x185/0x1f0 > [226832.552457] ? br_handle_frame_finish+0x440/0x440 [bridge] > [226832.553424] __netif_receive_skb_core+0x2b3/0xf50 > [226832.554266] ? __build_skb+0x1f/0x50 > [226832.554921] ? vmxnet3_msix_rx+0x4a/0x60 [vmxnet3] > [226832.555775] __netif_receive_skb_list_core+0x128/0x2c0 > [226832.556684] ? dev_gro_receive+0x5e5/0x680 > [226832.557426] netif_receive_skb_list_internal+0x1bc/0x2d0 > [226832.558366] ? vmxnet3_rq_rx_complete+0xa29/0xef0 [vmxnet3] > [226832.559353] gro_normal_list.part.0+0x19/0x40 > [226832.560133] napi_complete_done+0x86/0x130 > [226832.560873] vmxnet3_poll_rx_only+0x7b/0xa0 [vmxnet3] > [226832.561774] net_rx_action+0x138/0x390 > [226832.562468] __do_softirq+0xee/0x2ff > [226832.563142] irq_exit+0xe9/0xf0 > [226832.563722] do_IRQ+0x55/0xe0 > [226832.564274] common_interrupt+0xf/0xf > [226832.564941] </IRQ> > [226832.565347] RIP: 0010:native_safe_halt+0xe/0x10 > [226832.566159] Code: cc cc cc cc cc cc cc cc cc cc cc cc e9 07 00 00 00 > 0f 00 2d a6 a7 5f 00 f4 c3 66 90 e9 07 00 00 00 0f 00 2d 96 a7 5f 00 fb > f4 <c3> cc 0f 1f 44 00 00 41 54 55 53 e8 62 b7 74 ff 65 8b 2d 7b 41 60 > [226832.569345] RSP: 0018:ffffffff92603e98 EFLAGS: 00000246 ORIG_RAX: > ffffffffffffffdb > [226832.570664] RAX: ffffffff91a0ddf0 RBX: 0000000000000000 RCX: > 7fffffffffffffff > [226832.571911] RDX: 0000000000000000 RSI: 0000000000000000 RDI: > ffff9d4a1d41ea00 > [226832.573159] RBP: 0000000000000000 R08: 00000066a1715ded R09: > 0000000000000000 > [226832.574405] R10: 000000000000000f R11: 0000000000000000 R12: > ffffffff92614840 > [226832.575651] R13: 0000000000000000 R14: 0000000000000000 R15: > ffffffff92614840 > [226832.576904] ? __cpuidle_text_start+0x8/0x8 > [226832.577677] ? tick_nohz_idle_stop_tick+0x5f/0xc0 > [226832.578515] default_idle+0x1a/0x140 > [226832.579172] do_idle+0x1de/0x260 > [226832.579768] cpu_startup_entry+0x19/0x20 > [226832.580501] start_kernel+0x7a8/0x7b5 > [226832.581177] secondary_startup_64+0xb6/0xc0 > [226832.581932] Modules linked in: sch_hfsc wireguard curve25519_x86_64 > libchacha20poly1305 chacha_x86_64 poly1305_x86_64 ip6_udp_tunnel > udp_tunnel libblake2s blake2s_x86_64 libcurve25519_generic libchacha > libblake2s_generic bridge stp llc xt_NETMAP xt_nat iptable_nat xt_CT > iptable_raw xt_tcpmss xt_TCPMSS iptable_mangle nfnetlink_log xt_time > xt_NFLOG xt_recent xt_multiport xt_connlimit nf_conncount xt_iprange > ipt_REJECT nf_reject_ipv4 xt_set xt_limit xt_conntrack iptable_filter > ip_set_list_set ip_set_hash_ip ip_set_hash_net ip_set_bitmap_port ip_set > nfnetlink nf_nat_ftp nf_nat nf_conntrack_ftp nf_conntrack nf_defrag_ipv6 > nf_defrag_ipv4 libcrc32c crct10dif_pclmul crc32_pclmul > ghash_clmulni_intel vmxnet3 ip_tables crc32c_intel vmw_pvscsi > [226832.592819] ---[ end trace ff2b6d140cf02850 ]--- > [226832.593647] RIP: 0010:__list_del_entry_valid.cold+0xf/0x55 > [226832.594617] Code: c3 ff 0f 0b 48 89 d1 4c 89 c6 4c 89 ca 48 c7 c7 c0 > 2a 3d 92 e8 15 c2 c3 ff 0f 0b 48 89 fe 48 c7 c7 50 2b 3d 92 e8 04 c2 c3 > ff <0f> 0b 48 c7 c7 00 2c 3d 92 e8 f6 c1 c3 ff 0f 0b 48 89 f2 48 89 fe > [226832.597803] RSP: 0018:ffffaad240003918 EFLAGS: 00010286 > [226832.598726] RAX: 000000000000004e RBX: ffff9d4a0b19a000 RCX: > 0000000000000000 > [226832.599971] RDX: ffff9d4a1d427c80 RSI: ffff9d4a1d419cc8 RDI: > 0000000000000300 > [226832.601218] RBP: ffff9d4a03b00000 R08: 0000000000000464 R09: > 0000000000000003 > [226832.602465] R10: 0000000000000000 R11: 0000000000000001 R12: > ffff9d4a0b19a010 > [226832.603712] R13: ffff9d4a08c8c000 R14: ffff9d4a03b000f8 R15: > ffff9d4a03b00000 > [226832.604961] FS: 0000000000000000(0000) GS:ffff9d4a1d400000(0000) > knlGS:0000000000000000 > [226832.606367] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 > [226832.607381] CR2: 000055d7057581a8 CR3: 0000000098fe0003 CR4: > 00000000003606f0 > [226832.608655] Kernel panic - not syncing: Fatal exception in interrupt > [226832.609795] Kernel Offset: 0x10000000 from 0xffffffff81000000 > (relocation range: 0xffffffff80000000-0xffffffffbfffffff) > [226832.611651] Rebooting in 1 seconds.. > [226833.619635] ACPI MEMORY or I/O RESET_REG.
