Re-post the log , sorry for the format. Feb 11 14:17:31 kernel: ============================================================================= Feb 11 14:17:31 kernel: BUG rxe-qp (Tainted: G OE ): Objects remaining in rxe-qp on __kmem_cache_shutdown() Feb 11 14:17:31 kernel: ----------------------------------------------------------------------------- Feb 11 14:17:31 kernel: Disabling lock debugging due to kernel taint Feb 11 14:17:31 kernel: INFO: Slab 0xfffff4c4b027a000 objects=16 used=1 fp=0xffff96f3c9e83f00 flags=0x17ffffc0008100 Feb 11 14:17:31 kernel: CPU: 27 PID: 25588 Comm: rmmod Tainted: G B OE 4.14.97-.el7.centos.x86_64 #1 Feb 11 14:17:31 kernel: Hardware name: /80010056, BIOS 4.1.15 03/28/2017 Feb 11 14:17:31 kernel: Call Trace: Feb 11 14:17:31 kernel: dump_stack+0x5a/0x7b Feb 11 14:17:31 kernel: slab_err+0xb4/0xe0 Feb 11 14:17:31 kernel: ? calibrate_delay+0x138/0x5f0 Feb 11 14:17:31 kernel: ? on_each_cpu_mask+0x27/0x60 Feb 11 14:17:31 kernel: ? on_each_cpu_cond+0xaf/0x140 Feb 11 14:17:31 kernel: ? __kmalloc+0x179/0x200 Feb 11 14:17:31 kernel: ? __kmem_cache_shutdown+0x194/0x3d0 Feb 11 14:17:31 kernel: __kmem_cache_shutdown+0x1b4/0x3d0 Feb 11 14:17:31 kernel: shutdown_cache+0x13/0x1b0 Feb 11 14:17:31 kernel: kmem_cache_destroy+0x1e4/0x220 Feb 11 14:17:31 kernel: rxe_cache_clean+0x41/0x60 [rdma_rxe] Feb 11 14:17:31 kernel: rxe_module_exit+0xf/0x68 [rdma_rxe] Feb 11 14:17:31 kernel: SyS_delete_module+0x175/0x270 Feb 11 14:17:31 kernel: do_syscall_64+0x74/0x190 Feb 11 14:17:31 kernel: entry_SYSCALL_64_after_hwframe+0x3d/0xa2 Feb 11 14:17:31 kernel: RIP: 0033:0x7ff146d3f517 Feb 11 14:17:31 kernel: RSP: 002b:00007ffd4b5c1598 EFLAGS: 00000202 ORIG_RAX: 00000000000000b0 Feb 11 14:17:31 kernel: RAX: ffffffffffffffda RBX: 0000000000d78280 RCX: 00007ff146d3f517 Feb 11 14:17:31 kernel: RDX: 00007ff146db3ca0 RSI: 0000000000000800 RDI: 0000000000d782e8 Feb 11 14:17:31 kernel: RBP: 0000000000000000 R08: 00007ff147008060 R09: 00007ff146db3ca0 Feb 11 14:17:31 kernel: R10: 00007ffd4b5c1020 R11: 0000000000000202 R12: 00007ffd4b5c36ca Feb 11 14:17:31 kernel: R13: 0000000000000000 R14: 0000000000d78280 R15: 0000000000d78010 Feb 11 14:17:31 kernel: INFO: Object 0xffff96f3c9e84ec0 @offset=20160 Feb 11 14:17:31 kernel: kmem_cache_destroy rxe-qp: Slab cache still has objects Feb 11 14:17:31 kernel: CPU: 27 PID: 25588 Comm: rmmod Tainted: G B OE 4.14.97-.el7.centos.x86_64 #1 Feb 11 14:17:31 kernel: Hardware name: /80010056, BIOS 4.1.15 03/28/2017 Feb 11 14:17:31 kernel: Call Trace: Feb 11 14:17:31 kernel: dump_stack+0x5a/0x7b Feb 11 14:17:31 kernel: kmem_cache_destroy+0x203/0x220 Feb 11 14:17:31 kernel: rxe_cache_clean+0x41/0x60 [rdma_rxe] Feb 11 14:17:31 kernel: rxe_module_exit+0xf/0x68 [rdma_rxe] Feb 11 14:17:31 kernel: SyS_delete_module+0x175/0x270 Feb 11 14:17:31 kernel: do_syscall_64+0x74/0x190 Feb 11 14:17:31 kernel: entry_SYSCALL_64_after_hwframe+0x3d/0xa2 Feb 11 14:17:31 kernel: RIP: 0033:0x7ff146d3f517 Feb 11 14:17:31 kernel: RSP: 002b:00007ffd4b5c1598 EFLAGS: 00000202 ORIG_RAX: 00000000000000b0 Feb 11 14:17:31 kernel: RAX: ffffffffffffffda RBX: 0000000000d78280 RCX: 00007ff146d3f517 Feb 11 14:17:31 kernel: RDX: 00007ff146db3ca0 RSI: 0000000000000800 RDI: 0000000000d782e8 On Tue, Feb 11, 2020 at 3:09 PM Frank Huang <tigerinxm@xxxxxxxxx> wrote: > > Hi, All > > When I use the old version of rdma_rxe (kernel 4.14.97), There is a > slab leak of qp, is it fixed in newest version? I found the commit > history on kernel.org, have not found same issue with it? > > > Feb 11 14:17:31 57c4c63f-e817-4e22-aec9-72bc376b757c kernel: > ============================================================================= > Feb 11 14:17:31 57c4c63f-e817-4e22-aec9-72bc376b757c kernel: BUG > rxe-qp (Tainted: G OE ): Objects remaining in rxe-qp on > __kmem_cache_shutdown() > Feb 11 14:17:31 57c4c63f-e817-4e22-aec9-72bc376b757c kernel: > ----------------------------------------------------------------------------- > Feb 11 14:17:31 57c4c63f-e817-4e22-aec9-72bc376b757c kernel: Disabling > lock debugging due to kernel taint > Feb 11 14:17:31 57c4c63f-e817-4e22-aec9-72bc376b757c kernel: INFO: > Slab 0xfffff4c4b027a000 objects=16 used=1 fp=0xffff96f3c9e83f00 > flags=0x17ffffc0008100 > Feb 11 14:17:31 57c4c63f-e817-4e22-aec9-72bc376b757c kernel: CPU: 27 > PID: 25588 Comm: rmmod Tainted: G B OE > 4.14.97-.el7.centos.x86_64 #1 > Feb 11 14:17:31 57c4c63f-e817-4e22-aec9-72bc376b757c kernel: Hardware > name: 80010056, BIOS 4.1.15 03/28/2017 > Feb 11 14:17:31 57c4c63f-e817-4e22-aec9-72bc376b757c kernel: Call Trace: > Feb 11 14:17:31 57c4c63f-e817-4e22-aec9-72bc376b757c kernel: > dump_stack+0x5a/0x7b > Feb 11 14:17:31 57c4c63f-e817-4e22-aec9-72bc376b757c kernel: slab_err+0xb4/0xe0 > Feb 11 14:17:31 57c4c63f-e817-4e22-aec9-72bc376b757c kernel: ? > calibrate_delay+0x138/0x5f0 > Feb 11 14:17:31 57c4c63f-e817-4e22-aec9-72bc376b757c kernel: ? > on_each_cpu_mask+0x27/0x60 > Feb 11 14:17:31 57c4c63f-e817-4e22-aec9-72bc376b757c kernel: ? > on_each_cpu_cond+0xaf/0x140 > Feb 11 14:17:31 57c4c63f-e817-4e22-aec9-72bc376b757c kernel: ? > __kmalloc+0x179/0x200 > Feb 11 14:17:31 57c4c63f-e817-4e22-aec9-72bc376b757c kernel: ? > __kmem_cache_shutdown+0x194/0x3d0 > Feb 11 14:17:31 57c4c63f-e817-4e22-aec9-72bc376b757c kernel: > __kmem_cache_shutdown+0x1b4/0x3d0 > Feb 11 14:17:31 57c4c63f-e817-4e22-aec9-72bc376b757c kernel: > shutdown_cache+0x13/0x1b0 > Feb 11 14:17:31 57c4c63f-e817-4e22-aec9-72bc376b757c kernel: > kmem_cache_destroy+0x1e4/0x220 > Feb 11 14:17:31 57c4c63f-e817-4e22-aec9-72bc376b757c kernel: > rxe_cache_clean+0x41/0x60 [rdma_rxe] > Feb 11 14:17:31 57c4c63f-e817-4e22-aec9-72bc376b757c kernel: > rxe_module_exit+0xf/0x68 [rdma_rxe] > Feb 11 14:17:31 57c4c63f-e817-4e22-aec9-72bc376b757c kernel: > SyS_delete_module+0x175/0x270 > Feb 11 14:17:31 57c4c63f-e817-4e22-aec9-72bc376b757c kernel: > do_syscall_64+0x74/0x190 > Feb 11 14:17:31 57c4c63f-e817-4e22-aec9-72bc376b757c kernel: > entry_SYSCALL_64_after_hwframe+0x3d/0xa2 > Feb 11 14:17:31 57c4c63f-e817-4e22-aec9-72bc376b757c kernel: RIP: > 0033:0x7ff146d3f517 > Feb 11 14:17:31 57c4c63f-e817-4e22-aec9-72bc376b757c kernel: RSP: > 002b:00007ffd4b5c1598 EFLAGS: 00000202 ORIG_RAX: 00000000000000b0 > Feb 11 14:17:31 57c4c63f-e817-4e22-aec9-72bc376b757c kernel: RAX: > ffffffffffffffda RBX: 0000000000d78280 RCX: 00007ff146d3f517 > Feb 11 14:17:31 57c4c63f-e817-4e22-aec9-72bc376b757c kernel: RDX: > 00007ff146db3ca0 RSI: 0000000000000800 RDI: 0000000000d782e8 > Feb 11 14:17:31 57c4c63f-e817-4e22-aec9-72bc376b757c kernel: RBP: > 0000000000000000 R08: 00007ff147008060 R09: 00007ff146db3ca0 > Feb 11 14:17:31 57c4c63f-e817-4e22-aec9-72bc376b757c kernel: R10: > 00007ffd4b5c1020 R11: 0000000000000202 R12: 00007ffd4b5c36ca > Feb 11 14:17:31 57c4c63f-e817-4e22-aec9-72bc376b757c kernel: R13: > 0000000000000000 R14: 0000000000d78280 R15: 0000000000d78010 > Feb 11 14:17:31 57c4c63f-e817-4e22-aec9-72bc376b757c kernel: INFO: > Object 0xffff96f3c9e84ec0 @offset=20160 > Feb 11 14:17:31 57c4c63f-e817-4e22-aec9-72bc376b757c kernel: > kmem_cache_destroy rxe-qp: Slab cache still has objects > Feb 11 14:17:31 57c4c63f-e817-4e22-aec9-72bc376b757c kernel: CPU: 27 > PID: 25588 Comm: rmmod Tainted: G B OE > 4.14.97-.el7.centos.x86_64 #1 > Feb 11 14:17:31 57c4c63f-e817-4e22-aec9-72bc376b757c kernel: Hardware > name: 80010056, BIOS 4.1.15 03/28/2017 > Feb 11 14:17:31 57c4c63f-e817-4e22-aec9-72bc376b757c kernel: Call Trace: > Feb 11 14:17:31 57c4c63f-e817-4e22-aec9-72bc376b757c kernel: > dump_stack+0x5a/0x7b > Feb 11 14:17:31 57c4c63f-e817-4e22-aec9-72bc376b757c kernel: > kmem_cache_destroy+0x203/0x220 > Feb 11 14:17:31 57c4c63f-e817-4e22-aec9-72bc376b757c kernel: > rxe_cache_clean+0x41/0x60 [rdma_rxe] > Feb 11 14:17:31 57c4c63f-e817-4e22-aec9-72bc376b757c kernel: > rxe_module_exit+0xf/0x68 [rdma_rxe] > Feb 11 14:17:31 57c4c63f-e817-4e22-aec9-72bc376b757c kernel: > SyS_delete_module+0x175/0x270 > Feb 11 14:17:31 57c4c63f-e817-4e22-aec9-72bc376b757c kernel: > do_syscall_64+0x74/0x190 > Feb 11 14:17:31 57c4c63f-e817-4e22-aec9-72bc376b757c kernel: > entry_SYSCALL_64_after_hwframe+0x3d/0xa2 > Feb 11 14:17:31 57c4c63f-e817-4e22-aec9-72bc376b757c kernel: RIP: > 0033:0x7ff146d3f517 > Feb 11 14:17:31 57c4c63f-e817-4e22-aec9-72bc376b757c kernel: RSP: > 002b:00007ffd4b5c1598 EFLAGS: 00000202 ORIG_RAX: 00000000000000b0 > Feb 11 14:17:31 57c4c63f-e817-4e22-aec9-72bc376b757c kernel: RAX: > ffffffffffffffda RBX: 0000000000d78280 RCX: 00007ff146d3f517 > Feb 11 14:17:31 57c4c63f-e817-4e22-aec9-72bc376b757c kernel: RDX: > 00007ff146db3ca0 RSI: 0000000000000800 RDI: 0000000000d782e8 > Feb 11 14:17:31 57c4c63f-e817-4e22-aec9-72bc376b757c kernel: RBP: > 0000000000000000 R08: 00007ff147008060 R09: 00007ff146db3ca0 > Feb 11 14:17:31 57c4c63f-e817-4e22-aec9-72bc376b757c kernel: R10: > 00007ffd4b5c1020 R11: 0000000000000202 R12: 00007ffd4b5c36ca > Feb 11 14:17:31 57c4c63f-e817-4e22-aec9-72bc376b757c kernel: R13: > 0000000000000000 R14: 0000000000d78280 R15: 0000000000d78010
