Hi Leon, Sagi,
We're trying to run simple nvmf connect over connectx4 on kernel 4.15.4 and we're hitting the following
kernel panic on the initiator side.
Are there any known issues on this kernel?
Server configuration
[root@lbtlvb-pcie157 linux-4.15.4]# nvmetcli
/> ls
o- / ......................................................................................................................... [...]
o- hosts ................................................................................................................... [...]
o- ports ................................................................................................................... [...]
| o- 1 ..................................................................................................................... [...]
| o- referrals ........................................................................................................... [...]
| o- subsystems .......................................................................................................... [...]
| o- nvme-subsystem-tmp ............................................................................................... [...]
o- subsystems .............................................................................................................. [...]
o- nvme-subsystem-tmp ................................................................................................... [...]
o- allowed_hosts ....................................................................................................... [...]
o- namespaces .......................................................................................................... [...]
o- 1 ................................................................................................................. [...]
Discovery is successful with the following command:
nvme discover -t rdma -a 192.168.20.157 -s 1023
Discovery Log Number of Records 1, Generation counter 1
=====Discovery Log Entry 0======
trtype: rdma
adrfam: ipv4
subtype: nvme subsystem
treq: not specified
portid: 1
trsvcid: 1023
subnqn: nvme-subsystem-tmp
traddr: 192.168.20.157
rdma_prtype: not specified
rdma_qptype: connected
rdma_cms: rdma-cm
rdma_pkey: 0x0000
When running connect as follows, we get the kernel panic
nvme connect -t rdma -n nvme-subsystem-tmp -a 192.168.20.157 -s 1023
Please advise how to proceed.
Thanks,
Michal
[ 663.010545] nvme nvme0: new ctrl: NQN "nqn.2014-08.org.nvmexpress.discovery", addr 192.168.20.157:1023
[ 663.010545] nvme nvme0: new ctrl: NQN "nqn.2014-08.org.nvmexpress.discovery", addr 192.168.20.157:1023
[ 663.052781] nvme nvme0: creating 24 I/O queues.
[ 663.052781] nvme nvme0: creating 24 I/O queues.
[ 663.408093] nvme nvme0: Connect command failed, error wo/DNR bit: -16402
[ 663.408093] nvme nvme0: Connect command failed, error wo/DNR bit: -16402
[ 663.409116] nvme nvme0: failed to connect queue: 3 ret=-18
[ 663.409116] nvme nvme0: failed to connect queue: 3 ret=-18
[ 666.441761] general protection fault: 0000 [#1] SMP PTI
[ 666.441761] general protection fault: 0000 [#1] SMP PTI
[ 666.442762] Modules linked in: null_blk nvme_rdma nvme_fabrics nvme_core rpcsec_gss_krb5 nfsv4 dns_resolver netconsole qedr(O) nfsv3 nfs fscache xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack libcrc32c ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter iscsi_tcp libiscsi_tcp rpcrdma ib_isert iscsi_target_mod ib_iser ib_srpt target_core_mod ib_srp scsi_transport_srp ib_ipoib rdma_ucm ib_ucm ib_uverbs ib_umad rdma_cm ib_cm iw_cm mlx5_ib ib_core intel_rapl sb_edac x86_pkg_temp_thermal intel_powerclamp coretemp kvm vfat irqbypass fat ipmi_ssif crct10dif_pclmul mlx5_core crc32_pclmul ghash_clmulni_intel pcbc qede(O) aesni_intel crypto_simd
[ 666.442762] Modules linked in: null_blk nvme_rdma nvme_fabrics nvme_core rpcsec_gss_krb5 nfsv4 dns_resolver netconsole qedr(O) nfsv3 nfs fscache xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack libcrc32c ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter iscsi_tcp libiscsi_tcp rpcrdma ib_isert iscsi_target_mod ib_iser ib_srpt target_core_mod ib_srp scsi_transport_srp ib_ipoib rdma_ucm ib_ucm ib_uverbs ib_umad rdma_cm ib_cm iw_cm mlx5_ib ib_core intel_rapl sb_edac x86_pkg_temp_thermal intel_powerclamp coretemp kvm vfat irqbypass fat ipmi_ssif crct10dif_pclmul mlx5_core crc32_pclmul ghash_clmulni_intel pcbc qede(O) aesni_intel crypto_simd
[ 666.450974] iTCO_wdt glue_helper ipmi_si qed(O) iTCO_vendor_support cryptd mxm_wmi devlink mei_me iscsi_boot_sysfs ipmi_devintf dcdbas mei pcspkr sg shpchp lpc_ich ipmi_msghandler wmi nfsd acpi_power_meter auth_rpcgss nfs_acl lockd grace sunrpc ip_tables ext4 mbcache jbd2 mgag200 i2c_algo_bit drm_kms_helper sd_mod syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm ahci libahci libata tg3 crc32c_intel i2c_core [last unloaded: netconsole]
[ 666.450974] iTCO_wdt glue_helper ipmi_si qed(O) iTCO_vendor_support cryptd mxm_wmi devlink mei_me iscsi_boot_sysfs ipmi_devintf dcdbas mei pcspkr sg shpchp lpc_ich ipmi_msghandler wmi nfsd acpi_power_meter auth_rpcgss nfs_acl lockd grace sunrpc ip_tables ext4 mbcache jbd2 mgag200 i2c_algo_bit drm_kms_helper sd_mod syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm ahci libahci libata tg3 crc32c_intel i2c_core [last unloaded: netconsole]
[ 666.456393] CPU: 18 PID: 514 Comm: kworker/u48:4 Tainted: G O 4.15.4-kdump #1
[ 666.456393] CPU: 18 PID: 514 Comm: kworker/u48:4 Tainted: G O 4.15.4-kdump #1
[ 666.457819] Hardware name: Dell Inc. PowerEdge R430/0CN7X8, BIOS 2.4.2 01/09/2017
[ 666.457819] Hardware name: Dell Inc. PowerEdge R430/0CN7X8, BIOS 2.4.2 01/09/2017
[ 666.459268] Workqueue: nvme-wq nvme_rdma_error_recovery_work [nvme_rdma]
[ 666.459268] Workqueue: nvme-wq nvme_rdma_error_recovery_work [nvme_rdma]
[ 666.460728] RIP: 0010:kfree+0x47/0x170
[ 666.460728] RIP: 0010:kfree+0x47/0x170
[ 666.462171] RSP: 0018:ffffb7a307417dd8 EFLAGS: 00010207
[ 666.462171] RSP: 0018:ffffb7a307417dd8 EFLAGS: 00010207
[ 666.463623] RAX: 0189b9f754000c00 RBX: 627269760003000b RCX: 0000000000000002
[ 666.463623] RAX: 0189b9f754000c00 RBX: 627269760003000b RCX: 0000000000000002
[ 666.465087] RDX: 00005fee80000000 RSI: 000d000800003072 RDI: 627269760003000b
[ 666.465087] RDX: 00005fee80000000 RSI: 000d000800003072 RDI: 627269760003000b
[ 666.466549] RBP: ffffa0305a1f4000 R08: 0000000000000000 R09: ffffffff9b39bb60
[ 666.466549] RBP: ffffa0305a1f4000 R08: 0000000000000000 R09: ffffffff9b39bb60
[ 666.468015] R10: 00000000f19fdc01 R11: ffffa030f19fc800 R12: ffffffffc0c6e912
[ 666.468015] R10: 00000000f19fdc01 R11: ffffa030f19fc800 R12: ffffffffc0c6e912
[ 666.469483] R13: ffffa030f7250000 R14: ffffa0305a1f4018 R15: ffffa0305a1f3080
[ 666.469483] R13: ffffa030f7250000 R14: ffffa0305a1f4018 R15: ffffa0305a1f3080
[ 666.470949] FS: 0000000000000000(0000) GS:ffffa030ff480000(0000) knlGS:0000000000000000
[ 666.470949] FS: 0000000000000000(0000) GS:ffffa030ff480000(0000) knlGS:0000000000000000
[ 666.472429] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 666.472429] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 666.473909] CR2: 00005580f84d93e8 CR3: 00000006c700a005 CR4: 00000000003606e0
[ 666.473909] CR2: 00005580f84d93e8 CR3: 00000006c700a005 CR4: 00000000003606e0
[ 666.475405] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[ 666.475405] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[ 666.476896] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
[ 666.476896] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
[ 666.478386] Call Trace:
[ 666.478386] Call Trace:
[ 666.479855] nvme_rdma_free_ring.constprop.66+0x52/0x90 [nvme_rdma]
[ 666.479855] nvme_rdma_free_ring.constprop.66+0x52/0x90 [nvme_rdma]
[ 666.481335] nvme_rdma_destroy_queue_ib+0x4f/0x70 [nvme_rdma]
[ 666.481335] nvme_rdma_destroy_queue_ib+0x4f/0x70 [nvme_rdma]
[ 666.482806] nvme_rdma_free_queue+0x36/0xa0 [nvme_rdma]
[ 666.482806] nvme_rdma_free_queue+0x36/0xa0 [nvme_rdma]
[ 666.484275] nvme_rdma_error_recovery_work+0x7a/0xc0 [nvme_rdma]
[ 666.484275] nvme_rdma_error_recovery_work+0x7a/0xc0 [nvme_rdma]
[ 666.485758] process_one_work+0x141/0x340
[ 666.485758] process_one_work+0x141/0x340
[ 666.487240] worker_thread+0x47/0x3e0
[ 666.487240] worker_thread+0x47/0x3e0
[ 666.488723] kthread+0xf5/0x130
[ 666.488723] kthread+0xf5/0x130
[ 666.490205] ? rescuer_thread+0x380/0x380
[ 666.490205] ? rescuer_thread+0x380/0x380
[ 666.491690] ? kthread_associate_blkcg+0x90/0x90
[ 666.491690] ? kthread_associate_blkcg+0x90/0x90
[ 666.493168] ? kthread_associate_blkcg+0x90/0x90
[ 666.493168] ? kthread_associate_blkcg+0x90/0x90
[ 666.494634] ret_from_fork+0x35/0x40
[ 666.494634] ret_from_fork+0x35/0x40
[ 666.496091] Code: 97 00 00 00 b8 00 00 00 80 48 8b 15 d4 bc df 00 48 01 d8 0f 83 d1 00 00 00 48 01 d0 48 c1 e8 0c 48 c1 e0 06 48 03 05 81 24 e3 00 <4c> 8b 58 20 41 f6 c3 01 0f 85 11 01 00 00 49 89 c3 49 8b 43 20
[ 666.496091] Code: 97 00 00 00 b8 00 00 00 80 48 8b 15 d4 bc df 00 48 01 d8 0f 83 d1 00 00 00 48 01 d0 48 c1 e8 0c 48 c1 e0 06 48 03 05 81 24 e3 00 <4c> 8b 58 20 41 f6 c3 01 0f 85 11 01 00 00 49 89 c3 49 8b 43 20
[ 666.499173] RIP: kfree+0x47/0x170 RSP: ffffb7a307417dd8
[ 666.499173] RIP: kfree+0x47/0x170 RSP: ffffb7a307417dd8
[ 666.500738] ---[ end trace a1adaa28eb8d1199 ]---
[ 666.500738] ---[ end trace a1adaa28eb8d1199 ]---
[ 666.556115] Kernel panic - not syncing: Fatal exception
[ 666.556115] Kernel panic - not syncing: Fatal exception
[ 666.557685] Kernel Offset: 0x1a000000 from 0xffffffff81000000 (relocation range: 0xffffffff80000000-0xffffffffbfffffff)
[ 666.557685] Kernel Offset: 0x1a000000 from 0xffffffff81000000 (relocation range: 0xffffffff80000000-0xffffffffbfffffff)
[ 666.561817] ---[ end Kernel panic - not syncing: Fatal exception
[ 666.561817] ---[ end Kernel panic - not syncing: Fatal exception
[ 666.562684] WARNING: CPU: 18 PID: 514 at kernel/sched/core.c:1188 set_task_cpu+0x184/0x190
[ 666.562684] WARNING: CPU: 18 PID: 514 at kernel/sched/core.c:1188 set_task_cpu+0x184/0x190
[ 666.563550] Modules linked in: null_blk nvme_rdma nvme_fabrics nvme_core rpcsec_gss_krb5 nfsv4 dns_resolver netconsole qedr(O) nfsv3 nfs fscache xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack libcrc32c ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter iscsi_tcp libiscsi_tcp rpcrdma ib_isert iscsi_target_mod ib_iser ib_srpt target_core_mod ib_srp scsi_transport_srp ib_ipoib rdma_ucm ib_ucm ib_uverbs ib_umad rdma_cm ib_cm iw_cm mlx5_ib ib_core intel_rapl sb_edac x86_pkg_temp_thermal intel_powerclamp coretemp kvm vfat irqbypass fat ipmi_ssif crct10dif_pclmul mlx5_core crc32_pclmul ghash_clmulni_intel pcbc qede(O) aesni_intel crypto_simd
[ 666.563550] Modules linked in: null_blk nvme_rdma nvme_fabrics nvme_core rpcsec_gss_krb5 nfsv4 dns_resolver netconsole qedr(O) nfsv3 nfs fscache xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack libcrc32c ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter iscsi_tcp libiscsi_tcp rpcrdma ib_isert iscsi_target_mod ib_iser ib_srpt target_core_mod ib_srp scsi_transport_srp ib_ipoib rdma_ucm ib_ucm ib_uverbs ib_umad rdma_cm ib_cm iw_cm mlx5_ib ib_core intel_rapl sb_edac x86_pkg_temp_thermal intel_powerclamp coretemp kvm vfat irqbypass fat ipmi_ssif crct10dif_pclmul mlx5_core crc32_pclmul ghash_clmulni_intel pcbc qede(O) aesni_intel crypto_simd
[ 666.569769] iTCO_wdt glue_helper ipmi_si qed(O) iTCO_vendor_support cryptd mxm_wmi devlink mei_me iscsi_boot_sysfs ipmi_devintf dcdbas mei pcspkr sg shpchp lpc_ich ipmi_msghandler wmi nfsd acpi_power_meter auth_rpcgss nfs_acl lockd grace sunrpc ip_tables ext4 mbcache jbd2 mgag200 i2c_algo_bit drm_kms_helper sd_mod syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm ahci libahci libata tg3 crc32c_intel i2c_core [last unloaded: netconsole]
[ 666.569769] iTCO_wdt glue_helper ipmi_si qed(O) iTCO_vendor_support cryptd mxm_wmi devlink mei_me iscsi_boot_sysfs ipmi_devintf dcdbas mei pcspkr sg shpchp lpc_ich ipmi_msghandler wmi nfsd acpi_power_meter auth_rpcgss nfs_acl lockd grace sunrpc ip_tables ext4 mbcache jbd2 mgag200 i2c_algo_bit drm_kms_helper sd_mod syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm ahci libahci libata tg3 crc32c_intel i2c_core [last unloaded: netconsole]
[ 666.573324] CPU: 18 PID: 514 Comm: kworker/u48:4 Tainted: G D O 4.15.4-kdump #1
[ 666.573324] CPU: 18 PID: 514 Comm: kworker/u48:4 Tainted: G D O 4.15.4-kdump #1
[ 666.574195] Hardware name: Dell Inc. PowerEdge R430/0CN7X8, BIOS 2.4.2 01/09/2017
[ 666.574195] Hardware name: Dell Inc. PowerEdge R430/0CN7X8, BIOS 2.4.2 01/09/2017
[ 666.575068] Workqueue: nvme-wq nvme_rdma_error_recovery_work [nvme_rdma]
[ 666.575068] Workqueue: nvme-wq nvme_rdma_error_recovery_work [nvme_rdma]
[ 666.575935] RIP: 0010:set_task_cpu+0x184/0x190
[ 666.575935] RIP: 0010:set_task_cpu+0x184/0x190
[ 666.576792] RSP: 0018:ffffa030ff483cf8 EFLAGS: 00010046
[ 666.576792] RSP: 0018:ffffa030ff483cf8 EFLAGS: 00010046
[ 666.577648] RAX: 0000000000000200 RBX: ffffa030f2180000 RCX: 0000000000000001
[ 666.577648] RAX: 0000000000000200 RBX: ffffa030f2180000 RCX: 0000000000000001
[ 666.578512] RDX: 0000000000000001 RSI: 0000000000000000 RDI: ffffa030f2180000
[ 666.578512] RDX: 0000000000000001 RSI: 0000000000000000 RDI: ffffa030f2180000
[ 666.579372] RBP: 0000000000022380 R08: 0000000000ffffff R09: 0000000000000000
[ 666.579372] RBP: 0000000000022380 R08: 0000000000ffffff R09: 0000000000000000
[ 666.580228] R10: 0000000000005720 R11: 0000000000000000 R12: 0000000000000000
[ 666.580228] R10: 0000000000005720 R11: 0000000000000000 R12: 0000000000000000
[ 666.581079] R13: 0000000000000000 R14: 0000000000000046 R15: 0000000000000000
[ 666.581079] R13: 0000000000000000 R14: 0000000000000046 R15: 0000000000000000
[ 666.581922] FS: 0000000000000000(0000) GS:ffffa030ff480000(0000) knlGS:0000000000000000
[ 666.581922] FS: 0000000000000000(0000) GS:ffffa030ff480000(0000) knlGS:0000000000000000
[ 666.582770] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 666.582770] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 666.583609] CR2: 00005580f84d93e8 CR3: 00000006c700a005 CR4: 00000000003606e0
[ 666.583609] CR2: 00005580f84d93e8 CR3: 00000006c700a005 CR4: 00000000003606e0
[ 666.584452] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[ 666.584452] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[ 666.585289] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
[ 666.585289] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
[ 666.586122] Call Trace:
[ 666.586122] Call Trace:
[ 666.586953] <IRQ>
[ 666.586953] <IRQ>
[ 666.587773] try_to_wake_up+0x161/0x440
[ 666.587773] try_to_wake_up+0x161/0x440
[ 666.588591] ? account_entity_enqueue+0xc5/0xf0
[ 666.588591] ? account_entity_enqueue+0xc5/0xf0
[ 666.589409] __wake_up_common+0x8a/0x150
[ 666.589409] __wake_up_common+0x8a/0x150
[ 666.590225] ep_poll_callback+0xc9/0x2f0
[ 666.590225] ep_poll_callback+0xc9/0x2f0
[ 666.591035] __wake_up_common+0x8a/0x150
[ 666.591035] __wake_up_common+0x8a/0x150
[ 666.591838] ? try_to_wake_up+0x54/0x440
[ 666.591838] ? try_to_wake_up+0x54/0x440
[ 666.592639] __wake_up_common_lock+0x7a/0xc0
[ 666.592639] __wake_up_common_lock+0x7a/0xc0
[ 666.593445] irq_work_run_list+0x46/0x70
[ 666.593445] irq_work_run_list+0x46/0x70
[ 666.594251] ? tick_sched_do_timer+0x60/0x60
[ 666.594251] ? tick_sched_do_timer+0x60/0x60
[ 666.595056] update_process_times+0x3b/0x50
[ 666.595056] update_process_times+0x3b/0x50
[ 666.595867] tick_sched_handle+0x26/0x60
[ 666.595867] tick_sched_handle+0x26/0x60
[ 666.596676] tick_sched_timer+0x34/0x70
[ 666.596676] tick_sched_timer+0x34/0x70
[ 666.597466] __hrtimer_run_queues+0xdc/0x220
[ 666.597466] __hrtimer_run_queues+0xdc/0x220
[ 666.598241] hrtimer_interrupt+0x99/0x190
[ 666.598241] hrtimer_interrupt+0x99/0x190
[ 666.599003] smp_apic_timer_interrupt+0x56/0x120
[ 666.599003] smp_apic_timer_interrupt+0x56/0x120
[ 666.599764] apic_timer_interrupt+0xa2/0xb0
[ 666.599764] apic_timer_interrupt+0xa2/0xb0
[ 666.600521] </IRQ>
[ 666.600521] </IRQ>
[ 666.601258] RIP: 0010:panic+0x1fa/0x23c
[ 666.601258] RIP: 0010:panic+0x1fa/0x23c
[ 666.601979] RSP: 0018:ffffb7a307417c88 EFLAGS: 00000246 ORIG_RAX: ffffffffffffff11
[ 666.601979] RSP: 0018:ffffb7a307417c88 EFLAGS: 00000246 ORIG_RAX: ffffffffffffff11
[ 666.602707] RAX: 0000000000000034 RBX: 0000000000000200 RCX: 0000000000000006
[ 666.602707] RAX: 0000000000000034 RBX: 0000000000000200 RCX: 0000000000000006
[ 666.603422] RDX: 0000000000000000 RSI: 0000000000000086 RDI: ffffa030ff496930
[ 666.603422] RDX: 0000000000000000 RSI: 0000000000000086 RDI: ffffa030ff496930
[ 666.604116] RBP: ffffb7a307417cf8 R08: 00000000006e0004 R09: 00000000000005b6
[ 666.604116] RBP: ffffb7a307417cf8 R08: 00000000006e0004 R09: 00000000000005b6
[ 666.604792] R10: 0000000000005720 R11: 0000000000000000 R12: ffffffff9be4fed0
[ 666.604792] R10: 0000000000005720 R11: 0000000000000000 R12: ffffffff9be4fed0
[ 666.605451] R13: 0000000000000000 R14: 0000000000000000 R15: ffffa0305a1f3080
[ 666.605451] R13: 0000000000000000 R14: 0000000000000000 R15: ffffa0305a1f3080
[ 666.606088] ? panic+0x1f3/0x23c
[ 666.606088] ? panic+0x1f3/0x23c
[ 666.606703] oops_end+0xaf/0xc0
[ 666.606703] oops_end+0xaf/0xc0
[ 666.607292] ? nvme_rdma_free_ring.constprop.66+0x52/0x90 [nvme_rdma]
[ 666.607292] ? nvme_rdma_free_ring.constprop.66+0x52/0x90 [nvme_rdma]
[ 666.607877] general_protection+0x2c/0x60
[ 666.607877] general_protection+0x2c/0x60
[ 666.608439] RIP: 0010:kfree+0x47/0x170
[ 666.608439] RIP: 0010:kfree+0x47/0x170
[ 666.608977] RSP: 0018:ffffb7a307417dd8 EFLAGS: 00010207
[ 666.608977] RSP: 0018:ffffb7a307417dd8 EFLAGS: 00010207
[ 666.609499] RAX: 0189b9f754000c00 RBX: 627269760003000b RCX: 0000000000000002
[ 666.609499] RAX: 0189b9f754000c00 RBX: 627269760003000b RCX: 0000000000000002
[ 666.610022] RDX: 00005fee80000000 RSI: 000d000800003072 RDI: 627269760003000b
[ 666.610022] RDX: 00005fee80000000 RSI: 000d000800003072 RDI: 627269760003000b
[ 666.610537] RBP: ffffa0305a1f4000 R08: 0000000000000000 R09: ffffffff9b39bb60
[ 666.610537] RBP: ffffa0305a1f4000 R08: 0000000000000000 R09: ffffffff9b39bb60
[ 666.611048] R10: 00000000f19fdc01 R11: ffffa030f19fc800 R12: ffffffffc0c6e912
[ 666.611048] R10: 00000000f19fdc01 R11: ffffa030f19fc800 R12: ffffffffc0c6e912
[ 666.611556] R13: ffffa030f7250000 R14: ffffa0305a1f4018 R15: ffffa0305a1f3080
[ 666.611556] R13: ffffa030f7250000 R14: ffffa0305a1f4018 R15: ffffa0305a1f3080
[ 666.612065] ? nvme_rdma_free_ring.constprop.66+0x52/0x90 [nvme_rdma]
[ 666.612065] ? nvme_rdma_free_ring.constprop.66+0x52/0x90 [nvme_rdma]
[ 666.612575] ? unmap_single+0x20/0x20
[ 666.612575] ? unmap_single+0x20/0x20
[ 666.613080] nvme_rdma_free_ring.constprop.66+0x52/0x90 [nvme_rdma]
[ 666.613080] nvme_rdma_free_ring.constprop.66+0x52/0x90 [nvme_rdma]
[ 666.613598] nvme_rdma_destroy_queue_ib+0x4f/0x70 [nvme_rdma]
[ 666.613598] nvme_rdma_destroy_queue_ib+0x4f/0x70 [nvme_rdma]
[ 666.614120] nvme_rdma_free_queue+0x36/0xa0 [nvme_rdma]
[ 666.614120] nvme_rdma_free_queue+0x36/0xa0 [nvme_rdma]
[ 666.614645] nvme_rdma_error_recovery_work+0x7a/0xc0 [nvme_rdma]
[ 666.614645] nvme_rdma_error_recovery_work+0x7a/0xc0 [nvme_rdma]
[ 666.615173] process_one_work+0x141/0x340
[ 666.615173] process_one_work+0x141/0x340
[ 666.615690] worker_thread+0x47/0x3e0
[ 666.615690] worker_thread+0x47/0x3e0
[ 666.616200] kthread+0xf5/0x130
[ 666.616200] kthread+0xf5/0x130
[ 666.616704] ? rescuer_thread+0x380/0x380
[ 666.616704] ? rescuer_thread+0x380/0x380
[ 666.617212] ? kthread_associate_blkcg+0x90/0x90
[ 666.617212] ? kthread_associate_blkcg+0x90/0x90
[ 666.617715] ? kthread_associate_blkcg+0x90/0x90
[ 666.617715] ? kthread_associate_blkcg+0x90/0x90
[ 666.618217] ret_from_fork+0x35/0x40
[ 666.618217] ret_from_fork+0x35/0x40
[ 666.618716] Code: ff 80 8b 9c 08 00 00 04 e9 2b ff ff ff 0f ff e9 c7 fe ff ff f7 83 84 00 00 00 fd ff ff ff 0f 84 d1 fe ff ff 0f ff e9 ca fe ff ff <0f> ff e9 d9 fe ff ff 0f 1f 44 00 00 0f 1f 44 00 00 41 55 49 89
[ 666.618716] Code: ff 80 8b 9c 08 00 00 04 e9 2b ff ff ff 0f ff e9 c7 fe ff ff f7 83 84 00 00 00 fd ff ff ff 0f 84 d1 fe ff ff 0f ff e9 ca fe ff ff <0f> ff e9 d9 fe ff ff 0f 1f 44 00 00 0f 1f 44 00 00 41 55 49 89
[ 666.619811] ---[ end trace a1adaa28eb8d119a ]---
[ 666.619811] ---[ end trace a1adaa28eb8d119a ]---
--
To unsubscribe from this list: send the line "unsubscribe linux-rdma" in
the body of a message to majordomo@xxxxxxxxxxxxxxx
More majordomo info at http://vger.kernel.org/majordomo-info.html
