Hi all!
We have a problem with ISCSI LIO Target. We mount rbd image to Ubuntu Server machine and further export it to VMware ESXi host by ISCSI Target LIO (i.e. this machine is ceph-iscsi converter for VMware). It works fine, but after 2-3 days of working this machine hangs and therefore iscsi path falls off. Sometimes it may result in hanging whole ESXi host.
This is log of this ISCSI LIO target before hanging:
root@is-k13bi32e2s6vdi-002:/tmp# more /var/log/syslog.1
Feb 3 13:17:01 is-k13bi32e2s6vdi-002 CRON[10237]: (root) CMD ( cd / && run-parts --report /etc/cron.hourly)
Feb 3 13:25:01 is-k13bi32e2s6vdi-002 CRON[10242]: (root) CMD (command -v debian-sa1 > /dev/null && debian-sa1 1 1)
Feb 3 13:35:01 is-k13bi32e2s6vdi-002 CRON[10247]: (root) CMD (command -v debian-sa1 > /dev/null && debian-sa1 1 1)
Feb 3 13:45:01 is-k13bi32e2s6vdi-002 CRON[10252]: (root) CMD (command -v debian-sa1 > /dev/null && debian-sa1 1 1)
Feb 3 13:55:01 is-k13bi32e2s6vdi-002 CRON[10258]: (root) CMD (command -v debian-sa1 > /dev/null && debian-sa1 1 1)
Feb 3 14:02:48 is-k13bi32e2s6vdi-002 kernel: [699523.553713] Detected MISCOMPARE for addr: ffff88007989d000 buf: ffff88007b1ac800
Feb 3 14:02:48 is-k13bi32e2s6vdi-002 kernel: [699523.553969] Target/iblock: Send MISCOMPARE check condition and sense
Feb 3 14:05:01 is-k13bi32e2s6vdi-002 CRON[10263]: (root) CMD (command -v debian-sa1 > /dev/null && debian-sa1 1 1)
Feb 3 14:05:17 is-k13bi32e2s6vdi-002 kernel: [699672.627202] ABORT_TASK: Found referenced iSCSI task_tag: 5216104
Feb 3 14:05:17 is-k13bi32e2s6vdi-002 kernel: [699672.627377] ABORT_TASK: ref_tag: 5216104 already complete, skipping
Feb 3 14:05:17 is-k13bi32e2s6vdi-002 kernel: [699672.627536] ABORT_TASK: Sending TMR_TASK_DOES_NOT_EXIST for ref_tag: 5216104
Feb 3 14:05:28 is-k13bi32e2s6vdi-002 kernel: [699683.926031] ABORT_TASK: Found referenced iSCSI task_tag: 5216282
Feb 3 14:05:56 is-k13bi32e2s6vdi-002 kernel: [699712.490630] ABORT_TASK: Sending TMR_TASK_DOES_NOT_EXIST for ref_tag: 5216297
Feb 3 14:05:56 is-k13bi32e2s6vdi-002 kernel: [699712.490808] ABORT_TASK: Found referenced iSCSI task_tag: 5216298
Feb 3 14:07:24 is-k13bi32e2s6vdi-002 kernel: [699800.241198] ABORT_TASK: Sending TMR_FUNCTION_COMPLETE for ref_tag: 5216364
Feb 3 14:07:24 is-k13bi32e2s6vdi-002 kernel: [699800.241397] ABORT_TASK: Sending TMR_TASK_DOES_NOT_EXIST for ref_tag: 5216363
Feb 3 14:07:24 is-k13bi32e2s6vdi-002 kernel: [699800.241627] ABORT_TASK: Sending TMR_TASK_DOES_NOT_EXIST for ref_tag: 5216365
Feb 3 14:07:51 is-k13bi32e2s6vdi-002 kernel: [699827.561155] ABORT_TASK: Found referenced iSCSI task_tag: 5216413
Feb 3 14:07:51 is-k13bi32e2s6vdi-002 kernel: [699827.561327] ABORT_TASK: ref_tag: 5216413 already complete, skipping
Feb 3 14:07:51 is-k13bi32e2s6vdi-002 kernel: [699827.561486] ABORT_TASK: Sending TMR_TASK_DOES_NOT_EXIST for ref_tag: 5216413
Feb 3 14:07:52 is-k13bi32e2s6vdi-002 kernel: [699827.948992] TARGET_CORE[iSCSI]: Detected NON_EXISTENT_LUN Access for 0x000000ed
Feb 3 14:07:52 is-k13bi32e2s6vdi-002 kernel: [699827.952995] TARGET_CORE[iSCSI]: Detected NON_EXISTENT_LUN Access for 0x000000f6
Feb 3 14:07:52 is-k13bi32e2s6vdi-002 kernel: [699827.953428] TARGET_CORE[iSCSI]: Detected NON_EXISTENT_LUN Access for 0x000000f7
Feb 3 14:07:52 is-k13bi32e2s6vdi-002 kernel: [699827.953801] TARGET_CORE[iSCSI]: Detected NON_EXISTENT_LUN Access for 0x000000f8
Feb 3 14:07:52 is-k13bi32e2s6vdi-002 kernel: [699827.954240] TARGET_CORE[iSCSI]: Detected NON_EXISTENT_LUN Access for 0x000000f9
Feb 3 14:07:52 is-k13bi32e2s6vdi-002 kernel: [699827.954820] TARGET_CORE[iSCSI]: Detected NON_EXISTENT_LUN Access for 0x000000fa
Feb 3 14:07:52 is-k13bi32e2s6vdi-002 kernel: [699827.955252] TARGET_CORE[iSCSI]: Detected NON_EXISTENT_LUN Access for 0x000000fb
Feb 3 14:07:52 is-k13bi32e2s6vdi-002 kernel: [699827.955683] TARGET_CORE[iSCSI]: Detected NON_EXISTENT_LUN Access for 0x000000fc
Feb 3 14:07:52 is-k13bi32e2s6vdi-002 kernel: [699827.956119] TARGET_CORE[iSCSI]: Detected NON_EXISTENT_LUN Access for 0x000000fd
Feb 3 14:07:52 is-k13bi32e2s6vdi-002 kernel: [699827.956551] TARGET_CORE[iSCSI]: Detected NON_EXISTENT_LUN Access for 0x000000fe
Feb 3 14:07:52 is-k13bi32e2s6vdi-002 kernel: [699827.956979] TARGET_CORE[iSCSI]: Detected NON_EXISTENT_LUN Access for 0x000000ff
Feb 3 14:09:20 is-k13bi32e2s6vdi-002 kernel: [699915.993867] ABORT_TASK: Found referenced iSCSI task_tag: 5216771
Feb 3 14:11:20 is-k13bi32e2s6vdi-002 kernel: [700036.344663] ABORT_TASK: Sending TMR_FUNCTION_COMPLETE for ref_tag: 5216886
Feb 3 14:11:20 is-k13bi32e2s6vdi-002 kernel: [700036.344836] ABORT_TASK: Found referenced iSCSI task_tag: 5216892
Feb 3 14:11:20 is-k13bi32e2s6vdi-002 kernel: [700036.344991] ABORT_TASK: Sending TMR_FUNCTION_COMPLETE for ref_tag: 5216892
Feb 3 14:11:55 is-k13bi32e2s6vdi-002 kernel: [700071.279185] ABORT_TASK: Found referenced iSCSI task_tag: 5216923
Feb 3 14:11:55 is-k13bi32e2s6vdi-002 kernel: [700071.284945] ABORT_TASK: Sending TMR_FUNCTION_COMPLETE for ref_tag: 5216923
Feb 3 14:11:55 is-k13bi32e2s6vdi-002 kernel: [700071.285144] ABORT_TASK: Sending TMR_TASK_DOES_NOT_EXIST for ref_tag: 5216920
Feb 3 14:12:08 is-k13bi32e2s6vdi-002 kernel: [700084.905276] ABORT_TASK: Found referenced iSCSI task_tag: 5216948
Feb 3 14:12:08 is-k13bi32e2s6vdi-002 kernel: [700084.905460] ABORT_TASK: ref_tag: 5216948 already complete, skipping
Feb 3 14:12:08 is-k13bi32e2s6vdi-002 kernel: [700084.905684] ABORT_TASK: Sending TMR_TASK_DOES_NOT_EXIST for ref_tag: 5216948
Feb 3 14:12:25 is-k13bi32e2s6vdi-002 kernel: [700100.974615] ABORT_TASK: Found referenced iSCSI task_tag: 5216965
Feb 3 14:12:25 is-k13bi32e2s6vdi-002 kernel: [700100.974789] ABORT_TASK: ref_tag: 5216965 already complete, skipping
Feb 3 14:12:25 is-k13bi32e2s6vdi-002 kernel: [700100.974947] ABORT_TASK: Sending TMR_TASK_DOES_NOT_EXIST for ref_tag: 5216965
Feb 3 14:13:08 is-k13bi32e2s6vdi-002 kernel: [700144.799941] ABORT_TASK: Found referenced iSCSI task_tag: 5217457
Feb 3 14:13:08 is-k13bi32e2s6vdi-002 kernel: [700144.800120] ABORT_TASK: Sending TMR_FUNCTION_COMPLETE for ref_tag: 5217457
Feb 3 14:13:08 is-k13bi32e2s6vdi-002 kernel: [700144.800360] ABORT_TASK: Found referenced iSCSI task_tag: 5217460
Feb 3 14:13:08 is-k13bi32e2s6vdi-002 kernel: [700144.809765] ABORT_TASK: Sending TMR_FUNCTION_COMPLETE for ref_tag: 5217460
Feb 3 14:13:08 is-k13bi32e2s6vdi-002 kernel: [700144.809975] ABORT_TASK: Sending TMR_TASK_DOES_NOT_EXIST for ref_tag: 5217457
Feb 3 14:13:08 is-k13bi32e2s6vdi-002 kernel: [700144.810152] ABORT_TASK: Found referenced iSCSI task_tag: 5217467
Feb 3 14:13:08 is-k13bi32e2s6vdi-002 kernel: [700144.814473] ABORT_TASK: Sending TMR_FUNCTION_COMPLETE for ref_tag: 5217467
Feb 3 14:13:22 is-k13bi32e2s6vdi-002 kernel: [700158.879097] TARGET_CORE[iSCSI]: Detected NON_EXISTENT_LUN Access for 0x000000f2
Feb 3 14:13:22 is-k13bi32e2s6vdi-002 kernel: [700158.879607] TARGET_CORE[iSCSI]: Detected NON_EXISTENT_LUN Access for 0x000000f3
Feb 3 14:13:22 is-k13bi32e2s6vdi-002 kernel: [700158.880495] TARGET_CORE[iSCSI]: Detected NON_EXISTENT_LUN Access for 0x000000f4
Feb 3 14:13:22 is-k13bi32e2s6vdi-002 kernel: [700158.881152] TARGET_CORE[iSCSI]: Detected NON_EXISTENT_LUN Access for 0x000000f5
Feb 3 14:13:22 is-k13bi32e2s6vdi-002 kernel: [700158.881657] TARGET_CORE[iSCSI]: Detected NON_EXISTENT_LUN Access for 0x000000f6
Feb 3 14:13:22 is-k13bi32e2s6vdi-002 kernel: [700158.882152] TARGET_CORE[iSCSI]: Detected NON_EXISTENT_LUN Access for 0x000000f7
Feb 3 14:13:22 is-k13bi32e2s6vdi-002 kernel: [700158.882595] TARGET_CORE[iSCSI]: Detected NON_EXISTENT_LUN Access for 0x000000f8
Feb 3 14:13:22 is-k13bi32e2s6vdi-002 kernel: [700158.883043] TARGET_CORE[iSCSI]: Detected NON_EXISTENT_LUN Access for 0x000000f9
Feb 3 14:13:22 is-k13bi32e2s6vdi-002 kernel: [700158.883465] TARGET_CORE[iSCSI]: Detected NON_EXISTENT_LUN Access for 0x000000fa
Feb 3 14:13:22 is-k13bi32e2s6vdi-002 kernel: [700158.884088] TARGET_CORE[iSCSI]: Detected NON_EXISTENT_LUN Access for 0x000000fb
Feb 3 14:13:22 is-k13bi32e2s6vdi-002 kernel: [700158.887319] TARGET_CORE[iSCSI]: Detected NON_EXISTENT_LUN Access for 0x000000fc
Feb 3 14:13:22 is-k13bi32e2s6vdi-002 kernel: [700158.888113] TARGET_CORE[iSCSI]: Detected NON_EXISTENT_LUN Access for 0x000000fd
Feb 3 14:13:22 is-k13bi32e2s6vdi-002 kernel: [700158.888566] TARGET_CORE[iSCSI]: Detected NON_EXISTENT_LUN Access for 0x000000fe
Feb 3 14:13:22 is-k13bi32e2s6vdi-002 kernel: [700158.889006] TARGET_CORE[iSCSI]: Detected NON_EXISTENT_LUN Access for 0x000000ff
Feb 3 14:13:52 is-k13bi32e2s6vdi-002 kernel: [700188.708170] ABORT_TASK: Found referenced iSCSI task_tag: 5217864
Feb 3 14:13:52 is-k13bi32e2s6vdi-002 kernel: [700188.708374] ABORT_TASK: Sending TMR_FUNCTION_COMPLETE for ref_tag: 5217864
Feb 3 14:13:52 is-k13bi32e2s6vdi-002 kernel: [700188.708552] ABORT_TASK: Found referenced iSCSI task_tag: 5217872
Feb 3 14:13:52 is-k13bi32e2s6vdi-002 kernel: [700188.722018] ABORT_TASK: Sending TMR_FUNCTION_COMPLETE for ref_tag: 5217872
Feb 3 14:15:01 is-k13bi32e2s6vdi-002 CRON[10269]: (root) CMD (command -v debian-sa1 > /dev/null && debian-sa1 1 1)
Feb 3 14:17:01 is-k13bi32e2s6vdi-002 CRON[10272]: (root) CMD ( cd / && run-parts --report /etc/cron.hourly)
Feb 3 14:17:36 is-k13bi32e2s6vdi-002 kernel: [700413.091158] ABORT_TASK: Sending TMR_TASK_DOES_NOT_EXIST for ref_tag: 5231082
Feb 3 14:17:36 is-k13bi32e2s6vdi-002 kernel: [700413.091364] ABORT_TASK: Found referenced iSCSI task_tag: 5231086
Feb 3 14:17:36 is-k13bi32e2s6vdi-002 kernel: [700413.099220] ABORT_TASK: Sending TMR_FUNCTION_COMPLETE for ref_tag: 5231086
Feb 3 14:18:06 is-k13bi32e2s6vdi-002 kernel: [700442.562756] ABORT_TASK: Sending TMR_TASK_DOES_NOT_EXIST for ref_tag: 5231103
Feb 3 14:18:06 is-k13bi32e2s6vdi-002 kernel: [700442.562976] ABORT_TASK: Found referenced iSCSI task_tag: 5231106
Feb 3 14:18:06 is-k13bi32e2s6vdi-002 kernel: [700442.563131] ABORT_TASK: ref_tag: 5231106 already complete, skipping
Feb 3 14:18:06 is-k13bi32e2s6vdi-002 kernel: [700442.563290] ABORT_TASK: Sending TMR_TASK_DOES_NOT_EXIST for ref_tag: 5231106
Feb 3 14:18:06 is-k13bi32e2s6vdi-002 kernel: [700443.032553] TARGET_CORE[iSCSI]: Detected NON_EXISTENT_LUN Access for 0x000000f4
Feb 3 14:18:06 is-k13bi32e2s6vdi-002 kernel: [700443.033004] TARGET_CORE[iSCSI]: Detected NON_EXISTENT_LUN Access for 0x000000f5
Feb 3 14:18:06 is-k13bi32e2s6vdi-002 kernel: [700443.033544] TARGET_CORE[iSCSI]: Detected NON_EXISTENT_LUN Access for 0x000000f6
Feb 3 14:18:06 is-k13bi32e2s6vdi-002 kernel: [700443.033997] TARGET_CORE[iSCSI]: Detected NON_EXISTENT_LUN Access for 0x000000f7
Feb 3 14:18:06 is-k13bi32e2s6vdi-002 kernel: [700443.034831] TARGET_CORE[iSCSI]: Detected NON_EXISTENT_LUN Access for 0x000000f8
Feb 3 14:18:06 is-k13bi32e2s6vdi-002 kernel: [700443.035504] TARGET_CORE[iSCSI]: Detected NON_EXISTENT_LUN Access for 0x000000f9
Feb 3 14:18:06 is-k13bi32e2s6vdi-002 kernel: [700443.035868] TARGET_CORE[iSCSI]: Detected NON_EXISTENT_LUN Access for 0x000000fa
Feb 3 14:18:06 is-k13bi32e2s6vdi-002 kernel: [700443.036325] TARGET_CORE[iSCSI]: Detected NON_EXISTENT_LUN Access for 0x000000fb
Feb 3 14:18:06 is-k13bi32e2s6vdi-002 kernel: [700443.036810] TARGET_CORE[iSCSI]: Detected NON_EXISTENT_LUN Access for 0x000000fc
Feb 3 14:18:06 is-k13bi32e2s6vdi-002 kernel: [700443.037386] TARGET_CORE[iSCSI]: Detected NON_EXISTENT_LUN Access for 0x000000fd
Feb 3 14:18:06 is-k13bi32e2s6vdi-002 kernel: [700443.037858] TARGET_CORE[iSCSI]: Detected NON_EXISTENT_LUN Access for 0x000000fe
Feb 3 14:18:06 is-k13bi32e2s6vdi-002 kernel: [700443.038273] TARGET_CORE[iSCSI]: Detected NON_EXISTENT_LUN Access for 0x000000ff
Feb 3 14:20:19 is-k13bi32e2s6vdi-002 kernel: [700576.307787] ABORT_TASK: Found referenced iSCSI task_tag: 5237788
Feb 3 14:20:19 is-k13bi32e2s6vdi-002 kernel: [700576.316830] ABORT_TASK: Sending TMR_FUNCTION_COMPLETE for ref_tag: 5237788
Feb 3 14:20:19 is-k13bi32e2s6vdi-002 kernel: [700576.317030] ABORT_TASK: Sending TMR_TASK_DOES_NOT_EXIST for ref_tag: 5237780
Feb 3 14:21:18 is-k13bi32e2s6vdi-002 kernel: [700635.290176] ABORT_TASK: Found referenced iSCSI task_tag: 5238229
Feb 3 14:21:18 is-k13bi32e2s6vdi-002 kernel: [700635.296050] ABORT_TASK: Sending TMR_FUNCTION_COMPLETE for ref_tag: 5238229
Feb 3 14:21:18 is-k13bi32e2s6vdi-002 kernel: [700635.296232] ABORT_TASK: Sending TMR_TASK_DOES_NOT_EXIST for ref_tag: 5238228
Feb 3 14:21:18 is-k13bi32e2s6vdi-002 kernel: [700635.296460] ABORT_TASK: Sending TMR_TASK_DOES_NOT_EXIST for ref_tag: 5238229
Feb 3 14:22:02 is-k13bi32e2s6vdi-002 kernel: [700679.137473] ABORT_TASK: Found referenced iSCSI task_tag: 5238292
Feb 3 14:22:02 is-k13bi32e2s6vdi-002 kernel: [700679.137654] ABORT_TASK: Sending TMR_FUNCTION_COMPLETE for ref_tag: 5238292
Feb 3 14:22:02 is-k13bi32e2s6vdi-002 kernel: [700679.137826] ABORT_TASK: Found referenced iSCSI task_tag: 5238298
Feb 3 14:22:02 is-k13bi32e2s6vdi-002 kernel: [700679.148727] ABORT_TASK: Sending TMR_FUNCTION_COMPLETE for ref_tag: 5238298
Feb 3 14:22:02 is-k13bi32e2s6vdi-002 kernel: [700679.148929] ABORT_TASK: Sending TMR_TASK_DOES_NOT_EXIST for ref_tag: 5238296
Feb 3 14:22:17 is-k13bi32e2s6vdi-002 kernel: [700693.927187] iSCSI Login timeout on Network Portal 10.1.1.7:3260
Feb 3 14:22:30 is-k13bi32e2s6vdi-002 kernel: [700706.613521] NMI watchdog: BUG: soft lockup - CPU#1 stuck for 22s! [iscsi_ttx:2002]
Feb 3 14:22:30 is-k13bi32e2s6vdi-002 kernel: [700706.613764] Modules linked in: ib_srpt(E) ib_cm(E) ib_sa(E) ib_mad(E) ib_core(E) ib_addr(E) tcm_qla2xxx(E) qla2xxx(E) tcm_loop(
E) tcm_fc(E) libfc(E) scsi_transport_fc(E) iscsi_target_mod(E) target_core_pscsi(E) target_core_file(E) target_core_iblock(E) target_core_mod(E) configfs(E) rbd(E) libceph(E) li
bcrc32c(E) ppdev(E) coretemp(E) microcode(E) serio_raw(E) i2c_piix4(E) shpchp(E) parport_pc(E) lp(E) parport(E) psmouse(E) floppy(E) vmw_pvscsi(E) vmxnet3(E)
Feb 3 14:22:30 is-k13bi32e2s6vdi-002 kernel: [700706.614912] irq event stamp: 24644920
Feb 3 14:22:30 is-k13bi32e2s6vdi-002 kernel: [700706.615021] hardirqs last enabled at (24644919): [<ffffffff8105e5bd>] __local_bh_enable_ip+0x6d/0xd0
Feb 3 14:22:30 is-k13bi32e2s6vdi-002 kernel: [700706.615307] hardirqs last disabled at (24644920): [<ffffffff8173c8b7>] _raw_spin_lock_irq+0x17/0x50
Feb 3 14:22:30 is-k13bi32e2s6vdi-002 kernel: [700706.615560] softirqs last enabled at (24644918): [<ffffffffa01792d2>] iscsit_conn_all_queues_empty+0x72/0x90 [iscsi_target_mod]
Feb 3 14:22:30 is-k13bi32e2s6vdi-002 kernel: [700706.615904] softirqs last disabled at (24644916): [<ffffffffa01792b8>] iscsit_conn_all_queues_empty+0x58/0x90 [iscsi_target_mod]
Feb 3 14:22:30 is-k13bi32e2s6vdi-002 kernel: [700706.616212] CPU: 1 PID: 2002 Comm: iscsi_ttx Tainted: G E 3.18.0-ceph #1
Feb 3 14:22:30 is-k13bi32e2s6vdi-002 kernel: [700706.616429] Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 07/09/2012
Feb 3 14:22:30 is-k13bi32e2s6vdi-002 kernel: [700706.616705] task: ffff88007a9921d0 ti: ffff88007a99c000 task.ti: ffff88007a99c000
Feb 3 14:22:30 is-k13bi32e2s6vdi-002 kernel: [700706.616916] RIP: 0010:[<ffffffff8173cf91>] [<ffffffff8173cf91>] _raw_spin_unlock_irqrestore+0x41/0x70
Feb 3 14:22:30 is-k13bi32e2s6vdi-002 kernel: [700706.617173] RSP: 0018:ffff88007a99fc78 EFLAGS: 00000282
Feb 3 14:22:30 is-k13bi32e2s6vdi-002 kernel: [700706.617311] RAX: 0000000000000000 RBX: 0000000000000001 RCX: 0000000047e347e2
Feb 3 14:22:30 is-k13bi32e2s6vdi-002 kernel: [700706.617516] RDX: 00000000000047e3 RSI: 0000000000000001 RDI: ffffffff8173cf8f
Feb 3 14:22:30 is-k13bi32e2s6vdi-002 kernel: [700706.617720] RBP: ffff88007a99fc88 R08: 0000000000000001 R09: 0000000000000000
Feb 3 14:22:30 is-k13bi32e2s6vdi-002 kernel: [700706.617924] R10: 0000000000000000 R11: 0000000000000000 R12: ffffffffa01137bb
Feb 3 14:22:30 is-k13bi32e2s6vdi-002 kernel: [700706.618128] R13: 0000000000000000 R14: 0000000000000046 R15: ffff88007a99fc58
Feb 3 14:22:30 is-k13bi32e2s6vdi-002 kernel: [700706.618445] FS: 0000000000000000(0000) GS:ffff88007fd00000(0000) knlGS:0000000000000000
Feb 3 14:22:30 is-k13bi32e2s6vdi-002 kernel: [700706.618669] CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b
Feb 3 14:22:30 is-k13bi32e2s6vdi-002 kernel: [700706.618817] CR2: 00007f30e19f2000 CR3: 0000000036bfa000 CR4: 00000000000007e0
Feb 3 14:22:30 is-k13bi32e2s6vdi-002 kernel: [700706.619095] Stack:
Feb 3 14:22:30 is-k13bi32e2s6vdi-002 kernel: [700706.619167] ffff88007b6b6330 ffff88007b6b6480 ffff88007a99fcc8 ffffffffa011384b
Feb 3 14:22:30 is-k13bi32e2s6vdi-002 kernel: [700706.619388] ffff88007a99fcb8 ffffffff8173cf09 0000000000000001 ffff88007b6b6330
Feb 3 14:22:30 is-k13bi32e2s6vdi-002 kernel: [700706.619608] 0000000000000001 0000000000000001 ffff88007a99fcf8 ffffffffa0115285
Feb 3 14:22:30 is-k13bi32e2s6vdi-002 kernel: [700706.619830] Call Trace:
Feb 3 14:22:30 is-k13bi32e2s6vdi-002 kernel: [700706.619953] [<ffffffffa011384b>] transport_wait_for_tasks+0xbb/0x150 [target_core_mod]
Feb 3 14:22:30 is-k13bi32e2s6vdi-002 kernel: [700706.620181] [<ffffffff8173cf09>] ? _raw_spin_unlock_bh+0x39/0x40
Feb 3 14:22:30 is-k13bi32e2s6vdi-002 kernel: [700706.620346] [<ffffffffa0115285>] transport_generic_free_cmd+0xc5/0xe0 [target_core_mod]
Feb 3 14:22:30 is-k13bi32e2s6vdi-002 kernel: [700706.620578] [<ffffffffa0179756>] iscsit_free_cmd+0x96/0x160 [iscsi_target_mod]
Feb 3 14:22:30 is-k13bi32e2s6vdi-002 kernel: [700706.620798] [<ffffffffa0182574>] iscsit_close_connection+0x3c4/0x730 [iscsi_target_mod]
Feb 3 14:22:30 is-k13bi32e2s6vdi-002 kernel: [700706.621029] [<ffffffffa016e3ab>] ? iscsit_take_action_for_connection_exit+0x5b/0x110 [iscsi_target_mod]
Feb 3 14:22:30 is-k13bi32e2s6vdi-002 kernel: [700706.621293] [<ffffffffa016e3d3>] iscsit_take_action_for_connection_exit+0x83/0x110 [iscsi_target_mod]
Feb 3 14:22:30 is-k13bi32e2s6vdi-002 kernel: [700706.621553] [<ffffffffa017f720>] iscsi_target_tx_thread+0x150/0x210 [iscsi_target_mod]
Feb 3 14:22:30 is-k13bi32e2s6vdi-002 kernel: [700706.621781] [<ffffffff8109c9b0>] ? prepare_to_wait_event+0x100/0x100
Feb 3 14:22:30 is-k13bi32e2s6vdi-002 kernel: [700706.621951] [<ffffffffa017f5d0>] ? iscsit_thread_get_cpumask+0xc0/0xc0 [iscsi_target_mod]
Feb 3 14:22:30 is-k13bi32e2s6vdi-002 kernel: [700706.622182] [<ffffffff8107a664>] kthread+0xe4/0x100
Feb 3 14:22:30 is-k13bi32e2s6vdi-002 kernel: [700706.622315] [<ffffffff8107a580>] ? flush_kthread_worker+0xf0/0xf0
Feb 3 14:22:30 is-k13bi32e2s6vdi-002 kernel: [700706.622473] [<ffffffff8173d62c>] ret_from_fork+0x7c/0xb0
Feb 3 14:22:30 is-k13bi32e2s6vdi-002 kernel: [700706.622615] [<ffffffff8107a580>] ? flush_kthread_worker+0xf0/0xf0
Feb 3 14:22:30 is-k13bi32e2s6vdi-002 kernel: [700706.622771] Code: 89 fc 48 8d 7f 18 48 89 5d f0 48 89 f3 be 01 00 00 00 e8 33 bc 96 ff 4c 89 e7 e8 2b f1 96 ff f6 c7 02 74 1e e
8 61 c9 96 ff 53 9d <65> ff 0c 25 a0 aa 00 00 48 8b 5d f0 4c 8b 65 f8 c9 c3 0f 1f 44
Feb 3 14:22:58 is-k13bi32e2s6vdi-002 kernel: [700734.636328] NMI watchdog: BUG: soft lockup - CPU#1 stuck for 22s! [iscsi_ttx:2002]
Feb 3 14:22:58 is-k13bi32e2s6vdi-002 kernel: [700734.636576] Modules linked in: ib_srpt(E) ib_cm(E) ib_sa(E) ib_mad(E) ib_core(E) ib_addr(E) tcm_qla2xxx(E) qla2xxx(E) tcm_loop(
E) tcm_fc(E) libfc(E) scsi_transport_fc(E) iscsi_target_mod(E) target_core_pscsi(E) target_core_file(E) target_core_iblock(E) target_core_mod(E) configfs(E) rbd(E) libceph(E) li
bcrc32c(E) ppdev(E) coretemp(E) microcode(E) serio_raw(E) i2c_piix4(E) shpchp(E) parport_pc(E) lp(E) parport(E) psmouse(E) floppy(E) vmw_pvscsi(E) vmxnet3(E)
Feb 3 14:22:58 is-k13bi32e2s6vdi-002 kernel: [700734.637722] irq event stamp: 24644920
Feb 3 14:22:58 is-k13bi32e2s6vdi-002 kernel: [700734.637831] hardirqs last enabled at (24644919): [<ffffffff8105e5bd>] __local_bh_enable_ip+0x6d/0xd0
Feb 3 14:22:58 is-k13bi32e2s6vdi-002 kernel: [700734.638114] hardirqs last disabled at (24644920): [<ffffffff8173c8b7>] _raw_spin_lock_irq+0x17/0x50
Feb 3 14:22:58 is-k13bi32e2s6vdi-002 kernel: [700734.638364] softirqs last enabled at (24644918): [<ffffffffa01792d2>] iscsit_conn_all_queues_empty+0x72/0x90 [iscsi_target_mod]
Feb 3 14:22:58 is-k13bi32e2s6vdi-002 kernel: [700734.638682] softirqs last disabled at (24644916): [<ffffffffa01792b8>] iscsit_conn_all_queues_empty+0x58/0x90 [iscsi_target_mod]
Feb 3 14:22:58 is-k13bi32e2s6vdi-002 kernel: [700734.638991] CPU: 1 PID: 2002 Comm: iscsi_ttx Tainted: G EL 3.18.0-ceph #1
Feb 3 14:22:58 is-k13bi32e2s6vdi-002 kernel: [700734.639207] Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 07/09/2012
Feb 3 14:22:58 is-k13bi32e2s6vdi-002 kernel: [700734.639484] task: ffff88007a9921d0 ti: ffff88007a99c000 task.ti: ffff88007a99c000
Feb 3 14:22:58 is-k13bi32e2s6vdi-002 kernel: [700734.639695] RIP: 0010:[<ffffffff810a8bb0>] [<ffffffff810a8bb0>] lock_release+0x0/0x250
Feb 3 14:22:58 is-k13bi32e2s6vdi-002 kernel: [700734.639935] RSP: 0018:ffff88007a99fca0 EFLAGS: 00000292
Feb 3 14:22:58 is-k13bi32e2s6vdi-002 kernel: [700734.640075] RAX: 0000000000000000 RBX: 0000000000000246 RCX: 0000000045e945e8
Feb 3 14:22:58 is-k13bi32e2s6vdi-002 kernel: [700734.640280] RDX: ffffffffa0179688 RSI: 0000000000000001 RDI: ffff880079eaa738
Feb 3 14:22:58 is-k13bi32e2s6vdi-002 kernel: [700734.640485] RBP: ffff88007a99fcb8 R08: 0000000000000001 R09: 0000000000000000
Feb 3 14:22:58 is-k13bi32e2s6vdi-002 kernel: [700734.640688] R10: 0000000000000000 R11: 0000000000000000 R12: ffffffffa0179537
Feb 3 14:22:58 is-k13bi32e2s6vdi-002 kernel: [700734.640892] R13: 0000000000000000 R14: 0000000000000246 R15: ffff88007a99fc88
Feb 3 14:22:58 is-k13bi32e2s6vdi-002 kernel: [700734.641148] FS: 0000000000000000(0000) GS:ffff88007fd00000(0000) knlGS:0000000000000000
Feb 3 14:22:58 is-k13bi32e2s6vdi-002 kernel: [700734.641372] CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b
Feb 3 14:22:58 is-k13bi32e2s6vdi-002 kernel: [700734.641520] CR2: 00007f30e19f2000 CR3: 0000000036bfa000 CR4: 00000000000007e0
Feb 3 14:22:58 is-k13bi32e2s6vdi-002 kernel: [700734.641768] Stack:
Feb 3 14:22:58 is-k13bi32e2s6vdi-002 kernel: [700734.641840] ffffffff8173cef3 0000000000000001 ffff88007b6b6000 ffff88007a99fcf8
Feb 3 14:22:58 is-k13bi32e2s6vdi-002 kernel: [700734.642060] ffffffffa0179688 ffff88007a99fcf8 ffff88007b6b6000 0000000000000001
Feb 3 14:22:58 is-k13bi32e2s6vdi-002 kernel: [700734.642281] 0000000000000001 ffff88007b6b6330 ffff88007b6b6330 ffff88007a99fd38
Feb 3 14:22:58 is-k13bi32e2s6vdi-002 kernel: [700734.642501] Call Trace:
Feb 3 14:22:58 is-k13bi32e2s6vdi-002 kernel: [700734.642590] [<ffffffff8173cef3>] ? _raw_spin_unlock_bh+0x23/0x40
Feb 3 14:22:58 is-k13bi32e2s6vdi-002 kernel: [700734.642756] [<ffffffffa0179688>] __iscsit_free_cmd+0x248/0x280 [iscsi_target_mod]
Feb 3 14:22:58 is-k13bi32e2s6vdi-002 kernel: [700734.642980] [<ffffffffa017977e>] iscsit_free_cmd+0xbe/0x160 [iscsi_target_mod]
Feb 3 14:22:58 is-k13bi32e2s6vdi-002 kernel: [700734.643196] [<ffffffffa0182574>] iscsit_close_connection+0x3c4/0x730 [iscsi_target_mod]
Feb 3 14:22:58 is-k13bi32e2s6vdi-002 kernel: [700734.643427] [<ffffffffa016e3ab>] ? iscsit_take_action_for_connection_exit+0x5b/0x110 [iscsi_target_mod]
Feb 3 14:22:58 is-k13bi32e2s6vdi-002 kernel: [700734.643686] [<ffffffffa016e3d3>] iscsit_take_action_for_connection_exit+0x83/0x110 [iscsi_target_mod]
Feb 3 14:22:58 is-k13bi32e2s6vdi-002 kernel: [700734.643942] [<ffffffffa017f720>] iscsi_target_tx_thread+0x150/0x210 [iscsi_target_mod]
Feb 3 14:22:58 is-k13bi32e2s6vdi-002 kernel: [700734.644172] [<ffffffff8109c9b0>] ? prepare_to_wait_event+0x100/0x100
Feb 3 14:22:58 is-k13bi32e2s6vdi-002 kernel: [700734.644342] [<ffffffffa017f5d0>] ? iscsit_thread_get_cpumask+0xc0/0xc0 [iscsi_target_mod]
Feb 3 14:22:58 is-k13bi32e2s6vdi-002 kernel: [700734.644573] [<ffffffff8107a664>] kthread+0xe4/0x100
Feb 3 14:22:58 is-k13bi32e2s6vdi-002 kernel: [700734.644706] [<ffffffff8107a580>] ? flush_kthread_worker+0xf0/0xf0
Feb 3 14:22:58 is-k13bi32e2s6vdi-002 kernel: [700734.644864] [<ffffffff8173d62c>] ret_from_fork+0x7c/0xb0
Feb 3 14:22:58 is-k13bi32e2s6vdi-002 kernel: [700734.645005] [<ffffffff8107a580>] ? flush_kthread_worker+0xf0/0xf0
Feb 3 14:22:58 is-k13bi32e2s6vdi-002 kernel: [700734.645161] Code: c7 c2 9e 7a a7 81 be 34 0d 00 00 48 c7 c7 08 c0 a6 81 31 c0 e8 02 17 fb ff e9 c6 fe ff ff 66 66 66 66 2e 0f 1
f 84 00 00 00 00 00 <55> 65 48 8b 04 25 c0 aa 00 00 48 89 e5 48 83 ec 40 4c 89 65 e0
Feb 3 14:23:02 is-k13bi32e2s6vdi-002 kernel: [700739.204059] INFO: rcu_sched self-detected stall on CPU { 1} (t=15000 jiffies g=507862 c=507861 q=509)
Feb 3 14:23:02 is-k13bi32e2s6vdi-002 kernel: [700739.204349] Task dump for CPU 1:
Feb 3 14:23:02 is-k13bi32e2s6vdi-002 kernel: [700739.204447] iscsi_ttx R running task 0 2002 2 0x0000000c
Feb 3 14:23:02 is-k13bi32e2s6vdi-002 kernel: [700739.205044] 0000000000000002 ffff88007fd03d58 ffffffff8108762b ffffffff81087598
Feb 3 14:23:02 is-k13bi32e2s6vdi-002 kernel: [700739.205267] 00000000fe27fe26 0000000000000001 ffffffff81c54a00 ffff88007fd03d78
Feb 3 14:23:02 is-k13bi32e2s6vdi-002 kernel: [700739.205488] ffffffff8108ae6f ffffffff81c54a00 ffffffff81c54a00 ffff88007fd03da8
Feb 3 14:23:02 is-k13bi32e2s6vdi-002 kernel: [700739.205713] Call Trace:
Feb 3 14:23:02 is-k13bi32e2s6vdi-002 kernel: [700739.205798] <IRQ> [<ffffffff8108762b>] sched_show_task+0xfb/0x160
Feb 3 14:23:02 is-k13bi32e2s6vdi-002 kernel: [700739.205973] [<ffffffff81087598>] ? sched_show_task+0x68/0x160
Feb 3 14:23:02 is-k13bi32e2s6vdi-002 kernel: [700739.206124] [<ffffffff8108ae6f>] dump_cpu_task+0x3f/0x50
Feb 3 14:23:02 is-k13bi32e2s6vdi-002 kernel: [700739.206271] [<ffffffff810c392b>] rcu_dump_cpu_stacks+0x8b/0xc0
Feb 3 14:23:02 is-k13bi32e2s6vdi-002 kernel: [700739.206425] [<ffffffff810c7210>] rcu_check_callbacks+0x490/0x6e0
Feb 3 14:23:02 is-k13bi32e2s6vdi-002 kernel: [700739.206584] [<ffffffff810cc5b8>] update_process_times+0x48/0x80
Feb 3 14:23:02 is-k13bi32e2s6vdi-002 kernel: [700739.206744] [<ffffffff810dc6d3>] tick_sched_handle.isra.15+0x33/0x70
Feb 3 14:23:02 is-k13bi32e2s6vdi-002 kernel: [700739.206914] [<ffffffff810dc97c>] tick_sched_timer+0x4c/0x80
Feb 3 14:23:02 is-k13bi32e2s6vdi-002 kernel: [700739.207061] [<ffffffff810ccf4f>] __run_hrtimer+0x9f/0x2a0
Feb 3 14:23:02 is-k13bi32e2s6vdi-002 kernel: [700739.207204] [<ffffffff810dc930>] ? tick_sched_do_timer+0x40/0x40
Feb 3 14:23:02 is-k13bi32e2s6vdi-002 kernel: [700739.207360] [<ffffffff810cd7c5>] ? hrtimer_interrupt+0x75/0x260
Feb 3 14:23:02 is-k13bi32e2s6vdi-002 kernel: [700739.207514] [<ffffffff810cd857>] hrtimer_interrupt+0x107/0x260
Feb 3 14:23:02 is-k13bi32e2s6vdi-002 kernel: [700739.207676] [<ffffffff8103566b>] local_apic_timer_interrupt+0x3b/0x60
Feb 3 14:23:02 is-k13bi32e2s6vdi-002 kernel: [700739.207846] [<ffffffff81740315>] smp_apic_timer_interrupt+0x45/0x60
Feb 3 14:23:02 is-k13bi32e2s6vdi-002 kernel: [700739.208009] [<ffffffff8173e6ef>] apic_timer_interrupt+0x6f/0x80
Feb 3 14:23:02 is-k13bi32e2s6vdi-002 kernel: [700739.208162] <EOI> [<ffffffff810abf57>] ? do_raw_spin_lock+0x57/0x160
Feb 3 14:23:02 is-k13bi32e2s6vdi-002 kernel: [700739.208336] [<ffffffff8173cac7>] _raw_spin_lock_bh+0x47/0x50
Feb 3 14:23:02 is-k13bi32e2s6vdi-002 kernel: [700739.208503] [<ffffffffa017860a>] ? iscsit_free_r2ts_from_list+0x2a/0x80 [iscsi_target_mod]
Feb 3 14:23:02 is-k13bi32e2s6vdi-002 kernel: [700739.208742] [<ffffffffa017860a>] iscsit_free_r2ts_from_list+0x2a/0x80 [iscsi_target_mod]
Feb 3 14:23:02 is-k13bi32e2s6vdi-002 kernel: [700739.208979] [<ffffffffa01795dd>] __iscsit_free_cmd+0x19d/0x280 [iscsi_target_mod]
Feb 3 14:23:02 is-k13bi32e2s6vdi-002 kernel: [700739.209201] [<ffffffffa017974b>] iscsit_free_cmd+0x8b/0x160 [iscsi_target_mod]
Feb 3 14:23:02 is-k13bi32e2s6vdi-002 kernel: [700739.209416] [<ffffffffa0182574>] iscsit_close_connection+0x3c4/0x730 [iscsi_target_mod]
Feb 3 14:23:02 is-k13bi32e2s6vdi-002 kernel: [700739.209647] [<ffffffffa016e3ab>] ? iscsit_take_action_for_connection_exit+0x5b/0x110 [iscsi_target_mod]
Feb 3 14:23:02 is-k13bi32e2s6vdi-002 kernel: [700739.209913] [<ffffffffa016e3d3>] iscsit_take_action_for_connection_exit+0x83/0x110 [iscsi_target_mod]
Feb 3 14:23:02 is-k13bi32e2s6vdi-002 kernel: [700739.210168] [<ffffffffa017f720>] iscsi_target_tx_thread+0x150/0x210 [iscsi_target_mod]
Feb 3 14:23:02 is-k13bi32e2s6vdi-002 kernel: [700739.210392] [<ffffffff8109c9b0>] ? prepare_to_wait_event+0x100/0x100
Feb 3 14:23:02 is-k13bi32e2s6vdi-002 kernel: [700739.210561] [<ffffffffa017f5d0>] ? iscsit_thread_get_cpumask+0xc0/0xc0 [iscsi_target_mod]
Feb 3 14:23:02 is-k13bi32e2s6vdi-002 kernel: [700739.210791] [<ffffffff8107a664>] kthread+0xe4/0x100
Feb 3 14:23:02 is-k13bi32e2s6vdi-002 kernel: [700739.210924] [<ffffffff8107a580>] ? flush_kthread_worker+0xf0/0xf0
Feb 3 14:23:02 is-k13bi32e2s6vdi-002 kernel: [700739.211082] [<ffffffff8173d62c>] ret_from_fork+0x7c/0xb0
Feb 3 14:23:02 is-k13bi32e2s6vdi-002 kernel: [700739.211223] [<ffffffff8107a580>] ? flush_kthread_worker+0xf0/0xf0
Feb 3 14:23:30 is-k13bi32e2s6vdi-002 kernel: [700766.662388] NMI watchdog: BUG: soft lockup - CPU#1 stuck for 22s! [iscsi_ttx:2002]
Feb 3 14:23:30 is-k13bi32e2s6vdi-002 kernel: [700766.662629] Modules linked in: ib_srpt(E) ib_cm(E) ib_sa(E) ib_mad(E) ib_core(E) ib_addr(E) tcm_qla2xxx(E) qla2xxx(E) tcm_loop(
E) tcm_fc(E) libfc(E) scsi_transport_fc(E) iscsi_target_mod(E) target_core_pscsi(E) target_core_file(E) target_core_iblock(E) target_core_mod(E) configfs(E) rbd(E) libceph(E) li
bcrc32c(E) ppdev(E) coretemp(E) microcode(E) serio_raw(E) i2c_piix4(E) shpchp(E) parport_pc(E) lp(E) parport(E) psmouse(E) floppy(E) vmw_pvscsi(E) vmxnet3(E)
Feb 3 14:23:30 is-k13bi32e2s6vdi-002 kernel: [700766.663774] irq event stamp: 24644920
Feb 3 14:23:30 is-k13bi32e2s6vdi-002 kernel: [700766.663883] hardirqs last enabled at (24644919): [<ffffffff8105e5bd>] __local_bh_enable_ip+0x6d/0xd0
Feb 3 14:23:30 is-k13bi32e2s6vdi-002 kernel: [700766.664154] hardirqs last disabled at (24644920): [<ffffffff8173c8b7>] _raw_spin_lock_irq+0x17/0x50
Feb 3 14:23:30 is-k13bi32e2s6vdi-002 kernel: [700766.664403] softirqs last enabled at (24644918): [<ffffffffa01792d2>] iscsit_conn_all_queues_empty+0x72/0x90 [iscsi_target_mod]
Feb 3 14:23:30 is-k13bi32e2s6vdi-002 kernel: [700766.664720] softirqs last disabled at (24644916): [<ffffffffa01792b8>] iscsit_conn_all_queues_empty+0x58/0x90 [iscsi_target_mod]
Feb 3 14:23:30 is-k13bi32e2s6vdi-002 kernel: [700766.665029] CPU: 1 PID: 2002 Comm: iscsi_ttx Tainted: G EL 3.18.0-ceph #1
Feb 3 14:23:30 is-k13bi32e2s6vdi-002 kernel: [700766.665245] Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 07/09/2012
Feb 3 14:23:30 is-k13bi32e2s6vdi-002 kernel: [700766.665522] task: ffff88007a9921d0 ti: ffff88007a99c000 task.ti: ffff88007a99c000
Feb 3 14:23:30 is-k13bi32e2s6vdi-002 kernel: [700766.665733] RIP: 0010:[<ffffffff8105dd44>] [<ffffffff8105dd44>] __local_bh_disable_ip+0x54/0x90
Feb 3 14:23:30 is-k13bi32e2s6vdi-002 kernel: [700766.665978] RSP: 0018:ffff88007a99fce8 EFLAGS: 00000246
Feb 3 14:23:30 is-k13bi32e2s6vdi-002 kernel: [700766.666116] RAX: ffff88007a9921d0 RBX: ffffffffa0179688 RCX: 00000000f9b87227
Feb 3 14:23:30 is-k13bi32e2s6vdi-002 kernel: [700766.666324] RDX: 00000000f9b87227 RSI: 0000000000000000 RDI: ffffffffa018257d
Feb 3 14:23:30 is-k13bi32e2s6vdi-002 kernel: [700766.666529] RBP: ffff88007a99fd08 R08: ffff88007b6b6420 R09: 0000000000000000
Feb 3 14:23:30 is-k13bi32e2s6vdi-002 kernel: [700766.666735] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000246
Feb 3 14:23:30 is-k13bi32e2s6vdi-002 kernel: [700766.666940] R13: 0000000000000000 R14: 00000000810a98fd R15: ffff88007a99fc48
Feb 3 14:23:30 is-k13bi32e2s6vdi-002 kernel: [700766.667197] FS: 0000000000000000(0000) GS:ffff88007fd00000(0000) knlGS:0000000000000000
Feb 3 14:23:30 is-k13bi32e2s6vdi-002 kernel: [700766.667421] CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b
Feb 3 14:23:30 is-k13bi32e2s6vdi-002 kernel: [700766.667569] CR2: 00007f30e19f2000 CR3: 0000000036bfa000 CR4: 00000000000007e0
Feb 3 14:23:30 is-k13bi32e2s6vdi-002 kernel: [700766.667879] Stack:
Feb 3 14:23:30 is-k13bi32e2s6vdi-002 kernel: [700766.667952] ffff88007b6b6000 ffff880079eaa640 ffff880078ed0800 ffff88007b6b6000
Feb 3 14:23:30 is-k13bi32e2s6vdi-002 kernel: [700766.668173] ffff88007a99fd38 ffffffff8173ca9f ffff880078ed0800 ffff88007b6b6000
Feb 3 14:23:30 is-k13bi32e2s6vdi-002 kernel: [700766.668394] 0000000000000008 ffff880079eaa000 ffff88007a99fda8 ffffffffa018257d
Feb 3 14:23:30 is-k13bi32e2s6vdi-002 kernel: [700766.668615] Call Trace:
Feb 3 14:23:30 is-k13bi32e2s6vdi-002 kernel: [700766.668703] [<ffffffff8173ca9f>] _raw_spin_lock_bh+0x1f/0x50
Feb 3 14:23:30 is-k13bi32e2s6vdi-002 kernel: [700766.668860] [<ffffffffa018257d>] iscsit_close_connection+0x3cd/0x730 [iscsi_target_mod]
Feb 3 14:23:30 is-k13bi32e2s6vdi-002 kernel: [700766.669095] [<ffffffffa016e3ab>] ? iscsit_take_action_for_connection_exit+0x5b/0x110 [iscsi_target_mod]
Feb 3 14:23:30 is-k13bi32e2s6vdi-002 kernel: [700766.669355] [<ffffffffa016e3d3>] iscsit_take_action_for_connection_exit+0x83/0x110 [iscsi_target_mod]
Feb 3 14:23:30 is-k13bi32e2s6vdi-002 kernel: [700766.669613] [<ffffffffa017f720>] iscsi_target_tx_thread+0x150/0x210 [iscsi_target_mod]
Feb 3 14:23:30 is-k13bi32e2s6vdi-002 kernel: [700766.669840] [<ffffffff8109c9b0>] ? prepare_to_wait_event+0x100/0x100
Feb 3 14:23:30 is-k13bi32e2s6vdi-002 kernel: [700766.670011] [<ffffffffa017f5d0>] ? iscsit_thread_get_cpumask+0xc0/0xc0 [iscsi_target_mod]
Feb 3 14:23:30 is-k13bi32e2s6vdi-002 kernel: [700766.670247] [<ffffffff8107a664>] kthread+0xe4/0x100
Feb 3 14:23:30 is-k13bi32e2s6vdi-002 kernel: [700766.670382] [<ffffffff8107a580>] ? flush_kthread_worker+0xf0/0xf0
Feb 3 14:23:30 is-k13bi32e2s6vdi-002 kernel: [700766.670540] [<ffffffff8173d62c>] ret_from_fork+0x7c/0xb0
Feb 3 14:23:30 is-k13bi32e2s6vdi-002 kernel: [700766.670683] [<ffffffff8107a580>] ? flush_kthread_worker+0xf0/0xf0
Feb 3 14:23:30 is-k13bi32e2s6vdi-002 kernel: [700766.670839] Code: 89 f3 75 35 9c 41 5d fa 65 01 1c 25 a0 aa 00 00 65 8b 04 25 a0 aa 00 00 48 31 c3 80 e7 ff 75 08 4c 89 e7 e8 6
f bf 04 00 41 55 9d <48> 8b 5d e8 4c 8b 65 f0 4c 8b 6d f8 c9 c3 80 3d ec a8 ca 00 01
Feb 3 14:23:58 is-k13bi32e2s6vdi-002 kernel: [700794.685205] NMI watchdog: BUG: soft lockup - CPU#1 stuck for 22s! [iscsi_ttx:2002]
Feb 3 14:23:58 is-k13bi32e2s6vdi-002 kernel: [700794.685447] Modules linked in: ib_srpt(E) ib_cm(E) ib_sa(E) ib_mad(E) ib_core(E) ib_addr(E) tcm_qla2xxx(E) qla2xxx(E) tcm_loop(
E) tcm_fc(E) libfc(E) scsi_transport_fc(E) iscsi_target_mod(E) target_core_pscsi(E) target_core_file(E) target_core_iblock(E) target_core_mod(E) configfs(E) rbd(E) libceph(E) li
bcrc32c(E) ppdev(E) coretemp(E) microcode(E) serio_raw(E) i2c_piix4(E) shpchp(E) parport_pc(E) lp(E) parport(E) psmouse(E) floppy(E) vmw_pvscsi(E) vmxnet3(E)
Feb 3 14:23:58 is-k13bi32e2s6vdi-002 kernel: [700794.686567] irq event stamp: 24644920
Feb 3 14:23:58 is-k13bi32e2s6vdi-002 kernel: [700794.686675] hardirqs last enabled at (24644919): [<ffffffff8105e5bd>] __local_bh_enable_ip+0x6d/0xd0
Feb 3 14:23:58 is-k13bi32e2s6vdi-002 kernel: [700794.686948] hardirqs last disabled at (24644920): [<ffffffff8173c8b7>] _raw_spin_lock_irq+0x17/0x50
Feb 3 14:23:58 is-k13bi32e2s6vdi-002 kernel: [700794.687197] softirqs last enabled at (24644918): [<ffffffffa01792d2>] iscsit_conn_all_queues_empty+0x72/0x90 [iscsi_target_mod]
Feb 3 14:23:58 is-k13bi32e2s6vdi-002 kernel: [700794.687518] softirqs last disabled at (24644916): [<ffffffffa01792b8>] iscsit_conn_all_queues_empty+0x58/0x90 [iscsi_target_mod]
Feb 3 14:23:58 is-k13bi32e2s6vdi-002 kernel: [700794.687829] CPU: 1 PID: 2002 Comm: iscsi_ttx Tainted: G EL 3.18.0-ceph #1
Feb 3 14:23:58 is-k13bi32e2s6vdi-002 kernel: [700794.688045] Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 07/09/2012
Feb 3 14:23:58 is-k13bi32e2s6vdi-002 kernel: [700794.688321] task: ffff88007a9921d0 ti: ffff88007a99c000 task.ti: ffff88007a99c000
Feb 3 14:23:58 is-k13bi32e2s6vdi-002 kernel: [700794.688532] RIP: 0010:[<ffffffff8105e5bf>] [<ffffffff8105e5bf>] __local_bh_enable_ip+0x6f/0xd0
Feb 3 14:23:58 is-k13bi32e2s6vdi-002 kernel: [700794.688775] RSP: 0018:ffff88007a99fc90 EFLAGS: 00000246
Feb 3 14:23:58 is-k13bi32e2s6vdi-002 kernel: [700794.688913] RAX: 0000000000000000 RBX: ffffffffa0179537 RCX: 000000002af72af6
Feb 3 14:23:58 is-k13bi32e2s6vdi-002 kernel: [700794.689118] RDX: 0000000000002af7 RSI: 0000000000000201 RDI: ffffffff8105e5bd
Feb 3 14:23:58 is-k13bi32e2s6vdi-002 kernel: [700794.689322] RBP: ffff88007a99fc98 R08: 0000000000000001 R09: 0000000000000000
Feb 3 14:23:58 is-k13bi32e2s6vdi-002 kernel: [700794.689525] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000246
Feb 3 14:23:58 is-k13bi32e2s6vdi-002 kernel: [700794.689729] R13: ffff88007a99fc88 R14: 0000000000000001 R15: ffffffffa0179537
Feb 3 14:23:58 is-k13bi32e2s6vdi-002 kernel: [700794.689941] FS: 0000000000000000(0000) GS:ffff88007fd00000(0000) knlGS:0000000000000000
Feb 3 14:23:58 is-k13bi32e2s6vdi-002 kernel: [700794.690165] CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b
Feb 3 14:23:58 is-k13bi32e2s6vdi-002 kernel: [700794.690313] CR2: 00007f30e19f2000 CR3: 0000000036bfa000 CR4: 00000000000007e0
Feb 3 14:23:58 is-k13bi32e2s6vdi-002 kernel: [700794.690529] Stack:
Feb 3 14:23:58 is-k13bi32e2s6vdi-002 kernel: [700794.690601] ffff880079eaa000 ffff88007a99fcb8 ffffffff8173cf09 0000000000000001
Feb 3 14:23:58 is-k13bi32e2s6vdi-002 kernel: [700794.690822] ffff88007b6b6000 ffff88007a99fcf8 ffffffffa0179688 ffff88007a99fcf8
Feb 3 14:23:58 is-k13bi32e2s6vdi-002 kernel: [700794.691042] ffff88007b6b6000 0000000000000001 0000000000000001 ffff88007b6b6330
Feb 3 14:23:58 is-k13bi32e2s6vdi-002 kernel: [700794.691263] Call Trace:
Feb 3 14:23:58 is-k13bi32e2s6vdi-002 kernel: [700794.691352] [<ffffffff8173cf09>] _raw_spin_unlock_bh+0x39/0x40
Feb 3 14:23:58 is-k13bi32e2s6vdi-002 kernel: [700794.691511] [<ffffffffa0179688>] __iscsit_free_cmd+0x248/0x280 [iscsi_target_mod]
Feb 3 14:23:58 is-k13bi32e2s6vdi-002 kernel: [700794.691738] [<ffffffffa017977e>] iscsit_free_cmd+0xbe/0x160 [iscsi_target_mod]
Feb 3 14:23:58 is-k13bi32e2s6vdi-002 kernel: [700794.691953] [<ffffffffa0182574>] iscsit_close_connection+0x3c4/0x730 [iscsi_target_mod]
Feb 3 14:23:58 is-k13bi32e2s6vdi-002 kernel: [700794.692189] [<ffffffffa016e3ab>] ? iscsit_take_action_for_connection_exit+0x5b/0x110 [iscsi_target_mod]
Feb 3 14:23:58 is-k13bi32e2s6vdi-002 kernel: [700794.692448] [<ffffffffa016e3d3>] iscsit_take_action_for_connection_exit+0x83/0x110 [iscsi_target_mod]
Feb 3 14:23:58 is-k13bi32e2s6vdi-002 kernel: [700794.692705] [<ffffffffa017f720>] iscsi_target_tx_thread+0x150/0x210 [iscsi_target_mod]
Feb 3 14:23:58 is-k13bi32e2s6vdi-002 kernel: [700794.692944] [<ffffffff8109c9b0>] ? prepare_to_wait_event+0x100/0x100
Feb 3 14:23:58 is-k13bi32e2s6vdi-002 kernel: [700794.693114] [<ffffffffa017f5d0>] ? iscsit_thread_get_cpumask+0xc0/0xc0 [iscsi_target_mod]
Feb 3 14:23:58 is-k13bi32e2s6vdi-002 kernel: [700794.693760] [<ffffffff8107a664>] kthread+0xe4/0x100
Feb 3 14:23:58 is-k13bi32e2s6vdi-002 kernel: [700794.693895] [<ffffffff8107a580>] ? flush_kthread_worker+0xf0/0xf0
Feb 3 14:23:58 is-k13bi32e2s6vdi-002 kernel: [700794.694055] [<ffffffff8173d62c>] ret_from_fork+0x7c/0xb0
Feb 3 14:23:58 is-k13bi32e2s6vdi-002 kernel: [700794.694198] [<ffffffff8107a580>] ? flush_kthread_worker+0xf0/0xf0
Feb 3 14:23:58 is-k13bi32e2s6vdi-002 kernel: [700794.694354] Code: 02 00 00 74 3f 65 01 1c 25 a0 aa 00 00 65 8b 04 25 a0 aa 00 00 a9 00 ff 1f 00 74 4f 65 ff 0c 25 a0 aa 00 00 e
8 33 b3 04 00 fb 5b <41> 5c 5d c3 0f 1f 44 00 00 9c 58 f6 c4 02 75 aa 90 eb 9e 66 0f
Feb 3 14:24:26 is-k13bi32e2s6vdi-002 kernel: [700822.708009] NMI watchdog: BUG: soft lockup - CPU#1 stuck for 23s! [iscsi_ttx:2002]
Feb 3 14:24:26 is-k13bi32e2s6vdi-002 kernel: [700822.708253] Modules linked in: ib_srpt(E) ib_cm(E) ib_sa(E) ib_mad(E) ib_core(E) ib_addr(E) tcm_qla2xxx(E) qla2xxx(E) tcm_loop(
E) tcm_fc(E) libfc(E) scsi_transport_fc(E) iscsi_target_mod(E) target_core_pscsi(E) target_core_file(E) target_core_iblock(E) target_core_mod(E) configfs(E) rbd(E) libceph(E) li
bcrc32c(E) ppdev(E) coretemp(E) microcode(E) serio_raw(E) i2c_piix4(E) shpchp(E) parport_pc(E) lp(E) parport(E) psmouse(E) floppy(E) vmw_pvscsi(E) vmxnet3(E)
Feb 3 14:24:26 is-k13bi32e2s6vdi-002 kernel: [700822.709398] irq event stamp: 24644920
Feb 3 14:24:26 is-k13bi32e2s6vdi-002 kernel: [700822.709507] hardirqs last enabled at (24644919): [<ffffffff8105e5bd>] __local_bh_enable_ip+0x6d/0xd0
Feb 3 14:24:26 is-k13bi32e2s6vdi-002 kernel: [700822.709785] hardirqs last disabled at (24644920): [<ffffffff8173c8b7>] _raw_spin_lock_irq+0x17/0x50
Feb 3 14:24:26 is-k13bi32e2s6vdi-002 kernel: [700822.710035] softirqs last enabled at (24644918): [<ffffffffa01792d2>] iscsit_conn_all_queues_empty+0x72/0x90 [iscsi_target_mod]
Feb 3 14:24:26 is-k13bi32e2s6vdi-002 kernel: [700822.710354] softirqs last disabled at (24644916): [<ffffffffa01792b8>] iscsit_conn_all_queues_empty+0x58/0x90 [iscsi_target_mod]
Feb 3 14:24:26 is-k13bi32e2s6vdi-002 kernel: [700822.710665] CPU: 1 PID: 2002 Comm: iscsi_ttx Tainted: G EL 3.18.0-ceph #1
Feb 3 14:24:26 is-k13bi32e2s6vdi-002 kernel: [700822.710882] Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 07/09/2012
Feb 3 14:24:26 is-k13bi32e2s6vdi-002 kernel: [700822.711161] task: ffff88007a9921d0 ti: ffff88007a99c000 task.ti: ffff88007a99c000
Feb 3 14:24:26 is-k13bi32e2s6vdi-002 kernel: [700822.711373] RIP: 0010:[<ffffffff810abf57>] [<ffffffff810abf57>] do_raw_spin_lock+0x57/0x160
Feb 3 14:24:26 is-k13bi32e2s6vdi-002 kernel: [700822.711612] RSP: 0018:ffff88007a99fc38 EFLAGS: 00000246
Feb 3 14:24:26 is-k13bi32e2s6vdi-002 kernel: [700822.711750] RAX: 0000000000000027 RBX: ffff88007b6b6208 RCX: 0000000000000000
Feb 3 14:24:26 is-k13bi32e2s6vdi-002 kernel: [700822.711954] RDX: 0000000000270027 RSI: 0000000000000000 RDI: ffff88007b6b61c0
Feb 3 14:24:26 is-k13bi32e2s6vdi-002 kernel: [700822.712158] RBP: ffff88007a99fc58 R08: 0000000000000001 R09: 0000000000000000
Feb 3 14:24:26 is-k13bi32e2s6vdi-002 kernel: [700822.712361] R10: 0000000000000000 R11: 0000000000000000 R12: ffff88007b6b61c0
Feb 3 14:24:26 is-k13bi32e2s6vdi-002 kernel: [700822.712565] R13: ffff88007a99fc88 R14: ffff88007b6b6480 R15: 0000000000000282
Feb 3 14:24:26 is-k13bi32e2s6vdi-002 kernel: [700822.712775] FS: 0000000000000000(0000) GS:ffff88007fd00000(0000) knlGS:0000000000000000
Feb 3 14:24:26 is-k13bi32e2s6vdi-002 kernel: [700822.712999] CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b
Feb 3 14:24:26 is-k13bi32e2s6vdi-002 kernel: [700822.713146] CR2: 00007f30e19f2000 CR3: 0000000036bfa000 CR4: 00000000000007e0
Feb 3 14:24:26 is-k13bi32e2s6vdi-002 kernel: [700822.713358] Stack:
Feb 3 14:24:26 is-k13bi32e2s6vdi-002 kernel: [700822.713430] ffff88007b6b6000 ffff88007b6b61c0 ffff88007b6b6000 ffff88007b6b6208
Feb 3 14:24:26 is-k13bi32e2s6vdi-002 kernel: [700822.713652] ffff88007a99fc88 ffffffff8173cac7 ffffffffa017860a ffff88007b6b6000
Feb 3 14:24:26 is-k13bi32e2s6vdi-002 kernel: [700822.713873] ffff88007a99fc98 ffff88007b6b6000 ffff88007a99fcb8 ffffffffa017860a
Feb 3 14:24:26 is-k13bi32e2s6vdi-002 kernel: [700822.714101] Call Trace:
Feb 3 14:24:26 is-k13bi32e2s6vdi-002 kernel: [700822.714190] [<ffffffff8173cac7>] _raw_spin_lock_bh+0x47/0x50
Feb 3 14:24:26 is-k13bi32e2s6vdi-002 kernel: [700822.714349] [<ffffffffa017860a>] ? iscsit_free_r2ts_from_list+0x2a/0x80 [iscsi_target_mod]
Feb 3 14:24:26 is-k13bi32e2s6vdi-002 kernel: [700822.714587] [<ffffffffa017860a>] iscsit_free_r2ts_from_list+0x2a/0x80 [iscsi_target_mod]
Feb 3 14:24:26 is-k13bi32e2s6vdi-002 kernel: [700822.714821] [<ffffffffa01795dd>] __iscsit_free_cmd+0x19d/0x280 [iscsi_target_mod]
Feb 3 14:24:26 is-k13bi32e2s6vdi-002 kernel: [700822.715043] [<ffffffffa017974b>] iscsit_free_cmd+0x8b/0x160 [iscsi_target_mod]
Feb 3 14:24:26 is-k13bi32e2s6vdi-002 kernel: [700822.715259] [<ffffffffa0182574>] iscsit_close_connection+0x3c4/0x730 [iscsi_target_mod]
Feb 3 14:24:26 is-k13bi32e2s6vdi-002 kernel: [700822.715490] [<ffffffffa016e3ab>] ? iscsit_take_action_for_connection_exit+0x5b/0x110 [iscsi_target_mod]
Feb 3 14:24:26 is-k13bi32e2s6vdi-002 kernel: [700822.715753] [<ffffffffa016e3d3>] iscsit_take_action_for_connection_exit+0x83/0x110 [iscsi_target_mod]
Feb 3 14:24:26 is-k13bi32e2s6vdi-002 kernel: [700822.716010] [<ffffffffa017f720>] iscsi_target_tx_thread+0x150/0x210 [iscsi_target_mod]
Feb 3 14:24:26 is-k13bi32e2s6vdi-002 kernel: [700822.716236] [<ffffffff8109c9b0>] ? prepare_to_wait_event+0x100/0x100
Feb 3 14:24:26 is-k13bi32e2s6vdi-002 kernel: [700822.716404] [<ffffffffa017f5d0>] ? iscsit_thread_get_cpumask+0xc0/0xc0 [iscsi_target_mod]
Feb 3 14:24:26 is-k13bi32e2s6vdi-002 kernel: [700822.716635] [<ffffffff8107a664>] kthread+0xe4/0x100
Feb 3 14:24:26 is-k13bi32e2s6vdi-002 kernel: [700822.716769] [<ffffffff8107a580>] ? flush_kthread_worker+0xf0/0xf0
Feb 3 14:24:26 is-k13bi32e2s6vdi-002 kernel: [700822.716928] [<ffffffff8173d62c>] ret_from_fork+0x7c/0xb0
Feb 3 14:24:26 is-k13bi32e2s6vdi-002 kernel: [700822.717072] [<ffffffff8107a580>] ? flush_kthread_worker+0xf0/0xf0
Feb 3 14:24:26 is-k13bi32e2s6vdi-002 kernel: [700822.717229] Code: 04 25 c0 aa 00 00 48 39 43 10 0f 84 be 00 00 00 65 8b 04 25 84 a0 00 00 39 43 08 0f 84 99 00 00 00 8b 13 89 d
0 c1 e8 10 66 39 c2 <74> 57 4c 69 2d bc b0 b6 00 fa 00 00 00 4d 85 ed 0f 84 b2 00 00
Feb 3 14:24:54 is-k13bi32e2s6vdi-002 kernel: [700850.730821] NMI watchdog: BUG: soft lockup - CPU#1 stuck for 23s! [iscsi_ttx:2002]
Feb 3 14:24:54 is-k13bi32e2s6vdi-002 kernel: [700850.731063] Modules linked in: ib_srpt(E) ib_cm(E) ib_sa(E) ib_mad(E) ib_core(E) ib_addr(E) tcm_qla2xxx(E) qla2xxx(E) tcm_loop(
E) tcm_fc(E) libfc(E) scsi_transport_fc(E) iscsi_target_mod(E) target_core_pscsi(E) target_core_file(E) target_core_iblock(E) target_core_mod(E) configfs(E) rbd(E) libceph(E) li
bcrc32c(E) ppdev(E) coretemp(E) microcode(E) serio_raw(E) i2c_piix4(E) shpchp(E) parport_pc(E) lp(E) parport(E) psmouse(E) floppy(E) vmw_pvscsi(E) vmxnet3(E)
Feb 3 14:24:54 is-k13bi32e2s6vdi-002 kernel: [700850.732207] irq event stamp: 24644920
Feb 3 14:24:54 is-k13bi32e2s6vdi-002 kernel: [700850.732315] hardirqs last enabled at (24644919): [<ffffffff8105e5bd>] __local_bh_enable_ip+0x6d/0xd0
Feb 3 14:24:54 is-k13bi32e2s6vdi-002 kernel: [700850.732592] hardirqs last disabled at (24644920): [<ffffffff8173c8b7>] _raw_spin_lock_irq+0x17/0x50
Feb 3 14:24:54 is-k13bi32e2s6vdi-002 kernel: [700850.732841] softirqs last enabled at (24644918): [<ffffffffa01792d2>] iscsit_conn_all_queues_empty+0x72/0x90 [iscsi_target_mod]
Feb 3 14:24:54 is-k13bi32e2s6vdi-002 kernel: [700850.733160] softirqs last disabled at (24644916): [<ffffffffa01792b8>] iscsit_conn_all_queues_empty+0x58/0x90 [iscsi_target_mod]
Feb 3 14:24:54 is-k13bi32e2s6vdi-002 kernel: [700850.733469] CPU: 1 PID: 2002 Comm: iscsi_ttx Tainted: G EL 3.18.0-ceph #1
Feb 3 14:24:54 is-k13bi32e2s6vdi-002 kernel: [700850.733686] Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 07/09/2012
Feb 3 14:24:54 is-k13bi32e2s6vdi-002 kernel: [700850.733963] task: ffff88007a9921d0 ti: ffff88007a99c000 task.ti: ffff88007a99c000
Feb 3 14:24:54 is-k13bi32e2s6vdi-002 kernel: [700850.734176] RIP: 0010:[<ffffffff8173cf91>] [<ffffffff8173cf91>] _raw_spin_unlock_irqrestore+0x41/0x70
Feb 3 14:24:54 is-k13bi32e2s6vdi-002 kernel: [700850.734431] RSP: 0018:ffff88007a99fc78 EFLAGS: 00000282
Feb 3 14:24:54 is-k13bi32e2s6vdi-002 kernel: [700850.734570] RAX: 0000000000000000 RBX: 0000000000000001 RCX: 00000000e021e020
Feb 3 14:24:54 is-k13bi32e2s6vdi-002 kernel: [700850.734775] RDX: 000000000000e021 RSI: 0000000000000001 RDI: ffffffff8173cf8f
Feb 3 14:24:54 is-k13bi32e2s6vdi-002 kernel: [700850.734980] RBP: ffff88007a99fc88 R08: 0000000000000001 R09: 0000000000000000
Feb 3 14:24:54 is-k13bi32e2s6vdi-002 kernel: [700850.735185] R10: 0000000000000000 R11: 0000000000000000 R12: ffffffffa01137bb
Feb 3 14:24:54 is-k13bi32e2s6vdi-002 kernel: [700850.735389] R13: 0000000000000000 R14: 0000000000000046 R15: ffff88007a99fc58
Feb 3 14:24:54 is-k13bi32e2s6vdi-002 kernel: [700850.735602] FS: 0000000000000000(0000) GS:ffff88007fd00000(0000) knlGS:0000000000000000
Feb 3 14:24:54 is-k13bi32e2s6vdi-002 kernel: [700850.735827] CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b
Feb 3 14:24:54 is-k13bi32e2s6vdi-002 kernel: [700850.735975] CR2: 00007f30e19f2000 CR3: 0000000036bfa000 CR4: 00000000000007e0
Feb 3 14:24:54 is-k13bi32e2s6vdi-002 kernel: [700850.736188] Stack:
Feb 3 14:24:54 is-k13bi32e2s6vdi-002 kernel: [700850.736260] ffff88007b6b6330 ffff88007b6b6480 ffff88007a99fcc8 ffffffffa011384b
Feb 3 14:24:54 is-k13bi32e2s6vdi-002 kernel: [700850.736481] ffff88007a99fcb8 ffffffff8173cf09 0000000000000001 ffff88007b6b6330
Feb 3 14:24:54 is-k13bi32e2s6vdi-002 kernel: [700850.736703] 0000000000000001 0000000000000001 ffff88007a99fcf8 ffffffffa0115285
Feb 3 14:24:54 is-k13bi32e2s6vdi-002 kernel: [700850.736926] Call Trace:
Feb 3 14:24:54 is-k13bi32e2s6vdi-002 kernel: [700850.737037] [<ffffffffa011384b>] transport_wait_for_tasks+0xbb/0x150 [target_core_mod]
Feb 3 14:24:54 is-k13bi32e2s6vdi-002 kernel: [700850.737265] [<ffffffff8173cf09>] ? _raw_spin_unlock_bh+0x39/0x40
Feb 3 14:24:54 is-k13bi32e2s6vdi-002 kernel: [700850.737431] [<ffffffffa0115285>] transport_generic_free_cmd+0xc5/0xe0 [target_core_mod]
Feb 3 14:24:54 is-k13bi32e2s6vdi-002 kernel: [700850.737663] [<ffffffffa0179756>] iscsit_free_cmd+0x96/0x160 [iscsi_target_mod]
Feb 3 14:24:54 is-k13bi32e2s6vdi-002 kernel: [700850.737880] [<ffffffffa0182574>] iscsit_close_connection+0x3c4/0x730 [iscsi_target_mod]
Feb 3 14:24:54 is-k13bi32e2s6vdi-002 kernel: [700850.738112] [<ffffffffa016e3ab>] ? iscsit_take_action_for_connection_exit+0x5b/0x110 [iscsi_target_mod]
Feb 3 14:24:54 is-k13bi32e2s6vdi-002 kernel: [700850.738371] [<ffffffffa016e3d3>] iscsit_take_action_for_connection_exit+0x83/0x110 [iscsi_target_mod]
Feb 3 14:24:54 is-k13bi32e2s6vdi-002 kernel: [700850.738631] [<ffffffffa017f720>] iscsi_target_tx_thread+0x150/0x210 [iscsi_target_mod]
Feb 3 14:24:54 is-k13bi32e2s6vdi-002 kernel: [700850.738857] [<ffffffff8109c9b0>] ? prepare_to_wait_event+0x100/0x100
Feb 3 14:24:54 is-k13bi32e2s6vdi-002 kernel: [700850.739026] [<ffffffffa017f5d0>] ? iscsit_thread_get_cpumask+0xc0/0xc0 [iscsi_target_mod]
Feb 3 14:24:54 is-k13bi32e2s6vdi-002 kernel: [700850.739256] [<ffffffff8107a664>] kthread+0xe4/0x100
Feb 3 14:24:54 is-k13bi32e2s6vdi-002 kernel: [700850.739391] [<ffffffff8107a580>] ? flush_kthread_worker+0xf0/0xf0
Feb 3 14:24:54 is-k13bi32e2s6vdi-002 kernel: [700850.739548] [<ffffffff8173d62c>] ret_from_fork+0x7c/0xb0
Feb 3 14:24:54 is-k13bi32e2s6vdi-002 kernel: [700850.739691] [<ffffffff8107a580>] ? flush_kthread_worker+0xf0/0xf0
Feb 3 14:24:54 is-k13bi32e2s6vdi-002 kernel: [700850.739848] Code: 89 fc 48 8d 7f 18 48 89 5d f0 48 89 f3 be 01 00 00 00 e8 33 bc 96 ff 4c 89 e7 e8 2b f1 96 ff f6 c7 02 74 1e e
8 61 c9 96 ff 53 9d <65> ff 0c 25 a0 aa 00 00 48 8b 5d f0 4c 8b 65 f8 c9 c3 0f 1f 44
_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
