On Mon, 2014-05-19 at 19:09 +0000, Moussa Ba (moussaba) wrote: > Nick, > > After 3.2.19 + patches , we still get the OOPS below on one of our > hosts. The other ones seem fine, but this particular host still > generates time outs. > Comments inline below.. > Moussa > > P.S.: what is the unsupported SCSI command here? We see it on all > Targets, not sure if it is an issue or not. The main concern is the > timeouts we get on intiators and the oops below Opcode 0x85 is the ATA_16 passthrough, and the warning below can be safely ignored. > > > [69969.299856] TARGET_CORE[iSCSI]: Unsupported SCSI Opcode 0x85, sending CHECK_CONDITION. > [69969.303538] TARGET_CORE[iSCSI]: Unsupported SCSI Opcode 0x85, sending CHECK_CONDITION. > [69969.307167] TARGET_CORE[iSCSI]: Unsupported SCSI Opcode 0x85, sending CHECK_CONDITION. > [69969.310941] TARGET_CORE[iSCSI]: Unsupported SCSI Opcode 0x85, sending CHECK_CONDITION. > [69969.314522] TARGET_CORE[iSCSI]: Unsupported SCSI Opcode 0x85, sending CHECK_CONDITION. > [69969.318319] TARGET_CORE[iSCSI]: Unsupported SCSI Opcode 0x85, sending CHECK_CONDITION. > [69969.322086] TARGET_CORE[iSCSI]: Unsupported SCSI Opcode 0x85, sending CHECK_CONDITION. > [69969.326002] TARGET_CORE[iSCSI]: Unsupported SCSI Opcode 0x85, sending CHECK_CONDITION. > [69969.329748] TARGET_CORE[iSCSI]: Unsupported SCSI Opcode 0x85, sending CHECK_CONDITION. > [69969.333510] TARGET_CORE[iSCSI]: Unsupported SCSI Opcode 0x85, sending CHECK_CONDITION. > [70008.527611] Unknown RDMA CMA event: 15 > [70019.157223] Unknown RDMA CMA event: 15 > [70024.288185] iSCSI Login timeout on Network Portal 192.168.101.101:3260 > [70035.061653] iSCSI Login timeout on Network Portal 192.168.102.101:3272 > [70132.335615] INFO: task iscsi_ttx:8861 blocked for more than 120 seconds. > [70132.335619] Tainted: GF 3.12.19+ #2 > [70132.335620] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. > [70132.335621] iscsi_ttx D ffffffff81613440 0 8861 2 0x00000004 > [70132.335624] ffff88045deefc78 0000000000000046 ffff88045deeffd8 0000000000012d40 > [70132.335627] ffff88045deee010 0000000000012d40 0000000000012d40 0000000000012d40 > [70132.335636] ffff88045deeffd8 0000000000012d40 ffff88046ed18aa0 ffff88046f9a5500 > [70132.335639] Call Trace: > [70132.335645] [<ffffffff81556239>] schedule+0x29/0x70 > [70132.335647] [<ffffffff81553c75>] schedule_timeout+0x175/0x200 > [70132.335660] [<ffffffffa03eabc8>] ? ib_modify_qp+0x18/0x20 [ib_core] > [70132.335662] [<ffffffffa074dcb4>] ? cma_modify_qp_err+0x64/0x80 [rdma_cm] > [70132.335665] [<ffffffff815561d6>] wait_for_completion+0xc6/0x100 > [70132.335668] [<ffffffff81080c90>] ? try_to_wake_up+0x2c0/0x2c0 > [70132.335671] [<ffffffffa075d7a7>] isert_wait_conn+0x77/0xf0 [ib_isert] > [70132.335678] [<ffffffffa06fab5e>] iscsit_close_connection+0xce/0x560 [iscsi_target_mod] > [70132.335684] [<ffffffffa06ea853>] iscsit_take_action_for_connection_exit+0x83/0x110 [iscsi_target_mod] > [70132.335689] [<ffffffffa06fbae0>] iscsi_target_tx_thread+0x180/0x220 [iscsi_target_mod] > [70132.335693] [<ffffffff810701e0>] ? wake_up_bit+0x40/0x40 > [70132.335698] [<ffffffffa06fb960>] ? iscsit_handle_snack+0x190/0x190 [iscsi_target_mod] > [70132.335701] [<ffffffff8106f99e>] kthread+0xce/0xe0 > [70132.335703] [<ffffffff8106f8d0>] ? kthread_freezable_should_stop+0x70/0x70 > [70132.335705] [<ffffffff8156026c>] ret_from_fork+0x7c/0xb0 > [70132.335707] [<ffffffff8106f8d0>] ? kthread_freezable_should_stop+0x70/0x70 > [70132.335716] INFO: task iscsi_np:9120 blocked for more than 120 seconds. > [70132.335717] Tainted: GF 3.12.19+ #2 > [70132.335718] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. > [70132.335719] iscsi_np D ffffffff81613440 0 9120 2 0x00000004 > [70132.335721] ffff880450f77be8 0000000000000046 ffff880450f77fd8 0000000000012d40 > [70132.335723] ffff880450f76010 0000000000012d40 0000000000012d40 0000000000012d40 > [70132.335725] ffff880450f77fd8 0000000000012d40 ffff880450f2eaa0 ffff88046f9a4aa0 > [70132.335727] Call Trace: > [70132.335729] [<ffffffff81556239>] schedule+0x29/0x70 > [70132.335731] [<ffffffff81553c75>] schedule_timeout+0x175/0x200 > [70132.335734] [<ffffffff812753b6>] ? vsnprintf+0x416/0x5b0 > [70132.335739] [<ffffffffa06e4582>] ? iscsi_update_param_value+0x32/0x90 [iscsi_target_mod] > [70132.335741] [<ffffffff815561d6>] wait_for_completion+0xc6/0x100 > [70132.335743] [<ffffffff81080c90>] ? try_to_wake_up+0x2c0/0x2c0 > [70132.335748] [<ffffffffa06fa195>] iscsit_stop_session+0x1a5/0x1c0 [iscsi_target_mod] > [70132.335753] [<ffffffffa06efc2b>] iscsi_check_for_session_reinstatement+0x1db/0x250 [iscsi_target_mod] > [70132.335759] [<ffffffffa06f0ee5>] iscsi_target_check_for_existing_instances+0x35/0x40 [iscsi_target_mod] > [70132.335763] [<ffffffffa06f130b>] iscsi_target_handle_csg_one+0x8b/0x150 [iscsi_target_mod] > [70132.335768] [<ffffffffa06f160e>] iscsi_target_do_login+0xee/0x180 [iscsi_target_mod] > [70132.335773] [<ffffffffa06f16c7>] iscsi_target_start_negotiation+0x27/0xb0 [iscsi_target_mod] > [70132.335777] [<ffffffffa06f059e>] __iscsi_target_login_thread+0x26e/0x630 [iscsi_target_mod] > [70132.335782] [<ffffffffa06f0960>] ? __iscsi_target_login_thread+0x630/0x630 [iscsi_target_mod] > [70132.335786] [<ffffffffa06f0991>] iscsi_target_login_thread+0x31/0x40 [iscsi_target_mod] > [70132.335788] [<ffffffff8106f99e>] kthread+0xce/0xe0 > [70132.335791] [<ffffffff8106f8d0>] ? kthread_freezable_should_stop+0x70/0x70 > [70132.335793] [<ffffffff8156026c>] ret_from_fork+0x7c/0xb0 > [70132.335795] [<ffffffff8106f8d0>] ? kthread_freezable_should_stop+0x70/0x70 > [70132.335812] INFO: task kworker/u33:4:19729 blocked for more than 120 seconds. > [70132.335812] Tainted: GF 3.12.19+ #2 > [70132.335813] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. > [70132.335814] kworker/u33:4 D ffffffff81613440 0 19729 2 0x00000000 > [70132.335818] Workqueue: isert_rx_wq isert_cq_rx_work [ib_isert] > [70132.335819] ffff880075f61828 0000000000000046 ffff880075f61fd8 0000000000012d40 > [70132.335821] ffff880075f60010 0000000000012d40 0000000000012d40 0000000000012d40 > [70132.335823] ffff880075f61fd8 0000000000012d40 ffff88044fe33500 ffffffff81a10480 > [70132.335825] Call Trace: > [70132.335827] [<ffffffff81556239>] schedule+0x29/0x70 > [70132.335829] [<ffffffff81553c75>] schedule_timeout+0x175/0x200 > [70132.335831] [<ffffffff815555ca>] __down+0x6a/0xa0 > [70132.335833] [<ffffffff81074fc1>] down+0x41/0x50 > [70132.335841] [<ffffffffa021028e>] mtip_hw_get_scatterlist+0x3e/0x140 [mtip32xx] > [70132.335845] [<ffffffffa0210416>] mtip_make_request+0x86/0x2d0 [mtip32xx] > [70132.335848] [<ffffffff8124933a>] generic_make_request+0xca/0x100 > [70132.335851] [<ffffffff812493dc>] submit_bio+0x6c/0x140 > [70132.335855] [<ffffffffa0370a77>] ? dm_merge_bvec+0x97/0xe0 [dm_mod] > [70132.335858] [<ffffffffa06cc58c>] iblock_submit_bios+0x4c/0x80 [target_core_iblock] > [70132.335861] [<ffffffffa06cd0cc>] iblock_execute_rw+0x32c/0x340 [target_core_iblock] > [70132.335863] [<ffffffff8127a969>] ? sg_miter_get_next_page+0x29/0x80 > [70132.335872] [<ffffffffa067d462>] sbc_execute_rw+0x22/0x30 [target_core_mod] > [70132.335878] [<ffffffffa067c347>] __target_execute_cmd+0x27/0x80 [target_core_mod] > [70132.335884] [<ffffffffa067c6ee>] target_execute_cmd+0xde/0x180 [target_core_mod] > [70132.335889] [<ffffffffa06ecef8>] iscsit_execute_cmd+0x228/0x290 [iscsi_target_mod] > [70132.335895] [<ffffffffa06f7bbd>] iscsit_sequence_cmd+0xfd/0x1d0 [iscsi_target_mod] > [70132.335897] [<ffffffffa075e0dd>] isert_handle_scsi_cmd+0x8d/0x1b0 [ib_isert] > [70132.335902] [<ffffffffa06f7d0b>] ? iscsit_allocate_cmd+0x7b/0x120 [iscsi_target_mod] > [70132.335905] [<ffffffffa075ef35>] isert_rx_opcode+0x245/0x2d0 [ib_isert] > [70132.335909] [<ffffffffa0421e14>] ? mlx4_ib_poll_one+0x324/0x680 [mlx4_ib] > [70132.335911] [<ffffffffa075f026>] isert_rx_do_work+0x66/0x180 [ib_isert] > [70132.335915] [<ffffffffa042222e>] ? mlx4_ib_poll_cq+0xbe/0xd0 [mlx4_ib] > [70132.335917] [<ffffffffa075f977>] isert_rx_completion+0x97/0x2a0 [ib_isert] > [70132.335919] [<ffffffffa075fcab>] isert_cq_rx_work+0x12b/0x1b0 [ib_isert] > [70132.335922] [<ffffffff810685a3>] process_one_work+0x183/0x490 > [70132.335923] [<ffffffff81069a7f>] worker_thread+0x11f/0x3a0 > [70132.335925] [<ffffffff81069960>] ? manage_workers+0x160/0x160 > [70132.335927] [<ffffffff8106f99e>] kthread+0xce/0xe0 > [70132.335929] [<ffffffff8106f8d0>] ? kthread_freezable_should_stop+0x70/0x70 > [70132.335931] [<ffffffff8156026c>] ret_from_fork+0x7c/0xb0 > [70132.335933] [<ffffffff8106f8d0>] ? kthread_freezable_should_stop+0x70/0x70 It appears that iblock_submit_bio() -> submit_bio -> mtip_make_request() -> mtip_hw_get_scatterlist() is blocked on the mtip port semaphore, and never gets released.. iser-target expects iblock_submit_bio() to (eventually) return, and the rest of the hung_task_timeout messages are due to this kworker thread not returning when isert_cq_rx_work() is expected to process work completions during session reinstatement events. > [70252.218389] INFO: task iscsi_ttx:8861 blocked for more than 120 seconds. > [70252.218393] Tainted: GF 3.12.19+ #2 > [70252.218393] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. > [70252.218395] iscsi_ttx D ffffffff81613440 0 8861 2 0x00000004 > [70252.218397] ffff88045deefc78 0000000000000046 ffff88045deeffd8 0000000000012d40 > [70252.218400] ffff88045deee010 0000000000012d40 0000000000012d40 0000000000012d40 > [70252.218403] ffff88045deeffd8 0000000000012d40 ffff88046ed18aa0 ffff88046f9a5500 > [70252.218405] Call Trace: > [70252.218418] [<ffffffff81556239>] schedule+0x29/0x70 > [70252.218420] [<ffffffff81553c75>] schedule_timeout+0x175/0x200 > [70252.218433] [<ffffffffa03eabc8>] ? ib_modify_qp+0x18/0x20 [ib_core] > [70252.218436] [<ffffffffa074dcb4>] ? cma_modify_qp_err+0x64/0x80 [rdma_cm] > [70252.218438] [<ffffffff815561d6>] wait_for_completion+0xc6/0x100 > [70252.218441] [<ffffffff81080c90>] ? try_to_wake_up+0x2c0/0x2c0 > [70252.218444] [<ffffffffa075d7a7>] isert_wait_conn+0x77/0xf0 [ib_isert] > [70252.218452] [<ffffffffa06fab5e>] iscsit_close_connection+0xce/0x560 [iscsi_target_mod] > [70252.218457] [<ffffffffa06ea853>] iscsit_take_action_for_connection_exit+0x83/0x110 [iscsi_target_mod] > [70252.218463] [<ffffffffa06fbae0>] iscsi_target_tx_thread+0x180/0x220 [iscsi_target_mod] > [70252.218467] [<ffffffff810701e0>] ? wake_up_bit+0x40/0x40 > [70252.218472] [<ffffffffa06fb960>] ? iscsit_handle_snack+0x190/0x190 [iscsi_target_mod] > [70252.218474] [<ffffffff8106f99e>] kthread+0xce/0xe0 > [70252.218476] [<ffffffff8106f8d0>] ? kthread_freezable_should_stop+0x70/0x70 > [70252.218480] [<ffffffff8156026c>] ret_from_fork+0x7c/0xb0 > [70252.218482] [<ffffffff8106f8d0>] ? kthread_freezable_should_stop+0x70/0x70 > [70252.218488] INFO: task iscsi_np:9024 blocked for more than 120 seconds. > [70252.218489] Tainted: GF 3.12.19+ #2 > [70252.218490] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. > [70252.218491] iscsi_np D ffffffff81613440 0 9024 2 0x00000004 > [70252.218492] ffff88045df07be8 0000000000000046 ffff88045df07fd8 0000000000012d40 > [70252.218495] ffff88045df06010 0000000000012d40 0000000000012d40 0000000000012d40 > [70252.218497] ffff88045df07fd8 0000000000012d40 ffff88045d65aaa0 ffff88046f9a4aa0 > [70252.218499] Call Trace: > [70252.218501] [<ffffffff81556239>] schedule+0x29/0x70 > [70252.218503] [<ffffffff81553c75>] schedule_timeout+0x175/0x200 > [70252.218506] [<ffffffff812753b6>] ? vsnprintf+0x416/0x5b0 > [70252.218510] [<ffffffffa06e4582>] ? iscsi_update_param_value+0x32/0x90 [iscsi_target_mod] > [70252.218512] [<ffffffff815561d6>] wait_for_completion+0xc6/0x100 > [70252.218514] [<ffffffff81080c90>] ? try_to_wake_up+0x2c0/0x2c0 > [70252.218519] [<ffffffffa06fa195>] iscsit_stop_session+0x1a5/0x1c0 [iscsi_target_mod] > [70252.218525] [<ffffffffa06efc2b>] iscsi_check_for_session_reinstatement+0x1db/0x250 [iscsi_target_mod] > [70252.218530] [<ffffffffa06f0ee5>] iscsi_target_check_for_existing_instances+0x35/0x40 [iscsi_target_mod] > [70252.218534] [<ffffffffa06f130b>] iscsi_target_handle_csg_one+0x8b/0x150 [iscsi_target_mod] > [70252.218539] [<ffffffffa06f160e>] iscsi_target_do_login+0xee/0x180 [iscsi_target_mod] > [70252.218544] [<ffffffffa06f16c7>] iscsi_target_start_negotiation+0x27/0xb0 [iscsi_target_mod] > [70252.218548] [<ffffffffa06f059e>] __iscsi_target_login_thread+0x26e/0x630 [iscsi_target_mod] > [70252.218553] [<ffffffffa06f0960>] ? __iscsi_target_login_thread+0x630/0x630 [iscsi_target_mod] > [70252.218557] [<ffffffffa06f0991>] iscsi_target_login_thread+0x31/0x40 [iscsi_target_mod] > [70252.218559] [<ffffffff8106f99e>] kthread+0xce/0xe0 > [70252.218562] [<ffffffff8106f8d0>] ? kthread_freezable_should_stop+0x70/0x70 > [70252.218564] [<ffffffff8156026c>] ret_from_fork+0x7c/0xb0 > [70252.218566] [<ffffffff8106f8d0>] ? kthread_freezable_should_stop+0x70/0x70 > [70252.218569] INFO: task iscsi_np:9120 blocked for more than 120 seconds. > [70252.218569] Tainted: GF 3.12.19+ #2 > [70252.218570] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. > [70252.218571] iscsi_np D ffffffff81613440 0 9120 2 0x00000004 > [70252.218572] ffff880450f77be8 0000000000000046 ffff880450f77fd8 0000000000012d40 > [70252.218574] ffff880450f76010 0000000000012d40 0000000000012d40 0000000000012d40 > [70252.218577] ffff880450f77fd8 0000000000012d40 ffff880450f2eaa0 ffff88046f9a4aa0 > [70252.218579] Call Trace: > [70252.218581] [<ffffffff81556239>] schedule+0x29/0x70 > [70252.218582] [<ffffffff81553c75>] schedule_timeout+0x175/0x200 > [70252.218584] [<ffffffff812753b6>] ? vsnprintf+0x416/0x5b0 > [70252.218589] [<ffffffffa06e4582>] ? iscsi_update_param_value+0x32/0x90 [iscsi_target_mod] > [70252.218591] [<ffffffff815561d6>] wait_for_completion+0xc6/0x100 > [70252.218593] [<ffffffff81080c90>] ? try_to_wake_up+0x2c0/0x2c0 > [70252.218598] [<ffffffffa06fa195>] iscsit_stop_session+0x1a5/0x1c0 [iscsi_target_mod] > [70252.218602] [<ffffffffa06efc2b>] iscsi_check_for_session_reinstatement+0x1db/0x250 [iscsi_target_mod] > [70252.218607] [<ffffffffa06f0ee5>] iscsi_target_check_for_existing_instances+0x35/0x40 [iscsi_target_mod] > [70252.218611] [<ffffffffa06f130b>] iscsi_target_handle_csg_one+0x8b/0x150 [iscsi_target_mod] > [70252.218616] [<ffffffffa06f160e>] iscsi_target_do_login+0xee/0x180 [iscsi_target_mod] > [70252.218621] [<ffffffffa06f16c7>] iscsi_target_start_negotiation+0x27/0xb0 [iscsi_target_mod] > [70252.218626] [<ffffffffa06f059e>] __iscsi_target_login_thread+0x26e/0x630 [iscsi_target_mod] > [70252.218630] [<ffffffffa06f0960>] ? __iscsi_target_login_thread+0x630/0x630 [iscsi_target_mod] > [70252.218635] [<ffffffffa06f0991>] iscsi_target_login_thread+0x31/0x40 [iscsi_target_mod] > [70252.218637] [<ffffffff8106f99e>] kthread+0xce/0xe0 > [70252.218639] [<ffffffff8106f8d0>] ? kthread_freezable_should_stop+0x70/0x70 > [70252.218641] [<ffffffff8156026c>] ret_from_fork+0x7c/0xb0 > [70252.218643] [<ffffffff8106f8d0>] ? kthread_freezable_should_stop+0x70/0x70 > [70252.218648] INFO: task iscsi_trx:15334 blocked for more than 120 seconds. > [70252.218649] Tainted: GF 3.12.19+ #2 > [70252.218650] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. > [70252.218651] iscsi_trx D ffffffff81613440 0 15334 2 0x00000004 > [70252.218652] ffff88044569bc48 0000000000000046 ffff88044569bfd8 0000000000012d40 > [70252.218654] ffff88044569a010 0000000000012d40 0000000000012d40 0000000000012d40 > [70252.218656] ffff88044569bfd8 0000000000012d40 ffff88046a87a080 ffff88046f9a4aa0 > [70252.218659] Call Trace: > [70252.218661] [<ffffffff81556239>] schedule+0x29/0x70 > [70252.218662] [<ffffffff81553c75>] schedule_timeout+0x175/0x200 > [70252.218666] [<ffffffffa03eabc8>] ? ib_modify_qp+0x18/0x20 [ib_core] > [70252.218669] [<ffffffffa074dcb4>] ? cma_modify_qp_err+0x64/0x80 [rdma_cm] > [70252.218671] [<ffffffff815561d6>] wait_for_completion+0xc6/0x100 > [70252.218673] [<ffffffff81080c90>] ? try_to_wake_up+0x2c0/0x2c0 > [70252.218675] [<ffffffffa075d7a7>] isert_wait_conn+0x77/0xf0 [ib_isert] > [70252.218680] [<ffffffffa06fab5e>] iscsit_close_connection+0xce/0x560 [iscsi_target_mod] > [70252.218682] [<ffffffff81080c90>] ? try_to_wake_up+0x2c0/0x2c0 > [70252.218687] [<ffffffffa06ea853>] iscsit_take_action_for_connection_exit+0x83/0x110 [iscsi_target_mod] > [70252.218692] [<ffffffffa06ffbcf>] iscsi_target_rx_thread+0x21f/0x300 [iscsi_target_mod] > [70252.218694] [<ffffffff81555d6b>] ? __schedule+0x3db/0x6e0 > [70252.218699] [<ffffffffa06ff9b0>] ? iscsi_target_rx_opcode+0x280/0x280 [iscsi_target_mod] > [70252.218703] [<ffffffffa06ff9b0>] ? iscsi_target_rx_opcode+0x280/0x280 [iscsi_target_mod] > [70252.218706] [<ffffffff8106f99e>] kthread+0xce/0xe0 > [70252.218708] [<ffffffff8106f8d0>] ? kthread_freezable_should_stop+0x70/0x70 > [70252.218710] [<ffffffff8156026c>] ret_from_fork+0x7c/0xb0 > [70252.218712] [<ffffffff8106f8d0>] ? kthread_freezable_should_stop+0x70/0x70 > [70252.218722] INFO: task kworker/u33:4:19729 blocked for more than 120 seconds. > [70252.218722] Tainted: GF 3.12.19+ #2 > [70252.218723] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. > [70252.218724] kworker/u33:4 D ffffffff81613440 0 19729 2 0x00000000 > [70252.218728] Workqueue: isert_rx_wq isert_cq_rx_work [ib_isert] > [70252.218729] ffff880075f61828 0000000000000046 ffff880075f61fd8 0000000000012d40 > [70252.218731] ffff880075f60010 0000000000012d40 0000000000012d40 0000000000012d40 > [70252.218733] ffff880075f61fd8 0000000000012d40 ffff88044fe33500 ffffffff81a10480 > [70252.218735] Call Trace: > [70252.218737] [<ffffffff81556239>] schedule+0x29/0x70 > [70252.218739] [<ffffffff81553c75>] schedule_timeout+0x175/0x200 > [70252.218741] [<ffffffff815555ca>] __down+0x6a/0xa0 > [70252.218743] [<ffffffff81074fc1>] down+0x41/0x50 > [70252.218750] [<ffffffffa021028e>] mtip_hw_get_scatterlist+0x3e/0x140 [mtip32xx] > [70252.218753] [<ffffffffa0210416>] mtip_make_request+0x86/0x2d0 [mtip32xx] > [70252.218757] [<ffffffff8124933a>] generic_make_request+0xca/0x100 > [70252.218759] [<ffffffff812493dc>] submit_bio+0x6c/0x140 > [70252.218764] [<ffffffffa0370a77>] ? dm_merge_bvec+0x97/0xe0 [dm_mod] > [70252.218767] [<ffffffffa06cc58c>] iblock_submit_bios+0x4c/0x80 [target_core_iblock] > [70252.218769] [<ffffffffa06cd0cc>] iblock_execute_rw+0x32c/0x340 [target_core_iblock] > [70252.218772] [<ffffffff8127a969>] ? sg_miter_get_next_page+0x29/0x80 > [70252.218782] [<ffffffffa067d462>] sbc_execute_rw+0x22/0x30 [target_core_mod] > [70252.218788] [<ffffffffa067c347>] __target_execute_cmd+0x27/0x80 [target_core_mod] > [70252.218793] [<ffffffffa067c6ee>] target_execute_cmd+0xde/0x180 [target_core_mod] > [70252.218799] [<ffffffffa06ecef8>] iscsit_execute_cmd+0x228/0x290 [iscsi_target_mod] > [70252.218804] [<ffffffffa06f7bbd>] iscsit_sequence_cmd+0xfd/0x1d0 [iscsi_target_mod] > [70252.218807] [<ffffffffa075e0dd>] isert_handle_scsi_cmd+0x8d/0x1b0 [ib_isert] > [70252.218812] [<ffffffffa06f7d0b>] ? iscsit_allocate_cmd+0x7b/0x120 [iscsi_target_mod] > [70252.218814] [<ffffffffa075ef35>] isert_rx_opcode+0x245/0x2d0 [ib_isert] > [70252.218818] [<ffffffffa0421e14>] ? mlx4_ib_poll_one+0x324/0x680 [mlx4_ib] > [70252.218821] [<ffffffffa075f026>] isert_rx_do_work+0x66/0x180 [ib_isert] > [70252.218824] [<ffffffffa042222e>] ? mlx4_ib_poll_cq+0xbe/0xd0 [mlx4_ib] > [70252.218826] [<ffffffffa075f977>] isert_rx_completion+0x97/0x2a0 [ib_isert] > [70252.218829] [<ffffffffa075fcab>] isert_cq_rx_work+0x12b/0x1b0 [ib_isert] > [70252.218831] [<ffffffff810685a3>] process_one_work+0x183/0x490 > [70252.218833] [<ffffffff81069a7f>] worker_thread+0x11f/0x3a0 > [70252.218834] [<ffffffff81069960>] ? manage_workers+0x160/0x160 > [70252.218836] [<ffffffff8106f99e>] kthread+0xce/0xe0 > [70252.218839] [<ffffffff8106f8d0>] ? kthread_freezable_should_stop+0x70/0x70 > [70252.218841] [<ffffffff8156026c>] ret_from_fork+0x7c/0xb0 > [70252.218843] [<ffffffff8106f8d0>] ? kthread_freezable_should_stop+0x70/0x70 Ditto here as well.. > [70372.101187] INFO: task iscsi_ttx:8861 blocked for more than 120 seconds. > [70372.101191] Tainted: GF 3.12.19+ #2 > [70372.101192] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. > [70372.101193] iscsi_ttx D ffffffff81613440 0 8861 2 0x00000004 > [70372.101203] ffff88045deefc78 0000000000000046 ffff88045deeffd8 0000000000012d40 > [70372.101206] ffff88045deee010 0000000000012d40 0000000000012d40 0000000000012d40 > [70372.101209] ffff88045deeffd8 0000000000012d40 ffff88046ed18aa0 ffff88046f9a5500 > [70372.101211] Call Trace: > [70372.101217] [<ffffffff81556239>] schedule+0x29/0x70 > [70372.101219] [<ffffffff81553c75>] schedule_timeout+0x175/0x200 > [70372.101232] [<ffffffffa03eabc8>] ? ib_modify_qp+0x18/0x20 [ib_core] > [70372.101235] [<ffffffffa074dcb4>] ? cma_modify_qp_err+0x64/0x80 [rdma_cm] > [70372.101237] [<ffffffff815561d6>] wait_for_completion+0xc6/0x100 > [70372.101240] [<ffffffff81080c90>] ? try_to_wake_up+0x2c0/0x2c0 > [70372.101243] [<ffffffffa075d7a7>] isert_wait_conn+0x77/0xf0 [ib_isert] > [70372.101251] [<ffffffffa06fab5e>] iscsit_close_connection+0xce/0x560 [iscsi_target_mod] > [70372.101257] [<ffffffffa06ea853>] iscsit_take_action_for_connection_exit+0x83/0x110 [iscsi_target_mod] > [70372.101262] [<ffffffffa06fbae0>] iscsi_target_tx_thread+0x180/0x220 [iscsi_target_mod] > [70372.101265] [<ffffffff810701e0>] ? wake_up_bit+0x40/0x40 > [70372.101271] [<ffffffffa06fb960>] ? iscsit_handle_snack+0x190/0x190 [iscsi_target_mod] > [70372.101273] [<ffffffff8106f99e>] kthread+0xce/0xe0 > [70372.101275] [<ffffffff8106f8d0>] ? kthread_freezable_should_stop+0x70/0x70 > [70372.101277] [<ffffffff8156026c>] ret_from_fork+0x7c/0xb0 > [70372.101279] [<ffffffff8106f8d0>] ? kthread_freezable_should_stop+0x70/0x70 > [70372.101286] INFO: task iscsi_np:9024 blocked for more than 120 seconds. > [70372.101287] Tainted: GF 3.12.19+ #2 > [70372.101288] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. > [70372.101289] iscsi_np D ffffffff81613440 0 9024 2 0x00000004 > [70372.101290] ffff88045df07be8 0000000000000046 ffff88045df07fd8 0000000000012d40 > [70372.101293] ffff88045df06010 0000000000012d40 0000000000012d40 0000000000012d40 > [70372.101295] ffff88045df07fd8 0000000000012d40 ffff88045d65aaa0 ffff88046f9a4aa0 > [70372.101297] Call Trace: > [70372.101299] [<ffffffff81556239>] schedule+0x29/0x70 > [70372.101301] [<ffffffff81553c75>] schedule_timeout+0x175/0x200 > [70372.101304] [<ffffffff812753b6>] ? vsnprintf+0x416/0x5b0 > [70372.101309] [<ffffffffa06e4582>] ? iscsi_update_param_value+0x32/0x90 [iscsi_target_mod] > [70372.101311] [<ffffffff815561d6>] wait_for_completion+0xc6/0x100 > [70372.101313] [<ffffffff81080c90>] ? try_to_wake_up+0x2c0/0x2c0 > [70372.101318] [<ffffffffa06fa195>] iscsit_stop_session+0x1a5/0x1c0 [iscsi_target_mod] > [70372.101323] [<ffffffffa06efc2b>] iscsi_check_for_session_reinstatement+0x1db/0x250 [iscsi_target_mod] > [70372.101328] [<ffffffffa06f0ee5>] iscsi_target_check_for_existing_instances+0x35/0x40 [iscsi_target_mod] > [70372.101333] [<ffffffffa06f130b>] iscsi_target_handle_csg_one+0x8b/0x150 [iscsi_target_mod] > [70372.101338] [<ffffffffa06f160e>] iscsi_target_do_login+0xee/0x180 [iscsi_target_mod] > [70372.101342] [<ffffffffa06f16c7>] iscsi_target_start_negotiation+0x27/0xb0 [iscsi_target_mod] > [70372.101347] [<ffffffffa06f059e>] __iscsi_target_login_thread+0x26e/0x630 [iscsi_target_mod] > [70372.101351] [<ffffffffa06f0960>] ? __iscsi_target_login_thread+0x630/0x630 [iscsi_target_mod] > [70372.101356] [<ffffffffa06f0991>] iscsi_target_login_thread+0x31/0x40 [iscsi_target_mod] > [70372.101358] [<ffffffff8106f99e>] kthread+0xce/0xe0 > [70372.101360] [<ffffffff8106f8d0>] ? kthread_freezable_should_stop+0x70/0x70 > [70372.101362] [<ffffffff8156026c>] ret_from_fork+0x7c/0xb0 > [70372.101364] [<ffffffff8106f8d0>] ? kthread_freezable_should_stop+0x70/0x70 > [71125.139998] TARGET_CORE[iSCSI]: Unsupported SCSI Opcode 0x85, sending CHECK_CONDITION. > [71125.144194] TARGET_CORE[iSCSI]: Unsupported SCSI Opcode 0x85, sending CHECK_CONDITION. > [71125.148195] TARGET_CORE[iSCSI]: Unsupported SCSI Opcode 0x85, sending CHECK_CONDITION. > [71125.152161] TARGET_CORE[iSCSI]: Unsupported SCSI Opcode 0x85, sending CHECK_CONDITION. > [71125.155908] TARGET_CORE[iSCSI]: Unsupported SCSI Opcode 0x85, sending CHECK_CONDITION. > -- -- To unsubscribe from this list: send the line "unsubscribe target-devel" in the body of a message to majordomo@xxxxxxxxxxxxxxx More majordomo info at http://vger.kernel.org/majordomo-info.html
