Hi Santosh, On Wed, 2014-06-18 at 15:34 +0530, Santosh Kulkarni wrote: > Hi Nab, > > Facing Kernel OOP when i am issuing Writes across Multiple connections > in a single session. > The crash happens immediately when the DataOut PDU is sent on the second > connection. > To confirm, this occurs when the initiator sends a ISCSI_OP_SCSI_CMD with ITT=X setting it's allegiance to one connection, and then (illegally) sends a ISCSI_OP_SCSI_DATA_OUT with ITT=X on another connection, right..? Please include a wireshark capture, along with iscsi_target_mod pr_debug output enabled. Thanks, --nab > > Here is the Crash Dump > > [188185.653521] ------------[ cut here ]------------ > [188185.653527] WARNING: CPU: 0 PID: 963 at lib/list_debug.c:33 > __list_add+0xbe/0xd0() > [188185.653529] list_add corruption. prev->next should be next > (ffff88003ccf3100), but was ffff8800269276a0. (prev=ffff8800269276a0). > [188185.653529] Modules linked in: target_core_pscsi target_core_file > target_core_iblock iscsi_target_mod target_core_mod bnep bluetooth > 6lowpan_iphc rfkill ip6t_REJECT nf_conntrack_ipv6 nf_defrag_ipv6 > xt_state nf_conntrack ip6table_filter ip6_tables snd_intel8x0 > snd_ac97_codec ac97_bus joydev snd_seq snd_seq_device snd_pcm ppdev > pcspkr e1000 microcode parport_pc parport snd_timer snd soundcore > i2c_piix4 i2c_core uinput > [188185.653545] CPU: 0 PID: 963 Comm: iscsi_trx Tainted: G W > 3.14.0-rc6+ #3 > [188185.653546] Hardware name: innotek GmbH VirtualBox, BIOS VirtualBox > 12/01/2006 > [188185.653547] 0000000000000009 ffff88003bbc9bd8 ffffffff81693b55 > 0000000000000007 > [188185.653549] ffff88003bbc9c28 ffff88003bbc9c18 ffffffff8106d82c > ffff88003bf8a400 > [188185.653551] ffff8800269276a0 ffff88003ccf3100 ffff8800269276a0 > 0000000000000246 > [188185.653552] Call Trace: > [188185.653555] [<ffffffff81693b55>] dump_stack+0x46/0x58 > [188185.653557] [<ffffffff8106d82c>] warn_slowpath_common+0x8c/0xc0 > [188185.653559] [<ffffffff8106d916>] warn_slowpath_fmt+0x46/0x50 > [188185.653569] [<ffffffffa01f6dba>] ? target_alloc_sgl+0xca/0x150 > [target_core_mod] > [188185.653570] [<ffffffff8133a07e>] __list_add+0xbe/0xd0 > [188185.653577] [<ffffffffa01f6f52>] > transport_generic_new_cmd+0x112/0x1b0 [target_core_mod] > [188185.653582] [<ffffffffa01f7034>] > transport_handle_cdb_direct+0x44/0xa0 [target_core_mod] > [188185.653588] [<ffffffffa023b404>] iscsit_execute_cmd+0x264/0x290 > [iscsi_target_mod] > [188185.653593] [<ffffffffa024444d>] iscsit_sequence_cmd+0xcd/0x1b0 > [iscsi_target_mod] > [188185.653598] [<ffffffffa0247798>] iscsit_process_scsi_cmd+0x98/0x120 > [iscsi_target_mod] > [188185.653602] [<ffffffffa024ac79>] iscsi_target_rx_thread+0x569/0xf00 > [iscsi_target_mod] > [188185.653605] [<ffffffff810a9274>] ? dequeue_task_fair+0x314/0x4e0 > [188185.653607] [<ffffffff8169722e>] ? __schedule+0x2de/0x740 > [188185.653611] [<ffffffffa024a710>] ? > iscsi_target_tx_thread+0x210/0x210 [iscsi_target_mod] > [188185.653613] [<ffffffff8108fec9>] kthread+0xc9/0xe0 > [188185.653615] [<ffffffff8108fe00>] ? flush_kthread_worker+0x80/0x80 > [188185.653617] [<ffffffff816a2fac>] ret_from_fork+0x7c/0xb0 > [188185.653619] [<ffffffff8108fe00>] ? flush_kthread_worker+0x80/0x80 > [188185.653620] ---[ end trace 3dd841d40b2b0701 ]--- > [188185.653621] ------------[ cut here ]------------ > [188185.653622] WARNING: CPU: 0 PID: 963 at lib/list_debug.c:36 > __list_add+0x9c/0xd0() > [188185.653623] list_add double add: new=ffff8800269276a0, > prev=ffff8800269276a0, next=ffff88003ccf3100. > [188185.653624] Modules linked in: target_core_pscsi target_core_file > target_core_iblock iscsi_target_mod target_core_mod bnep bluetooth > 6lowpan_iphc rfkill ip6t_REJECT nf_conntrack_ipv6 nf_defrag_ipv6 > xt_state nf_conntrack ip6table_filter ip6_tables snd_intel8x0 > snd_ac97_codec ac97_bus joydev snd_seq snd_seq_device snd_pcm ppdev > pcspkr e1000 microcode parport_pc parport snd_timer snd soundcore > i2c_piix4 i2c_core uinput > [188185.653633] CPU: 0 PID: 963 Comm: iscsi_trx Tainted: G W > 3.14.0-rc6+ #3 > [188185.653634] Hardware name: innotek GmbH VirtualBox, BIOS VirtualBox > 12/01/2006 > [188185.653634] 0000000000000009 ffff88003bbc9bd8 ffffffff81693b55 > 0000000000000007 > [188185.653636] ffff88003bbc9c28 ffff88003bbc9c18 ffffffff8106d82c > ffff88003bf8a400 > [188185.653637] ffff8800269276a0 ffff88003ccf3100 ffff8800269276a0 > 0000000000000246 > [188185.653638] Call Trace: > [188185.653640] [<ffffffff81693b55>] dump_stack+0x46/0x58 > [188185.653641] [<ffffffff8106d82c>] warn_slowpath_common+0x8c/0xc0 > [188185.653643] [<ffffffff8106d916>] warn_slowpath_fmt+0x46/0x50 > [188185.653648] [<ffffffffa01f6dba>] ? target_alloc_sgl+0xca/0x150 > [target_core_mod] > [188185.653650] [<ffffffff8133a05c>] __list_add+0x9c/0xd0 > [188185.653655] [<ffffffffa01f6f52>] > transport_generic_new_cmd+0x112/0x1b0 [target_core_mod] > [188185.653660] [<ffffffffa01f7034>] > transport_handle_cdb_direct+0x44/0xa0 [target_core_mod] > [188185.653664] [<ffffffffa023b404>] iscsit_execute_cmd+0x264/0x290 > [iscsi_target_mod] > [188185.653669] [<ffffffffa024444d>] iscsit_sequence_cmd+0xcd/0x1b0 > [iscsi_target_mod] > [188185.653674] [<ffffffffa0247798>] iscsit_process_scsi_cmd+0x98/0x120 > [iscsi_target_mod] > [188185.653678] [<ffffffffa024ac79>] iscsi_target_rx_thread+0x569/0xf00 > [iscsi_target_mod] > [188185.653680] [<ffffffff810a9274>] ? dequeue_task_fair+0x314/0x4e0 > [188185.653682] [<ffffffff8169722e>] ? __schedule+0x2de/0x740 > [188185.653686] [<ffffffffa024a710>] ? > iscsi_target_tx_thread+0x210/0x210 [iscsi_target_mod] > [188185.653688] [<ffffffff8108fec9>] kthread+0xc9/0xe0 > [188185.653689] [<ffffffff8108fe00>] ? flush_kthread_worker+0x80/0x80 > [188185.653691] [<ffffffff816a2fac>] ret_from_fork+0x7c/0xb0 > [188185.653693] [<ffffffff8108fe00>] ? flush_kthread_worker+0x80/0x80 > [188185.653694] ---[ end trace 3dd841d40b2b0702 ]--- > [188185.653963] Command ITT: 0xa3a3a3a3 received DataOUT after last > DataOUT received, dumping payload > > > Kernel Details > > [root@lio-dev ~]# uname -a > Linux lio-dev 3.14.0-rc6+ #3 SMP Thu Apr 10 13:27:04 IST 2014 x86_64 > x86_64 x86_64 GNU/Linux > > [root@lio-dev ~]# cat /sys/kernel/config/target/version > Target Engine Core ConfigFS Infrastructure v4.1.0 on Linux/x86_64 on > 3.14.0-rc6+ > > > > Regards > Santosh > -- > To unsubscribe from this list: send the line "unsubscribe target-devel" in > the body of a message to majordomo@xxxxxxxxxxxxxxx > More majordomo info at http://vger.kernel.org/majordomo-info.html -- To unsubscribe from this list: send the line "unsubscribe target-devel" in the body of a message to majordomo@xxxxxxxxxxxxxxx More majordomo info at http://vger.kernel.org/majordomo-info.html