On Wed, 2014-05-14 at 17:23 -0700, Jun Wu wrote: > On Wed, May 14, 2014 at 2:39 PM, Nicholas A. Bellinger > <nab@xxxxxxxxxxxxxxx> wrote: > > On Tue, 2014-05-13 at 14:52 -0700, Jun Wu wrote: > >> Hi Nicholas, > >> > >> We had to roll back system from 3.14 to 3.11 due to compile issues of > >> our software. So I am not able to verify your fix at this point. > > > > That is unfortunate your stuck on a now unsupported stable kernel. > > There are some other libfc related fixes that have gone in during the > > v3.13 timeframe, so I'd strongly recommend upgrading to at least that > > stable version. > > > > In any event, I'll be pushing that particular >= v3.13.y patch anyways, > > as it's a obvious regression bugfix for percpu-ida pre-allocation. > > > >> I ran the same tests on 3.11 instead. > >> > >> In one case the target crashed with following message: > >> > >> May 13 13:06:25 poc2 kernel: BUG: unable to handle kernel paging > >> request at ffffffffffffffa4 > >> May 13 13:06:25 poc2 kernel: IP: [<ffffffff8164ac07>] > >> _raw_spin_lock_bh+0x17/0x40 > >> May 13 13:06:25 poc2 kernel: PGD 1c0f067 PUD 1c11067 PMD 0 > >> May 13 13:06:25 poc2 kernel: Oops: 0002 [#1] SMP > >> May 13 13:06:25 poc2 kernel: Modules linked in: fcoe libfcoe 8021q > > garp mrp tcm_fc libfc scsi_transport_fc scsi_tgt target_core_pscsi > >> target_core_file target_core_iblock iscsi_target_mod target_core_mod > >> ip6t_rpfilter ip6t_REJECT xt_conntrack ebtable_nat ebtable_broute > >> bridge stp llc ebtable_filter ebtables ip6table_nat nf_conntrack_ipv6 > >> nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security > >> ip6table_raw ip6table_filter ip6_tables iptable_nat nf_conntrack_ipv4 > >> nf_defrag_ipv4 nf_nat_ipv4 nf_nat nf_conntrack iptable_mangle > >> iptable_security iptable_raw nfsd auth_rpcgss nfs_acl lockd sunrpc > >> ixgbe mdio igb ptp pps_core serio_raw ses enclosure iTCO_wdt > >> iTCO_vendor_support lpc_ich mfd_core shpchp i2c_i801 coretemp > >> kvm_intel kvm crc32c_intel microcode i7core_edac ioatdma acpi_cpufreq > >> edac_core dca mperf radeon i2c_algo_bit > >> May 13 13:06:25 poc2 kernel: drm_kms_helper ttm drm ata_generic > >> i2c_core pata_acpi pata_jmicron aacraid > >> May 13 13:06:25 poc2 kernel: CPU: 0 PID: 1810 Comm: kworker/0:0 Not > >> tainted 3.11.10-301.fc20.x86_64 #1 > >> May 13 13:06:25 poc2 kernel: Hardware name: Supermicro X8DTN/X8DTN, > >> BIOS 2.1c 10/28/2011 > >> May 13 13:06:25 poc2 kernel: Workqueue: target_completion target_complete_ok_work [target_core_mod] > >> May 13 13:06:25 poc2 kernel: task: ffff88032c5096e0 ti: ffff88031bb78000 task.ti: ffff88031bb78000 > >> May 13 13:06:25 poc2 kernel: RIP: 0010:[<ffffffff8164ac07>] [<ffffffff8164ac07>] _raw_spin_lock_bh+0x17/0x40 > >> May 13 13:06:25 poc2 kernel: RSP: 0018:ffff88031bb79cf0 EFLAGS: 00010206 > >> May 13 13:06:25 poc2 kernel: RAX: 0000000000000100 RBX: ffffffffffffffa4 RCX: 0000000000000000 > >> May 13 13:06:25 poc2 kernel: RDX: 0000000000000000 RSI: 0000000000000000 RDI: ffffffffffffffa4 > >> May 13 13:06:25 poc2 kernel: RBP: ffff88031bb79cf8 R08: 00000000ffffffff R09: ffff88031a37f678 > >> May 13 13:06:25 poc2 kernel: R10: 0000000000000001 R11: 0000000000000044 R12: 0000000000000000 > >> May 13 13:06:25 poc2 kernel: R13: ffff88031a37f678 R14: ffff88062d9fd6c8 R15: ffff88032c6da05c > >> May 13 13:06:25 poc2 kernel: FS: 0000000000000000(0000) GS:ffff880333c00000(0000) knlGS:0000000000000000 > >> May 13 13:06:25 poc2 kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b > >> May 13 13:06:25 poc2 kernel: CR2: ffffffffffffffa4 CR3: 0000000001c0c000 CR4: 00000000000007f0 > >> May 13 13:06:25 poc2 kernel: Stack: > >> May 13 13:06:25 poc2 kernel: ffffffffffffffa4 ffff88031bb79d18 ffffffffa0594d2b ffff880328d13410 > >> May 13 13:06:25 poc2 kernel: ffff88031a37c200 ffff88031bb79d58 ffffffffa05356f2 0000000000000018 > >> May 13 13:06:25 poc2 kernel: ffff88062cea8800 0000000000000000 ffffea000c8eb640 0000000000000000 > >> May 13 13:06:25 poc2 kernel: Call Trace: > >> May 13 13:06:25 poc2 kernel: [<ffffffffa0594d2b>] fc_seq_start_next+0x1b/0x40 [libfc] > >> May 13 13:06:25 poc2 kernel: [<ffffffffa05356f2>] ft_queue_status+0xf2/0x220 [tcm_fc] > >> May 13 13:06:25 poc2 kernel: [<ffffffffa0536972>] ft_queue_data_in+0x72/0x5a0 [tcm_fc] > >> May 13 13:06:25 poc2 kernel: [<ffffffffa04f57ba>] target_complete_ok_work+0x14a/0x2b0 [target_core_mod] > >> May 13 13:06:25 poc2 kernel: [<ffffffff810810f5>] process_one_work+0x175/0x430 > >> May 13 13:06:25 poc2 kernel: [<ffffffff81081d1b>] worker_thread+0x11b/0x3a0 > >> May 13 13:06:25 poc2 kernel: [<ffffffff81081c00>] ? rescuer_thread+0x340/0x340 > >> May 13 13:06:25 poc2 kernel: [<ffffffff81088660>] kthread+0xc0/0xd0 > >> May 13 13:06:25 poc2 kernel: [<ffffffff810885a0>] ? insert_kthread_work+0x40/0x40 > >> May 13 13:06:25 poc2 kernel: [<ffffffff8165332c>] ret_from_fork+0x7c/0xb0 > >> May 13 13:06:25 poc2 kernel: [<ffffffff810885a0>] ? insert_kthread_work+0x40/0x40 > >> May 13 13:06:25 poc2 kernel: Code: 1f 44 00 00 f3 90 0f b6 07 38 d0 75 > >> f7 5d c3 0f 1f 44 00 00 66 66 66 66 90 55 48 89 e5 53 48 89 fb e8 7e > >> 05 a2 ff b8 00 01 00 00 <f0> 66 0f c1 03 0f b6 d4 38 c2 74 0e 0f 1f 44 > >> 00 00 f3 90 0f b6 > >> May 13 13:06:25 poc2 kernel: RIP [<ffffffff8164ac07>] _raw_spin_lock_bh+0x17/0x40 > >> > > > > So before we start debugging again, please confirm that this is a > > *completely* stock v3.11.10 build, and that your not building > > out-of-tree target modules again. > > Yes we installed official Fedora 20 iso image and then > yum install targetcli > modprobe fcoe > > Kernel version is 3.11.10-301.fc20.x86_64 which is a stock kernel distribution. > So I'd still recommend >= v3.13.y in order to pick-up the other libfc related bugfixes that have gone in since v3.11.y ran out of stable support some months ago. I can't tell if that is related to the bug(s) that your hitting on both initiator + target sides here, but it definitely would not hurt. Also, here is the updated >= v3.13.y percpu-ida pre-allocation regression fix that will be going into v3.15-rc6 shortly. Note this is different from the original version, so please make sure you use this one instead. https://git.kernel.org/cgit/linux/kernel/git/nab/target-pending.git/commit/?id=e7c36ac16b91bf09e94f82d1838f0f9f114bed08 --nab -- To unsubscribe from this list: send the line "unsubscribe target-devel" in the body of a message to majordomo@xxxxxxxxxxxxxxx More majordomo info at http://vger.kernel.org/majordomo-info.html
