Not the first time I've contacted the mailing list, but I really want
this to work. I've invested countless hours and money trying to
resolve this.
My configuration:
Target filer (this is the THIRD filer I have built thinking maybe it
was the hardware causing the issue)
OS: Fedora 23
targetcli shell version: 2.1.fb42
Kernel: 4.2.8-300.fc23.x86_64
motherboard: Supermicro X8DAH+-F
Power supplies: 2x 1200w gold rated PSUs
FC cards: 2x QLE2462
SCSI card: LSI 9260-8i
Disk configuration: 20x 600gb enterprise raptor 10k drives in RAID 6 +
480GB intel 730-series SSD via cachecade 2.0
Hosts:
test host 1 (host works all day without a problem)
Motherboard: Arima NM462
OS: ESXi 5.0 (build 441354)
FC card: QLE2462
SAN connection: Directly connected via two port
test host 1 (SAN crashes within about a minute of host connecting to
storage, see attached logs)
Motherboard: Arima NM462
OS: ESXi 6.0 u1 (build 3073146)
FC card: QLE2462
SAN connection: Directly connected via two port
I have tried a large number of other hosts and they all act the same
way regardless of hardware. ESXi <6 is no problem, but 6 and newer
crash the filer very quickly.
Jan 23 14:33:59 dracofiler kernel: ------------[ cut here ]------------
Jan 23 14:33:59 dracofiler kernel: kernel BUG at drivers/scsi/qla2xxx/qla_target.c:3105!
Jan 23 14:33:59 dracofiler kernel: invalid opcode: 0000 [#1] SMP
Jan 23 14:33:59 dracofiler kernel: Modules linked in: tcm_qla2xxx target_core_user uio target_core_pscsi target_core_file target_core_iblock iscsi_target_mod target_core_mod ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 xt_conntrack ebtable_filter ebtable_broute bridge stp llc ebtable_nat ebtables ip6table_raw ip6table_mangle ip6table_security ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_filter ip6_tables iptable_raw iptable_mangle iptable_security iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat nf_conntrack coretemp snd_hda_codec_realtek kvm_intel snd_hda_codec_generic kvm crct10dif_pclmul crc32_pclmul snd_hda_intel joydev snd_hda_codec iTCO_wdt gpio_ich tpm_infineon snd_hda_core iTCO_vendor_support snd_hwdep snd_seq snd_seq_device tpm_tis snd_pcm ses enclosure tpm ioatdma snd_timer snd
Jan 23 14:33:59 dracofiler kernel: lpc_ich i7core_edac edac_core soundcore i5500_temp shpchp i2c_i801 acpi_cpufreq nfsd nfs_acl lockd auth_rpcgss grace sunrpc xfs libcrc32c qla2xxx mgag200 drm_kms_helper crc32c_intel ttm serio_raw drm firewire_ohci scsi_transport_fc igb firewire_core ata_generic pata_acpi crc_itu_t ptp megaraid_sas pata_jmicron pps_core dca i2c_algo_bit
Jan 23 14:33:59 dracofiler kernel: CPU: 14 PID: 42 Comm: kworker/u50:0 Tainted: G I 4.2.8-300.fc23.x86_64 #1
Jan 23 14:33:59 dracofiler kernel: Hardware name: iXsystems iX2224-E16R1200LPB/2.5/X8DAH, BIOS 2.1 12/30/2011
Jan 23 14:33:59 dracofiler kernel: Workqueue: tmr-iblock target_tmr_work [target_core_mod]
Jan 23 14:33:59 dracofiler kernel: task: ffff880631abd4c0 ti: ffff880631ad0000 task.ti: ffff880631ad0000
Jan 23 14:33:59 dracofiler kernel: RIP: 0010:[<ffffffffa028d497>] [<ffffffffa028d497>] qlt_free_cmd+0x127/0x140 [qla2xxx]
Jan 23 14:33:59 dracofiler kernel: RSP: 0018:ffff880631ad3c68 EFLAGS: 00010002
Jan 23 14:33:59 dracofiler kernel: RAX: 0000000000000000 RBX: ffff8806211b5f00 RCX: ffffffffa02b4981
Jan 23 14:33:59 dracofiler kernel: RDX: 000000000000e074 RSI: ffff88062eefe7a8 RDI: 0000000000004000
Jan 23 14:33:59 dracofiler kernel: RBP: ffff880631ad3c98 R08: ffffffffa02a2650 R09: ffff8806211b5f00
Jan 23 14:33:59 dracofiler kernel: R10: ffff88062e9dc240 R11: ffff88062d184000 R12: ffff88062f9decc0
Jan 23 14:33:59 dracofiler kernel: R13: ffff88062eeba100 R14: 0000000000000292 R15: 0000000000000000
Jan 23 14:33:59 dracofiler kernel: FS: 0000000000000000(0000) GS:ffff88063fb80000(0000) knlGS:0000000000000000
Jan 23 14:33:59 dracofiler kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b
Jan 23 14:33:59 dracofiler kernel: CR2: 00007f64ba9e6c00 CR3: 0000000001c0b000 CR4: 00000000000006e0
Jan 23 14:33:59 dracofiler kernel: Stack:
Jan 23 14:33:59 dracofiler kernel: ffff880600000120 0000000000000292 ffff880631ad3c98 ffff8806211b5fc0
Jan 23 14:33:59 dracofiler kernel: ffff8806211b5f00 ffff88062eeba100 ffff880631ad3ca8 ffffffffa0741d64
Jan 23 14:33:59 dracofiler kernel: ffff880631ad3cd8 ffffffffa0690c32 ffff88063ffe9d80 ffff8806211b5f00
Jan 23 14:33:59 dracofiler kernel: Call Trace:
Jan 23 14:33:59 dracofiler kernel: [<ffffffffa0741d64>] tcm_qla2xxx_release_cmd+0x14/0x30 [tcm_qla2xxx]
Jan 23 14:33:59 dracofiler kernel: [<ffffffffa0690c32>] target_release_cmd_kref+0x52/0x80 [target_core_mod]
Jan 23 14:33:59 dracofiler kernel: [<ffffffffa0691a9f>] target_put_sess_cmd+0xaf/0xc0 [target_core_mod]
Jan 23 14:33:59 dracofiler kernel: [<ffffffffa0691d31>] transport_release_cmd+0x41/0x60 [target_core_mod]
Jan 23 14:33:59 dracofiler kernel: [<ffffffffa0693140>] transport_cmd_finish_abort+0xe0/0x2c0 [target_core_mod]
Jan 23 14:33:59 dracofiler kernel: [<ffffffffa068e73d>] core_tmr_abort_task+0x13d/0x1f0 [target_core_mod]
Jan 23 14:33:59 dracofiler kernel: [<ffffffffa069199a>] target_tmr_work+0xca/0xe0 [target_core_mod]
Jan 23 14:33:59 dracofiler kernel: [<ffffffff810b651e>] process_one_work+0x19e/0x3f0
Jan 23 14:33:59 dracofiler kernel: [<ffffffff810b67be>] worker_thread+0x4e/0x450
Jan 23 14:33:59 dracofiler kernel: [<ffffffff810b6770>] ? process_one_work+0x3f0/0x3f0
Jan 23 14:33:59 dracofiler kernel: [<ffffffff810bc8c8>] kthread+0xd8/0xf0
Jan 23 14:33:59 dracofiler kernel: [<ffffffff810bc7f0>] ? kthread_worker_fn+0x160/0x160
Jan 23 14:33:59 dracofiler kernel: [<ffffffff8177a69f>] ret_from_fork+0x3f/0x70
Jan 23 14:33:59 dracofiler kernel: [<ffffffff810bc7f0>] ? kthread_worker_fn+0x160/0x160
Jan 23 14:33:59 dracofiler kernel: Code: c8 4e e1 0f b6 83 c0 02 00 00 e9 61 ff ff ff be 2c 0c 00 00 48 c7 c7 88 e5 2a a0 e8 54 11 e1 e0 48 83 c4 18 5b 41 5c 41 5d 5d c3 <0f> 0b 0f 0b 48 8b bb c8 02 00 00 e8 f9 25 f7 e0 e9 4e ff ff ff
Jan 23 14:33:59 dracofiler kernel: RIP [<ffffffffa028d497>] qlt_free_cmd+0x127/0x140 [qla2xxx]
Jan 23 14:33:59 dracofiler kernel: RSP <ffff880631ad3c68>
Jan 23 14:33:59 dracofiler kernel: Detected MISCOMPARE for addr: ffff88062f708000 buf: ffff880630106e00
Jan 23 14:33:59 dracofiler kernel: Target/iblock: Send MISCOMPARE check condition and sense
Jan 23 14:33:59 dracofiler kernel: Detected MISCOMPARE for addr: ffff880627bbe000 buf: ffff880630106e00
Jan 23 14:33:59 dracofiler kernel: Target/iblock: Send MISCOMPARE check condition and sense
Jan 23 14:33:59 dracofiler kernel: ---[ end trace 0ca6e59e741e02ec ]---
Jan 23 14:33:59 dracofiler kernel: BUG: unable to handle kernel paging request at ffffffffffffffd8
Jan 23 14:33:59 dracofiler kernel: IP: [<ffffffff810bcd50>] kthread_data+0x10/0x20
Jan 23 14:33:59 dracofiler kernel: PGD 1c0e067 PUD 1c10067 PMD 0
Jan 23 14:33:59 dracofiler kernel: Oops: 0000 [#2] SMP
Jan 23 14:34:49 dracofiler systemd: systemd-udevd.service: Watchdog timeout (limit 1min)!
Jan 23 14:34:49 dracofiler audit: ANOM_ABEND auid=4294967295 uid=0 gid=0 ses=4294967295 subj=system_u:system_r:udev_t:s0-s0:c0.c1023 pid=798 comm="systemd-udevd" exe="/usr/lib/systemd/systemd-udevd" sig=6
Jan 23 14:34:59 dracofiler kernel: Modules linked in: tcm_qla2xxx target_core_user uio target_core_pscsi target_core_file target_core_iblock iscsi_target_mod target_core_mod ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 xt_conntrack ebtable_filter ebtable_broute bridge stp llc ebtable_nat ebtables ip6table_raw ip6table_mangle ip6table_security ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_filter ip6_tables iptable_raw iptable_mangle iptable_security iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat nf_conntrack coretemp snd_hda_codec_realtek kvm_intel snd_hda_codec_generic kvm crct10dif_pclmul crc32_pclmul snd_hda_intel joydev snd_hda_codec iTCO_wdt gpio_ich tpm_infineon snd_hda_core iTCO_vendor_support snd_hwdep snd_seq snd_seq_device tpm_tis snd_pcm ses enclosure tpm ioatdma snd_timer snd
Jan 23 14:34:59 dracofiler kernel: lpc_ich i7core_edac edac_core soundcore i5500_temp shpchp i2c_i801 acpi_cpufreq nfsd nfs_acl lockd auth_rpcgss grace sunrpc xfs libcrc32c qla2xxx mgag200 drm_kms_helper crc32c_intel ttm serio_raw drm firewire_ohci scsi_transport_fc igb firewire_core ata_generic pata_acpi crc_itu_t ptp megaraid_sas pata_jmicron pps_core dca i2c_algo_bit
Jan 23 14:34:59 dracofiler kernel: CPU: 5 PID: 42 Comm: kworker/u50:0 Tainted: G D I 4.2.8-300.fc23.x86_64 #1
Jan 23 14:34:59 dracofiler kernel: Hardware name: iXsystems iX2224-E16R1200LPB/2.5/X8DAH, BIOS 2.1 12/30/2011
Jan 23 14:34:59 dracofiler kernel: task: ffff880631abd4c0 ti: ffff880631ad0000 task.ti: ffff880631ad0000
Jan 23 14:34:59 dracofiler kernel: RIP: 0010:[<ffffffff810bcd50>] [<ffffffff810bcd50>] kthread_data+0x10/0x20
Jan 23 14:34:59 dracofiler kernel: RSP: 0018:ffff880631ad38d8 EFLAGS: 00010096
Jan 23 14:34:59 dracofiler kernel: RAX: 0000000000000000 RBX: 0000000000000005 RCX: 0000000000000005
Jan 23 14:34:59 dracofiler kernel: RDX: 0000000000000005 RSI: 0000000000000005 RDI: ffff880631abd4c0
Jan 23 14:34:59 dracofiler kernel: RBP: ffff880631ad38d8 R08: ffff880631abd550 R09: 0000000000000000
Jan 23 14:34:59 dracofiler kernel: R10: 0000000000000000 R11: 0000000000000000 R12: 00000000000167c0
Jan 23 14:34:59 dracofiler kernel: R13: ffff880631abd4c0 R14: ffff88063fa567c0 R15: 0000000000000005
Jan 23 14:34:59 dracofiler kernel: FS: 0000000000000000(0000) GS:ffff88063fa40000(0000) knlGS:0000000000000000
Jan 23 14:34:59 dracofiler kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b
Jan 23 14:34:59 dracofiler kernel: CR2: 0000000000000028 CR3: 0000000001c0b000 CR4: 00000000000006e0
Jan 23 14:34:59 dracofiler kernel: Stack:
Jan 23 14:34:59 dracofiler kernel: ffff880631ad38f8 ffffffff810b7395 ffff880631ad38f8 ffff88063fa567c0
Jan 23 14:34:59 dracofiler kernel: ffff880631ad3948 ffffffff81775ea0 ffff880600000000 ffff880631abd4c0
Jan 23 14:34:59 dracofiler kernel: ffff880631ad3948 ffff880631ad4000 ffff880631ad39b0 ffff880631ad39b0
Jan 23 14:34:59 dracofiler kernel: Call Trace:
Jan 23 14:34:59 dracofiler kernel: [<ffffffff810b7395>] wq_worker_sleeping+0x15/0xa0
Jan 23 14:34:59 dracofiler kernel: [<ffffffff81775ea0>] __schedule+0x620/0x950
Jan 23 14:34:59 dracofiler kernel: [<ffffffff81776207>] schedule+0x37/0x80
Jan 23 14:34:59 dracofiler kernel: [<ffffffff810a104a>] do_exit+0x80a/0xae0
Jan 23 14:34:59 dracofiler kernel: [<ffffffff810180fe>] oops_end+0x9e/0xd0
Jan 23 14:34:59 dracofiler kernel: [<ffffffff810185bb>] die+0x4b/0x70
Jan 23 14:34:59 dracofiler kernel: [<ffffffff81014cf1>] do_trap+0xb1/0x140
Jan 23 14:34:59 dracofiler kernel: [<ffffffff81014f18>] do_error_trap+0xa8/0x170
Jan 23 14:34:59 dracofiler kernel: [<ffffffffa028d497>] ? qlt_free_cmd+0x127/0x140 [qla2xxx]
Jan 23 14:34:59 dracofiler kernel: [<ffffffff810136f1>] ? __switch_to+0x261/0x4b0
Jan 23 14:34:59 dracofiler kernel: [<ffffffff81779d1e>] ? _raw_spin_unlock_irqrestore+0xe/0x10
Jan 23 14:34:59 dracofiler kernel: [<ffffffff81015750>] do_invalid_op+0x20/0x30
Jan 23 14:34:59 dracofiler kernel: [<ffffffff8177bc0e>] invalid_op+0x1e/0x30
Jan 23 14:34:59 dracofiler kernel: [<ffffffffa028d497>] ? qlt_free_cmd+0x127/0x140 [qla2xxx]
Jan 23 14:34:59 dracofiler kernel: [<ffffffffa028d3c4>] ? qlt_free_cmd+0x54/0x140 [qla2xxx]
Jan 23 14:34:59 dracofiler kernel: [<ffffffffa0741d64>] tcm_qla2xxx_release_cmd+0x14/0x30 [tcm_qla2xxx]
Jan 23 14:34:59 dracofiler kernel: [<ffffffffa0690c32>] target_release_cmd_kref+0x52/0x80 [target_core_mod]
Jan 23 14:34:59 dracofiler kernel: [<ffffffffa0691a9f>] target_put_sess_cmd+0xaf/0xc0 [target_core_mod]
Jan 23 14:34:59 dracofiler kernel: [<ffffffffa0691d31>] transport_release_cmd+0x41/0x60 [target_core_mod]
Jan 23 14:34:59 dracofiler kernel: [<ffffffffa0693140>] transport_cmd_finish_abort+0xe0/0x2c0 [target_core_mod]
Jan 23 14:34:59 dracofiler kernel: [<ffffffffa068e73d>] core_tmr_abort_task+0x13d/0x1f0 [target_core_mod]
Jan 23 14:34:59 dracofiler kernel: [<ffffffffa069199a>] target_tmr_work+0xca/0xe0 [target_core_mod]
Jan 23 14:34:59 dracofiler kernel: [<ffffffff810b651e>] process_one_work+0x19e/0x3f0
Jan 23 14:34:59 dracofiler kernel: [<ffffffff810b67be>] worker_thread+0x4e/0x450
Jan 23 14:34:59 dracofiler kernel: [<ffffffff810b6770>] ? process_one_work+0x3f0/0x3f0
Jan 23 14:34:59 dracofiler kernel: [<ffffffff810bc8c8>] kthread+0xd8/0xf0
Jan 23 14:34:59 dracofiler kernel: [<ffffffff810bc7f0>] ? kthread_worker_fn+0x160/0x160
Jan 23 14:34:59 dracofiler kernel: [<ffffffff8177a69f>] ret_from_fork+0x3f/0x70
Jan 23 14:34:59 dracofiler kernel: [<ffffffff810bc7f0>] ? kthread_worker_fn+0x160/0x160
Jan 23 14:34:59 dracofiler kernel: Code: c4 08 44 89 e8 5b 41 5c 41 5d 5d c3 4c 89 e7 e8 e7 eb fd ff eb 88 0f 1f 44 00 00 66 66 66 66 90 48 8b 87 90 05 00 00 55 48 89 e5 <48> 8b 40 d8 5d c3 66 2e 0f 1f 84 00 00 00 00 00 66 66 66 66 90
Jan 23 14:34:59 dracofiler kernel: RIP [<ffffffff810bcd50>] kthread_data+0x10/0x20
Jan 23 14:34:59 dracofiler kernel: RSP <ffff880631ad38d8>
Jan 23 14:34:59 dracofiler kernel: CR2: ffffffffffffffd8
Jan 23 14:34:59 dracofiler kernel: ---[ end trace 0ca6e59e741e02ed ]---
Jan 23 14:34:59 dracofiler kernel: Fixing recursive fault but reboot is needed!
Jan 23 14:34:59 dracofiler kernel: ------------[ cut here ]------------
Jan 23 14:34:59 dracofiler kernel: WARNING: CPU: 0 PID: 0 at kernel/watchdog.c:338 watchdog_overflow_callback+0x79/0xa0()
Jan 23 14:34:59 dracofiler kernel: Watchdog detected hard LOCKUP on cpu 0
Jan 23 14:34:59 dracofiler kernel: Modules linked in:
Jan 23 14:34:59 dracofiler kernel: tcm_qla2xxx target_core_user uio target_core_pscsi target_core_file target_core_iblock iscsi_target_mod target_core_mod ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 xt_conntrack ebtable_filter ebtable_broute bridge stp llc ebtable_nat ebtables ip6table_raw ip6table_mangle ip6table_security ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_filter ip6_tables iptable_raw iptable_mangle iptable_security iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat nf_conntrack coretemp snd_hda_codec_realtek kvm_intel snd_hda_codec_generic kvm crct10dif_pclmul crc32_pclmul snd_hda_intel joydev snd_hda_codec iTCO_wdt gpio_ich tpm_infineon snd_hda_core iTCO_vendor_support snd_hwdep snd_seq snd_seq_device tpm_tis snd_pcm ses enclosure tpm ioatdma snd_timer snd lpc_ich i7core_edac
Jan 23 14:34:59 dracofiler kernel: edac_core soundcore i5500_temp shpchp i2c_i801 acpi_cpufreq nfsd nfs_acl lockd auth_rpcgss grace sunrpc xfs libcrc32c qla2xxx mgag200 drm_kms_helper crc32c_intel ttm serio_raw drm firewire_ohci scsi_transport_fc igb firewire_core ata_generic pata_acpi crc_itu_t ptp megaraid_sas pata_jmicron pps_core dca i2c_algo_bit
Jan 23 14:34:59 dracofiler kernel: CPU: 0 PID: 0 Comm: swapper/0 Tainted: G D I 4.2.8-300.fc23.x86_64 #1
Jan 23 14:34:59 dracofiler kernel: Hardware name: iXsystems iX2224-E16R1200LPB/2.5/X8DAH, BIOS 2.1 12/30/2011
Jan 23 14:34:59 dracofiler kernel: 0000000000000000 3d0b2b211ee83017 ffff880333a05aa0 ffffffff817738ca
Jan 23 14:34:59 dracofiler kernel: 0000000000000000 ffff880333a05af8 ffff880333a05ae0 ffffffff8109e4c6
Jan 23 14:34:59 dracofiler kernel: 0000000000000000 ffff8806318b9000 0000000000000000 ffff880333a05c00
Jan 23 14:34:59 dracofiler kernel: Call Trace:
Jan 23 14:34:59 dracofiler kernel: <NMI> [<ffffffff817738ca>] dump_stack+0x45/0x57
Jan 23 14:34:59 dracofiler kernel: [<ffffffff8109e4c6>] warn_slowpath_common+0x86/0xc0
Jan 23 14:34:59 dracofiler kernel: [<ffffffff8109e555>] warn_slowpath_fmt+0x55/0x70
Jan 23 14:34:59 dracofiler kernel: [<ffffffff81153049>] watchdog_overflow_callback+0x79/0xa0
Jan 23 14:34:59 dracofiler kernel: [<ffffffff81197f70>] __perf_event_overflow+0x90/0x1c0
Jan 23 14:34:59 dracofiler kernel: [<ffffffff81198b74>] perf_event_overflow+0x14/0x20
Jan 23 14:34:59 dracofiler kernel: [<ffffffff81033b37>] intel_pmu_handle_irq+0x1e7/0x470
Jan 23 14:34:59 dracofiler kernel: [<ffffffff811e345d>] ? vunmap_page_range+0x1dd/0x2d0
Jan 23 14:34:59 dracofiler kernel: [<ffffffff811e3a71>] ? unmap_kernel_range_noflush+0x11/0x20
Jan 23 14:34:59 dracofiler kernel: [<ffffffff81459c2f>] ? ghes_copy_tofrom_phys+0x10f/0x2a0
Jan 23 14:34:59 dracofiler kernel: [<ffffffff81459e58>] ? ghes_read_estatus+0x98/0x170
Jan 23 14:34:59 dracofiler kernel: [<ffffffff8102a426>] perf_event_nmi_handler+0x26/0x40
Jan 23 14:34:59 dracofiler kernel: [<ffffffff810188b3>] nmi_handle+0x83/0x120
Jan 23 14:34:59 dracofiler kernel: [<ffffffff81018e64>] default_do_nmi+0xb4/0xf0
Jan 23 14:34:59 dracofiler kernel: [<ffffffff81018f8a>] do_nmi+0xea/0x140
Jan 23 14:34:59 dracofiler kernel: [<ffffffff8177c5c1>] end_repeat_nmi+0x1a/0x1e
Jan 23 14:34:59 dracofiler kernel: [<ffffffff810e6745>] ? queued_spin_lock_slowpath+0x115/0x170
Jan 23 14:34:59 dracofiler kernel: [<ffffffff810e6745>] ? queued_spin_lock_slowpath+0x115/0x170
Jan 23 14:34:59 dracofiler kernel: [<ffffffff810e6745>] ? queued_spin_lock_slowpath+0x115/0x170
Jan 23 14:34:59 dracofiler kernel: <<EOE>> <IRQ> [<ffffffff81779f30>] _raw_spin_lock+0x20/0x30
Jan 23 14:34:59 dracofiler kernel: [<ffffffff810dc522>] sched_rt_period_timer+0xe2/0x2c0
Jan 23 14:34:59 dracofiler kernel: [<ffffffff810dc440>] ? balance_runtime+0x190/0x190
Jan 23 14:34:59 dracofiler kernel: [<ffffffff8110878e>] __hrtimer_run_queues+0xee/0x220
Jan 23 14:34:59 dracofiler kernel: [<ffffffff81108eb8>] hrtimer_interrupt+0xa8/0x190
Jan 23 14:34:59 dracofiler kernel: [<ffffffff8104e98c>] local_apic_timer_interrupt+0x3c/0x70
Jan 23 14:34:59 dracofiler kernel: [<ffffffff8177cfb1>] smp_apic_timer_interrupt+0x41/0x60
Jan 23 14:34:59 dracofiler kernel: [<ffffffff8177b14b>] apic_timer_interrupt+0x6b/0x70
Jan 23 14:34:59 dracofiler kernel: <EOI> [<ffffffff81108aef>] ? hrtimer_start_range_ns+0x1bf/0x3b0
Jan 23 14:34:59 dracofiler kernel: [<ffffffff8161691d>] ? cpuidle_enter_state+0x12d/0x270
Jan 23 14:34:59 dracofiler kernel: [<ffffffff816168fb>] ? cpuidle_enter_state+0x10b/0x270
Jan 23 14:34:59 dracofiler kernel: [<ffffffff81616a97>] cpuidle_enter+0x17/0x20
Jan 23 14:34:59 dracofiler kernel: [<ffffffff810dfd02>] call_cpuidle+0x32/0x60
Jan 23 14:34:59 dracofiler kernel: [<ffffffff81616a73>] ? cpuidle_select+0x13/0x20
Jan 23 14:34:59 dracofiler kernel: [<ffffffff810dff98>] cpu_startup_entry+0x268/0x320
Jan 23 14:34:59 dracofiler kernel: [<ffffffff8176a00c>] rest_init+0x7c/0x80
Jan 23 14:34:59 dracofiler kernel: [<ffffffff81d5702d>] start_kernel+0x49d/0x4be
Jan 23 14:34:59 dracofiler kernel: [<ffffffff81d56120>] ? early_idt_handler_array+0x120/0x120
Jan 23 14:34:59 dracofiler kernel: [<ffffffff81d56339>] x86_64_start_reservations+0x2a/0x2c
Jan 23 14:34:59 dracofiler kernel: [<ffffffff81d56485>] x86_64_start_kernel+0x14a/0x16d
Jan 23 14:34:59 dracofiler kernel: ---[ end trace 0ca6e59e741e02ee ]---
Jan 23 14:34:59 dracofiler kernel: ------------[ cut here ]------------
Jan 23 14:34:59 dracofiler kernel: WARNING: CPU: 5 PID: 42 at kernel/watchdog.c:338 watchdog_overflow_callback+0x79/0xa0()
Jan 23 14:34:59 dracofiler kernel: Watchdog detected hard LOCKUP on cpu 5
Jan 23 14:34:59 dracofiler kernel: Modules linked in:
Jan 23 14:34:59 dracofiler kernel: tcm_qla2xxx target_core_user uio target_core_pscsi target_core_file target_core_iblock iscsi_target_mod target_core_mod ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 xt_conntrack ebtable_filter ebtable_broute bridge stp llc ebtable_nat ebtables ip6table_raw ip6table_mangle ip6table_security ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_filter ip6_tables iptable_raw iptable_mangle iptable_security iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat nf_conntrack coretemp snd_hda_codec_realtek kvm_intel snd_hda_codec_generic kvm crct10dif_pclmul crc32_pclmul snd_hda_intel joydev snd_hda_codec iTCO_wdt gpio_ich tpm_infineon snd_hda_core iTCO_vendor_support snd_hwdep snd_seq snd_seq_device tpm_tis snd_pcm ses enclosure tpm ioatdma snd_timer snd lpc_ich i7core_edac
Jan 23 14:34:59 dracofiler kernel: edac_core soundcore i5500_temp shpchp i2c_i801 acpi_cpufreq nfsd nfs_acl lockd auth_rpcgss grace sunrpc xfs libcrc32c qla2xxx mgag200 drm_kms_helper crc32c_intel ttm serio_raw drm firewire_ohci scsi_transport_fc igb firewire_core ata_generic pata_acpi crc_itu_t ptp megaraid_sas pata_jmicron pps_core dca i2c_algo_bit
Jan 23 14:34:59 dracofiler kernel: CPU: 5 PID: 42 Comm: kworker/u50:0 Tainted: G D W I 4.2.8-300.fc23.x86_64 #1
Jan 23 14:34:59 dracofiler kernel: Hardware name: iXsystems iX2224-E16R1200LPB/2.5/X8DAH, BIOS 2.1 12/30/2011
Jan 23 14:34:59 dracofiler kernel: 0000000000000000 0000000081e303bf ffff88063fa45aa0 ffffffff817738ca
Jan 23 14:34:59 dracofiler kernel: 0000000000000000 ffff88063fa45af8 ffff88063fa45ae0 ffffffff8109e4c6
Jan 23 14:34:59 dracofiler kernel: 0000000000000000 ffff880631b28000 0000000000000000 ffff88063fa45c00
Jan 23 14:34:59 dracofiler kernel: Call Trace:
Jan 23 14:34:59 dracofiler kernel: <NMI> [<ffffffff817738ca>] dump_stack+0x45/0x57
Jan 23 14:34:59 dracofiler kernel: [<ffffffff8109e4c6>] warn_slowpath_common+0x86/0xc0
Jan 23 14:34:59 dracofiler kernel: [<ffffffff8109e555>] warn_slowpath_fmt+0x55/0x70
Jan 23 14:34:59 dracofiler kernel: [<ffffffff81153049>] watchdog_overflow_callback+0x79/0xa0
Jan 23 14:34:59 dracofiler kernel: [<ffffffff81197f70>] __perf_event_overflow+0x90/0x1c0
Jan 23 14:34:59 dracofiler kernel: [<ffffffff81198b74>] perf_event_overflow+0x14/0x20
Jan 23 14:34:59 dracofiler kernel: [<ffffffff81033b37>] intel_pmu_handle_irq+0x1e7/0x470
Jan 23 14:34:59 dracofiler kernel: [<ffffffff811e345d>] ? vunmap_page_range+0x1dd/0x2d0
Jan 23 14:34:59 dracofiler kernel: [<ffffffff811e3a71>] ? unmap_kernel_range_noflush+0x11/0x20
Jan 23 14:34:59 dracofiler kernel: [<ffffffff81459c2f>] ? ghes_copy_tofrom_phys+0x10f/0x2a0
Jan 23 14:34:59 dracofiler kernel: [<ffffffff81459e58>] ? ghes_read_estatus+0x98/0x170
Jan 23 14:34:59 dracofiler kernel: [<ffffffff8102a426>] perf_event_nmi_handler+0x26/0x40
Jan 23 14:34:59 dracofiler kernel: [<ffffffff810188b3>] nmi_handle+0x83/0x120
Jan 23 14:34:59 dracofiler kernel: [<ffffffff81018e64>] default_do_nmi+0xb4/0xf0
Jan 23 14:34:59 dracofiler kernel: [<ffffffff81018f8a>] do_nmi+0xea/0x140
Jan 23 14:34:59 dracofiler kernel: [<ffffffff8177c5c1>] end_repeat_nmi+0x1a/0x1e
Jan 23 14:34:59 dracofiler kernel: [<ffffffff810e678c>] ? queued_spin_lock_slowpath+0x15c/0x170
Jan 23 14:34:59 dracofiler kernel: [<ffffffff810e678c>] ? queued_spin_lock_slowpath+0x15c/0x170
Jan 23 14:34:59 dracofiler kernel: [<ffffffff810e678c>] ? queued_spin_lock_slowpath+0x15c/0x170
Jan 23 14:34:59 dracofiler kernel: <<EOE>> [<ffffffff81779f07>] _raw_spin_lock_irq+0x27/0x30
Jan 23 14:34:59 dracofiler kernel: [<ffffffff81775908>] __schedule+0x88/0x950
Jan 23 14:34:59 dracofiler kernel: [<ffffffff81776207>] schedule+0x37/0x80
Jan 23 14:34:59 dracofiler kernel: [<ffffffff810a112a>] do_exit+0x8ea/0xae0
Jan 23 14:34:59 dracofiler kernel: [<ffffffff810180fe>] oops_end+0x9e/0xd0
Jan 23 14:34:59 dracofiler kernel: [<ffffffff81064c25>] no_context+0x135/0x380
Jan 23 14:34:59 dracofiler kernel: [<ffffffff81064ef0>] __bad_area_nosemaphore+0x80/0x1f0
Jan 23 14:34:59 dracofiler kernel: [<ffffffff81065073>] bad_area_nosemaphore+0x13/0x20
Jan 23 14:34:59 dracofiler kernel: [<ffffffff81065357>] __do_page_fault+0xb7/0x400
Jan 23 14:34:59 dracofiler kernel: [<ffffffff81779d1e>] ? _raw_spin_unlock_irqrestore+0xe/0x10
Jan 23 14:34:59 dracofiler kernel: [<ffffffff810656cf>] do_page_fault+0x2f/0x80
Jan 23 14:34:59 dracofiler kernel: [<ffffffff8177c238>] page_fault+0x28/0x30
Jan 23 14:34:59 dracofiler kernel: [<ffffffff810bcd50>] ? kthread_data+0x10/0x20
Jan 23 14:34:59 dracofiler kernel: [<ffffffff810b7395>] wq_worker_sleeping+0x15/0xa0
Jan 23 14:34:59 dracofiler kernel: [<ffffffff81775ea0>] __schedule+0x620/0x950
Jan 23 14:34:59 dracofiler kernel: [<ffffffff81776207>] schedule+0x37/0x80
Jan 23 14:34:59 dracofiler kernel: [<ffffffff810a104a>] do_exit+0x80a/0xae0
Jan 23 14:34:59 dracofiler kernel: [<ffffffff810180fe>] oops_end+0x9e/0xd0
Jan 23 14:34:59 dracofiler kernel: [<ffffffff810185bb>] die+0x4b/0x70
Jan 23 14:34:59 dracofiler kernel: [<ffffffff81014cf1>] do_trap+0xb1/0x140
Jan 23 14:34:59 dracofiler kernel: [<ffffffff81014f18>] do_error_trap+0xa8/0x170
Jan 23 14:34:59 dracofiler kernel: [<ffffffffa028d497>] ? qlt_free_cmd+0x127/0x140 [qla2xxx]
Jan 23 14:34:59 dracofiler kernel: [<ffffffff810136f1>] ? __switch_to+0x261/0x4b0
Jan 23 14:34:59 dracofiler kernel: [<ffffffff81779d1e>] ? _raw_spin_unlock_irqrestore+0xe/0x10
Jan 23 14:34:59 dracofiler kernel: [<ffffffff81015750>] do_invalid_op+0x20/0x30
Jan 23 14:34:59 dracofiler kernel: [<ffffffff8177bc0e>] invalid_op+0x1e/0x30
Jan 23 14:34:59 dracofiler kernel: [<ffffffffa028d497>] ? qlt_free_cmd+0x127/0x140 [qla2xxx]
Jan 23 14:34:59 dracofiler kernel: [<ffffffffa028d3c4>] ? qlt_free_cmd+0x54/0x140 [qla2xxx]
Jan 23 14:34:59 dracofiler kernel: [<ffffffffa0741d64>] tcm_qla2xxx_release_cmd+0x14/0x30 [tcm_qla2xxx]
Jan 23 14:34:59 dracofiler kernel: [<ffffffffa0690c32>] target_release_cmd_kref+0x52/0x80 [target_core_mod]
Jan 23 14:34:59 dracofiler kernel: [<ffffffffa0691a9f>] target_put_sess_cmd+0xaf/0xc0 [target_core_mod]
Jan 23 14:34:59 dracofiler kernel: [<ffffffffa0691d31>] transport_release_cmd+0x41/0x60 [target_core_mod]
Jan 23 14:34:59 dracofiler kernel: [<ffffffffa0693140>] transport_cmd_finish_abort+0xe0/0x2c0 [target_core_mod]
Jan 23 14:34:59 dracofiler kernel: [<ffffffffa068e73d>] core_tmr_abort_task+0x13d/0x1f0 [target_core_mod]
Jan 23 14:34:59 dracofiler kernel: [<ffffffffa069199a>] target_tmr_work+0xca/0xe0 [target_core_mod]
Jan 23 14:34:59 dracofiler kernel: [<ffffffff810b651e>] process_one_work+0x19e/0x3f0
Jan 23 14:34:59 dracofiler kernel: [<ffffffff810b67be>] worker_thread+0x4e/0x450
Jan 23 14:34:59 dracofiler kernel: [<ffffffff810b6770>] ? process_one_work+0x3f0/0x3f0
Jan 23 14:34:59 dracofiler kernel: [<ffffffff810bc8c8>] kthread+0xd8/0xf0
Jan 23 14:34:59 dracofiler kernel: [<ffffffff810bc7f0>] ? kthread_worker_fn+0x160/0x160
Jan 23 14:34:59 dracofiler kernel: [<ffffffff8177a69f>] ret_from_fork+0x3f/0x70
Jan 23 14:34:59 dracofiler kernel: [<ffffffff810bc7f0>] ? kthread_worker_fn+0x160/0x160
Jan 23 14:34:59 dracofiler kernel: ---[ end trace 0ca6e59e741e02ef ]---
Jan 23 14:34:59 dracofiler kernel: INFO: rcu_sched detected stalls on CPUs/tasks: { 5} (detected by 1, t=60004 jiffies, g=41610, c=41609, q=0)
Jan 23 14:34:59 dracofiler kernel: Task dump for CPU 5:
Jan 23 14:34:59 dracofiler kernel: kworker/u50:0 D 0000000000000010 0 42 0 0x00000008
Jan 23 14:34:59 dracofiler kernel: 0000000000010096 ffff880631ad38d8 0000000000000018 0000000000000296
Jan 23 14:34:59 dracofiler kernel: ffff880631ad38f8 ffffffff810b7395 ffff880631ad38f8 ffff88063fa567c0
Jan 23 14:34:59 dracofiler kernel: ffff880631ad3948 ffffffff81775ea0 ffff880600000000 ffff880631abd4c0
Jan 23 14:34:59 dracofiler kernel: Call Trace:
Jan 23 14:34:59 dracofiler kernel: [<ffffffff810b7395>] ? wq_worker_sleeping+0x15/0xa0
Jan 23 14:34:59 dracofiler kernel: [<ffffffff81775ea0>] ? __schedule+0x620/0x950
Jan 23 14:34:59 dracofiler kernel: [<ffffffff81776207>] ? schedule+0x37/0x80
Jan 23 14:34:59 dracofiler kernel: [<ffffffff810a104a>] ? do_exit+0x80a/0xae0
Jan 23 14:34:59 dracofiler kernel: [<ffffffff810180fe>] ? oops_end+0x9e/0xd0
Jan 23 14:34:59 dracofiler kernel: [<ffffffff810185bb>] ? die+0x4b/0x70
Jan 23 14:34:59 dracofiler kernel: [<ffffffff81014cf1>] ? do_trap+0xb1/0x140
Jan 23 14:34:59 dracofiler kernel: [<ffffffff81014f18>] ? do_error_trap+0xa8/0x170
Jan 23 14:34:59 dracofiler kernel: [<ffffffffa028d497>] ? qlt_free_cmd+0x127/0x140 [qla2xxx]
Jan 23 14:34:59 dracofiler kernel: [<ffffffff810136f1>] ? __switch_to+0x261/0x4b0
Jan 23 14:34:59 dracofiler kernel: [<ffffffff81779d1e>] ? _raw_spin_unlock_irqrestore+0xe/0x10
Jan 23 14:34:59 dracofiler kernel: [<ffffffff81015750>] ? do_invalid_op+0x20/0x30
Jan 23 14:34:59 dracofiler kernel: [<ffffffff8177bc0e>] ? invalid_op+0x1e/0x30
Jan 23 14:34:59 dracofiler kernel: [<ffffffffa028d497>] ? qlt_free_cmd+0x127/0x140 [qla2xxx]
Jan 23 14:34:59 dracofiler kernel: [<ffffffffa028d3c4>] ? qlt_free_cmd+0x54/0x140 [qla2xxx]
Jan 23 14:34:59 dracofiler kernel: [<ffffffffa0741d64>] ? tcm_qla2xxx_release_cmd+0x14/0x30 [tcm_qla2xxx]
Jan 23 14:34:59 dracofiler kernel: [<ffffffffa0690c32>] ? target_release_cmd_kref+0x52/0x80 [target_core_mod]
Jan 23 14:34:59 dracofiler kernel: [<ffffffffa0691a9f>] ? target_put_sess_cmd+0xaf/0xc0 [target_core_mod]
Jan 23 14:34:59 dracofiler kernel: [<ffffffffa0691d31>] ? transport_release_cmd+0x41/0x60 [target_core_mod]
Jan 23 14:34:59 dracofiler kernel: [<ffffffffa0693140>] ? transport_cmd_finish_abort+0xe0/0x2c0 [target_core_mod]
Jan 23 14:34:59 dracofiler kernel: [<ffffffffa068e73d>] ? core_tmr_abort_task+0x13d/0x1f0 [target_core_mod]
Jan 23 14:34:59 dracofiler kernel: [<ffffffffa069199a>] ? target_tmr_work+0xca/0xe0 [target_core_mod]
Jan 23 14:34:59 dracofiler kernel: [<ffffffff810b651e>] ? process_one_work+0x19e/0x3f0
Jan 23 14:34:59 dracofiler kernel: [<ffffffff810b67be>] ? worker_thread+0x4e/0x450
Jan 23 14:34:59 dracofiler kernel: [<ffffffff810b6770>] ? process_one_work+0x3f0/0x3f0
Jan 23 14:34:59 dracofiler kernel: [<ffffffff810bc8c8>] ? kthread+0xd8/0xf0
Jan 23 14:34:59 dracofiler kernel: [<ffffffff810bc7f0>] ? kthread_worker_fn+0x160/0x160
Jan 23 14:34:59 dracofiler kernel: [<ffffffff8177a69f>] ? ret_from_fork+0x3f/0x70
Jan 23 14:34:59 dracofiler kernel: [<ffffffff810bc7f0>] ? kthread_worker_fn+0x160/0x160Jan 24 10:02:09 dracofiler kernel: ------------[ cut here ]------------
Jan 24 10:02:09 dracofiler kernel: kernel BUG at drivers/scsi/qla2xxx/qla_target.c:3105!
Jan 24 10:02:09 dracofiler kernel: invalid opcode: 0000 [#1] SMP
Jan 24 10:02:09 dracofiler kernel: Modules linked in: ip6t_rpfilter tcm_qla2xxx target_core_user uio target_core_pscsi target_core_file target_core_iblock iscsi_target_mod target_core_mod ip6t_REJECT nf_reject_ipv6 xt_conntrack ebtable_nat ebtable_filter ebtable_broute bridge stp llc ebtables ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_raw ip6table_mangle ip6table_security ip6table_filter ip6_tables iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat nf_conntrack iptable_raw iptable_mangle iptable_security snd_hda_codec_realtek snd_hda_codec_generic snd_hda_intel snd_hda_codec coretemp kvm_intel snd_hda_core snd_hwdep snd_seq snd_seq_device kvm snd_pcm ses iTCO_wdt gpio_ich enclosure iTCO_vendor_support crct10dif_pclmul snd_timer snd crc32_pclmul joydev shpchp soundcore ioatdma i2c_i801
Jan 24 10:02:09 dracofiler kernel: i7core_edac edac_core i5500_temp lpc_ich tpm_infineon tpm_tis tpm acpi_cpufreq nfsd nfs_acl lockd grace auth_rpcgss sunrpc xfs libcrc32c ata_generic pata_acpi qla2xxx mgag200 drm_kms_helper ttm crc32c_intel drm serio_raw firewire_ohci igb firewire_core scsi_transport_fc crc_itu_t pata_jmicron ptp megaraid_sas pps_core dca i2c_algo_bit
Jan 24 10:02:09 dracofiler kernel: CPU: 4 PID: 42 Comm: kworker/u50:0 Tainted: G I 4.2.8-300.fc23.x86_64 #1
Jan 24 10:02:09 dracofiler kernel: Hardware name: iXsystems iX2224-E16R1200LPB/2.5/X8DAH, BIOS 2.1 12/30/2011
Jan 24 10:02:09 dracofiler kernel: Workqueue: tmr-iblock target_tmr_work [target_core_mod]
Jan 24 10:02:09 dracofiler kernel: task: ffff880631abd4c0 ti: ffff880631ac8000 task.ti: ffff880631ac8000
Jan 24 10:02:09 dracofiler kernel: RIP: 0010:[<ffffffffa024e497>] [<ffffffffa024e497>] qlt_free_cmd+0x127/0x140 [qla2xxx]
Jan 24 10:02:09 dracofiler kernel: RSP: 0018:ffff880631acbc68 EFLAGS: 00010002
Jan 24 10:02:09 dracofiler kernel: RAX: 0000000000000000 RBX: ffff880626fbee80 RCX: ffffffffa0275981
Jan 24 10:02:09 dracofiler kernel: RDX: 000000000000e074 RSI: ffff88062f6c87a8 RDI: 0000000000004000
Jan 24 10:02:09 dracofiler kernel: RBP: ffff880631acbc98 R08: ffffffffa0263650 R09: ffff880626fbee80
Jan 24 10:02:09 dracofiler kernel: R10: ffff880617853a40 R11: 0000000000000000 R12: ffff8806302d0f00
Jan 24 10:02:09 dracofiler kernel: R13: ffff8806309fe700 R14: 0000000000000292 R15: 0000000000000000
Jan 24 10:02:09 dracofiler kernel: FS: 0000000000000000(0000) GS:ffff88063fa00000(0000) knlGS:0000000000000000
Jan 24 10:02:09 dracofiler kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b
Jan 24 10:02:09 dracofiler kernel: CR2: 00007f6cf2673e30 CR3: 0000000001c0b000 CR4: 00000000000006e0
Jan 24 10:02:09 dracofiler kernel: Stack:
Jan 24 10:02:09 dracofiler kernel: ffff880600000443 0000000000000292 ffff880631acbc98 ffff880626fbef40
Jan 24 10:02:09 dracofiler kernel: ffff880626fbee80 ffff8806309fe700 ffff880631acbca8 ffffffffa0749d64
Jan 24 10:02:09 dracofiler kernel: ffff880631acbcd8 ffffffffa069cc32 ffff88063ffe9d80 ffff880626fbee80
Jan 24 10:02:09 dracofiler kernel: Call Trace:
Jan 24 10:02:09 dracofiler kernel: [<ffffffffa0749d64>] tcm_qla2xxx_release_cmd+0x14/0x30 [tcm_qla2xxx]
Jan 24 10:02:09 dracofiler kernel: [<ffffffffa069cc32>] target_release_cmd_kref+0x52/0x80 [target_core_mod]
Jan 24 10:02:09 dracofiler kernel: [<ffffffffa069da9f>] target_put_sess_cmd+0xaf/0xc0 [target_core_mod]
Jan 24 10:02:09 dracofiler kernel: [<ffffffffa069dd31>] transport_release_cmd+0x41/0x60 [target_core_mod]
Jan 24 10:02:09 dracofiler kernel: [<ffffffffa069f140>] transport_cmd_finish_abort+0xe0/0x2c0 [target_core_mod]
Jan 24 10:02:09 dracofiler kernel: [<ffffffffa069a73d>] core_tmr_abort_task+0x13d/0x1f0 [target_core_mod]
Jan 24 10:02:09 dracofiler kernel: [<ffffffffa069d99a>] target_tmr_work+0xca/0xe0 [target_core_mod]
Jan 24 10:02:09 dracofiler kernel: [<ffffffff810b651e>] process_one_work+0x19e/0x3f0
Jan 24 10:02:09 dracofiler kernel: [<ffffffff810b67be>] worker_thread+0x4e/0x450
Jan 24 10:02:09 dracofiler kernel: [<ffffffff810b6770>] ? process_one_work+0x3f0/0x3f0
Jan 24 10:02:09 dracofiler kernel: [<ffffffff810bc8c8>] kthread+0xd8/0xf0
Jan 24 10:02:09 dracofiler kernel: [<ffffffff810bc7f0>] ? kthread_worker_fn+0x160/0x160
Jan 24 10:02:09 dracofiler kernel: [<ffffffff8177a69f>] ret_from_fork+0x3f/0x70
Jan 24 10:02:09 dracofiler kernel: [<ffffffff810bc7f0>] ? kthread_worker_fn+0x160/0x160
Jan 24 10:02:09 dracofiler kernel: Code: b8 52 e1 0f b6 83 c0 02 00 00 e9 61 ff ff ff be 2c 0c 00 00 48 c7 c7 88 f5 26 a0 e8 54 01 e5 e0 48 83 c4 18 5b 41 5c 41 5d 5d c3 <0f> 0b 0f 0b 48 8b bb c8 02 00 00 e8 f9 15 fb e0 e9 4e ff ff ff
Jan 24 10:02:09 dracofiler kernel: RIP [<ffffffffa024e497>] qlt_free_cmd+0x127/0x140 [qla2xxx]
Jan 24 10:02:09 dracofiler kernel: RSP <ffff880631acbc68>
Jan 24 10:02:09 dracofiler kernel: qla2xxx [0000:83:00.1]-f094:12: sess ffff8806302d0f00 received double plogi.
Jan 24 10:02:09 dracofiler kernel: ---[ end trace f29f899caf1ea5de ]---
Jan 24 10:02:13 dracofiler kernel: BUG: unable to handle kernel paging request at ffffffffffffffd8
Jan 24 10:02:13 dracofiler kernel: IP: [<ffffffff810bcd50>] kthread_data+0x10/0x20
Jan 24 10:02:13 dracofiler kernel: PGD 1c0e067 PUD 1c10067 PMD 0
Jan 24 10:02:13 dracofiler kernel: Oops: 0000 [#2] SMP
Jan 24 10:02:13 dracofiler kernel: Modules linked in: ip6t_rpfilter tcm_qla2xxx target_core_user uio target_core_pscsi target_core_file target_core_iblock iscsi_target_mod target_core_mod ip6t_REJECT nf_reject_ipv6 xt_conntrack ebtable_nat ebtable_filter ebtable_broute bridge stp llc ebtables ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_raw ip6table_mangle ip6table_security ip6table_filter ip6_tables iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat nf_conntrack iptable_raw iptable_mangle iptable_security snd_hda_codec_realtek snd_hda_codec_generic snd_hda_intel snd_hda_codec coretemp kvm_intel snd_hda_core snd_hwdep snd_seq snd_seq_device kvm snd_pcm ses iTCO_wdt gpio_ich enclosure iTCO_vendor_support crct10dif_pclmul snd_timer snd crc32_pclmul joydev shpchp soundcore ioatdma i2c_i801
Jan 24 10:02:13 dracofiler kernel: i7core_edac edac_core i5500_temp lpc_ich tpm_infineon tpm_tis tpm acpi_cpufreq nfsd nfs_acl lockd grace auth_rpcgss sunrpc xfs libcrc32c ata_generic pata_acpi qla2xxx mgag200 drm_kms_helper ttm crc32c_intel drm serio_raw firewire_ohci igb firewire_core scsi_transport_fc crc_itu_t pata_jmicron ptp megaraid_sas pps_core dca i2c_algo_bit
Jan 24 10:02:13 dracofiler kernel: CPU: 4 PID: 42 Comm: kworker/u50:0 Tainted: G D I 4.2.8-300.fc23.x86_64 #1
Jan 24 10:02:13 dracofiler kernel: Hardware name: iXsystems iX2224-E16R1200LPB/2.5/X8DAH, BIOS 2.1 12/30/2011
Jan 24 10:02:13 dracofiler kernel: task: ffff880631abd4c0 ti: ffff880631ac8000 task.ti: ffff880631ac8000
Jan 24 10:02:13 dracofiler kernel: RIP: 0010:[<ffffffff810bcd50>] [<ffffffff810bcd50>] kthread_data+0x10/0x20
Jan 24 10:02:13 dracofiler kernel: RSP: 0018:ffff880631acb8d8 EFLAGS: 00010096
Jan 24 10:02:13 dracofiler kernel: RAX: 0000000000000000 RBX: 0000000000000004 RCX: 0000000000000005
Jan 24 10:02:13 dracofiler kernel: RDX: 0000000000000005 RSI: 0000000000000004 RDI: ffff880631abd4c0
Jan 24 10:02:13 dracofiler kernel: RBP: ffff880631acb8d8 R08: ffff880631abd550 R09: 0000000000000000
Jan 24 10:02:13 dracofiler kernel: R10: 0000000000000000 R11: 0000000000000000 R12: 00000000000167c0
Jan 24 10:02:13 dracofiler kernel: R13: ffff880631abd4c0 R14: ffff88063fa167c0 R15: 0000000000000004
Jan 24 10:02:13 dracofiler kernel: FS: 0000000000000000(0000) GS:ffff88063fa00000(0000) knlGS:0000000000000000
Jan 24 10:02:13 dracofiler kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b
Jan 24 10:02:13 dracofiler kernel: CR2: 0000000000000028 CR3: 0000000001c0b000 CR4: 00000000000006e0
Jan 24 10:02:13 dracofiler kernel: Stack:
Jan 24 10:02:13 dracofiler kernel: ffff880631acb8f8 ffffffff810b7395 ffff880631acb8f8 ffff88063fa167c0
Jan 24 10:02:13 dracofiler kernel: ffff880631acb948 ffffffff81775ea0 ffff880600000000 ffff880631abd4c0
Jan 24 10:02:13 dracofiler kernel: ffff880631acb948 ffff880631acc000 ffff880631acb9b0 ffff880631acb9b0
Jan 24 10:02:13 dracofiler kernel: Call Trace:
Jan 24 10:02:13 dracofiler kernel: [<ffffffff810b7395>] wq_worker_sleeping+0x15/0xa0
Jan 24 10:02:13 dracofiler kernel: [<ffffffff81775ea0>] __schedule+0x620/0x950
Jan 24 10:02:13 dracofiler kernel: [<ffffffff81776207>] schedule+0x37/0x80
Jan 24 10:02:13 dracofiler kernel: [<ffffffff810a104a>] do_exit+0x80a/0xae0
Jan 24 10:02:13 dracofiler kernel: [<ffffffff810180fe>] oops_end+0x9e/0xd0
Jan 24 10:02:13 dracofiler kernel: [<ffffffff810185bb>] die+0x4b/0x70
Jan 24 10:02:13 dracofiler kernel: [<ffffffff81014cf1>] do_trap+0xb1/0x140
Jan 24 10:02:13 dracofiler kernel: [<ffffffff81014f18>] do_error_trap+0xa8/0x170
Jan 24 10:02:13 dracofiler kernel: [<ffffffffa024e497>] ? qlt_free_cmd+0x127/0x140 [qla2xxx]
Jan 24 10:02:13 dracofiler kernel: [<ffffffff810c6d9d>] ? ttwu_do_wakeup+0x1d/0xd0
Jan 24 10:02:13 dracofiler kernel: [<ffffffff81779d1e>] ? _raw_spin_unlock_irqrestore+0xe/0x10
Jan 24 10:02:13 dracofiler kernel: [<ffffffff81015750>] do_invalid_op+0x20/0x30
Jan 24 10:02:13 dracofiler kernel: [<ffffffff8177bc0e>] invalid_op+0x1e/0x30
Jan 24 10:02:13 dracofiler kernel: [<ffffffffa024e497>] ? qlt_free_cmd+0x127/0x140 [qla2xxx]
Jan 24 10:02:13 dracofiler kernel: [<ffffffffa024e3c4>] ? qlt_free_cmd+0x54/0x140 [qla2xxx]
Jan 24 10:02:13 dracofiler kernel: [<ffffffffa0749d64>] tcm_qla2xxx_release_cmd+0x14/0x30 [tcm_qla2xxx]
Jan 24 10:02:13 dracofiler kernel: [<ffffffffa069cc32>] target_release_cmd_kref+0x52/0x80 [target_core_mod]
Jan 24 10:02:13 dracofiler kernel: [<ffffffffa069da9f>] target_put_sess_cmd+0xaf/0xc0 [target_core_mod]
Jan 24 10:02:13 dracofiler kernel: [<ffffffffa069dd31>] transport_release_cmd+0x41/0x60 [target_core_mod]
Jan 24 10:02:13 dracofiler kernel: [<ffffffffa069f140>] transport_cmd_finish_abort+0xe0/0x2c0 [target_core_mod]
Jan 24 10:02:13 dracofiler kernel: [<ffffffffa069a73d>] core_tmr_abort_task+0x13d/0x1f0 [target_core_mod]
Jan 24 10:02:13 dracofiler kernel: [<ffffffffa069d99a>] target_tmr_work+0xca/0xe0 [target_core_mod]
Jan 24 10:02:13 dracofiler kernel: [<ffffffff810b651e>] process_one_work+0x19e/0x3f0
Jan 24 10:02:13 dracofiler kernel: [<ffffffff810b67be>] worker_thread+0x4e/0x450
Jan 24 10:02:13 dracofiler kernel: [<ffffffff810b6770>] ? process_one_work+0x3f0/0x3f0
Jan 24 10:02:13 dracofiler kernel: [<ffffffff810bc8c8>] kthread+0xd8/0xf0
Jan 24 10:02:13 dracofiler kernel: [<ffffffff810bc7f0>] ? kthread_worker_fn+0x160/0x160
Jan 24 10:02:13 dracofiler kernel: [<ffffffff8177a69f>] ret_from_fork+0x3f/0x70
Jan 24 10:02:13 dracofiler kernel: [<ffffffff810bc7f0>] ? kthread_worker_fn+0x160/0x160
Jan 24 10:02:13 dracofiler kernel: Code: c4 08 44 89 e8 5b 41 5c 41 5d 5d c3 4c 89 e7 e8 e7 eb fd ff eb 88 0f 1f 44 00 00 66 66 66 66 90 48 8b 87 90 05 00 00 55 48 89 e5 <48> 8b 40 d8 5d c3 66 2e 0f 1f 84 00 00 00 00 00 66 66 66 66 90
Jan 24 10:02:13 dracofiler kernel: RIP [<ffffffff810bcd50>] kthread_data+0x10/0x20
Jan 24 10:02:13 dracofiler kernel: RSP <ffff880631acb8d8>
Jan 24 10:02:13 dracofiler kernel: CR2: ffffffffffffffd8
Jan 24 10:02:13 dracofiler kernel: ---[ end trace f29f899caf1ea5df ]---
Jan 24 10:02:13 dracofiler kernel: Fixing recursive fault but reboot is needed!
Jan 24 10:02:13 dracofiler kernel: qla2xxx [0000:83:00.1]-f094:12: sess ffff8806302d0f00 received double plogi.
Jan 24 10:02:14 dracofiler kernel: qla2xxx [0000:82:00.1]-f094:10: sess ffff88062ecc5e00 received double plogi.
Jan 24 10:02:19 dracofiler kernel: qla2xxx [0000:82:00.1]-f094:10: sess ffff88062ecc5e00 received double plogi.
Jan 24 10:02:23 dracofiler kernel: qla2xxx [0000:82:00.1]-f094:10: sess ffff88062ecc5e00 received double plogi.
Jan 24 10:02:27 dracofiler kernel: qla2xxx [0000:82:00.1]-f094:10: sess ffff88062ecc5e00 received double plogi.
Jan 24 10:02:32 dracofiler kernel: ------------[ cut here ]------------
Jan 24 10:02:32 dracofiler kernel: WARNING: CPU: 0 PID: 0 at kernel/watchdog.c:338 watchdog_overflow_callback+0x79/0xa0()
Jan 24 10:02:32 dracofiler kernel: Watchdog detected hard LOCKUP on cpu 0
Jan 24 10:02:32 dracofiler kernel: Modules linked in:
Jan 24 10:02:32 dracofiler kernel: ip6t_rpfilter tcm_qla2xxx target_core_user uio target_core_pscsi target_core_file target_core_iblock iscsi_target_mod target_core_mod ip6t_REJECT nf_reject_ipv6 xt_conntrack ebtable_nat ebtable_filter ebtable_broute bridge stp llc ebtables ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_raw ip6table_mangle ip6table_security ip6table_filter ip6_tables iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat nf_conntrack iptable_raw iptable_mangle iptable_security snd_hda_codec_realtek snd_hda_codec_generic snd_hda_intel snd_hda_codec coretemp kvm_intel snd_hda_core snd_hwdep snd_seq snd_seq_device kvm snd_pcm ses iTCO_wdt gpio_ich enclosure iTCO_vendor_support crct10dif_pclmul snd_timer snd crc32_pclmul joydev shpchp soundcore ioatdma i2c_i801 i7core_edac edac_core
Jan 24 10:02:32 dracofiler kernel: i5500_temp lpc_ich tpm_infineon tpm_tis tpm acpi_cpufreq nfsd nfs_acl lockd grace auth_rpcgss sunrpc xfs libcrc32c ata_generic pata_acpi qla2xxx mgag200 drm_kms_helper ttm crc32c_intel drm serio_raw firewire_ohci igb firewire_core scsi_transport_fc crc_itu_t pata_jmicron ptp megaraid_sas pps_core dca i2c_algo_bit
Jan 24 10:02:32 dracofiler kernel: CPU: 0 PID: 0 Comm: swapper/0 Tainted: G D I 4.2.8-300.fc23.x86_64 #1
Jan 24 10:02:32 dracofiler kernel: Hardware name: iXsystems iX2224-E16R1200LPB/2.5/X8DAH, BIOS 2.1 12/30/2011
Jan 24 10:02:32 dracofiler kernel: 0000000000000000 a2e323a918e72587 ffff880333a05aa0 ffffffff817738ca
Jan 24 10:02:32 dracofiler kernel: 0000000000000000 ffff880333a05af8 ffff880333a05ae0 ffffffff8109e4c6
Jan 24 10:02:32 dracofiler kernel: 0000000000000000 ffff8806318b9000 0000000000000000 ffff880333a05c00
Jan 24 10:02:32 dracofiler kernel: Call Trace:
Jan 24 10:02:32 dracofiler kernel: <NMI> [<ffffffff817738ca>] dump_stack+0x45/0x57
Jan 24 10:02:32 dracofiler kernel: [<ffffffff8109e4c6>] warn_slowpath_common+0x86/0xc0
Jan 24 10:02:32 dracofiler kernel: [<ffffffff8109e555>] warn_slowpath_fmt+0x55/0x70
Jan 24 10:02:32 dracofiler kernel: [<ffffffff81153049>] watchdog_overflow_callback+0x79/0xa0
Jan 24 10:02:32 dracofiler kernel: [<ffffffff81197f70>] __perf_event_overflow+0x90/0x1c0
Jan 24 10:02:32 dracofiler kernel: [<ffffffff81198b74>] perf_event_overflow+0x14/0x20
Jan 24 10:02:32 dracofiler kernel: [<ffffffff81033b37>] intel_pmu_handle_irq+0x1e7/0x470
Jan 24 10:02:32 dracofiler kernel: [<ffffffff811e345d>] ? vunmap_page_range+0x1dd/0x2d0
Jan 24 10:02:32 dracofiler kernel: [<ffffffff811e3a71>] ? unmap_kernel_range_noflush+0x11/0x20
Jan 24 10:02:32 dracofiler kernel: [<ffffffff81459c2f>] ? ghes_copy_tofrom_phys+0x10f/0x2a0
Jan 24 10:02:32 dracofiler kernel: [<ffffffff81459e58>] ? ghes_read_estatus+0x98/0x170
Jan 24 10:02:32 dracofiler kernel: [<ffffffff8102a426>] perf_event_nmi_handler+0x26/0x40
Jan 24 10:02:32 dracofiler kernel: [<ffffffff810188b3>] nmi_handle+0x83/0x120
Jan 24 10:02:32 dracofiler kernel: [<ffffffff81018df2>] default_do_nmi+0x42/0xf0
Jan 24 10:02:32 dracofiler kernel: [<ffffffff81018f8a>] do_nmi+0xea/0x140
Jan 24 10:02:32 dracofiler kernel: [<ffffffff8177c5c1>] end_repeat_nmi+0x1a/0x1e
Jan 24 10:02:32 dracofiler kernel: [<ffffffff810e6747>] ? queued_spin_lock_slowpath+0x117/0x170
Jan 24 10:02:32 dracofiler kernel: [<ffffffff810e6747>] ? queued_spin_lock_slowpath+0x117/0x170
Jan 24 10:02:32 dracofiler kernel: [<ffffffff810e6747>] ? queued_spin_lock_slowpath+0x117/0x170
Jan 24 10:02:32 dracofiler kernel: <<EOE>> <IRQ> [<ffffffff81779f30>] _raw_spin_lock+0x20/0x30
Jan 24 10:02:32 dracofiler kernel: [<ffffffff810dc522>] sched_rt_period_timer+0xe2/0x2c0
Jan 24 10:02:32 dracofiler kernel: [<ffffffff810dc440>] ? balance_runtime+0x190/0x190
Jan 24 10:02:32 dracofiler kernel: [<ffffffff8110878e>] __hrtimer_run_queues+0xee/0x220
Jan 24 10:02:32 dracofiler kernel: [<ffffffff81108eb8>] hrtimer_interrupt+0xa8/0x190
Jan 24 10:02:32 dracofiler kernel: [<ffffffff8104e98c>] local_apic_timer_interrupt+0x3c/0x70
Jan 24 10:02:32 dracofiler kernel: [<ffffffff8177cfb1>] smp_apic_timer_interrupt+0x41/0x60
Jan 24 10:02:32 dracofiler kernel: [<ffffffff8177b14b>] apic_timer_interrupt+0x6b/0x70
Jan 24 10:02:32 dracofiler kernel: <EOI> [<ffffffff81108aef>] ? hrtimer_start_range_ns+0x1bf/0x3b0
Jan 24 10:02:32 dracofiler kernel: [<ffffffff8161691d>] ? cpuidle_enter_state+0x12d/0x270
Jan 24 10:02:32 dracofiler kernel: [<ffffffff816168fb>] ? cpuidle_enter_state+0x10b/0x270
Jan 24 10:02:32 dracofiler kernel: [<ffffffff81616a97>] cpuidle_enter+0x17/0x20
Jan 24 10:02:32 dracofiler kernel: [<ffffffff810dfd02>] call_cpuidle+0x32/0x60
Jan 24 10:02:32 dracofiler kernel: [<ffffffff81616a73>] ? cpuidle_select+0x13/0x20
Jan 24 10:02:32 dracofiler kernel: [<ffffffff810dff98>] cpu_startup_entry+0x268/0x320
Jan 24 10:02:32 dracofiler kernel: [<ffffffff8176a00c>] rest_init+0x7c/0x80
Jan 24 10:02:32 dracofiler kernel: [<ffffffff81d5702d>] start_kernel+0x49d/0x4be
Jan 24 10:02:32 dracofiler kernel: [<ffffffff81d56120>] ? early_idt_handler_array+0x120/0x120
Jan 24 10:02:32 dracofiler kernel: [<ffffffff81d56339>] x86_64_start_reservations+0x2a/0x2c
Jan 24 10:02:32 dracofiler kernel: [<ffffffff81d56485>] x86_64_start_kernel+0x14a/0x16d
Jan 24 10:02:32 dracofiler kernel: ---[ end trace f29f899caf1ea5e0 ]---
Jan 24 10:02:32 dracofiler kernel: qla2xxx [0000:82:00.1]-f094:10: sess ffff88062ecc5e00 received double plogi.
Jan 24 10:02:36 dracofiler kernel: qla2xxx [0000:82:00.1]-f094:10: sess ffff88062ecc5e00 received double plogi.
Jan 24 10:02:41 dracofiler kernel: ------------[ cut here ]------------
Jan 24 10:02:41 dracofiler kernel: WARNING: CPU: 4 PID: 42 at kernel/watchdog.c:338 watchdog_overflow_callback+0x79/0xa0()
Jan 24 10:02:41 dracofiler kernel: Watchdog detected hard LOCKUP on cpu 4
Jan 24 10:02:41 dracofiler kernel: Modules linked in:
Jan 24 10:02:41 dracofiler kernel: ip6t_rpfilter tcm_qla2xxx target_core_user uio target_core_pscsi target_core_file target_core_iblock iscsi_target_mod target_core_mod ip6t_REJECT nf_reject_ipv6 xt_conntrack ebtable_nat ebtable_filter ebtable_broute bridge stp llc ebtables ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_raw ip6table_mangle ip6table_security ip6table_filter ip6_tables iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat nf_conntrack iptable_raw iptable_mangle iptable_security snd_hda_codec_realtek snd_hda_codec_generic snd_hda_intel snd_hda_codec coretemp kvm_intel snd_hda_core snd_hwdep snd_seq snd_seq_device kvm snd_pcm ses iTCO_wdt gpio_ich enclosure iTCO_vendor_support crct10dif_pclmul snd_timer snd crc32_pclmul joydev shpchp soundcore ioatdma i2c_i801 i7core_edac edac_core
Jan 24 10:02:41 dracofiler kernel: i5500_temp lpc_ich tpm_infineon tpm_tis tpm acpi_cpufreq nfsd nfs_acl lockd grace auth_rpcgss sunrpc xfs libcrc32c ata_generic pata_acpi qla2xxx mgag200 drm_kms_helper ttm crc32c_intel drm serio_raw firewire_ohci igb firewire_core scsi_transport_fc crc_itu_t pata_jmicron ptp megaraid_sas pps_core dca i2c_algo_bit
Jan 24 10:02:41 dracofiler kernel: CPU: 4 PID: 42 Comm: kworker/u50:0 Tainted: G D W I 4.2.8-300.fc23.x86_64 #1
Jan 24 10:02:41 dracofiler kernel: Hardware name: iXsystems iX2224-E16R1200LPB/2.5/X8DAH, BIOS 2.1 12/30/2011
Jan 24 10:02:41 dracofiler kernel: 0000000000000000 000000008f79a0c8 ffff88063fa05aa0 ffffffff817738ca
Jan 24 10:02:41 dracofiler kernel: 0000000000000000 ffff88063fa05af8 ffff88063fa05ae0 ffffffff8109e4c6
Jan 24 10:02:41 dracofiler kernel: 0000000000000000 ffff880631ad0000 0000000000000000 ffff88063fa05c00
Jan 24 10:02:41 dracofiler kernel: Call Trace:
Jan 24 10:02:41 dracofiler kernel: <NMI> [<ffffffff817738ca>] dump_stack+0x45/0x57
Jan 24 10:02:41 dracofiler kernel: [<ffffffff8109e4c6>] warn_slowpath_common+0x86/0xc0
Jan 24 10:02:41 dracofiler kernel: [<ffffffff8109e555>] warn_slowpath_fmt+0x55/0x70
Jan 24 10:02:41 dracofiler kernel: [<ffffffff81153049>] watchdog_overflow_callback+0x79/0xa0
Jan 24 10:02:41 dracofiler kernel: [<ffffffff81197f70>] __perf_event_overflow+0x90/0x1c0
Jan 24 10:02:41 dracofiler kernel: [<ffffffff81198b74>] perf_event_overflow+0x14/0x20
Jan 24 10:02:41 dracofiler kernel: [<ffffffff81033b37>] intel_pmu_handle_irq+0x1e7/0x470
Jan 24 10:02:41 dracofiler kernel: [<ffffffff811e345d>] ? vunmap_page_range+0x1dd/0x2d0
Jan 24 10:02:41 dracofiler kernel: [<ffffffff811e3a71>] ? unmap_kernel_range_noflush+0x11/0x20
Jan 24 10:02:41 dracofiler kernel: [<ffffffff81459c2f>] ? ghes_copy_tofrom_phys+0x10f/0x2a0
Jan 24 10:02:41 dracofiler kernel: [<ffffffff81459e58>] ? ghes_read_estatus+0x98/0x170
Jan 24 10:02:41 dracofiler kernel: [<ffffffff8102a426>] perf_event_nmi_handler+0x26/0x40
Jan 24 10:02:41 dracofiler kernel: [<ffffffff810188b3>] nmi_handle+0x83/0x120
Jan 24 10:02:41 dracofiler kernel: [<ffffffff81018df2>] default_do_nmi+0x42/0xf0
Jan 24 10:02:41 dracofiler kernel: [<ffffffff81018f8a>] do_nmi+0xea/0x140
Jan 24 10:02:41 dracofiler kernel: [<ffffffff8177c5c1>] end_repeat_nmi+0x1a/0x1e
Jan 24 10:02:41 dracofiler kernel: [<ffffffff810e678a>] ? queued_spin_lock_slowpath+0x15a/0x170
Jan 24 10:02:41 dracofiler kernel: [<ffffffff810e678a>] ? queued_spin_lock_slowpath+0x15a/0x170
Jan 24 10:02:41 dracofiler kernel: [<ffffffff810e678a>] ? queued_spin_lock_slowpath+0x15a/0x170
Jan 24 10:02:41 dracofiler kernel: <<EOE>> [<ffffffff81779f07>] _raw_spin_lock_irq+0x27/0x30
Jan 24 10:02:41 dracofiler kernel: [<ffffffff81775908>] __schedule+0x88/0x950
Jan 24 10:02:41 dracofiler kernel: [<ffffffff81776207>] schedule+0x37/0x80
Jan 24 10:02:41 dracofiler kernel: [<ffffffff810a112a>] do_exit+0x8ea/0xae0
Jan 24 10:02:41 dracofiler kernel: [<ffffffff810180fe>] oops_end+0x9e/0xd0
Jan 24 10:02:41 dracofiler kernel: [<ffffffff81064c25>] no_context+0x135/0x380
Jan 24 10:02:41 dracofiler kernel: [<ffffffff81064ef0>] __bad_area_nosemaphore+0x80/0x1f0
Jan 24 10:02:41 dracofiler kernel: [<ffffffff81065073>] bad_area_nosemaphore+0x13/0x20
Jan 24 10:02:41 dracofiler kernel: [<ffffffff81065357>] __do_page_fault+0xb7/0x400
Jan 24 10:02:41 dracofiler kernel: [<ffffffff81779d1e>] ? _raw_spin_unlock_irqrestore+0xe/0x10
Jan 24 10:02:41 dracofiler kernel: [<ffffffff810656cf>] do_page_fault+0x2f/0x80
Jan 24 10:02:41 dracofiler kernel: [<ffffffff8177c238>] page_fault+0x28/0x30
Jan 24 10:02:41 dracofiler kernel: [<ffffffff810bcd50>] ? kthread_data+0x10/0x20
Jan 24 10:02:41 dracofiler kernel: [<ffffffff810b7395>] wq_worker_sleeping+0x15/0xa0
Jan 24 10:02:41 dracofiler kernel: [<ffffffff81775ea0>] __schedule+0x620/0x950
Jan 24 10:02:41 dracofiler kernel: [<ffffffff81776207>] schedule+0x37/0x80
Jan 24 10:02:41 dracofiler kernel: [<ffffffff810a104a>] do_exit+0x80a/0xae0
Jan 24 10:02:41 dracofiler kernel: [<ffffffff810180fe>] oops_end+0x9e/0xd0
Jan 24 10:02:41 dracofiler kernel: [<ffffffff810185bb>] die+0x4b/0x70
Jan 24 10:02:41 dracofiler kernel: [<ffffffff81014cf1>] do_trap+0xb1/0x140
Jan 24 10:02:41 dracofiler kernel: [<ffffffff81014f18>] do_error_trap+0xa8/0x170
Jan 24 10:02:41 dracofiler kernel: [<ffffffffa024e497>] ? qlt_free_cmd+0x127/0x140 [qla2xxx]
Jan 24 10:02:41 dracofiler kernel: [<ffffffff810c6d9d>] ? ttwu_do_wakeup+0x1d/0xd0
Jan 24 10:02:41 dracofiler kernel: [<ffffffff81779d1e>] ? _raw_spin_unlock_irqrestore+0xe/0x10
Jan 24 10:02:41 dracofiler kernel: [<ffffffff81015750>] do_invalid_op+0x20/0x30
Jan 24 10:02:41 dracofiler kernel: [<ffffffff8177bc0e>] invalid_op+0x1e/0x30
Jan 24 10:02:41 dracofiler kernel: [<ffffffffa024e497>] ? qlt_free_cmd+0x127/0x140 [qla2xxx]
Jan 24 10:02:41 dracofiler kernel: [<ffffffffa024e3c4>] ? qlt_free_cmd+0x54/0x140 [qla2xxx]
Jan 24 10:02:41 dracofiler kernel: [<ffffffffa0749d64>] tcm_qla2xxx_release_cmd+0x14/0x30 [tcm_qla2xxx]
Jan 24 10:02:41 dracofiler kernel: [<ffffffffa069cc32>] target_release_cmd_kref+0x52/0x80 [target_core_mod]
Jan 24 10:02:41 dracofiler kernel: [<ffffffffa069da9f>] target_put_sess_cmd+0xaf/0xc0 [target_core_mod]
Jan 24 10:02:41 dracofiler kernel: [<ffffffffa069dd31>] transport_release_cmd+0x41/0x60 [target_core_mod]
Jan 24 10:02:41 dracofiler kernel: [<ffffffffa069f140>] transport_cmd_finish_abort+0xe0/0x2c0 [target_core_mod]
Jan 24 10:02:41 dracofiler kernel: [<ffffffffa069a73d>] core_tmr_abort_task+0x13d/0x1f0 [target_core_mod]
Jan 24 10:02:41 dracofiler kernel: [<ffffffffa069d99a>] target_tmr_work+0xca/0xe0 [target_core_mod]
Jan 24 10:02:41 dracofiler kernel: [<ffffffff810b651e>] process_one_work+0x19e/0x3f0
Jan 24 10:02:41 dracofiler kernel: [<ffffffff810b67be>] worker_thread+0x4e/0x450
Jan 24 10:02:41 dracofiler kernel: [<ffffffff810b6770>] ? process_one_work+0x3f0/0x3f0
Jan 24 10:02:41 dracofiler kernel: [<ffffffff810bc8c8>] kthread+0xd8/0xf0
Jan 24 10:02:41 dracofiler kernel: [<ffffffff810bc7f0>] ? kthread_worker_fn+0x160/0x160
Jan 24 10:02:41 dracofiler kernel: [<ffffffff8177a69f>] ret_from_fork+0x3f/0x70
Jan 24 10:02:41 dracofiler kernel: [<ffffffff810bc7f0>] ? kthread_worker_fn+0x160/0x160
Jan 24 10:02:41 dracofiler kernel: ---[ end trace f29f899caf1ea5e1 ]---
Jan 24 10:02:41 dracofiler kernel: qla2xxx [0000:82:00.1]-f094:10: sess ffff88062ecc5e00 received double plogi.
Jan 24 10:02:41 dracofiler kernel: qla2xxx [0000:83:00.0]-f094:11: sess ffff88062edaacc0 received double plogi.
Jan 24 10:02:45 dracofiler kernel: qla2xxx [0000:82:00.1]-f094:10: sess ffff88062ecc5e00 received double plogi.
Jan 24 10:02:46 dracofiler kernel: qla2xxx [0000:83:00.0]-f094:11: sess ffff88062edaacc0 received double plogi.
Jan 24 10:02:49 dracofiler kernel: qla2xxx [0000:82:00.1]-f094:10: sess ffff88062ecc5e00 received double plogi.
Jan 24 10:02:50 dracofiler kernel: qla2xxx [0000:83:00.0]-f094:11: sess ffff88062edaacc0 received double plogi.
Jan 24 10:02:54 dracofiler systemd: systemd-udevd.service: Watchdog timeout (limit 1min)!
Jan 24 10:02:54 dracofiler audit: ANOM_ABEND auid=4294967295 uid=0 gid=0 ses=4294967295 subj=system_u:system_r:udev_t:s0-s0:c0.c1023 pid=799 comm="systemd-udevd" exe="/usr/lib/systemd/systemd-udevd" sig=6
Jan 24 10:02:55 dracofiler kernel: qla2xxx [0000:83:00.0]-f094:11: sess ffff88062edaacc0 received double plogi.
Jan 24 10:02:59 dracofiler kernel: qla2xxx [0000:83:00.0]-f094:11: sess ffff88062edaacc0 received double plogi.
Jan 24 10:03:00 dracofiler abrt-server: Deleting problem directory ccpp-2016-01-24-10:02:54-799 (dup of ccpp-2016-01-23-14:34:49-798)
Jan 24 10:03:00 dracofiler abrt-server: No actions are found for event 'notify-dup'
Jan 24 10:03:03 dracofiler kernel: qla2xxx [0000:83:00.0]-f094:11: sess ffff88062edaacc0 received double plogi.
Jan 24 10:03:08 dracofiler kernel: qla2xxx [0000:83:00.0]-f094:11: sess ffff88062edaacc0 received double plogi.
Jan 24 10:03:09 dracofiler kernel: INFO: rcu_sched detected stalls on CPUs/tasks: { 4} (detected by 6, t=60003 jiffies, g=73783, c=73782, q=0)
Jan 24 10:03:09 dracofiler kernel: Task dump for CPU 4:
Jan 24 10:03:09 dracofiler kernel: kworker/u50:0 D 0000000000000010 0 42 0 0x00000008
Jan 24 10:03:09 dracofiler kernel: 0000000000010096 ffff880631acb8d8 0000000000000018 0000000000000296
Jan 24 10:03:09 dracofiler kernel: ffff880631acb8f8 ffffffff810b7395 ffff880631acb8f8 ffff88063fa167c0
Jan 24 10:03:09 dracofiler kernel: ffff880631acb948 ffffffff81775ea0 ffff880600000000 ffff880631abd4c0
Jan 24 10:03:09 dracofiler kernel: Call Trace:
Jan 24 10:03:09 dracofiler kernel: [<ffffffff810b7395>] ? wq_worker_sleeping+0x15/0xa0
Jan 24 10:03:09 dracofiler kernel: [<ffffffff81775ea0>] ? __schedule+0x620/0x950
Jan 24 10:03:09 dracofiler kernel: [<ffffffff81776207>] ? schedule+0x37/0x80
Jan 24 10:03:09 dracofiler kernel: [<ffffffff810a104a>] ? do_exit+0x80a/0xae0
Jan 24 10:03:09 dracofiler kernel: [<ffffffff810180fe>] ? oops_end+0x9e/0xd0
Jan 24 10:03:09 dracofiler kernel: [<ffffffff810185bb>] ? die+0x4b/0x70
Jan 24 10:03:09 dracofiler kernel: [<ffffffff81014cf1>] ? do_trap+0xb1/0x140
Jan 24 10:03:09 dracofiler kernel: [<ffffffff81014f18>] ? do_error_trap+0xa8/0x170
Jan 24 10:03:09 dracofiler kernel: [<ffffffffa024e497>] ? qlt_free_cmd+0x127/0x140 [qla2xxx]
Jan 24 10:03:09 dracofiler kernel: [<ffffffff810c6d9d>] ? ttwu_do_wakeup+0x1d/0xd0
Jan 24 10:03:09 dracofiler kernel: [<ffffffff81779d1e>] ? _raw_spin_unlock_irqrestore+0xe/0x10
Jan 24 10:03:09 dracofiler kernel: [<ffffffff81015750>] ? do_invalid_op+0x20/0x30
Jan 24 10:03:09 dracofiler kernel: [<ffffffff8177bc0e>] ? invalid_op+0x1e/0x30
Jan 24 10:03:09 dracofiler kernel: [<ffffffffa024e497>] ? qlt_free_cmd+0x127/0x140 [qla2xxx]
Jan 24 10:03:09 dracofiler kernel: [<ffffffffa024e3c4>] ? qlt_free_cmd+0x54/0x140 [qla2xxx]
Jan 24 10:03:09 dracofiler kernel: [<ffffffffa0749d64>] ? tcm_qla2xxx_release_cmd+0x14/0x30 [tcm_qla2xxx]
Jan 24 10:03:09 dracofiler kernel: [<ffffffffa069cc32>] ? target_release_cmd_kref+0x52/0x80 [target_core_mod]
Jan 24 10:03:09 dracofiler kernel: [<ffffffffa069da9f>] ? target_put_sess_cmd+0xaf/0xc0 [target_core_mod]
Jan 24 10:03:09 dracofiler kernel: [<ffffffffa069dd31>] ? transport_release_cmd+0x41/0x60 [target_core_mod]
Jan 24 10:03:09 dracofiler kernel: [<ffffffffa069f140>] ? transport_cmd_finish_abort+0xe0/0x2c0 [target_core_mod]
Jan 24 10:03:09 dracofiler kernel: [<ffffffffa069a73d>] ? core_tmr_abort_task+0x13d/0x1f0 [target_core_mod]
Jan 24 10:03:09 dracofiler kernel: [<ffffffffa069d99a>] ? target_tmr_work+0xca/0xe0 [target_core_mod]
Jan 24 10:03:09 dracofiler kernel: [<ffffffff810b651e>] ? process_one_work+0x19e/0x3f0
Jan 24 10:03:09 dracofiler kernel: [<ffffffff810b67be>] ? worker_thread+0x4e/0x450
Jan 24 10:03:09 dracofiler kernel: [<ffffffff810b6770>] ? process_one_work+0x3f0/0x3f0
Jan 24 10:03:09 dracofiler kernel: [<ffffffff810bc8c8>] ? kthread+0xd8/0xf0
Jan 24 10:03:09 dracofiler kernel: [<ffffffff810bc7f0>] ? kthread_worker_fn+0x160/0x160
Jan 24 10:03:09 dracofiler kernel: [<ffffffff8177a69f>] ? ret_from_fork+0x3f/0x70
Jan 24 10:03:09 dracofiler kernel: [<ffffffff810bc7f0>] ? kthread_worker_fn+0x160/0x160
Jan 24 10:03:34 dracofiler systemd: Starting dnf makecache...
Jan 24 10:03:34 dracofiler dnf: cachedir: /var/cache/dnf
Jan 24 10:03:34 dracofiler dnf: Loaded plugins: reposync, debuginfo-install, config-manager, playground, generate_completion_cache, builddep, download, langpacks, noroot, copr, needs-restarting, protected_packages, Query
Jan 24 10:03:34 dracofiler dnf: Adding en to language list
Jan 24 10:03:34 dracofiler dnf: Error reading file : /var/lib/dnf/plugins/langpacks/installed_langpacks as it does not exist
Jan 24 10:03:34 dracofiler dnf: initialized Langpacks plugin
Jan 24 10:03:34 dracofiler dnf: DNF version: 1.1.5
Jan 24 10:03:34 dracofiler dnf: Making cache files for all metadata files.
Jan 24 10:03:34 dracofiler dnf: Metadata cache refreshed recently.
Jan 24 10:03:34 dracofiler systemd: Started dnf makecache.
Jan 24 10:03:34 dracofiler audit: SERVICE_START pid=1 uid=0 auid=4294967295 ses=4294967295 subj=system_u:system_r:init_t:s0 msg='unit=dnf-makecache comm="systemd" exe="/usr/lib/systemd/systemd" hostname=? addr=? terminal=? res=success'
Jan 24 10:03:34 dracofiler audit: SERVICE_STOP pid=1 uid=0 auid=4294967295 ses=4294967295 subj=system_u:system_r:init_t:s0 msg='unit=dnf-makecache comm="systemd" exe="/usr/lib/systemd/systemd" hostname=? addr=? terminal=? res=success'
Jan 24 10:04:24 dracofiler systemd: systemd-udevd.service: State 'stop-sigabrt' timed out. Terminating.
Jan 24 10:05:55 dracofiler systemd: systemd-udevd.service: State 'stop-sigterm' timed out. Killing.
Jan 24 10:06:09 dracofiler kernel: INFO: rcu_sched detected stalls on CPUs/tasks: { 4} (detected by 6, t=240010 jiffies, g=73783, c=73782, q=0)
Jan 24 10:06:09 dracofiler kernel: Task dump for CPU 4:
Jan 24 10:06:09 dracofiler kernel: kworker/u50:0 D 0000000000000010 0 42 0 0x00000008
Jan 24 10:06:09 dracofiler kernel: 0000000000010096 ffff880631acb8d8 0000000000000018 0000000000000296
Jan 24 10:06:09 dracofiler kernel: ffff880631acb8f8 ffffffff810b7395 ffff880631acb8f8 ffff88063fa167c0
Jan 24 10:06:09 dracofiler kernel: ffff880631acb948 ffffffff81775ea0 ffff880600000000 ffff880631abd4c0
Jan 24 10:06:09 dracofiler kernel: Call Trace:
Jan 24 10:06:09 dracofiler kernel: [<ffffffff810b7395>] ? wq_worker_sleeping+0x15/0xa0
Jan 24 10:06:09 dracofiler kernel: [<ffffffff81775ea0>] ? __schedule+0x620/0x950
Jan 24 10:06:09 dracofiler kernel: [<ffffffff81776207>] ? schedule+0x37/0x80
Jan 24 10:06:09 dracofiler kernel: [<ffffffff810a104a>] ? do_exit+0x80a/0xae0
Jan 24 10:06:09 dracofiler kernel: [<ffffffff810180fe>] ? oops_end+0x9e/0xd0
Jan 24 10:06:09 dracofiler kernel: [<ffffffff810185bb>] ? die+0x4b/0x70
Jan 24 10:06:09 dracofiler kernel: [<ffffffff81014cf1>] ? do_trap+0xb1/0x140
Jan 24 10:06:09 dracofiler kernel: [<ffffffff81014f18>] ? do_error_trap+0xa8/0x170
Jan 24 10:06:09 dracofiler kernel: [<ffffffffa024e497>] ? qlt_free_cmd+0x127/0x140 [qla2xxx]
Jan 24 10:06:09 dracofiler kernel: [<ffffffff810c6d9d>] ? ttwu_do_wakeup+0x1d/0xd0
Jan 24 10:06:09 dracofiler kernel: [<ffffffff81779d1e>] ? _raw_spin_unlock_irqrestore+0xe/0x10
Jan 24 10:06:09 dracofiler kernel: [<ffffffff81015750>] ? do_invalid_op+0x20/0x30
Jan 24 10:06:09 dracofiler kernel: [<ffffffff8177bc0e>] ? invalid_op+0x1e/0x30
Jan 24 10:06:09 dracofiler kernel: [<ffffffffa024e497>] ? qlt_free_cmd+0x127/0x140 [qla2xxx]
Jan 24 10:06:09 dracofiler kernel: [<ffffffffa024e3c4>] ? qlt_free_cmd+0x54/0x140 [qla2xxx]
Jan 24 10:06:09 dracofiler kernel: [<ffffffffa0749d64>] ? tcm_qla2xxx_release_cmd+0x14/0x30 [tcm_qla2xxx]
Jan 24 10:06:09 dracofiler kernel: [<ffffffffa069cc32>] ? target_release_cmd_kref+0x52/0x80 [target_core_mod]
Jan 24 10:06:09 dracofiler kernel: [<ffffffffa069da9f>] ? target_put_sess_cmd+0xaf/0xc0 [target_core_mod]
Jan 24 10:06:09 dracofiler kernel: [<ffffffffa069dd31>] ? transport_release_cmd+0x41/0x60 [target_core_mod]
Jan 24 10:06:09 dracofiler kernel: [<ffffffffa069f140>] ? transport_cmd_finish_abort+0xe0/0x2c0 [target_core_mod]
Jan 24 10:06:09 dracofiler kernel: [<ffffffffa069a73d>] ? core_tmr_abort_task+0x13d/0x1f0 [target_core_mod]
Jan 24 10:06:09 dracofiler kernel: [<ffffffffa069d99a>] ? target_tmr_work+0xca/0xe0 [target_core_mod]
Jan 24 10:06:09 dracofiler kernel: [<ffffffff810b651e>] ? process_one_work+0x19e/0x3f0
Jan 24 10:06:09 dracofiler kernel: [<ffffffff810b67be>] ? worker_thread+0x4e/0x450
Jan 24 10:06:09 dracofiler kernel: [<ffffffff810b6770>] ? process_one_work+0x3f0/0x3f0
Jan 24 10:06:09 dracofiler kernel: [<ffffffff810bc8c8>] ? kthread+0xd8/0xf0
Jan 24 10:06:09 dracofiler kernel: [<ffffffff810bc7f0>] ? kthread_worker_fn+0x160/0x160
Jan 24 10:06:09 dracofiler kernel: [<ffffffff8177a69f>] ? ret_from_fork+0x3f/0x70
Jan 24 10:06:09 dracofiler kernel: [<ffffffff810bc7f0>] ? kthread_worker_fn+0x160/0x160
Jan 24 10:07:25 dracofiler systemd: systemd-udevd.service: Processes still around after SIGKILL. Ignoring.
Jan 24 10:08:55 dracofiler systemd: systemd-udevd.service: State 'stop-final-sigterm' timed out. Killing.
Jan 24 10:09:09 dracofiler kernel: INFO: rcu_sched detected stalls on CPUs/tasks: { 4} (detected by 6, t=420016 jiffies, g=73783, c=73782, q=0)
Jan 24 10:09:09 dracofiler kernel: Task dump for CPU 4:
Jan 24 10:09:09 dracofiler kernel: kworker/u50:0 D 0000000000000010 0 42 0 0x00000008
Jan 24 10:09:09 dracofiler kernel: 0000000000010096 ffff880631acb8d8 0000000000000018 0000000000000296
Jan 24 10:09:09 dracofiler kernel: ffff880631acb8f8 ffffffff810b7395 ffff880631acb8f8 ffff88063fa167c0
Jan 24 10:09:09 dracofiler kernel: ffff880631acb948 ffffffff81775ea0 ffff880600000000 ffff880631abd4c0
Jan 24 10:09:09 dracofiler kernel: Call Trace:
Jan 24 10:09:09 dracofiler kernel: [<ffffffff810b7395>] ? wq_worker_sleeping+0x15/0xa0
Jan 24 10:09:09 dracofiler kernel: [<ffffffff81775ea0>] ? __schedule+0x620/0x950
Jan 24 10:09:09 dracofiler kernel: [<ffffffff81776207>] ? schedule+0x37/0x80
Jan 24 10:09:09 dracofiler kernel: [<ffffffff810a104a>] ? do_exit+0x80a/0xae0
Jan 24 10:09:09 dracofiler kernel: [<ffffffff810180fe>] ? oops_end+0x9e/0xd0
Jan 24 10:09:09 dracofiler kernel: [<ffffffff810185bb>] ? die+0x4b/0x70
Jan 24 10:09:09 dracofiler kernel: [<ffffffff81014cf1>] ? do_trap+0xb1/0x140
Jan 24 10:09:09 dracofiler kernel: [<ffffffff81014f18>] ? do_error_trap+0xa8/0x170
Jan 24 10:09:09 dracofiler kernel: [<ffffffffa024e497>] ? qlt_free_cmd+0x127/0x140 [qla2xxx]
Jan 24 10:09:09 dracofiler kernel: [<ffffffff810c6d9d>] ? ttwu_do_wakeup+0x1d/0xd0
Jan 24 10:09:09 dracofiler kernel: [<ffffffff81779d1e>] ? _raw_spin_unlock_irqrestore+0xe/0x10
Jan 24 10:09:09 dracofiler kernel: [<ffffffff81015750>] ? do_invalid_op+0x20/0x30
Jan 24 10:09:09 dracofiler kernel: [<ffffffff8177bc0e>] ? invalid_op+0x1e/0x30
Jan 24 10:09:09 dracofiler kernel: [<ffffffffa024e497>] ? qlt_free_cmd+0x127/0x140 [qla2xxx]
Jan 24 10:09:09 dracofiler kernel: [<ffffffffa024e3c4>] ? qlt_free_cmd+0x54/0x140 [qla2xxx]
Jan 24 10:09:09 dracofiler kernel: [<ffffffffa0749d64>] ? tcm_qla2xxx_release_cmd+0x14/0x30 [tcm_qla2xxx]
Jan 24 10:09:09 dracofiler kernel: [<ffffffffa069cc32>] ? target_release_cmd_kref+0x52/0x80 [target_core_mod]
Jan 24 10:09:09 dracofiler kernel: [<ffffffffa069da9f>] ? target_put_sess_cmd+0xaf/0xc0 [target_core_mod]
Jan 24 10:09:09 dracofiler kernel: [<ffffffffa069dd31>] ? transport_release_cmd+0x41/0x60 [target_core_mod]
Jan 24 10:09:09 dracofiler kernel: [<ffffffffa069f140>] ? transport_cmd_finish_abort+0xe0/0x2c0 [target_core_mod]
Jan 24 10:09:09 dracofiler kernel: [<ffffffffa069a73d>] ? core_tmr_abort_task+0x13d/0x1f0 [target_core_mod]
Jan 24 10:09:09 dracofiler kernel: [<ffffffffa069d99a>] ? target_tmr_work+0xca/0xe0 [target_core_mod]
Jan 24 10:09:09 dracofiler kernel: [<ffffffff810b651e>] ? process_one_work+0x19e/0x3f0
Jan 24 10:09:09 dracofiler kernel: [<ffffffff810b67be>] ? worker_thread+0x4e/0x450
Jan 24 10:09:09 dracofiler kernel: [<ffffffff810b6770>] ? process_one_work+0x3f0/0x3f0
Jan 24 10:09:09 dracofiler kernel: [<ffffffff810bc8c8>] ? kthread+0xd8/0xf0
Jan 24 10:09:09 dracofiler kernel: [<ffffffff810bc7f0>] ? kthread_worker_fn+0x160/0x160
Jan 24 10:09:09 dracofiler kernel: [<ffffffff8177a69f>] ? ret_from_fork+0x3f/0x70
Jan 24 10:09:09 dracofiler kernel: [<ffffffff810bc7f0>] ? kthread_worker_fn+0x160/0x160
Jan 24 10:10:25 dracofiler systemd: systemd-udevd.service: Processes still around after final SIGKILL. Entering failed mode.
Jan 24 10:10:25 dracofiler systemd: systemd-udevd.service: Unit entered failed state.
Jan 24 10:10:25 dracofiler audit: SERVICE_STOP pid=1 uid=0 auid=4294967295 ses=4294967295 subj=system_u:system_r:init_t:s0 msg='unit=systemd-udevd comm="systemd" exe="/usr/lib/systemd/systemd" hostname=? addr=? terminal=? res=failed'
Jan 24 10:10:25 dracofiler systemd: systemd-udevd.service: Failed with result 'timeout'.
Jan 24 10:10:26 dracofiler systemd: systemd-udevd.service: Service has no hold-off time, scheduling restart.
Jan 24 10:10:26 dracofiler audit: SERVICE_START pid=1 uid=0 auid=4294967295 ses=4294967295 subj=system_u:system_r:init_t:s0 msg='unit=systemd-udevd comm="systemd" exe="/usr/lib/systemd/systemd" hostname=? addr=? terminal=? res=success'
Jan 24 10:10:26 dracofiler audit: SERVICE_STOP pid=1 uid=0 auid=4294967295 ses=4294967295 subj=system_u:system_r:init_t:s0 msg='unit=systemd-udevd comm="systemd" exe="/usr/lib/systemd/systemd" hostname=? addr=? terminal=? res=success'
Jan 24 10:10:26 dracofiler systemd: Starting udev Kernel Device Manager...
Jan 24 10:10:26 dracofiler systemd: Started udev Kernel Device Manager.
Jan 24 10:10:26 dracofiler audit: SERVICE_START pid=1 uid=0 auid=4294967295 ses=4294967295 subj=system_u:system_r:init_t:s0 msg='unit=systemd-udevd comm="systemd" exe="/usr/lib/systemd/systemd" hostname=? addr=? terminal=? res=success'
