Nicholas,
Okay, I have updated my server to the latest stable kernel
(4.4.1). It looked promising for a little while but then it died...
Once again this happened with zero traffic from the vSphere 5.5 host
other than starting it up. There aren't even any VMs on that host!
Please see the attached kernel log. Let me know if there's anything
else you would like me to try, let me know. I have a large number of
hosts that I can use to test various versions of ESXi if needed as
well (plus I have access to /all/ versions of ESX/ESXi).
Thanks,
Dan
On Sun, Feb 7, 2016 at 2:41 PM, Nicholas A. Bellinger
<nab@xxxxxxxxxxxxxxx> wrote:
> On Sun, 2016-02-07 at 14:36 -0500, Dan Lane wrote:
>> Thanks Nicholas, I understood the qlogic discussion to mean that there
>> was a bigger underlying issue, so I as waiting on their patch.
>
> 4.4-stable is for addressing the root cause of your specific issue.
>
> It also contains the extra qla2xxx patch mentioned earlier by Quinn.
>
>> If testing of the 4.4 kernel patch you created is still relevant then
>> I'll get to work on the kernel recompile.
>
> Yes, please.
>
>
>
>
>
>
>
Feb 7 20:29:05 dracofiler kernel: ABORT_TASK: Found referenced qla2xxx task_tag: 1221932
Feb 7 20:29:05 dracofiler kernel: ABORT_TASK: ref_tag: 1221932 already complete, skipping
Feb 7 20:29:05 dracofiler kernel: ABORT_TASK: Sending TMR_TASK_DOES_NOT_EXIST for ref_tag: 1221932
Feb 7 20:29:21 dracofiler systemd: Starting Cleanup of Temporary Directories...
Feb 7 20:29:22 dracofiler systemd: Started Cleanup of Temporary Directories.
Feb 7 20:29:22 dracofiler audit: SERVICE_START pid=1 uid=0 auid=4294967295 ses=4294967295 subj=system_u:system_r:init_t:s0 msg='unit=systemd-tmpfiles-clean comm="systemd" exe="/usr/lib/systemd/systemd" hostname=? addr=? terminal=? res=success'
Feb 7 20:29:22 dracofiler audit: SERVICE_STOP pid=1 uid=0 auid=4294967295 ses=4294967295 subj=system_u:system_r:init_t:s0 msg='unit=systemd-tmpfiles-clean comm="systemd" exe="/usr/lib/systemd/systemd" hostname=? addr=? terminal=? res=success'
Feb 7 20:30:22 dracofiler kernel: usb 6-2: USB disconnect, device number 3
Feb 7 20:30:48 dracofiler kernel: qla2xxx [0000:82:00.1]-500b:10: LOOP DOWN detected (2 5 0 0).
Feb 7 20:30:51 dracofiler kernel: qla2xxx [0000:82:00.0]-500a:9: LOOP UP detected (4 Gbps).
Feb 7 20:52:00 dracofiler kernel: qla2xxx [0000:82:00.1]-500a:10: LOOP UP detected (4 Gbps).
Feb 7 20:52:00 dracofiler kernel: qla2xxx [0000:82:00.1]-0121:10: Failed to enable receiving of RSCN requests: 0x2.
Feb 7 20:52:19 dracofiler kernel: MODE SENSE: unimplemented page/subpage: 0x1c/0x02
Feb 7 21:08:25 dracofiler kernel: ABORT_TASK: Found referenced qla2xxx task_tag: 1153732
Feb 7 21:08:25 dracofiler kernel: ABORT_TASK: ref_tag: 1153732 already complete, skipping
Feb 7 21:08:25 dracofiler kernel: ABORT_TASK: Sending TMR_TASK_DOES_NOT_EXIST for ref_tag: 1153732
Feb 7 21:08:25 dracofiler kernel: ABORT_TASK: Found referenced qla2xxx task_tag: 1153776
Feb 7 21:08:25 dracofiler kernel: ABORT_TASK: ref_tag: 1153776 already complete, skipping
Feb 7 21:08:25 dracofiler kernel: ABORT_TASK: Sending TMR_TASK_DOES_NOT_EXIST for ref_tag: 1153776
Feb 7 21:09:20 dracofiler kernel: ABORT_TASK: Found referenced qla2xxx task_tag: 1144580
Feb 7 21:09:20 dracofiler kernel: ABORT_TASK: ref_tag: 1144580 already complete, skipping
Feb 7 21:09:20 dracofiler kernel: ABORT_TASK: Sending TMR_TASK_DOES_NOT_EXIST for ref_tag: 1144580
Feb 7 21:09:21 dracofiler kernel: ABORT_TASK: Found referenced qla2xxx task_tag: 1200548
Feb 7 21:09:29 dracofiler kernel: ------------[ cut here ]------------
Feb 7 21:09:29 dracofiler kernel: kernel BUG at drivers/scsi/qla2xxx/qla_target.c:3099!
Feb 7 21:09:29 dracofiler kernel: invalid opcode: 0000 [#1] SMP
Feb 7 21:09:29 dracofiler kernel: Modules linked in: tcm_qla2xxx target_core_user uio target_core_pscsi target_core_file target_core_iblock iscsi_target_mod target_core_mod coretemp kvm_intel kvm snd_hda_codec_realtek snd_hda_codec_generic irqbypass crct10dif_pclmul snd_hda_intel snd_hda_codec crc32_pclmul snd_hda_core joydev ses snd_hwdep snd_seq enclosure iTCO_wdt gpio_ich iTCO_vendor_support pcspkr snd_seq_device i5500_temp snd_pcm tpm_infineon snd_timer snd soundcore ioatdma acpi_cpufreq shpchp tpm_tis i2c_i801 lpc_ich i7core_edac edac_core tpm nfsd nfs_acl lockd auth_rpcgss grace sunrpc xfs libcrc32c ata_generic pata_acpi mgag200 drm_kms_helper ttm qla2xxx drm igb crc32c_intel firewire_ohci serio_raw firewire_core megaraid_sas ptp scsi_transport_fc crc_itu_t pps_core pata_jmicron dca i2c_algo_bit fjes
Feb 7 21:09:29 dracofiler kernel: CPU: 12 PID: 167 Comm: kworker/u50:1 Tainted: G I 4.4.1 #1
Feb 7 21:09:29 dracofiler kernel: Hardware name: iXsystems iX2224-E16R1200LPB/2.5/X8DAH, BIOS 2.1 12/30/2011
Feb 7 21:09:29 dracofiler kernel: Workqueue: tmr-iblock target_tmr_work [target_core_mod]
Feb 7 21:09:29 dracofiler kernel: task: ffff88062cc60000 ti: ffff88062cc5c000 task.ti: ffff88062cc5c000
Feb 7 21:09:29 dracofiler kernel: RIP: 0010:[<ffffffffa01f8947>] [<ffffffffa01f8947>] qlt_free_cmd+0x127/0x140 [qla2xxx]
Feb 7 21:09:29 dracofiler kernel: RSP: 0018:ffff88062cc5fcd8 EFLAGS: 00010202
Feb 7 21:09:29 dracofiler kernel: RAX: 0000000000000000 RBX: ffff88062b99bf60 RCX: ffffffffa0220bad
Feb 7 21:09:29 dracofiler kernel: RDX: 000000000000e074 RSI: ffff88062cee97d8 RDI: 0000000000004000
Feb 7 21:09:29 dracofiler kernel: RBP: ffff88062cc5fcf8 R08: ffffffffa020e670 R09: ffff88062b99bf60
Feb 7 21:09:29 dracofiler kernel: R10: ffff88062dc458c0 R11: ffff88062cc60060 R12: ffff88062b7d6e40
Feb 7 21:09:29 dracofiler kernel: R13: ffff8806305df370 R14: ffff8806305df300 R15: 0000000000000246
Feb 7 21:09:29 dracofiler kernel: FS: 0000000000000000(0000) GS:ffff88063fb00000(0000) knlGS:0000000000000000
Feb 7 21:09:29 dracofiler kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b
Feb 7 21:09:29 dracofiler kernel: CR2: 00007fdffae61b80 CR3: 0000000001c09000 CR4: 00000000000006e0
Feb 7 21:09:29 dracofiler kernel: Stack:
Feb 7 21:09:29 dracofiler kernel: 00000001000000f0 ffff88062b99c074 ffff88062b99bf60 ffff8806305df370
Feb 7 21:09:29 dracofiler kernel: ffff88062cc5fd08 ffffffffa04fcd74 ffff88062cc5fd40 ffffffffa06062bf
Feb 7 21:09:29 dracofiler kernel: ffff88062b99bf60 0000000000000001 0000000000000001 ffff88062dc45f60
Feb 7 21:09:29 dracofiler kernel: Call Trace:
Feb 7 21:09:29 dracofiler kernel: [<ffffffffa04fcd74>] tcm_qla2xxx_release_cmd+0x14/0x30 [tcm_qla2xxx]
Feb 7 21:09:29 dracofiler kernel: [<ffffffffa06062bf>] target_release_cmd_kref+0x6f/0xa0 [target_core_mod]
Feb 7 21:09:29 dracofiler kernel: [<ffffffffa06072bd>] target_put_sess_cmd+0x2d/0x50 [target_core_mod]
Feb 7 21:09:29 dracofiler kernel: [<ffffffffa060755d>] transport_release_cmd+0x3d/0x50 [target_core_mod]
Feb 7 21:09:29 dracofiler kernel: [<ffffffffa0608660>] transport_cmd_finish_abort+0xe0/0x2c0 [target_core_mod]
Feb 7 21:09:29 dracofiler kernel: [<ffffffffa0603daf>] core_tmr_abort_task+0x14f/0x1f0 [target_core_mod]
Feb 7 21:09:29 dracofiler kernel: [<ffffffffa0606d62>] target_tmr_work+0xc2/0xd0 [target_core_mod]
Feb 7 21:09:29 dracofiler kernel: [<ffffffff810b9bee>] process_one_work+0x19e/0x3f0
Feb 7 21:09:29 dracofiler kernel: [<ffffffff810b9e8e>] worker_thread+0x4e/0x450
Feb 7 21:09:29 dracofiler kernel: [<ffffffff817858c9>] ? __schedule+0x3d9/0x9b0
Feb 7 21:09:29 dracofiler kernel: [<ffffffff810b9e40>] ? process_one_work+0x3f0/0x3f0
Feb 7 21:09:29 dracofiler kernel: [<ffffffff810b9e40>] ? process_one_work+0x3f0/0x3f0
Feb 7 21:09:29 dracofiler kernel: [<ffffffff810bf758>] kthread+0xd8/0xf0
Feb 7 21:09:29 dracofiler kernel: [<ffffffff810bf680>] ? kthread_worker_fn+0x160/0x160
Feb 7 21:09:29 dracofiler kernel: [<ffffffff8178a30f>] ret_from_fork+0x3f/0x70
Feb 7 21:09:29 dracofiler kernel: [<ffffffff810bf680>] ? kthread_worker_fn+0x160/0x160
Feb 7 21:09:29 dracofiler kernel: Code: 11 59 e1 0f b6 83 a0 02 00 00 e9 61 ff ff ff be 26 0c 00 00 48 c7 c7 90 a7 21 a0 e8 34 95 ea e0 48 83 c4 08 5b 41 5c 41 5d 5d c3 <0f> 0b 0f 0b 48 8b bb a8 02 00 00 e8 a9 e3 00 e1 e9 4e ff ff ff
Feb 7 21:09:29 dracofiler kernel: RIP [<ffffffffa01f8947>] qlt_free_cmd+0x127/0x140 [qla2xxx]
Feb 7 21:09:29 dracofiler kernel: RSP <ffff88062cc5fcd8>
Feb 7 21:09:29 dracofiler kernel: ---[ end trace b1b9954132181488 ]---
Feb 7 21:09:29 dracofiler kernel: BUG: unable to handle kernel paging request at ffffffffffffffd8
Feb 7 21:09:29 dracofiler kernel: IP: [<ffffffff810bfdb0>] kthread_data+0x10/0x20
Feb 7 21:09:29 dracofiler kernel: PGD 1c0c067 PUD 1c0e067 PMD 0
Feb 7 21:09:29 dracofiler kernel: Oops: 0000 [#2] SMP
Feb 7 21:09:29 dracofiler kernel: Modules linked in: tcm_qla2xxx target_core_user uio target_core_pscsi target_core_file target_core_iblock iscsi_target_mod target_core_mod coretemp kvm_intel kvm snd_hda_codec_realtek snd_hda_codec_generic irqbypass crct10dif_pclmul snd_hda_intel snd_hda_codec crc32_pclmul snd_hda_core joydev ses snd_hwdep snd_seq enclosure iTCO_wdt gpio_ich iTCO_vendor_support pcspkr snd_seq_device i5500_temp snd_pcm tpm_infineon snd_timer snd soundcore ioatdma acpi_cpufreq shpchp tpm_tis i2c_i801 lpc_ich i7core_edac edac_core tpm nfsd nfs_acl lockd auth_rpcgss grace sunrpc xfs libcrc32c ata_generic pata_acpi mgag200 drm_kms_helper ttm qla2xxx drm igb crc32c_intel firewire_ohci serio_raw firewire_core megaraid_sas ptp scsi_transport_fc crc_itu_t pps_core pata_jmicron dca i2c_algo_bit fjes
Feb 7 21:09:29 dracofiler kernel: CPU: 12 PID: 167 Comm: kworker/u50:1 Tainted: G D I 4.4.1 #1
Feb 7 21:09:29 dracofiler kernel: Hardware name: iXsystems iX2224-E16R1200LPB/2.5/X8DAH, BIOS 2.1 12/30/2011
Feb 7 21:09:29 dracofiler kernel: task: ffff88062cc60000 ti: ffff88062cc5c000 task.ti: ffff88062cc5c000
Feb 7 21:09:29 dracofiler kernel: RIP: 0010:[<ffffffff810bfdb0>] [<ffffffff810bfdb0>] kthread_data+0x10/0x20
Feb 7 21:09:29 dracofiler kernel: RSP: 0018:ffff88062cc5f9b0 EFLAGS: 00010002
Feb 7 21:10:29 dracofiler kernel: RAX: 0000000000000000 RBX: 000000000000000c RCX: ffffffff81f1bf80
Feb 7 21:10:29 dracofiler kernel: RDX: 000000000000000c RSI: 000000000000000c RDI: ffff88062cc60000
Feb 7 21:10:29 dracofiler kernel: RBP: ffff88062cc5f9b0 R08: ffff88062cc60088 R09: 0000000000000000
Feb 7 21:10:29 dracofiler kernel: R10: 0000000000006800 R11: ffff88062cc60060 R12: 0000000000000000
Feb 7 21:10:29 dracofiler kernel: R13: 0000000000016e00 R14: ffff88062cc60000 R15: ffff88063fb16e00
Feb 7 21:10:29 dracofiler kernel: FS: 0000000000000000(0000) GS:ffff88063fb00000(0000) knlGS:0000000000000000
Feb 7 21:10:29 dracofiler kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b
Feb 7 21:10:29 dracofiler kernel: CR2: 0000000000000028 CR3: 0000000001c09000 CR4: 00000000000006e0
Feb 7 21:10:29 dracofiler kernel: Stack:
Feb 7 21:10:29 dracofiler kernel: ffff88062cc5f9c8 ffffffff810ba921 ffff88063fb16e00 ffff88062cc5fa10
Feb 7 21:10:29 dracofiler kernel: ffffffff81785afa ffff88060000000c ffff88062cc60000 ffff88062cc60000
Feb 7 21:10:29 dracofiler kernel: ffff88062cc5fa60 ffff88062cc5fa60 ffff88062cc5f5c8 ffff88062cc5f5c8
Feb 7 21:10:29 dracofiler kernel: Call Trace:
Feb 7 21:10:29 dracofiler kernel: [<ffffffff810ba921>] wq_worker_sleeping+0x11/0x90
Feb 7 21:10:29 dracofiler kernel: [<ffffffff81785afa>] __schedule+0x60a/0x9b0
Feb 7 21:10:29 dracofiler kernel: [<ffffffff81785ed5>] schedule+0x35/0x80
Feb 7 21:10:29 dracofiler kernel: [<ffffffff810a4c63>] do_exit+0x743/0xaa0
Feb 7 21:10:29 dracofiler kernel: [<ffffffff810197da>] oops_end+0x9a/0xd0
Feb 7 21:10:29 dracofiler kernel: [<ffffffff81019c9b>] die+0x4b/0x70
Feb 7 21:10:29 dracofiler kernel: [<ffffffff81016d01>] do_trap+0xb1/0x140
Feb 7 21:10:29 dracofiler kernel: [<ffffffff810170a9>] do_error_trap+0x89/0x110
Feb 7 21:10:29 dracofiler kernel: [<ffffffffa01f8947>] ? qlt_free_cmd+0x127/0x140 [qla2xxx]
Feb 7 21:10:29 dracofiler kernel: [<ffffffff810c9dd0>] ? check_preempt_curr+0x80/0x90
Feb 7 21:10:29 dracofiler kernel: [<ffffffff810c9df9>] ? ttwu_do_wakeup+0x19/0xc0
Feb 7 21:10:29 dracofiler kernel: [<ffffffff81017660>] do_invalid_op+0x20/0x30
Feb 7 21:10:29 dracofiler kernel: [<ffffffff8178bb1e>] invalid_op+0x1e/0x30
Feb 7 21:10:29 dracofiler kernel: [<ffffffffa01f8947>] ? qlt_free_cmd+0x127/0x140 [qla2xxx]
Feb 7 21:10:29 dracofiler kernel: [<ffffffffa01f8874>] ? qlt_free_cmd+0x54/0x140 [qla2xxx]
Feb 7 21:10:29 dracofiler kernel: [<ffffffffa04fcd74>] tcm_qla2xxx_release_cmd+0x14/0x30 [tcm_qla2xxx]
Feb 7 21:10:29 dracofiler kernel: [<ffffffffa06062bf>] target_release_cmd_kref+0x6f/0xa0 [target_core_mod]
Feb 7 21:10:29 dracofiler kernel: [<ffffffffa06072bd>] target_put_sess_cmd+0x2d/0x50 [target_core_mod]
Feb 7 21:10:29 dracofiler kernel: [<ffffffffa060755d>] transport_release_cmd+0x3d/0x50 [target_core_mod]
Feb 7 21:10:29 dracofiler kernel: [<ffffffffa0608660>] transport_cmd_finish_abort+0xe0/0x2c0 [target_core_mod]
Feb 7 21:10:29 dracofiler kernel: [<ffffffffa0603daf>] core_tmr_abort_task+0x14f/0x1f0 [target_core_mod]
Feb 7 21:10:29 dracofiler kernel: [<ffffffffa0606d62>] target_tmr_work+0xc2/0xd0 [target_core_mod]
Feb 7 21:10:29 dracofiler kernel: [<ffffffff810b9bee>] process_one_work+0x19e/0x3f0
Feb 7 21:10:29 dracofiler kernel: [<ffffffff810b9e8e>] worker_thread+0x4e/0x450
Feb 7 21:10:29 dracofiler kernel: [<ffffffff817858c9>] ? __schedule+0x3d9/0x9b0
Feb 7 21:10:29 dracofiler kernel: [<ffffffff810b9e40>] ? process_one_work+0x3f0/0x3f0
Feb 7 21:10:29 dracofiler kernel: [<ffffffff810b9e40>] ? process_one_work+0x3f0/0x3f0
Feb 7 21:10:29 dracofiler kernel: [<ffffffff810bf758>] kthread+0xd8/0xf0
Feb 7 21:10:29 dracofiler kernel: [<ffffffff810bf680>] ? kthread_worker_fn+0x160/0x160
Feb 7 21:10:29 dracofiler kernel: [<ffffffff8178a30f>] ret_from_fork+0x3f/0x70
Feb 7 21:10:29 dracofiler kernel: [<ffffffff810bf680>] ? kthread_worker_fn+0x160/0x160
Feb 7 21:10:29 dracofiler kernel: Code: cf 48 89 e7 e8 b2 74 6c 00 e9 55 ff ff ff e8 88 1d fe ff 0f 1f 84 00 00 00 00 00 66 66 66 66 90 48 8b 87 10 05 00 00 55 48 89 e5 <48> 8b 40 d8 5d c3 66 2e 0f 1f 84 00 00 00 00 00 66 66 66 66 90
Feb 7 21:10:29 dracofiler kernel: RIP [<ffffffff810bfdb0>] kthread_data+0x10/0x20
Feb 7 21:10:29 dracofiler kernel: RSP <ffff88062cc5f9b0>
Feb 7 21:10:29 dracofiler kernel: CR2: ffffffffffffffd8
Feb 7 21:10:29 dracofiler kernel: ---[ end trace b1b9954132181489 ]---
Feb 7 21:10:29 dracofiler kernel: Fixing recursive fault but reboot is needed!
Message from syslogd@dracofiler at Feb 7 21:10:29 ...
kernel:NMI watchdog: Watchdog detected hard LOCKUP on cpu 12
Feb 7 21:10:29 dracofiler kernel: NMI watchdog: Watchdog detected hard LOCKUP on cpu 12
Feb 7 21:10:29 dracofiler kernel: Modules linked in:
Feb 7 21:10:29 dracofiler kernel: tcm_qla2xxx target_core_user uio target_core_pscsi target_core_file target_core_iblock iscsi_target_mod target_core_mod coretemp kvm_intel kvm snd_hda_codec_realtek snd_hda_codec_generic irqbypass crct10dif_pclmul snd_hda_intel snd_hda_codec crc32_pclmul snd_hda_core joydev ses snd_hwdep snd_seq enclosure iTCO_wdt gpio_ich iTCO_vendor_support pcspkr snd_seq_device i5500_temp snd_pcm tpm_infineon snd_timer snd soundcore ioatdma acpi_cpufreq shpchp tpm_tis i2c_i801 lpc_ich i7core_edac edac_core tpm nfsd nfs_acl lockd auth_rpcgss grace sunrpc xfs libcrc32c ata_generic pata_acpi mgag200 drm_kms_helper ttm qla2xxx drm igb crc32c_intel firewire_ohci serio_raw firewire_core megaraid_sas ptp scsi_transport_fc crc_itu_t pps_core pata_jmicron dca i2c_algo_bit fjes
Feb 7 21:10:29 dracofiler kernel: CPU: 12 PID: 167 Comm: kworker/u50:1 Tainted: G D I 4.4.1 #1
Feb 7 21:10:29 dracofiler kernel: Hardware name: iXsystems iX2224-E16R1200LPB/2.5/X8DAH, BIOS 2.1 12/30/2011
Feb 7 21:10:29 dracofiler kernel: 0000000000000000 00000000fc291ad3 ffff88063fb05b90 ffffffff813aa3ff
Feb 7 21:10:29 dracofiler kernel: 0000000000000000 ffff88063fb05ba8 ffffffff81155acd ffff880631bb0000
Feb 7 21:10:29 dracofiler kernel: ffff88063fb05be0 ffffffff8119da2c 0000000000000001 ffff88063fb0bf20
Feb 7 21:10:29 dracofiler kernel: Call Trace:
Feb 7 21:10:29 dracofiler kernel: <NMI> [<ffffffff813aa3ff>] dump_stack+0x44/0x55
Feb 7 21:10:29 dracofiler kernel: [<ffffffff81155acd>] watchdog_overflow_callback+0xbd/0xd0
Feb 7 21:10:29 dracofiler kernel: [<ffffffff8119da2c>] __perf_event_overflow+0x8c/0x1d0
Feb 7 21:10:29 dracofiler kernel: [<ffffffff8119e604>] perf_event_overflow+0x14/0x20
Feb 7 21:10:29 dracofiler kernel: [<ffffffff81034c81>] intel_pmu_handle_irq+0x1e1/0x460
Feb 7 21:10:29 dracofiler kernel: [<ffffffff811e8add>] ? vunmap_page_range+0x20d/0x330
Feb 7 21:10:29 dracofiler kernel: [<ffffffff811e90e1>] ? unmap_kernel_range_noflush+0x11/0x20
Feb 7 21:10:29 dracofiler kernel: [<ffffffff8146907f>] ? ghes_copy_tofrom_phys+0x10f/0x2a0
Feb 7 21:10:29 dracofiler kernel: [<ffffffff814692a8>] ? ghes_read_estatus+0x98/0x170
Feb 7 21:10:29 dracofiler kernel: [<ffffffff8102b438>] perf_event_nmi_handler+0x28/0x50
Feb 7 21:10:29 dracofiler kernel: [<ffffffff81019f87>] nmi_handle+0x67/0x100
Feb 7 21:10:29 dracofiler kernel: [<ffffffff8101a4dd>] default_do_nmi+0xad/0xf0
Feb 7 21:10:29 dracofiler kernel: [<ffffffff8101a602>] do_nmi+0xe2/0x130
Feb 7 21:10:29 dracofiler kernel: [<ffffffff8178c4f1>] end_repeat_nmi+0x1a/0x1e
Feb 7 21:10:29 dracofiler kernel: [<ffffffff810e986c>] ? queued_spin_lock_slowpath+0x15c/0x170
Feb 7 21:10:29 dracofiler kernel: [<ffffffff810e986c>] ? queued_spin_lock_slowpath+0x15c/0x170
Feb 7 21:10:29 dracofiler kernel: [<ffffffff810e986c>] ? queued_spin_lock_slowpath+0x15c/0x170
Feb 7 21:10:29 dracofiler kernel: <<EOE>> [<ffffffff81789c17>] _raw_spin_lock_irq+0x27/0x30
Feb 7 21:10:29 dracofiler kernel: [<ffffffff81785584>] __schedule+0x94/0x9b0
Feb 7 21:10:29 dracofiler kernel: [<ffffffff81785ed5>] schedule+0x35/0x80
Feb 7 21:10:29 dracofiler kernel: [<ffffffff810a4dbd>] do_exit+0x89d/0xaa0
Feb 7 21:10:29 dracofiler kernel: [<ffffffff810197da>] oops_end+0x9a/0xd0
Feb 7 21:10:29 dracofiler kernel: [<ffffffff81065ab5>] no_context+0x135/0x380
Feb 7 21:10:29 dracofiler kernel: [<ffffffff81065d80>] __bad_area_nosemaphore+0x80/0x1f0
Feb 7 21:10:29 dracofiler kernel: [<ffffffff81065f03>] bad_area_nosemaphore+0x13/0x20
Feb 7 21:10:29 dracofiler kernel: [<ffffffff810661c7>] __do_page_fault+0xb7/0x400
Feb 7 21:10:29 dracofiler kernel: [<ffffffff810c9df9>] ? ttwu_do_wakeup+0x19/0xc0
Feb 7 21:10:29 dracofiler kernel: [<ffffffff8106653f>] do_page_fault+0x2f/0x80
Feb 7 21:10:29 dracofiler kernel: [<ffffffff8178c188>] page_fault+0x28/0x30
Feb 7 21:10:29 dracofiler kernel: [<ffffffff810bfdb0>] ? kthread_data+0x10/0x20
Feb 7 21:10:29 dracofiler kernel: [<ffffffff810ba921>] wq_worker_sleeping+0x11/0x90
Feb 7 21:10:29 dracofiler kernel: [<ffffffff81785afa>] __schedule+0x60a/0x9b0
Feb 7 21:10:29 dracofiler kernel: [<ffffffff81785ed5>] schedule+0x35/0x80
Feb 7 21:10:29 dracofiler kernel: [<ffffffff810a4c63>] do_exit+0x743/0xaa0
Feb 7 21:10:29 dracofiler kernel: [<ffffffff810197da>] oops_end+0x9a/0xd0
Feb 7 21:10:29 dracofiler kernel: [<ffffffff81019c9b>] die+0x4b/0x70
Feb 7 21:10:29 dracofiler kernel: [<ffffffff81016d01>] do_trap+0xb1/0x140
Feb 7 21:10:29 dracofiler kernel: [<ffffffff810170a9>] do_error_trap+0x89/0x110
Feb 7 21:10:29 dracofiler kernel: [<ffffffffa01f8947>] ? qlt_free_cmd+0x127/0x140 [qla2xxx]
Feb 7 21:10:29 dracofiler kernel: [<ffffffff810c9dd0>] ? check_preempt_curr+0x80/0x90
Feb 7 21:10:29 dracofiler kernel: [<ffffffff810c9df9>] ? ttwu_do_wakeup+0x19/0xc0
Feb 7 21:10:29 dracofiler kernel: [<ffffffff81017660>] do_invalid_op+0x20/0x30
Feb 7 21:10:29 dracofiler kernel: [<ffffffff8178bb1e>] invalid_op+0x1e/0x30
Feb 7 21:10:29 dracofiler kernel: [<ffffffffa01f8947>] ? qlt_free_cmd+0x127/0x140 [qla2xxx]
Feb 7 21:10:29 dracofiler kernel: [<ffffffffa01f8874>] ? qlt_free_cmd+0x54/0x140 [qla2xxx]
Feb 7 21:10:29 dracofiler kernel: [<ffffffffa04fcd74>] tcm_qla2xxx_release_cmd+0x14/0x30 [tcm_qla2xxx]
Feb 7 21:10:29 dracofiler kernel: [<ffffffffa06062bf>] target_release_cmd_kref+0x6f/0xa0 [target_core_mod]
Feb 7 21:10:29 dracofiler kernel: [<ffffffffa06072bd>] target_put_sess_cmd+0x2d/0x50 [target_core_mod]
Feb 7 21:10:29 dracofiler kernel: [<ffffffffa060755d>] transport_release_cmd+0x3d/0x50 [target_core_mod]
Feb 7 21:10:29 dracofiler kernel: [<ffffffffa0608660>] transport_cmd_finish_abort+0xe0/0x2c0 [target_core_mod]
Feb 7 21:10:29 dracofiler kernel: [<ffffffffa0603daf>] core_tmr_abort_task+0x14f/0x1f0 [target_core_mod]
Feb 7 21:10:29 dracofiler kernel: [<ffffffffa0606d62>] target_tmr_work+0xc2/0xd0 [target_core_mod]
Feb 7 21:10:29 dracofiler kernel: [<ffffffff810b9bee>] process_one_work+0x19e/0x3f0
Feb 7 21:10:29 dracofiler kernel: [<ffffffff810b9e8e>] worker_thread+0x4e/0x450
Feb 7 21:10:29 dracofiler kernel: [<ffffffff817858c9>] ? __schedule+0x3d9/0x9b0
Feb 7 21:10:29 dracofiler kernel: [<ffffffff810b9e40>] ? process_one_work+0x3f0/0x3f0
Feb 7 21:10:29 dracofiler kernel: [<ffffffff810b9e40>] ? process_one_work+0x3f0/0x3f0
Feb 7 21:10:29 dracofiler kernel: [<ffffffff810bf758>] kthread+0xd8/0xf0
Feb 7 21:10:29 dracofiler kernel: [<ffffffff810bf680>] ? kthread_worker_fn+0x160/0x160
Feb 7 21:10:29 dracofiler kernel: [<ffffffff8178a30f>] ret_from_fork+0x3f/0x70
Feb 7 21:10:29 dracofiler kernel: [<ffffffff810bf680>] ? kthread_worker_fn+0x160/0x160
Message from syslogd@dracofiler at Feb 7 21:10:29 ...
kernel:NMI watchdog: Watchdog detected hard LOCKUP on cpu 1
Feb 7 21:10:29 dracofiler kernel: NMI watchdog: Watchdog detected hard LOCKUP on cpu 1
Feb 7 21:10:29 dracofiler kernel: Modules linked in:
Feb 7 21:10:29 dracofiler kernel: tcm_qla2xxx target_core_user uio target_core_pscsi target_core_file target_core_iblock iscsi_target_mod target_core_mod coretemp kvm_intel kvm snd_hda_codec_realtek snd_hda_codec_generic irqbypass crct10dif_pclmul snd_hda_intel snd_hda_codec crc32_pclmul snd_hda_core joydev ses snd_hwdep snd_seq enclosure iTCO_wdt gpio_ich iTCO_vendor_support pcspkr snd_seq_device i5500_temp snd_pcm tpm_infineon snd_timer snd soundcore ioatdma acpi_cpufreq shpchp tpm_tis i2c_i801 lpc_ich i7core_edac edac_core tpm nfsd nfs_acl lockd auth_rpcgss grace sunrpc xfs libcrc32c ata_generic pata_acpi mgag200 drm_kms_helper ttm qla2xxx drm igb crc32c_intel firewire_ohci serio_raw firewire_core megaraid_sas ptp scsi_transport_fc crc_itu_t pps_core pata_jmicron dca i2c_algo_bit fjes
Feb 7 21:10:29 dracofiler kernel: CPU: 1 PID: 0 Comm: swapper/1 Tainted: G D I 4.4.1 #1
Feb 7 21:10:29 dracofiler kernel: Hardware name: iXsystems iX2224-E16R1200LPB/2.5/X8DAH, BIOS 2.1 12/30/2011
Feb 7 21:10:29 dracofiler kernel: task: ffff880331a69bc0 ti: ffff880331a70000 task.ti: ffff880331a70000
Feb 7 21:10:29 dracofiler kernel: RIP: 0010:[<ffffffff81627b3d>] [<ffffffff81627b3d>] cpuidle_enter_state+0x12d/0x270
Feb 7 21:10:29 dracofiler kernel: RSP: 0018:ffff880331a73e68 EFLAGS: 00000246
Feb 7 21:10:29 dracofiler kernel: RAX: 0000000000000000 RBX: 0000030d9ccbb03e RCX: 0000000000000018
Feb 7 21:10:29 dracofiler kernel: RDX: 0000000000000000 RSI: 000000000b349eed RDI: 0000000000000000
Feb 7 21:10:29 dracofiler kernel: RBP: ffff880331a73ea8 R08: 000007e972115762 R09: 0000000000000018
Feb 7 21:10:29 dracofiler kernel: R10: 00000001002ea562 R11: 000000000003cbb8 R12: ffff880333a5f000
Feb 7 21:10:29 dracofiler kernel: R13: 0000000000000004 R14: ffffffff81cbc640 R15: ffff880331a70000
Feb 7 21:10:29 dracofiler kernel: FS: 0000000000000000(0000) GS:ffff880333a40000(0000) knlGS:0000000000000000
Feb 7 21:10:29 dracofiler kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b
Feb 7 21:10:29 dracofiler kernel: CR2: 00007fea67c00bb8 CR3: 0000000001c09000 CR4: 00000000000006e0
Feb 7 21:10:29 dracofiler kernel: Stack:
Feb 7 21:10:29 dracofiler kernel: 0000030d9c627459 0000000033a53d60 ffffffff81cbc658 ffffffff81d32bb8
Feb 7 21:10:29 dracofiler kernel: ffff880331a74000 ffff880333a5f000 ffffffff81cbc4c0 ffff880331a70000
Feb 7 21:10:29 dracofiler kernel: ffff880331a73eb8 ffffffff81627cb7 ffff880331a73ed0 ffffffff810e2ea2
Feb 7 21:10:29 dracofiler kernel: Call Trace:
Feb 7 21:10:29 dracofiler kernel: [<ffffffff81627cb7>] cpuidle_enter+0x17/0x20
Feb 7 21:10:29 dracofiler kernel: [<ffffffff810e2ea2>] call_cpuidle+0x32/0x60
Feb 7 21:10:29 dracofiler kernel: [<ffffffff81627c93>] ? cpuidle_select+0x13/0x20
Feb 7 21:10:29 dracofiler kernel: [<ffffffff810e3136>] cpu_startup_entry+0x266/0x320
Feb 7 21:10:29 dracofiler kernel: [<ffffffff8104ec04>] start_secondary+0x154/0x190
Feb 7 21:10:29 dracofiler kernel: Code: 66 90 31 ff e8 35 b2 ab ff 8b 45 cc 85 c0 74 17 9c 58 66 66 90 66 90 f6 c4 02 0f 85 06 01 00 00 31 ff e8 c7 0a af ff fb 66 66 90 <66> 66 90 48 2b 5d c0 48 ba cf f7 53 e3 a5 9b c4 20 48 89 d8 48
Feb 7 21:10:29 dracofiler kernel: INFO: rcu_sched detected stalls on CPUs/tasks:
Feb 7 21:10:29 dracofiler kernel: #01112-...: (1 GPs behind) idle=b8d/140000000000000/0 softirq=1880/1880 fqs=16068
Feb 7 21:10:29 dracofiler kernel: #011(detected by 3, t=60004 jiffies, g=5062, c=5061, q=0)
Feb 7 21:10:29 dracofiler kernel: Task dump for CPU 12:
Feb 7 21:10:29 dracofiler kernel: kworker/u50:1 D ffffffff810bfdb0 0 167 0 0x00000008
Feb 7 21:10:29 dracofiler kernel: 0000000000000010 0000000000010002 ffff88062cc5f9b0 0000000000000018
Feb 7 21:10:29 dracofiler kernel: ffff88062cc5f9c8 ffffffff810ba921 ffff88063fb16e00 ffff88062cc5fa10
Feb 7 21:10:29 dracofiler kernel: ffffffff81785afa ffff88060000000c ffff88062cc60000 ffff88062cc60000
Feb 7 21:10:29 dracofiler kernel: Call Trace:
Feb 7 21:10:29 dracofiler kernel: [<ffffffff810ba921>] ? wq_worker_sleeping+0x11/0x90
Feb 7 21:10:29 dracofiler kernel: [<ffffffff81785afa>] ? __schedule+0x60a/0x9b0
Feb 7 21:10:29 dracofiler kernel: [<ffffffff81785ed5>] ? schedule+0x35/0x80
Feb 7 21:10:29 dracofiler kernel: [<ffffffff810a4c63>] ? do_exit+0x743/0xaa0
Feb 7 21:10:29 dracofiler kernel: [<ffffffff810197da>] ? oops_end+0x9a/0xd0
Feb 7 21:10:29 dracofiler kernel: [<ffffffff81019c9b>] ? die+0x4b/0x70
Feb 7 21:10:29 dracofiler kernel: [<ffffffff81016d01>] ? do_trap+0xb1/0x140
Feb 7 21:10:29 dracofiler kernel: [<ffffffff810170a9>] ? do_error_trap+0x89/0x110
Feb 7 21:10:29 dracofiler kernel: [<ffffffffa01f8947>] ? qlt_free_cmd+0x127/0x140 [qla2xxx]
Feb 7 21:10:29 dracofiler kernel: [<ffffffff810c9dd0>] ? check_preempt_curr+0x80/0x90
Feb 7 21:10:29 dracofiler kernel: [<ffffffff810c9df9>] ? ttwu_do_wakeup+0x19/0xc0
Feb 7 21:10:29 dracofiler kernel: [<ffffffff81017660>] ? do_invalid_op+0x20/0x30
Feb 7 21:10:29 dracofiler kernel: [<ffffffff8178bb1e>] ? invalid_op+0x1e/0x30
Feb 7 21:10:29 dracofiler kernel: [<ffffffffa01f8947>] ? qlt_free_cmd+0x127/0x140 [qla2xxx]
Feb 7 21:10:29 dracofiler kernel: [<ffffffffa01f8874>] ? qlt_free_cmd+0x54/0x140 [qla2xxx]
Feb 7 21:10:29 dracofiler kernel: [<ffffffffa04fcd74>] ? tcm_qla2xxx_release_cmd+0x14/0x30 [tcm_qla2xxx]
Feb 7 21:10:29 dracofiler kernel: [<ffffffffa06062bf>] ? target_release_cmd_kref+0x6f/0xa0 [target_core_mod]
Feb 7 21:10:29 dracofiler kernel: [<ffffffffa06072bd>] ? target_put_sess_cmd+0x2d/0x50 [target_core_mod]
Feb 7 21:10:29 dracofiler kernel: [<ffffffffa060755d>] ? transport_release_cmd+0x3d/0x50 [target_core_mod]
Feb 7 21:10:29 dracofiler kernel: [<ffffffffa0608660>] ? transport_cmd_finish_abort+0xe0/0x2c0 [target_core_mod]
Feb 7 21:10:29 dracofiler kernel: [<ffffffffa0603daf>] ? core_tmr_abort_task+0x14f/0x1f0 [target_core_mod]
Feb 7 21:10:29 dracofiler kernel: [<ffffffffa0606d62>] ? target_tmr_work+0xc2/0xd0 [target_core_mod]
Feb 7 21:10:29 dracofiler kernel: [<ffffffff810b9bee>] ? process_one_work+0x19e/0x3f0
Feb 7 21:10:29 dracofiler kernel: [<ffffffff810b9e8e>] ? worker_thread+0x4e/0x450
Feb 7 21:10:29 dracofiler kernel: [<ffffffff817858c9>] ? __schedule+0x3d9/0x9b0
Feb 7 21:10:29 dracofiler kernel: [<ffffffff810b9e40>] ? process_one_work+0x3f0/0x3f0
Feb 7 21:10:29 dracofiler kernel: [<ffffffff810b9e40>] ? process_one_work+0x3f0/0x3f0
Feb 7 21:10:29 dracofiler kernel: [<ffffffff810bf758>] ? kthread+0xd8/0xf0
Feb 7 21:10:29 dracofiler kernel: [<ffffffff810bf680>] ? kthread_worker_fn+0x160/0x160
Feb 7 21:10:29 dracofiler kernel: [<ffffffff8178a30f>] ? ret_from_fork+0x3f/0x70
Feb 7 21:10:29 dracofiler kernel: [<ffffffff810bf680>] ? kthread_worker_fn+0x160/0x160
Feb 7 21:11:22 dracofiler systemd: systemd-udevd.service: Watchdog timeout (limit 3min)!
Feb 7 21:11:22 dracofiler audit: ANOM_ABEND auid=4294967295 uid=0 gid=0 ses=4294967295 subj=system_u:system_r:udev_t:s0-s0:c0.c1023 pid=1348 comm="systemd-udevd" exe="/usr/lib/systemd/systemd-udevd" sig=6
Feb 7 21:11:22 dracofiler abrt-hook-ccpp: Process 1348 (systemd-udevd) of user 0 killed by SIGABRT - dumping core
Feb 7 21:11:22 dracofiler audit: AVC avc: denied { getattr } for pid=1888 comm="abrt-hook-ccpp" path="ipc:[4026531839]" dev="nsfs" ino=4026531839 scontext=system_u:system_r:abrt_dump_oops_t:s0 tcontext=system_u:object_r:nsfs_t:s0 tclass=file permissive=1
Feb 7 21:11:26 dracofiler abrt-server: Deleting problem directory ccpp-2016-02-07-21:11:22-1348 (dup of ccpp-2016-01-23-14:34:49-798)
Feb 7 21:11:26 dracofiler abrt-server: No actions are found for event 'notify-dup'
Feb 7 21:12:52 dracofiler systemd: systemd-udevd.service: State 'stop-sigabrt' timed out. Terminating.
Feb 7 21:13:29 dracofiler kernel: INFO: rcu_sched detected stalls on CPUs/tasks:
Feb 7 21:13:29 dracofiler kernel: #01112-...: (1 GPs behind) idle=b8d/140000000000000/0 softirq=1880/1880 fqs=60957
Feb 7 21:13:29 dracofiler kernel: #011(detected by 0, t=240087 jiffies, g=5062, c=5061, q=0)
Feb 7 21:13:29 dracofiler kernel: Task dump for CPU 12:
Feb 7 21:13:29 dracofiler kernel: kworker/u50:1 D ffffffff810bfdb0 0 167 0 0x00000008
Feb 7 21:13:29 dracofiler kernel: 0000000000000010 0000000000010002 ffff88062cc5f9b0 0000000000000018
Feb 7 21:13:29 dracofiler kernel: ffff88062cc5f9c8 ffffffff810ba921 ffff88063fb16e00 ffff88062cc5fa10
Feb 7 21:13:29 dracofiler kernel: ffffffff81785afa ffff88060000000c ffff88062cc60000 ffff88062cc60000
Feb 7 21:13:29 dracofiler kernel: Call Trace:
Feb 7 21:13:29 dracofiler kernel: [<ffffffff810ba921>] ? wq_worker_sleeping+0x11/0x90
Feb 7 21:13:29 dracofiler kernel: [<ffffffff81785afa>] ? __schedule+0x60a/0x9b0
Feb 7 21:13:29 dracofiler kernel: [<ffffffff81785ed5>] ? schedule+0x35/0x80
Feb 7 21:13:29 dracofiler kernel: [<ffffffff810a4c63>] ? do_exit+0x743/0xaa0
Feb 7 21:13:29 dracofiler kernel: [<ffffffff810197da>] ? oops_end+0x9a/0xd0
Feb 7 21:13:29 dracofiler kernel: [<ffffffff81019c9b>] ? die+0x4b/0x70
Feb 7 21:13:29 dracofiler kernel: [<ffffffff81016d01>] ? do_trap+0xb1/0x140
Feb 7 21:13:29 dracofiler kernel: [<ffffffff810170a9>] ? do_error_trap+0x89/0x110
Feb 7 21:13:29 dracofiler kernel: [<ffffffffa01f8947>] ? qlt_free_cmd+0x127/0x140 [qla2xxx]
Feb 7 21:13:29 dracofiler kernel: [<ffffffff810c9dd0>] ? check_preempt_curr+0x80/0x90
Feb 7 21:13:29 dracofiler kernel: [<ffffffff810c9df9>] ? ttwu_do_wakeup+0x19/0xc0
Feb 7 21:13:29 dracofiler kernel: [<ffffffff81017660>] ? do_invalid_op+0x20/0x30
Feb 7 21:13:29 dracofiler kernel: [<ffffffff8178bb1e>] ? invalid_op+0x1e/0x30
Feb 7 21:13:29 dracofiler kernel: [<ffffffffa01f8947>] ? qlt_free_cmd+0x127/0x140 [qla2xxx]
Feb 7 21:13:29 dracofiler kernel: [<ffffffffa01f8874>] ? qlt_free_cmd+0x54/0x140 [qla2xxx]
Feb 7 21:13:29 dracofiler kernel: [<ffffffffa04fcd74>] ? tcm_qla2xxx_release_cmd+0x14/0x30 [tcm_qla2xxx]
Feb 7 21:13:29 dracofiler kernel: [<ffffffffa06062bf>] ? target_release_cmd_kref+0x6f/0xa0 [target_core_mod]
Feb 7 21:13:29 dracofiler kernel: [<ffffffffa06072bd>] ? target_put_sess_cmd+0x2d/0x50 [target_core_mod]
Feb 7 21:13:29 dracofiler kernel: [<ffffffffa060755d>] ? transport_release_cmd+0x3d/0x50 [target_core_mod]
Feb 7 21:13:29 dracofiler kernel: [<ffffffffa0608660>] ? transport_cmd_finish_abort+0xe0/0x2c0 [target_core_mod]
Feb 7 21:13:29 dracofiler kernel: [<ffffffffa0603daf>] ? core_tmr_abort_task+0x14f/0x1f0 [target_core_mod]
Feb 7 21:13:29 dracofiler kernel: [<ffffffffa0606d62>] ? target_tmr_work+0xc2/0xd0 [target_core_mod]
Feb 7 21:13:29 dracofiler kernel: [<ffffffff810b9bee>] ? process_one_work+0x19e/0x3f0
Feb 7 21:13:29 dracofiler kernel: [<ffffffff810b9e8e>] ? worker_thread+0x4e/0x450
Feb 7 21:13:29 dracofiler kernel: [<ffffffff817858c9>] ? __schedule+0x3d9/0x9b0
Feb 7 21:13:29 dracofiler kernel: [<ffffffff810b9e40>] ? process_one_work+0x3f0/0x3f0
Feb 7 21:13:29 dracofiler kernel: [<ffffffff810b9e40>] ? process_one_work+0x3f0/0x3f0
Feb 7 21:13:29 dracofiler kernel: [<ffffffff810bf758>] ? kthread+0xd8/0xf0
Feb 7 21:13:29 dracofiler kernel: [<ffffffff810bf680>] ? kthread_worker_fn+0x160/0x160
Feb 7 21:13:29 dracofiler kernel: [<ffffffff8178a30f>] ? ret_from_fork+0x3f/0x70
Feb 7 21:13:29 dracofiler kernel: [<ffffffff810bf680>] ? kthread_worker_fn+0x160/0x160
Feb 7 21:14:22 dracofiler systemd: systemd-udevd.service: State 'stop-sigterm' timed out. Killing.
Feb 7 21:15:52 dracofiler systemd: systemd-udevd.service: Processes still around after SIGKILL. Ignoring.
Feb 7 21:16:29 dracofiler kernel: INFO: rcu_sched detected stalls on CPUs/tasks:
Feb 7 21:16:29 dracofiler kernel: #01112-...: (1 GPs behind) idle=b8d/140000000000000/0 softirq=1880/1880 fqs=107322
Feb 7 21:16:29 dracofiler kernel: #011(detected by 5, t=420092 jiffies, g=5062, c=5061, q=0)
Feb 7 21:16:29 dracofiler kernel: Task dump for CPU 12:
Feb 7 21:16:29 dracofiler kernel: kworker/u50:1 D ffffffff810bfdb0 0 167 0 0x00000008
Feb 7 21:16:29 dracofiler kernel: 0000000000000010 0000000000010002 ffff88062cc5f9b0 0000000000000018
Feb 7 21:16:29 dracofiler kernel: ffff88062cc5f9c8 ffffffff810ba921 ffff88063fb16e00 ffff88062cc5fa10
Feb 7 21:16:29 dracofiler kernel: ffffffff81785afa ffff88060000000c ffff88062cc60000 ffff88062cc60000
Feb 7 21:16:29 dracofiler kernel: Call Trace:
Feb 7 21:16:29 dracofiler kernel: [<ffffffff810ba921>] ? wq_worker_sleeping+0x11/0x90
Feb 7 21:16:29 dracofiler kernel: [<ffffffff81785afa>] ? __schedule+0x60a/0x9b0
Feb 7 21:16:29 dracofiler kernel: [<ffffffff81785ed5>] ? schedule+0x35/0x80
Feb 7 21:16:29 dracofiler kernel: [<ffffffff810a4c63>] ? do_exit+0x743/0xaa0
Feb 7 21:16:29 dracofiler kernel: [<ffffffff810197da>] ? oops_end+0x9a/0xd0
Feb 7 21:16:29 dracofiler kernel: [<ffffffff81019c9b>] ? die+0x4b/0x70
Feb 7 21:16:29 dracofiler kernel: [<ffffffff81016d01>] ? do_trap+0xb1/0x140
Feb 7 21:16:29 dracofiler kernel: [<ffffffff810170a9>] ? do_error_trap+0x89/0x110
Feb 7 21:16:29 dracofiler kernel: [<ffffffffa01f8947>] ? qlt_free_cmd+0x127/0x140 [qla2xxx]
Feb 7 21:16:29 dracofiler kernel: [<ffffffff810c9dd0>] ? check_preempt_curr+0x80/0x90
Feb 7 21:16:29 dracofiler kernel: [<ffffffff810c9df9>] ? ttwu_do_wakeup+0x19/0xc0
Feb 7 21:16:29 dracofiler kernel: [<ffffffff81017660>] ? do_invalid_op+0x20/0x30
Feb 7 21:16:29 dracofiler kernel: [<ffffffff8178bb1e>] ? invalid_op+0x1e/0x30
Feb 7 21:16:29 dracofiler kernel: [<ffffffffa01f8947>] ? qlt_free_cmd+0x127/0x140 [qla2xxx]
Feb 7 21:16:29 dracofiler kernel: [<ffffffffa01f8874>] ? qlt_free_cmd+0x54/0x140 [qla2xxx]
Feb 7 21:16:29 dracofiler kernel: [<ffffffffa04fcd74>] ? tcm_qla2xxx_release_cmd+0x14/0x30 [tcm_qla2xxx]
Feb 7 21:16:29 dracofiler kernel: [<ffffffffa06062bf>] ? target_release_cmd_kref+0x6f/0xa0 [target_core_mod]
Feb 7 21:16:29 dracofiler kernel: [<ffffffffa06072bd>] ? target_put_sess_cmd+0x2d/0x50 [target_core_mod]
Feb 7 21:16:29 dracofiler kernel: [<ffffffffa060755d>] ? transport_release_cmd+0x3d/0x50 [target_core_mod]
Feb 7 21:16:29 dracofiler kernel: [<ffffffffa0608660>] ? transport_cmd_finish_abort+0xe0/0x2c0 [target_core_mod]
Feb 7 21:16:29 dracofiler kernel: [<ffffffffa0603daf>] ? core_tmr_abort_task+0x14f/0x1f0 [target_core_mod]
Feb 7 21:16:29 dracofiler kernel: [<ffffffffa0606d62>] ? target_tmr_work+0xc2/0xd0 [target_core_mod]
Feb 7 21:16:29 dracofiler kernel: [<ffffffff810b9bee>] ? process_one_work+0x19e/0x3f0
Feb 7 21:16:29 dracofiler kernel: [<ffffffff810b9e8e>] ? worker_thread+0x4e/0x450
Feb 7 21:16:29 dracofiler kernel: [<ffffffff817858c9>] ? __schedule+0x3d9/0x9b0
Feb 7 21:16:29 dracofiler kernel: [<ffffffff810b9e40>] ? process_one_work+0x3f0/0x3f0
Feb 7 21:16:29 dracofiler kernel: [<ffffffff810b9e40>] ? process_one_work+0x3f0/0x3f0
Feb 7 21:16:29 dracofiler kernel: [<ffffffff810bf758>] ? kthread+0xd8/0xf0
Feb 7 21:16:29 dracofiler kernel: [<ffffffff810bf680>] ? kthread_worker_fn+0x160/0x160
Feb 7 21:16:29 dracofiler kernel: [<ffffffff8178a30f>] ? ret_from_fork+0x3f/0x70
Feb 7 21:16:29 dracofiler kernel: [<ffffffff810bf680>] ? kthread_worker_fn+0x160/0x160
Feb 7 21:16:38 dracofiler audit: CRYPTO_SESSION pid=1791 uid=0 auid=0 ses=1 subj=system_u:system_r:sshd_t:s0-s0:c0.c1023 msg='op=start direction=from-server cipher=aes256-ctr ksize=256 mac=hmac-sha2-256 pfs=diffie-hellman-group14-sha1 spid=1803 suid=0 rport=59490 laddr=192.168.1.18 lport=22 exe="/usr/sbin/sshd" hostname=? addr=192.168.1.5 terminal=? res=success'
Feb 7 21:16:38 dracofiler audit: CRYPTO_SESSION pid=1791 uid=0 auid=0 ses=1 subj=system_u:system_r:sshd_t:s0-s0:c0.c1023 msg='op=start direction=from-client cipher=aes256-ctr ksize=256 mac=hmac-sha2-256 pfs=diffie-hellman-group14-sha1 spid=1803 suid=0 rport=59490 laddr=192.168.1.18 lport=22 exe="/usr/sbin/sshd" hostname=? addr=192.168.1.5 terminal=? res=success'
Feb 7 21:16:38 dracofiler dbus[1587]: [system] Activating service name='org.fedoraproject.Setroubleshootd' (using servicehelper)
Feb 7 21:16:38 dracofiler audit: CRYPTO_KEY_USER pid=1791 uid=0 auid=0 ses=1 subj=system_u:system_r:sshd_t:s0-s0:c0.c1023 msg='op=destroy kind=session fp=? direction=from-client spid=1803 suid=0 rport=59490 laddr=192.168.1.18 lport=22 exe="/usr/sbin/sshd" hostname=? addr=192.168.1.5 terminal=? res=success'
Feb 7 21:16:38 dracofiler audit: CRYPTO_KEY_USER pid=1791 uid=0 auid=0 ses=1 subj=system_u:system_r:sshd_t:s0-s0:c0.c1023 msg='op=destroy kind=session fp=? direction=from-server spid=1803 suid=0 rport=59490 laddr=192.168.1.18 lport=22 exe="/usr/sbin/sshd" hostname=? addr=192.168.1.5 terminal=? res=success'
Feb 7 21:16:39 dracofiler dbus[1587]: [system] Successfully activated service 'org.fedoraproject.Setroubleshootd'
Feb 7 21:16:40 dracofiler setroubleshoot: failed to retrieve rpm info for /file
Feb 7 21:16:40 dracofiler setroubleshoot: SELinux is preventing abrt-hook-ccpp from getattr access on the file file. For complete SELinux messages. run sealert -l 1154edbb-1519-4766-926b-96efb1f7ff5b
Feb 7 21:16:40 dracofiler python3: SELinux is preventing abrt-hook-ccpp from getattr access on the file file.#012#012***** Plugin catchall (100. confidence) suggests **************************#012#012If you believe that abrt-hook-ccpp should be allowed getattr access on the file file by default.#012Then you should report this as a bug.#012You can generate a local policy module to allow this access.#012Do#012allow this access for now by executing:#012# grep abrt-hook-ccpp /var/log/audit/audit.log | audit2allow -M mypol#012# semodule -i mypol.pp#012
Feb 7 21:17:23 dracofiler systemd: systemd-udevd.service: State 'stop-final-sigterm' timed out. Killing.
Feb 7 21:18:53 dracofiler systemd: systemd-udevd.service: Processes still around after final SIGKILL. Entering failed mode.
Feb 7 21:18:53 dracofiler systemd: systemd-udevd.service: Unit entered failed state.
Feb 7 21:18:53 dracofiler audit: SERVICE_STOP pid=1 uid=0 auid=4294967295 ses=4294967295 subj=system_u:system_r:init_t:s0 msg='unit=systemd-udevd comm="systemd" exe="/usr/lib/systemd/systemd" hostname=? addr=? terminal=? res=failed'
