raid6check lockup

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



I'm running mdadm version 4.2_rc2 raid6check on a EL7 system running
3.10.0-1160.42.2.el7.x86_64 and it seems to have gummed things up.  Cannot
strace it, and many processes seem to be stuck in IO:

19059 ?        DN     0:00 /usr/bin/perl
/usr/share/BackupPC/bin/BackupPC_nightly -m -P 7 112 119
19060 ?        DN     0:00 /usr/bin/perl
/usr/share/BackupPC/bin/BackupPC_nightly -P 7 120 127
20442 ?        D      0:00 /usr/sbin/pvs --noheadings --nosuffix --units g
--separator ,
20449 ?        Ds     0:00 /usr/bin/rsync --server --sender -slHogDtpAXrxe.iLsfxC
23386 ?        D      0:00 /usr/sbin/vgs --noheadings --nosuffix --units g
--separator ,
29908 ?        Ds     0:04 /usr/lib/systemd/systemd-logind
31848 ?        D      0:00 /usr/sbin/vgs --noheadings --nosuffix --units g
--separator ,

Got a bunch of hung task messages earlier on, but then not much:

Oct 12 18:12:16 kernel: INFO: task raid6check:5239 blocked for more than 120
seconds.
Oct 12 18:12:16 kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs"
disables this message.
Oct 12 18:12:16 kernel: raid6check      D ffff99102c5ae300     0  5239   5236
0x00000080
Oct 12 18:12:16 kernel: Call Trace:
Oct 12 18:12:16 kernel:  [<ffffffffb3389179>] schedule+0x29/0x70
Oct 12 18:12:16 kernel:  [<ffffffffb31abf45>] mddev_suspend+0xd5/0x1c0
Oct 12 18:12:16 kernel:  [<ffffffffb2cc6f50>] ? wake_up_atomic_t+0x30/0x30
Oct 12 18:12:16 kernel:  [<ffffffffb31ac165>] suspend_lo_store+0x65/0xd0
Oct 12 18:12:16 kernel:  [<ffffffffb31aad42>] md_attr_store+0x82/0xd0
Oct 12 18:12:16 kernel:  [<ffffffffb2edba42>] sysfs_kf_write+0x42/0x50
Oct 12 18:12:16 kernel:  [<ffffffffb2edb02b>] kernfs_fop_write+0xeb/0x160
Oct 12 18:12:16 kernel:  [<ffffffffb2e4e570>] vfs_write+0xc0/0x1f0
Oct 12 18:12:16 kernel:  [<ffffffffb3395ed5>] ?
system_call_after_swapgs+0xa2/0x13a
Oct 12 18:12:16 kernel:  [<ffffffffb2e4f34f>] SyS_write+0x7f/0xf0
Oct 12 18:12:16 kernel:  [<ffffffffb3395ed5>] ?
system_call_after_swapgs+0xa2/0x13a
Oct 12 18:12:16 kernel:  [<ffffffffb3395f92>] system_call_fastpath+0x25/0x2a
Oct 12 18:12:16 kernel:  [<ffffffffb3395ed5>] ?
system_call_after_swapgs+0xa2/0x13a
Oct 12 18:12:16 kernel: INFO: task kworker/u24:0:14899 blocked for more than
120 seconds.
Oct 12 18:12:16 kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs"
disables this message.
Oct 12 18:12:16 kernel: kworker/u24:0   D ffff99102b3226e0     0 14899      2
0x00000080
Oct 12 18:12:16 kernel: Workqueue: writeback bdi_writeback_workfn (flush-9:0)
Oct 12 18:12:16 kernel: Call Trace:
Oct 12 18:12:16 kernel:  [<ffffffffb3389179>] schedule+0x29/0x70
Oct 12 18:12:16 kernel:  [<ffffffffb31a7a2d>] md_handle_request+0x8d/0x150
Oct 12 18:12:16 kernel:  [<ffffffffb2cc6f50>] ? wake_up_atomic_t+0x30/0x30
Oct 12 18:12:16 kernel:  [<ffffffffb31a7b69>] md_make_request+0x79/0x190
Oct 12 18:12:16 kernel:  [<ffffffffb2f55ba7>] generic_make_request+0x147/0x380
Oct 12 18:12:16 kernel:  [<ffffffffb2e8c802>] ? bvec_alloc+0x92/0x120
Oct 12 18:12:16 kernel:  [<ffffffffb2f55e50>] submit_bio+0x70/0x150
Oct 12 18:12:16 kernel:  [<ffffffffb2e8caa3>] ? bio_alloc_bioset+0x213/0x310
Oct 12 18:12:16 kernel:  [<ffffffffc05f6e45>] xfs_add_to_ioend+0x145/0x1d0 [xfs]
Oct 12 18:12:16 kernel:  [<ffffffffc05f7475>] xfs_do_writepage+0x1e5/0x550 [xfs]
Oct 12 18:12:16 kernel:  [<ffffffffb2dca95c>] write_cache_pages+0x21c/0x470
Oct 12 18:12:16 kernel:  [<ffffffffc05f7290>] ? xfs_vm_writepages+0xa0/0xa0 [xfs]
Oct 12 18:12:16 kernel:  [<ffffffffc05f725b>] xfs_vm_writepages+0x6b/0xa0 [xfs]
Oct 12 18:12:16 kernel:  [<ffffffffb2dcb9b1>] do_writepages+0x21/0x50
Oct 12 18:12:16 kernel:  [<ffffffffb2e7def0>] __writeback_single_inode+0x40/0x260
Oct 12 18:12:16 kernel:  [<ffffffffb2e7ea74>] writeback_sb_inodes+0x1c4/0x430
Oct 12 18:12:16 kernel:  [<ffffffffb2e7ed7f>] __writeback_inodes_wb+0x9f/0xd0
Oct 12 18:12:16 kernel:  [<ffffffffb2e7f253>] wb_writeback+0x263/0x2f0
Oct 12 18:12:16 kernel:  [<ffffffffb2e6ae4c>] ? get_nr_inodes+0x4c/0x70
Oct 12 18:12:16 kernel:  [<ffffffffb2e7fe4b>] bdi_writeback_workfn+0x2cb/0x460
Oct 12 18:12:16 kernel:  [<ffffffffb2cbde8f>] process_one_work+0x17f/0x440
Oct 12 18:12:16 kernel:  [<ffffffffb2cbefa6>] worker_thread+0x126/0x3c0
Oct 12 18:12:16 kernel:  [<ffffffffb2cbee80>] ? manage_workers.isra.26+0x2a0/0x2a0
Oct 12 18:12:16 kernel:  [<ffffffffb2cc5e61>] kthread+0xd1/0xe0
Oct 12 18:12:16 kernel:  [<ffffffffb3395ec9>] ?
system_call_after_swapgs+0x96/0x13a
Oct 12 18:12:16 kernel:  [<ffffffffb2cc5d90>] ? insert_kthread_work+0x40/0x40
Oct 12 18:12:16 kernel:  [<ffffffffb3395df7>] ret_from_fork_nospec_begin+0x21/0x21
Oct 12 18:12:16 kernel:  [<ffffffffb2cc5d90>] ? insert_kthread_work+0x40/0x40
Oct 12 18:12:16 kernel: INFO: task kworker/2:1:16187 blocked for more than 120
seconds.
Oct 12 18:12:16 kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs"
disables this message.
Oct 12 18:12:16 kernel: kworker/2:1     D ffff990d363647e0     0 16187      2
0x00000080
Oct 12 18:12:16 kernel: Workqueue: xfs-cil/md0 xlog_cil_push_work [xfs]
Oct 12 18:12:16 kernel: Call Trace:
Oct 12 18:12:16 kernel:  [<ffffffffb3389179>] schedule+0x29/0x70
Oct 12 18:12:16 kernel:  [<ffffffffb31a7a2d>] md_handle_request+0x8d/0x150
Oct 12 18:12:16 kernel:  [<ffffffffb2cc6f50>] ? wake_up_atomic_t+0x30/0x30
Oct 12 18:12:16 kernel:  [<ffffffffb31a7b69>] md_make_request+0x79/0x190
Oct 12 18:12:16 kernel:  [<ffffffffb2f55ba7>] generic_make_request+0x147/0x380
Oct 12 18:12:16 kernel:  [<ffffffffb2f55e50>] submit_bio+0x70/0x150
Oct 12 18:12:16 kernel:  [<ffffffffc05fc283>] _xfs_buf_ioapply+0x2f3/0x460 [xfs]
Oct 12 18:12:16 kernel:  [<ffffffffc061e6c7>] ? xlog_bdstrat+0x37/0x70 [xfs]
Oct 12 18:12:16 kernel:  [<ffffffffc05fdc72>] __xfs_buf_submit+0x72/0x250 [xfs]
Oct 12 18:12:16 kernel:  [<ffffffffc061e6c7>] xlog_bdstrat+0x37/0x70 [xfs]
Oct 12 18:12:16 kernel:  [<ffffffffc0620526>] xlog_sync+0x2e6/0x3f0 [xfs]
Oct 12 18:12:16 kernel:  [<ffffffffc06206ab>]
xlog_state_release_iclog+0x7b/0xd0 [xfs]
Oct 12 18:12:16 kernel:  [<ffffffffc062136a>] xlog_write+0x5da/0x750 [xfs]
Oct 12 18:12:16 kernel:  [<ffffffffc0622d08>] xlog_cil_push+0x2a8/0x430 [xfs]
Oct 12 18:12:16 kernel:  [<ffffffffc0622ea5>] xlog_cil_push_work+0x15/0x20 [xfs]
Oct 12 18:12:16 kernel:  [<ffffffffb2cbde8f>] process_one_work+0x17f/0x440
Oct 12 18:12:16 kernel:  [<ffffffffb2cbf0f8>] worker_thread+0x278/0x3c0
Oct 12 18:12:16 kernel:  [<ffffffffb2cbee80>] ? manage_workers.isra.26+0x2a0/0x2a0
Oct 12 18:12:16 kernel:  [<ffffffffb2cc5e61>] kthread+0xd1/0xe0
Oct 12 18:12:16 kernel:  [<ffffffffb3395ec9>] ?
system_call_after_swapgs+0x96/0x13a
Oct 12 18:12:16 kernel:  [<ffffffffb2cc5d90>] ? insert_kthread_work+0x40/0x40
Oct 12 18:12:16 kernel:  [<ffffffffb3395df7>] ret_from_fork_nospec_begin+0x21/0x21
Oct 12 18:12:16 kernel:  [<ffffffffb2cc5d90>] ? insert_kthread_work+0x40/0x40
Oct 12 18:12:16 kernel: INFO: task kworker/2:0:16943 blocked for more than 120
seconds.
Oct 12 18:12:16 kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs"
disables this message.
Oct 12 18:12:16 kernel: kworker/2:0     D ffff99102afbd280     0 16943      2
0x00000080
Oct 12 18:12:16 kernel: Workqueue: xfs-sync/md0 xfs_log_worker [xfs]
Oct 12 18:12:16 kernel: Call Trace:
Oct 12 18:12:16 kernel:  [<ffffffffb3389179>] schedule+0x29/0x70
Oct 12 18:12:16 kernel:  [<ffffffffb3386e41>] schedule_timeout+0x221/0x2d0
Oct 12 18:12:16 kernel:  [<ffffffffb2cd7449>] ? ttwu_do_wakeup+0x19/0xe0
Oct 12 18:12:16 kernel:  [<ffffffffb2cd757f>] ? ttwu_do_activate+0x6f/0x80
Oct 12 18:12:16 kernel:  [<ffffffffb2cdab32>] ? try_to_wake_up+0x192/0x390
Oct 12 18:12:16 kernel:  [<ffffffffb338952d>] wait_for_completion+0xfd/0x140
Oct 12 18:12:16 kernel:  [<ffffffffb2cdadf0>] ? wake_up_state+0x20/0x20
Oct 12 18:12:16 kernel:  [<ffffffffb2cbe61a>] flush_work+0x10a/0x1b0
Oct 12 18:12:16 kernel:  [<ffffffffb2cbb330>] ? move_linked_works+0x90/0x90
Oct 12 18:12:16 kernel:  [<ffffffffc06236da>] xlog_cil_force_lsn+0x8a/0x210 [xfs]
Oct 12 18:12:16 kernel:  [<ffffffffb2ce4d1c>] ? dequeue_entity+0x11c/0x5c0
Oct 12 18:12:16 kernel:  [<ffffffffc06218e6>] ? xfs_log_worker+0x36/0x100 [xfs]
Oct 12 18:12:16 kernel:  [<ffffffffc062165b>] xfs_log_force+0x8b/0x2e0 [xfs]
Oct 12 18:12:16 kernel:  [<ffffffffb2c2b59e>] ? __switch_to+0xce/0x580
Oct 12 18:12:16 kernel:  [<ffffffffc06218e6>] xfs_log_worker+0x36/0x100 [xfs]
Oct 12 18:12:16 kernel:  [<ffffffffb2cbde8f>] process_one_work+0x17f/0x440
Oct 12 18:12:16 kernel:  [<ffffffffb2cbefa6>] worker_thread+0x126/0x3c0
Oct 12 18:12:16 kernel:  [<ffffffffb2cbee80>] ? manage_workers.isra.26+0x2a0/0x2a0
Oct 12 18:12:16 kernel:  [<ffffffffb2cc5e61>] kthread+0xd1/0xe0
Oct 12 18:12:16 kernel:  [<ffffffffb3395ec9>] ?
system_call_after_swapgs+0x96/0x13a
Oct 12 18:12:16 kernel:  [<ffffffffb2cc5d90>] ? insert_kthread_work+0x40/0x40
Oct 12 18:12:16 kernel:  [<ffffffffb3395df7>] ret_from_fork_nospec_begin+0x21/0x21
Oct 12 18:12:16 kernel:  [<ffffffffb2cc5d90>] ? insert_kthread_work+0x40/0x40
Oct 12 18:12:16 kernel: INFO: task kworker/5:1:17174 blocked for more than 120
seconds.
Oct 12 18:12:16 kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs"
disables this message.
Oct 12 18:12:16 kernel: kworker/5:1     D ffff991011e226e0     0 17174      2
0x00000080
Oct 12 18:12:16 kernel: Workqueue: md md_submit_flush_data
Oct 12 18:12:16 kernel: Call Trace:
Oct 12 18:12:16 kernel:  [<ffffffffb3389179>] schedule+0x29/0x70
Oct 12 18:12:16 kernel:  [<ffffffffb31a7a2d>] md_handle_request+0x8d/0x150
Oct 12 18:12:16 kernel:  [<ffffffffb2cc6f50>] ? wake_up_atomic_t+0x30/0x30
Oct 12 18:12:16 kernel:  [<ffffffffb31ac8c1>] md_submit_flush_data+0x81/0xb0
Oct 12 18:12:16 kernel:  [<ffffffffb2cbde8f>] process_one_work+0x17f/0x440
Oct 12 18:12:16 kernel:  [<ffffffffb2cbefa6>] worker_thread+0x126/0x3c0
Oct 12 18:12:16 kernel:  [<ffffffffb2cbee80>] ? manage_workers.isra.26+0x2a0/0x2a0
Oct 12 18:12:16 kernel:  [<ffffffffb2cc5e61>] kthread+0xd1/0xe0
Oct 12 18:12:16 kernel:  [<ffffffffb2cc5d90>] ? insert_kthread_work+0x40/0x40
Oct 12 18:12:16 kernel:  [<ffffffffb3395df7>] ret_from_fork_nospec_begin+0x21/0x21
Oct 12 18:12:16 kernel:  [<ffffffffb2cc5d90>] ? insert_kthread_work+0x40/0x40
Oct 12 18:12:16 kernel: INFO: task rsync_bpc:17209 blocked for more than 120
seconds.
Oct 12 18:12:16 kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs"
disables this message.
Oct 12 18:12:16 kernel: rsync_bpc       D ffff99102c5aa6e0     0 17209  17195
0x00000080
Oct 12 18:12:16 kernel: Call Trace:
Oct 12 18:12:16 kernel:  [<ffffffffb3389179>] schedule+0x29/0x70
Oct 12 18:12:16 kernel:  [<ffffffffb31acb96>] md_flush_request+0x106/0x200
Oct 12 18:12:16 kernel:  [<ffffffffb2cc6f50>] ? wake_up_atomic_t+0x30/0x30
Oct 12 18:12:16 kernel:  [<ffffffffc095aae8>] raid5_make_request+0xc88/0xca0
[raid456]
Oct 12 18:12:16 kernel:  [<ffffffffb2cc6f50>] ? wake_up_atomic_t+0x30/0x30
Oct 12 18:12:16 kernel:  [<ffffffffb2ce6321>] ? put_prev_entity+0x31/0x400
Oct 12 18:12:16 kernel:  [<ffffffffb2c2b621>] ? __switch_to+0x151/0x580
Oct 12 18:12:16 kernel:  [<ffffffffb31a7a70>] md_handle_request+0xd0/0x150
Oct 12 18:12:16 kernel:  [<ffffffffb2f53dcf>] ?
generic_make_request_checks+0x27f/0x390
Oct 12 18:12:16 kernel:  [<ffffffffb31a7b69>] md_make_request+0x79/0x190
Oct 12 18:12:16 kernel:  [<ffffffffb2f55ba7>] generic_make_request+0x147/0x380
Oct 12 18:12:16 kernel:  [<ffffffffb2f55e50>] submit_bio+0x70/0x150
Oct 12 18:12:16 kernel:  [<ffffffffc05fc283>] _xfs_buf_ioapply+0x2f3/0x460 [xfs]
Oct 12 18:12:16 kernel:  [<ffffffffc061e6c7>] ? xlog_bdstrat+0x37/0x70 [xfs]
Oct 12 18:12:16 kernel:  [<ffffffffc05fdc72>] __xfs_buf_submit+0x72/0x250 [xfs]
Oct 12 18:12:16 kernel:  [<ffffffffc061e6c7>] xlog_bdstrat+0x37/0x70 [xfs]
Oct 12 18:12:16 kernel:  [<ffffffffc0620526>] xlog_sync+0x2e6/0x3f0 [xfs]
Oct 12 18:12:16 kernel:  [<ffffffffc06206ab>]
xlog_state_release_iclog+0x7b/0xd0 [xfs]
Oct 12 18:12:16 kernel:  [<ffffffffc062180a>] xfs_log_force+0x23a/0x2e0 [xfs]
Oct 12 18:12:16 kernel:  [<ffffffffc05fd490>] ?
_xfs_buf_find.isra.9+0x170/0x330 [xfs]
Oct 12 18:12:16 kernel:  [<ffffffffc05fd31b>] xfs_buf_lock+0xcb/0xd0 [xfs]
Oct 12 18:12:16 kernel:  [<ffffffffc05fd490>] _xfs_buf_find.isra.9+0x170/0x330
[xfs]
Oct 12 18:12:16 kernel:  [<ffffffffc05fd6e5>] xfs_buf_get_map+0x35/0x250 [xfs]
Oct 12 18:12:16 kernel:  [<ffffffffc062ebe1>]
xfs_trans_get_buf_map+0x101/0x170 [xfs]
Oct 12 18:12:16 kernel:  [<ffffffffc05daf32>] xfs_da_get_buf+0xc2/0x100 [xfs]
Oct 12 18:12:16 kernel:  [<ffffffffc05e2a2f>] xfs_dir3_data_init+0x5f/0x280 [xfs]
Oct 12 18:12:16 kernel:  [<ffffffffc05e16af>] xfs_dir2_sf_to_block+0x12f/0x640
[xfs]
Oct 12 18:12:16 kernel:  [<ffffffffb2e291a2>] ? kmem_cache_alloc+0x1c2/0x1f0
Oct 12 18:12:16 kernel:  [<ffffffffc061de17>] ? kmem_zone_alloc+0x97/0x130 [xfs]
Oct 12 18:12:16 kernel:  [<ffffffffc05e99dc>] xfs_dir2_sf_addname+0xcc/0x5c0 [xfs]
Oct 12 18:12:16 kernel:  [<ffffffffc061da87>] ? kmem_alloc+0x97/0x130 [xfs]
Oct 12 18:12:16 kernel:  [<ffffffffc05df678>] xfs_dir_createname+0x1a8/0x200 [xfs]
Oct 12 18:12:16 kernel:  [<ffffffffc06130f8>] xfs_rename+0x878/0xaa0 [xfs]
Oct 12 18:12:16 kernel:  [<ffffffffc060d834>] xfs_vn_rename+0xe4/0x150 [xfs]
Oct 12 18:12:16 kernel:  [<ffffffffb2e5fec5>] vfs_rename+0x5d5/0x8e0
Oct 12 18:12:16 kernel:  [<ffffffffc060d750>] ? xfs_initxattrs+0x60/0x60 [xfs]
Oct 12 18:12:16 kernel:  [<ffffffffb2e61143>] SYSC_renameat2+0x503/0x5a0
Oct 12 18:12:16 kernel:  [<ffffffffb2e6166d>] ? do_filp_open+0x4d/0xb0
Oct 12 18:12:16 kernel:  [<ffffffffb3395ed5>] ?
system_call_after_swapgs+0xa2/0x13a
Oct 12 18:12:16 kernel:  [<ffffffffb3395ec9>] ?
system_call_after_swapgs+0x96/0x13a
Oct 12 18:12:16 kernel:  [<ffffffffb3395ed5>] ?
system_call_after_swapgs+0xa2/0x13a
Oct 12 18:12:16 kernel:  [<ffffffffb3395ec9>] ?
system_call_after_swapgs+0x96/0x13a
Oct 12 18:12:16 kernel:  [<ffffffffb2e6204e>] SyS_renameat2+0xe/0x10
Oct 12 18:12:16 kernel:  [<ffffffffb2e6208e>] SyS_rename+0x1e/0x20
Oct 12 18:12:16 kernel:  [<ffffffffb3395f92>] system_call_fastpath+0x25/0x2a
Oct 12 18:12:16 kernel:  [<ffffffffb3395ed5>] ?
system_call_after_swapgs+0xa2/0x13a
Oct 12 18:12:16 kernel: INFO: task rsync_bpc:17214 blocked for more than 120
seconds.
Oct 12 18:12:16 kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs"
disables this message.
Oct 12 18:12:16 kernel: rsync_bpc       D ffff99100ad0e8e0     0 17214  17211
0x00000080
Oct 12 18:12:16 kernel: Call Trace:
Oct 12 18:12:16 kernel:  [<ffffffffb3389179>] schedule+0x29/0x70
Oct 12 18:12:16 kernel:  [<ffffffffb31a7a2d>] md_handle_request+0x8d/0x150
Oct 12 18:12:16 kernel:  [<ffffffffb2cc6f50>] ? wake_up_atomic_t+0x30/0x30
Oct 12 18:12:16 kernel:  [<ffffffffb31a7b69>] md_make_request+0x79/0x190
Oct 12 18:12:16 kernel:  [<ffffffffb2f55ba7>] generic_make_request+0x147/0x380
Oct 12 18:12:16 kernel:  [<ffffffffb31a2180>] ? md_congested+0x50/0x50
Oct 12 18:12:16 kernel:  [<ffffffffb2f55e50>] submit_bio+0x70/0x150
Oct 12 18:12:16 kernel:  [<ffffffffc05fc283>] _xfs_buf_ioapply+0x2f3/0x460 [xfs]
Oct 12 18:12:16 kernel:  [<ffffffffc05fde75>] ? _xfs_buf_read+0x25/0x30 [xfs]
Oct 12 18:12:16 kernel:  [<ffffffffc05fdc72>] __xfs_buf_submit+0x72/0x250 [xfs]
Oct 12 18:12:16 kernel:  [<ffffffffc062ee39>] ?
xfs_trans_read_buf_map+0xe9/0x2c0 [xfs]
Oct 12 18:12:16 kernel:  [<ffffffffc05fde75>] _xfs_buf_read+0x25/0x30 [xfs]
Oct 12 18:12:16 kernel:  [<ffffffffc05fdf79>] xfs_buf_read_map+0xf9/0x160 [xfs]
Oct 12 18:12:16 kernel:  [<ffffffffc062ee39>]
xfs_trans_read_buf_map+0xe9/0x2c0 [xfs]
Oct 12 18:12:16 kernel:  [<ffffffffc05db5a3>] xfs_da_read_buf+0xd3/0x120 [xfs]
Oct 12 18:12:16 kernel:  [<ffffffffc05e1c36>] xfs_dir3_data_read+0x26/0x60 [xfs]
Oct 12 18:12:16 kernel:  [<ffffffffc05e6056>]
xfs_dir2_leafn_lookup_for_entry+0xf6/0x3c0 [xfs]
Oct 12 18:12:16 kernel:  [<ffffffffc05e79b7>]
xfs_dir2_leafn_lookup_int+0x17/0x30 [xfs]
Oct 12 18:12:16 kernel:  [<ffffffffc05dcbb4>]
xfs_da3_node_lookup_int+0x324/0x350 [xfs]
Oct 12 18:12:16 kernel:  [<ffffffffc05e866d>] xfs_dir2_node_lookup+0x4d/0x170
[xfs]
Oct 12 18:12:16 kernel:  [<ffffffffc05df8bd>] xfs_dir_lookup+0x1bd/0x1e0 [xfs]
Oct 12 18:12:16 kernel:  [<ffffffffc0610c69>] xfs_lookup+0x69/0x140 [xfs]
Oct 12 18:12:16 kernel:  [<ffffffffc060da88>] xfs_vn_lookup+0x78/0xc0 [xfs]
Oct 12 18:12:16 kernel:  [<ffffffffb2e591b3>] lookup_real+0x23/0x60
Oct 12 18:12:16 kernel:  [<ffffffffb2e59bd2>] __lookup_hash+0x42/0x60
Oct 12 18:12:16 kernel:  [<ffffffffb33800e5>] lookup_slow+0x42/0xa7
Oct 12 18:12:16 kernel:  [<ffffffffb2e5d7ce>] path_lookupat+0x89e/0x8d0
Oct 12 18:12:16 kernel:  [<ffffffffb32dffb0>] ? inet_recvmsg+0x80/0xb0
Oct 12 18:12:16 kernel:  [<ffffffffb2e29015>] ? kmem_cache_alloc+0x35/0x1f0
Oct 12 18:12:16 kernel:  [<ffffffffb2e6039f>] ? getname_flags+0x4f/0x1a0
Oct 12 18:12:16 kernel:  [<ffffffffb2e5d82b>] filename_lookup+0x2b/0xc0
Oct 12 18:12:16 kernel:  [<ffffffffb2e61537>] user_path_at_empty+0x67/0xc0
Oct 12 18:12:16 kernel:  [<ffffffffb3235731>] ? sock_aio_read+0x21/0x30
Oct 12 18:12:16 kernel:  [<ffffffffb2e4d9a3>] ? do_sync_read+0x93/0xe0
Oct 12 18:12:16 kernel:  [<ffffffffb2e615a1>] user_path_at+0x11/0x20
Oct 12 18:12:16 kernel:  [<ffffffffb2e53fe3>] vfs_fstatat+0x63/0xc0
Oct 12 18:12:16 kernel:  [<ffffffffb2e5439e>] SYSC_newstat+0x2e/0x60
Oct 12 18:12:16 kernel:  [<ffffffffb3395ed5>] ?
system_call_after_swapgs+0xa2/0x13a
Oct 12 18:12:16 kernel:  [<ffffffffb3395ec9>] ?
system_call_after_swapgs+0x96/0x13a
Oct 12 18:12:16 kernel:  [<ffffffffb3395ed5>] ?
system_call_after_swapgs+0xa2/0x13a
Oct 12 18:12:16 kernel:  [<ffffffffb3395ec9>] ?
system_call_after_swapgs+0x96/0x13a
Oct 12 18:12:16 kernel:  [<ffffffffb3395ed5>] ?
system_call_after_swapgs+0xa2/0x13a
Oct 12 18:12:16 kernel:  [<ffffffffb3395ec9>] ?
system_call_after_swapgs+0x96/0x13a
Oct 12 18:12:16 kernel:  [<ffffffffb3395ed5>] ?
system_call_after_swapgs+0xa2/0x13a
Oct 12 18:12:16 kernel:  [<ffffffffb3395ec9>] ?
system_call_after_swapgs+0x96/0x13a
Oct 12 18:12:16 kernel:  [<ffffffffb3395ed5>] ?
system_call_after_swapgs+0xa2/0x13a
Oct 12 18:12:16 kernel:  [<ffffffffb3395ec9>] ?
system_call_after_swapgs+0x96/0x13a
Oct 12 18:12:16 kernel:  [<ffffffffb3395ed5>] ?
system_call_after_swapgs+0xa2/0x13a
Oct 12 18:12:16 kernel:  [<ffffffffb2e5485e>] SyS_newstat+0xe/0x10
Oct 12 18:12:16 kernel:  [<ffffffffb3395f92>] system_call_fastpath+0x25/0x2a
Oct 12 18:12:16 kernel:  [<ffffffffb3395ed5>] ?
system_call_after_swapgs+0xa2/0x13a
Oct 12 18:12:16 kernel: INFO: task BackupPC_refCou:17492 blocked for more than
120 seconds.
Oct 12 18:12:16 kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs"
disables this message.
Oct 12 18:12:16 kernel: BackupPC_refCou D ffff990c36a9b760     0 17492  17490
0x00000080
Oct 12 18:12:16 kernel: Call Trace:
Oct 12 18:12:16 kernel:  [<ffffffffb3389179>] schedule+0x29/0x70
Oct 12 18:12:16 kernel:  [<ffffffffb31a7a2d>] md_handle_request+0x8d/0x150
Oct 12 18:12:16 kernel:  [<ffffffffb2cc6f50>] ? wake_up_atomic_t+0x30/0x30
Oct 12 18:12:16 kernel:  [<ffffffffb31a7b69>] md_make_request+0x79/0x190
Oct 12 18:12:16 kernel:  [<ffffffffb2f55ba7>] generic_make_request+0x147/0x380
Oct 12 18:12:16 kernel:  [<ffffffffc05f6ce0>] ? __xfs_get_blocks+0x6d0/0x6d0 [xfs]
Oct 12 18:12:16 kernel:  [<ffffffffb2f55e50>] submit_bio+0x70/0x150
Oct 12 18:12:16 kernel:  [<ffffffffb2dcdce4>] ? __lru_cache_add+0x64/0x90
Oct 12 18:12:16 kernel:  [<ffffffffb2e93eca>] mpage_bio_submit+0x2a/0x40
Oct 12 18:12:16 kernel:  [<ffffffffb2e9506f>] mpage_readpages+0x13f/0x170
Oct 12 18:12:16 kernel:  [<ffffffffc05f6ce0>] ? __xfs_get_blocks+0x6d0/0x6d0 [xfs]
Oct 12 18:12:16 kernel:  [<ffffffffc05f6ce0>] ? __xfs_get_blocks+0x6d0/0x6d0 [xfs]
Oct 12 18:12:16 kernel:  [<ffffffffb2e193b8>] ? alloc_pages_current+0x98/0x110
Oct 12 18:12:16 kernel:  [<ffffffffc05f6058>] xfs_vm_readpages+0x38/0x80 [xfs]
Oct 12 18:12:16 kernel:  [<ffffffffb2dcbe1f>]
__do_page_cache_readahead+0x1cf/0x260
Oct 12 18:12:16 kernel:  [<ffffffffb2dcbfcf>] ondemand_readahead+0x11f/0x240
Oct 12 18:12:16 kernel:  [<ffffffffb2dcc410>] page_cache_sync_readahead+0x60/0x80
Oct 12 18:12:16 kernel:  [<ffffffffb2dbf39c>]
do_generic_file_read.constprop.52+0xdc/0x510
Oct 12 18:12:16 kernel:  [<ffffffffb2dc0179>] generic_file_aio_read+0x1c9/0x290
Oct 12 18:12:16 kernel:  [<ffffffffc0601f55>]
xfs_file_buffered_aio_read+0x95/0x110 [xfs]
Oct 12 18:12:16 kernel:  [<ffffffffc06025a7>] xfs_file_aio_read+0x87/0x100 [xfs]
Oct 12 18:12:16 kernel:  [<ffffffffb2e4d9a3>] do_sync_read+0x93/0xe0
Oct 12 18:12:16 kernel:  [<ffffffffb2e4e3df>] vfs_read+0x9f/0x170
Oct 12 18:12:16 kernel:  [<ffffffffb2e4f25f>] SyS_read+0x7f/0xf0
Oct 12 18:12:16 kernel:  [<ffffffffb3395ed5>] ?
system_call_after_swapgs+0xa2/0x13a
Oct 12 18:12:16 kernel:  [<ffffffffb3395f92>] system_call_fastpath+0x25/0x2a
Oct 12 18:12:16 kernel:  [<ffffffffb3395ed5>] ?
system_call_after_swapgs+0xa2/0x13a



-- 
Orion Poplawski
IT Systems Manager                         720-772-5637
NWRA, Boulder/CoRA Office             FAX: 303-415-9702
3380 Mitchell Lane                       orion@xxxxxxxx
Boulder, CO 80301                 https://www.nwra.com/

<<attachment: smime.p7s>>


[Index of Archives]     [Linux RAID Wiki]     [ATA RAID]     [Linux SCSI Target Infrastructure]     [Linux Block]     [Linux IDE]     [Linux SCSI]     [Linux Hams]     [Device Mapper]     [Device Mapper Cryptographics]     [Kernel]     [Linux Admin]     [Linux Net]     [GFS]     [RPM]     [git]     [Yosemite Forum]


  Powered by Linux