XFS deadlock in 5.8.14-arch

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



Hello,

when copying 10GB of files (from/to XFS on LVM on LUKS on RAID), system hung and did not recover for >1 hour.
 
Other file access hung too. Had to REISUB. Some file corruption afterwards.
 
Is this a known issue? It only happened once, so far I am unable to reproduce it.

Kind regards
Johann
 
------------

Oct 11 15:15:43 kernel: INFO: task cp:9636 blocked for more than 122 seconds.
Oct 11 15:15:43 kernel:       Tainted: G     U            5.8.14-arch1-1 #1
Oct 11 15:15:43 kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
Oct 11 15:15:43 kernel: cp              D    0  9636   9616 0x00000000
Oct 11 15:15:43 kernel: Call Trace:
Oct 11 15:15:43 kernel:  __schedule+0x2a6/0x810
Oct 11 15:15:43 kernel:  ? __xfs_trans_commit+0xa1/0x350 [xfs]
Oct 11 15:15:43 kernel:  schedule+0x46/0xf0
Oct 11 15:15:43 kernel:  xfs_log_commit_cil+0x6d2/0x870 [xfs]
Oct 11 15:15:43 kernel:  ? wake_up_q+0xa0/0xa0
Oct 11 15:15:43 kernel:  __xfs_trans_commit+0xa1/0x350 [xfs]
Oct 11 15:15:43 kernel:  xfs_create+0x476/0x560 [xfs]
Oct 11 15:15:43 kernel:  xfs_generic_create+0x269/0x340 [xfs]
Oct 11 15:15:43 kernel:  ? d_splice_alias+0x165/0x450
Oct 11 15:15:43 kernel:  path_openat+0xdea/0x10f0
Oct 11 15:15:43 kernel:  do_filp_open+0x9c/0x140
Oct 11 15:15:43 kernel:  do_sys_openat2+0xbb/0x170
Oct 11 15:15:43 kernel:  __x64_sys_openat+0x54/0x90
Oct 11 15:15:43 kernel:  do_syscall_64+0x44/0x70
Oct 11 15:15:43 kernel:  entry_SYSCALL_64_after_hwframe+0x44/0xa9
Oct 11 15:15:43 kernel: RIP: 0033:0x7f088f47dc1b
Oct 11 15:15:43 kernel: Code: Bad RIP value.
Oct 11 15:15:43 kernel: RSP: 002b:00007ffed49d4280 EFLAGS: 00000246 ORIG_RAX: 0000000000000101
Oct 11 15:15:43 kernel: RAX: ffffffffffffffda RBX: 00007ffed49d4860 RCX: 00007f088f47dc1b
Oct 11 15:15:43 kernel: RDX: 00000000000000c1 RSI: 00005593f03038a0 RDI: 00000000ffffff9c
Oct 11 15:15:43 kernel: RBP: 00005593f03038a0 R08: 0000000000000001 R09: 0000000000000000
Oct 11 15:15:43 kernel: R10: 0000000000000180 R11: 0000000000000246 R12: 00000000000000c1
Oct 11 15:15:43 kernel: R13: 0000000000000000 R14: 00005593f03038a0 R15: 0000000000000003
Oct 11 15:15:43 kernel: INFO: task kworker/2:5:9646 blocked for more than 122 seconds.
Oct 11 15:15:43 kernel:       Tainted: G     U            5.8.14-arch1-1 #1
Oct 11 15:15:43 kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
Oct 11 15:15:43 kernel: kworker/2:5     D    0  9646      2 0x00004000
Oct 11 15:15:43 kernel: Workqueue: xfs-conv/dm-76 xfs_end_io [xfs]
Oct 11 15:15:43 kernel: Call Trace:
Oct 11 15:15:43 kernel:  __schedule+0x2a6/0x810
Oct 11 15:15:43 kernel:  ? __xfs_trans_commit+0xa1/0x350 [xfs]
Oct 11 15:15:43 kernel:  schedule+0x46/0xf0
Oct 11 15:15:43 kernel:  xfs_log_commit_cil+0x6d2/0x870 [xfs]
Oct 11 15:15:43 kernel:  ? wake_up_q+0xa0/0xa0
Oct 11 15:15:43 kernel:  __xfs_trans_commit+0xa1/0x350 [xfs]
Oct 11 15:15:43 kernel:  xfs_iomap_write_unwritten+0xf7/0x330 [xfs]
Oct 11 15:15:43 kernel:  xfs_end_ioend+0xc6/0x110 [xfs]
Oct 11 15:15:43 kernel:  xfs_end_io+0xbd/0xf0 [xfs]
Oct 11 15:15:43 kernel:  process_one_work+0x1da/0x3d0
Oct 11 15:15:43 kernel:  worker_thread+0x4d/0x3d0
Oct 11 15:15:43 kernel:  ? rescuer_thread+0x410/0x410
Oct 11 15:15:43 kernel:  kthread+0x142/0x160
Oct 11 15:15:43 kernel:  ? __kthread_bind_mask+0x60/0x60
Oct 11 15:15:43 kernel:  ret_from_fork+0x1f/0x30
Oct 11 15:15:43 kernel: INFO: task kworker/2:13:9654 blocked for more than 122 seconds.
Oct 11 15:15:43 kernel:       Tainted: G     U            5.8.14-arch1-1 #1
Oct 11 15:15:43 kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
Oct 11 15:15:43 kernel: kworker/2:13    D    0  9654      2 0x00004000
Oct 11 15:15:43 kernel: Workqueue: xfs-conv/dm-76 xfs_end_io [xfs]
Oct 11 15:15:43 kernel: Call Trace:
Oct 11 15:15:43 kernel:  __schedule+0x2a6/0x810
Oct 11 15:15:43 kernel:  ? __xfs_trans_commit+0xa1/0x350 [xfs]
Oct 11 15:15:43 kernel:  schedule+0x46/0xf0
Oct 11 15:15:43 kernel:  xfs_log_commit_cil+0x6d2/0x870 [xfs]
Oct 11 15:15:43 kernel:  ? wake_up_q+0xa0/0xa0
Oct 11 15:15:43 kernel:  __xfs_trans_commit+0xa1/0x350 [xfs]
Oct 11 15:15:43 kernel:  xfs_iomap_write_unwritten+0xf7/0x330 [xfs]
Oct 11 15:15:43 kernel:  xfs_end_ioend+0xc6/0x110 [xfs]
Oct 11 15:15:43 kernel:  xfs_end_io+0xbd/0xf0 [xfs]
Oct 11 15:15:43 kernel:  process_one_work+0x1da/0x3d0
Oct 11 15:15:43 kernel:  worker_thread+0x4d/0x3d0
Oct 11 15:15:43 kernel:  ? rescuer_thread+0x410/0x410
Oct 11 15:15:43 kernel:  kthread+0x142/0x160
Oct 11 15:15:43 kernel:  ? __kthread_bind_mask+0x60/0x60
Oct 11 15:15:43 kernel:  ret_from_fork+0x1f/0x30
Oct 11 15:15:43 kernel: INFO: task kworker/2:36:9677 blocked for more than 122 seconds.
Oct 11 15:15:43 kernel:       Tainted: G     U            5.8.14-arch1-1 #1
Oct 11 15:15:43 kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
Oct 11 15:15:43 kernel: kworker/2:36    D    0  9677      2 0x00004000
Oct 11 15:15:43 kernel: Workqueue: xfs-conv/dm-76 xfs_end_io [xfs]
Oct 11 15:15:43 kernel: Call Trace:
Oct 11 15:15:43 kernel:  __schedule+0x2a6/0x810
Oct 11 15:15:43 kernel:  ? __xfs_trans_commit+0xa1/0x350 [xfs]
Oct 11 15:15:43 kernel:  schedule+0x46/0xf0
Oct 11 15:15:43 kernel:  xfs_log_commit_cil+0x6d2/0x870 [xfs]
Oct 11 15:15:43 kernel:  ? wake_up_q+0xa0/0xa0
Oct 11 15:15:43 kernel:  __xfs_trans_commit+0xa1/0x350 [xfs]
Oct 11 15:15:43 kernel:  xfs_iomap_write_unwritten+0xf7/0x330 [xfs]
Oct 11 15:15:43 kernel:  xfs_end_ioend+0xc6/0x110 [xfs]
Oct 11 15:15:43 kernel:  xfs_end_io+0xbd/0xf0 [xfs]
Oct 11 15:15:43 kernel:  process_one_work+0x1da/0x3d0
Oct 11 15:15:43 kernel:  worker_thread+0x4d/0x3d0
Oct 11 15:15:43 kernel:  ? rescuer_thread+0x410/0x410
Oct 11 15:15:43 kernel:  kthread+0x142/0x160
Oct 11 15:15:43 kernel:  ? __kthread_bind_mask+0x60/0x60
Oct 11 15:15:43 kernel:  ret_from_fork+0x1f/0x30
Oct 11 15:15:43 kernel: INFO: task kworker/2:37:9678 blocked for more than 122 seconds.
Oct 11 15:15:43 kernel:       Tainted: G     U            5.8.14-arch1-1 #1
Oct 11 15:15:43 kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
Oct 11 15:15:43 kernel: kworker/2:37    D    0  9678      2 0x00004000
Oct 11 15:15:43 kernel: Workqueue: xfs-conv/dm-76 xfs_end_io [xfs]
Oct 11 15:15:43 kernel: Call Trace:
Oct 11 15:15:43 kernel:  __schedule+0x2a6/0x810
Oct 11 15:15:43 kernel:  ? __xfs_trans_commit+0xa1/0x350 [xfs]
Oct 11 15:15:43 kernel:  schedule+0x46/0xf0
Oct 11 15:15:43 kernel:  xfs_log_commit_cil+0x6d2/0x870 [xfs]
Oct 11 15:15:43 kernel:  ? wake_up_q+0xa0/0xa0
Oct 11 15:15:43 kernel:  __xfs_trans_commit+0xa1/0x350 [xfs]
Oct 11 15:15:43 kernel:  xfs_iomap_write_unwritten+0xf7/0x330 [xfs]
Oct 11 15:15:43 kernel:  xfs_end_ioend+0xc6/0x110 [xfs]
Oct 11 15:15:43 kernel:  xfs_end_io+0xbd/0xf0 [xfs]
Oct 11 15:15:43 kernel:  process_one_work+0x1da/0x3d0
Oct 11 15:15:43 kernel:  worker_thread+0x4d/0x3d0
Oct 11 15:15:43 kernel:  ? rescuer_thread+0x410/0x410
Oct 11 15:15:43 kernel:  kthread+0x142/0x160
Oct 11 15:15:43 kernel:  ? __kthread_bind_mask+0x60/0x60
Oct 11 15:15:43 kernel:  ret_from_fork+0x1f/0x30
Oct 11 15:15:43 kernel: INFO: task kworker/2:38:9679 blocked for more than 122 seconds.
Oct 11 15:15:43 kernel:       Tainted: G     U            5.8.14-arch1-1 #1
Oct 11 15:15:43 kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
Oct 11 15:15:43 kernel: kworker/2:38    D    0  9679      2 0x00004000
Oct 11 15:15:43 kernel: Workqueue: xfs-conv/dm-76 xfs_end_io [xfs]
Oct 11 15:15:43 kernel: Call Trace:
Oct 11 15:15:43 kernel:  __schedule+0x2a6/0x810
Oct 11 15:15:43 kernel:  ? __xfs_trans_commit+0xa1/0x350 [xfs]
Oct 11 15:15:43 kernel:  schedule+0x46/0xf0
Oct 11 15:15:43 kernel:  xfs_log_commit_cil+0x6d2/0x870 [xfs]
Oct 11 15:15:43 kernel:  ? wake_up_q+0xa0/0xa0
Oct 11 15:15:43 kernel:  __xfs_trans_commit+0xa1/0x350 [xfs]
Oct 11 15:15:43 kernel:  xfs_iomap_write_unwritten+0xf7/0x330 [xfs]
Oct 11 15:15:43 kernel:  xfs_end_ioend+0xc6/0x110 [xfs]
Oct 11 15:15:43 kernel:  xfs_end_io+0xbd/0xf0 [xfs]
Oct 11 15:15:43 kernel:  process_one_work+0x1da/0x3d0
Oct 11 15:15:43 kernel:  worker_thread+0x4d/0x3d0
Oct 11 15:15:43 kernel:  ? rescuer_thread+0x410/0x410
Oct 11 15:15:43 kernel:  kthread+0x142/0x160
Oct 11 15:15:43 kernel:  ? __kthread_bind_mask+0x60/0x60
Oct 11 15:15:43 kernel:  ret_from_fork+0x1f/0x30
Oct 11 15:15:43 kernel: INFO: task kworker/2:53:9694 blocked for more than 122 seconds.
Oct 11 15:15:43 kernel:       Tainted: G     U            5.8.14-arch1-1 #1
Oct 11 15:15:43 kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
Oct 11 15:15:43 kernel: kworker/2:53    D    0  9694      2 0x00004000
Oct 11 15:15:43 kernel: Workqueue: xfs-conv/dm-76 xfs_end_io [xfs]
Oct 11 15:15:43 kernel: Call Trace:
Oct 11 15:15:43 kernel:  __schedule+0x2a6/0x810
Oct 11 15:15:43 kernel:  ? __xfs_trans_commit+0xa1/0x350 [xfs]
Oct 11 15:15:43 kernel:  schedule+0x46/0xf0
Oct 11 15:15:43 kernel:  xfs_log_commit_cil+0x6d2/0x870 [xfs]
Oct 11 15:15:43 kernel:  ? wake_up_q+0xa0/0xa0
Oct 11 15:15:43 kernel:  __xfs_trans_commit+0xa1/0x350 [xfs]
Oct 11 15:15:43 kernel:  xfs_iomap_write_unwritten+0xf7/0x330 [xfs]
Oct 11 15:15:43 kernel:  xfs_end_ioend+0xc6/0x110 [xfs]
Oct 11 15:15:43 kernel:  xfs_end_io+0xbd/0xf0 [xfs]
Oct 11 15:15:43 kernel:  process_one_work+0x1da/0x3d0
Oct 11 15:15:43 kernel:  worker_thread+0x4d/0x3d0
Oct 11 15:15:43 kernel:  ? rescuer_thread+0x410/0x410
Oct 11 15:15:43 kernel:  kthread+0x142/0x160
Oct 11 15:15:43 kernel:  ? __kthread_bind_mask+0x60/0x60
Oct 11 15:15:43 kernel:  ret_from_fork+0x1f/0x30
Oct 11 15:15:43 kernel: INFO: task kworker/2:77:9718 blocked for more than 122 seconds.
Oct 11 15:15:43 kernel:       Tainted: G     U            5.8.14-arch1-1 #1
Oct 11 15:15:43 kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
Oct 11 15:15:43 kernel: kworker/2:77    D    0  9718      2 0x00004000
Oct 11 15:15:43 kernel: Workqueue: xfs-conv/dm-76 xfs_end_io [xfs]
Oct 11 15:15:43 kernel: Call Trace:
Oct 11 15:15:43 kernel:  __schedule+0x2a6/0x810
Oct 11 15:15:43 kernel:  ? __xfs_trans_commit+0xa1/0x350 [xfs]
Oct 11 15:15:43 kernel:  schedule+0x46/0xf0
Oct 11 15:15:43 kernel:  xfs_log_commit_cil+0x6d2/0x870 [xfs]
Oct 11 15:15:43 kernel:  ? wake_up_q+0xa0/0xa0
Oct 11 15:15:43 kernel:  __xfs_trans_commit+0xa1/0x350 [xfs]
Oct 11 15:15:43 kernel:  xfs_iomap_write_unwritten+0xf7/0x330 [xfs]
Oct 11 15:15:43 kernel:  xfs_end_ioend+0xc6/0x110 [xfs]
Oct 11 15:15:43 kernel:  xfs_end_io+0xbd/0xf0 [xfs]
Oct 11 15:15:43 kernel:  process_one_work+0x1da/0x3d0
Oct 11 15:15:43 kernel:  worker_thread+0x4d/0x3d0
Oct 11 15:15:43 kernel:  ? rescuer_thread+0x410/0x410
Oct 11 15:15:43 kernel:  kthread+0x142/0x160
Oct 11 15:15:43 kernel:  ? __kthread_bind_mask+0x60/0x60
Oct 11 15:15:43 kernel:  ret_from_fork+0x1f/0x30
Oct 11 15:15:43 kernel: INFO: task kworker/2:82:9723 blocked for more than 122 seconds.
Oct 11 15:15:43 kernel:       Tainted: G     U            5.8.14-arch1-1 #1
Oct 11 15:15:43 kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
Oct 11 15:15:43 kernel: kworker/2:82    D    0  9723      2 0x00004000
Oct 11 15:15:43 kernel: Workqueue: xfs-conv/dm-76 xfs_end_io [xfs]
Oct 11 15:15:43 kernel: Call Trace:
Oct 11 15:15:43 kernel:  __schedule+0x2a6/0x810
Oct 11 15:15:43 kernel:  ? __xfs_trans_commit+0xa1/0x350 [xfs]
Oct 11 15:15:43 kernel:  schedule+0x46/0xf0
Oct 11 15:15:43 kernel:  xfs_log_commit_cil+0x6d2/0x870 [xfs]
Oct 11 15:15:43 kernel:  ? wake_up_q+0xa0/0xa0
Oct 11 15:15:43 kernel:  __xfs_trans_commit+0xa1/0x350 [xfs]
Oct 11 15:15:43 kernel:  xfs_iomap_write_unwritten+0xf7/0x330 [xfs]
Oct 11 15:15:43 kernel:  xfs_end_ioend+0xc6/0x110 [xfs]
Oct 11 15:15:43 kernel:  xfs_end_io+0xbd/0xf0 [xfs]
Oct 11 15:15:43 kernel:  process_one_work+0x1da/0x3d0
Oct 11 15:15:43 kernel:  worker_thread+0x4d/0x3d0
Oct 11 15:15:43 kernel:  ? rescuer_thread+0x410/0x410
Oct 11 15:15:43 kernel:  kthread+0x142/0x160
Oct 11 15:15:43 kernel:  ? __kthread_bind_mask+0x60/0x60
Oct 11 15:15:43 kernel:  ret_from_fork+0x1f/0x30
Oct 11 15:15:43 kernel: INFO: task kworker/2:96:9737 blocked for more than 122 seconds.
Oct 11 15:15:43 kernel:       Tainted: G     U            5.8.14-arch1-1 #1
Oct 11 15:15:43 kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
Oct 11 15:15:43 kernel: kworker/2:96    D    0  9737      2 0x00004000
Oct 11 15:15:43 kernel: Workqueue: xfs-conv/dm-76 xfs_end_io [xfs]
Oct 11 15:15:43 kernel: Call Trace:
Oct 11 15:15:43 kernel:  __schedule+0x2a6/0x810
Oct 11 15:15:43 kernel:  ? __xfs_trans_commit+0xa1/0x350 [xfs]
Oct 11 15:15:43 kernel:  schedule+0x46/0xf0
Oct 11 15:15:43 kernel:  xfs_log_commit_cil+0x6d2/0x870 [xfs]
Oct 11 15:15:43 kernel:  ? wake_up_q+0xa0/0xa0
Oct 11 15:15:43 kernel:  __xfs_trans_commit+0xa1/0x350 [xfs]
Oct 11 15:15:43 kernel:  xfs_iomap_write_unwritten+0xf7/0x330 [xfs]
Oct 11 15:15:43 kernel:  xfs_end_ioend+0xc6/0x110 [xfs]
Oct 11 15:15:43 kernel:  xfs_end_io+0xbd/0xf0 [xfs]
Oct 11 15:15:43 kernel:  process_one_work+0x1da/0x3d0
Oct 11 15:15:43 kernel:  worker_thread+0x4d/0x3d0
Oct 11 15:15:43 kernel:  ? rescuer_thread+0x410/0x410
Oct 11 15:15:43 kernel:  kthread+0x142/0x160
Oct 11 15:15:43 kernel:  ? __kthread_bind_mask+0x60/0x60
Oct 11 15:15:43 kernel:  ret_from_fork+0x1f/0x30

----------




[Index of Archives]     [XFS Filesystem Development (older mail)]     [Linux Filesystem Development]     [Linux Audio Users]     [Yosemite Trails]     [Linux Kernel]     [Linux RAID]     [Linux SCSI]


  Powered by Linux