Re: again? - Write I/O queue hangup at random on recent Linus' kernels

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



Hello,

we disabled the wbt, issue is happening much sooner. The logs are attached
1/ "dmesg-20221011.log" form kernel messages
2/ "command.logs" from execution of
    (cd /sys/kernel/debug/block/vdc && find . -type f -exec grep -aH . {} \;)

Best regards,
Jaroslav Pulchart

čt 6. 10. 2022 v 18:57 odesílatel Bart Van Assche <bvanassche@xxxxxxx> napsal:
>
> On 10/6/22 05:36, Jaroslav Pulchart wrote:
> > I apply the
> > echo 0 > /sys/block/vdc/queue/wbt_lat_usec
> > at the production servers. I expect it will disable wbt. Could you
> > please confirm that my expectation is correct?
>
> Hi Jaroslav,
>
> I have no experience with WBT. But what I found in the documentation seems
> to confirm that the above command is sufficient to disable WBT:
>
>   What:         /sys/block/<disk>/queue/wbt_lat_usec
> Date:           November 2016
> Contact:        linux-block@xxxxxxxxxxxxxxx
> Description:
>                 [RW] If the device is registered for writeback throttling, then
>                 this file shows the target minimum read latency. If this latency
>                 is exceeded in a given window of time (see wb_window_usec), then
>                 the writeback throttling will start scaling back writes. Writing
>                 a value of '0' to this file disables the feature. Writing a
>                 value of '-1' to this file resets the value to the default
>                 setting.
>
>
> Best regards,
>
> Bart.
[27157.363315] INFO: task jbd2/vdc-8:5942 blocked for more than 122 seconds.
[27157.363938]       Tainted: G            E     5.19.12-1.gdc.el8.x86_64 #1
[27157.364394] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[27157.364918] task:jbd2/vdc-8      state:D stack:    0 pid: 5942 ppid:     2 flags:0x00004000
[27157.365483] Call Trace:
[27157.365650]  <TASK>
[27157.365800]  __schedule+0x392/0x7e0
[27157.366042]  ? bit_wait+0x60/0x60
[27157.366275]  schedule+0x50/0xc0
[27157.366489]  io_schedule+0x12/0x40
[27157.366719]  bit_wait_io+0xd/0x60
[27157.366952]  __wait_on_bit+0x2a/0x90
[27157.367191]  out_of_line_wait_on_bit+0x91/0xb0
[27157.367497]  ? sched_autogroup_detach+0x20/0x20
[27157.367804]  jbd2_journal_commit_transaction+0x10fe/0x1a00 [jbd2]
[27157.368215]  ? finish_task_switch+0x86/0x2c0
[27157.368512]  ? try_to_del_timer_sync+0x4d/0x80
[27157.368815]  kjournald2+0xc0/0x280 [jbd2]
[27157.369106]  ? add_wait_queue_priority+0xa0/0xa0
[27157.369418]  ? commit_timeout+0x10/0x10 [jbd2]
[27157.369722]  kthread+0xd7/0x100
[27157.369934]  ? kthread_complete_and_exit+0x20/0x20
[27157.370257]  ret_from_fork+0x1f/0x30
[27157.370498]  </TASK>
[27157.370656] INFO: task postmaster:7201 blocked for more than 122 seconds.
[27157.371110]       Tainted: G            E     5.19.12-1.gdc.el8.x86_64 #1
[27157.371560] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[27157.372077] task:postmaster      state:D stack:    0 pid: 7201 ppid:  7199 flags:0x00000000
[27157.372625] Call Trace:
[27157.372963]  <TASK>
[27157.373240]  __schedule+0x392/0x7e0
[27157.373608]  schedule+0x50/0xc0
[27157.373944]  jbd2_log_wait_commit+0xa3/0x110 [jbd2]
[27157.374409]  ? add_wait_queue_priority+0xa0/0xa0
[27157.374830]  ext4_fc_commit+0x297/0x860 [ext4]
[27157.375288]  ? filemap_fdatawrite_wbc+0x19/0x80
[27157.375701]  ? __filemap_fdatawrite_range+0x54/0x80
[27157.376134]  ? file_check_and_advance_wb_err+0x2e/0xd0
[27157.376588]  ext4_sync_file+0x2ff/0x370 [ext4]
[27157.377015]  do_fsync+0x38/0x70
[27157.377342]  __x64_sys_fsync+0x10/0x20
[27157.377698]  do_syscall_64+0x37/0x90
[27157.378041]  entry_SYSCALL_64_after_hwframe+0x63/0xcd
[27157.378486] RIP: 0033:0x7f3e83011ff5
[27157.378831] RSP: 002b:00007fff70b02dc8 EFLAGS: 00000246 ORIG_RAX: 000000000000004a
[27157.379459] RAX: ffffffffffffffda RBX: 000000000000022c RCX: 00007f3e83011ff5
[27157.380031] RDX: 0000000000000002 RSI: 00007fff70b02ed0 RDI: 000000000000022c
[27157.380625] RBP: 00007fff70b02ed0 R08: 0000000000000006 R09: 0000000000000030
[27157.381203] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000
[27157.381780] R13: 0000000000000000 R14: 000000000000000f R15: 0000000000000001
[27157.382360]  </TASK>
[27157.382612] INFO: task postmaster:7202 blocked for more than 122 seconds.
[27157.383167]       Tainted: G            E     5.19.12-1.gdc.el8.x86_64 #1
[27157.383722] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[27157.384352] task:postmaster      state:D stack:    0 pid: 7202 ppid:  7199 flags:0x00000000
[27157.384998] Call Trace:
[27157.385288]  <TASK>
[27157.385542]  __schedule+0x392/0x7e0
[27157.385887]  schedule+0x50/0xc0
[27157.386215]  rwsem_down_write_slowpath+0x3f5/0x6f0
[27157.386649]  ? pick_next_task+0x4d/0x910
[27157.387022]  ext4_buffered_write_iter+0x35/0xf0 [ext4]
[27157.387506]  ext4_file_write_iter+0x71/0x690 [ext4]
[27157.387959]  new_sync_write+0x106/0x190
[27157.388343]  vfs_write+0x1f6/0x280
[27157.388678]  ksys_pwrite64+0x65/0xa0
[27157.389027]  ? syscall_trace_enter.isra.19+0x126/0x1a0
[27157.389489]  do_syscall_64+0x37/0x90
[27157.389840]  entry_SYSCALL_64_after_hwframe+0x63/0xcd
[27157.390297] RIP: 0033:0x7f3e83012438
[27157.390641] RSP: 002b:00007fff70b02398 EFLAGS: 00000246 ORIG_RAX: 0000000000000012
[27157.391260] RAX: ffffffffffffffda RBX: 000000000001a668 RCX: 00007f3e83012438
[27157.391834] RDX: 0000000000002000 RSI: 00007f3de9daef80 RDI: 0000000000000034
[27157.392419] RBP: 0000000000002000 R08: 000000000a000010 R09: 0000000000d47ce0
[27157.393000] R10: 0000000034b6e000 R11: 0000000000000246 R12: 0000000000002000
[27157.393585] R13: 0000000034b6e000 R14: 00007f3de9daef80 R15: 00007f3e837f0d00
[27157.394156]  </TASK>
[27157.394424] INFO: task postmaster:7203 blocked for more than 122 seconds.
[27157.394973]       Tainted: G            E     5.19.12-1.gdc.el8.x86_64 #1
[27157.395541] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[27157.396158] task:postmaster      state:D stack:    0 pid: 7203 ppid:  7199 flags:0x00000000
[27157.396819] Call Trace:
[27157.397102]  <TASK>
[27157.397376]  __schedule+0x392/0x7e0
[27157.397730]  ? bit_wait+0x60/0x60
[27157.398067]  schedule+0x50/0xc0
[27157.398406]  io_schedule+0x12/0x40
[27157.398753]  bit_wait_io+0xd/0x60
[27157.399089]  __wait_on_bit+0x2a/0x90
[27157.399460]  out_of_line_wait_on_bit+0x91/0xb0
[27157.399871]  ? sched_autogroup_detach+0x20/0x20
[27157.400296]  do_get_write_access+0x27e/0x3d0 [jbd2]
[27157.400739]  jbd2_journal_get_write_access+0x4c/0x80 [jbd2]
[27157.401217]  __ext4_journal_get_write_access+0x85/0x1a0 [ext4]
[27157.401738]  ext4_reserve_inode_write+0x93/0xc0 [ext4]
[27157.402204]  __ext4_mark_inode_dirty+0x59/0x220 [ext4]
[27157.402676]  ? __ext4_journal_start_sb+0x105/0x120 [ext4]
[27157.403160]  ext4_dirty_inode+0x5d/0x80 [ext4]
[27157.403600]  __mark_inode_dirty+0x137/0x380
[27157.403992]  generic_update_time+0xa0/0xd0
[27157.404392]  file_update_time+0xcc/0x120
[27157.404765]  ? generic_write_checks+0x2d/0x70
[27157.405158]  ext4_write_checks+0x20/0x40 [ext4]
[27157.405607]  ext4_buffered_write_iter+0x40/0xf0 [ext4]
[27157.406088]  ext4_file_write_iter+0x71/0x690 [ext4]
[27157.406547]  new_sync_write+0x106/0x190
[27157.406915]  vfs_write+0x1f6/0x280
[27157.407260]  ksys_pwrite64+0x65/0xa0
[27157.407602]  ? syscall_trace_enter.isra.19+0x126/0x1a0
[27157.408046]  do_syscall_64+0x37/0x90
[27157.408403]  entry_SYSCALL_64_after_hwframe+0x63/0xcd
[27157.408841] RIP: 0033:0x7f3e83012438
[27157.409182] RSP: 002b:00007fff70b03878 EFLAGS: 00000246 ORIG_RAX: 0000000000000012
[27157.409797] RAX: ffffffffffffffda RBX: 0000000000caa000 RCX: 00007f3e83012438
[27157.410384] RDX: 00000000002d4000 RSI: 00007f39d81f8000 RDI: 0000000000000004
[27157.410956] RBP: 00007f39d81f8000 R08: 00000000002d4000 R09: 0000000002f16b64
[27157.411551] R10: 0000000000caa000 R11: 0000000000000246 R12: 00007f3e837f0d00
[27157.412124] R13: 000038d6e7f7e000 R14: 00000000000007be R15: 00000000002d4000
[27157.412717]  </TASK>
[27157.413164] INFO: task postmaster:490689 blocked for more than 122 seconds.
[27157.413752]       Tainted: G            E     5.19.12-1.gdc.el8.x86_64 #1
[27157.414310] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[27157.414927] task:postmaster      state:D stack:    0 pid:490689 ppid:  7199 flags:0x00000000
[27157.415600] Call Trace:
[27157.415883]  <TASK>
[27157.416150]  __schedule+0x392/0x7e0
[27157.416513]  ? bit_wait+0x60/0x60
[27157.416845]  schedule+0x50/0xc0
[27157.417161]  io_schedule+0x12/0x40
[27157.417511]  bit_wait_io+0xd/0x60
[27157.417840]  __wait_on_bit+0x2a/0x90
[27157.418181]  out_of_line_wait_on_bit+0x91/0xb0
[27157.418597]  ? sched_autogroup_detach+0x20/0x20
[27157.419022]  do_get_write_access+0x27e/0x3d0 [jbd2]
[27157.419467]  jbd2_journal_get_write_access+0x4c/0x80 [jbd2]
[27157.419943]  __ext4_journal_get_write_access+0x85/0x1a0 [ext4]
[27157.420455]  ext4_reserve_inode_write+0x93/0xc0 [ext4]
[27157.420921]  __ext4_mark_inode_dirty+0x59/0x220 [ext4]
[27157.421391]  ? __ext4_journal_start_sb+0x105/0x120 [ext4]
[27157.421867]  ext4_dirty_inode+0x5d/0x80 [ext4]
[27157.422297]  __mark_inode_dirty+0x137/0x380
[27157.422695]  generic_update_time+0xa0/0xd0
[27157.423070]  file_update_time+0xcc/0x120
[27157.423446]  ? generic_write_checks+0x2d/0x70
[27157.423843]  ext4_write_checks+0x20/0x40 [ext4]
[27157.424270]  ext4_buffered_write_iter+0x40/0xf0 [ext4]
[27157.424745]  ext4_file_write_iter+0x71/0x690 [ext4]
[27157.425186]  new_sync_write+0x106/0x190
[27157.425563]  vfs_write+0x1f6/0x280
[27157.425899]  ksys_pwrite64+0x65/0xa0
[27157.426240]  ? syscall_trace_enter.isra.19+0x126/0x1a0
[27157.426703]  do_syscall_64+0x37/0x90
[27157.427045]  entry_SYSCALL_64_after_hwframe+0x63/0xcd
[27157.427490] RIP: 0033:0x7f3e83012438
[27157.427837] RSP: 002b:00007fff70b02f68 EFLAGS: 00000246 ORIG_RAX: 0000000000000012
[27157.428443] RAX: ffffffffffffffda RBX: 0000000000000578 RCX: 00007f3e83012438
[27157.429013] RDX: 0000000000002000 RSI: 00007f3e45876f80 RDI: 0000000000000015
[27157.429597] RBP: 0000000000002000 R08: 000000000a000010 R09: 0000000000d47ce0
[27157.430169] R10: 0000000028ec6000 R11: 0000000000000246 R12: 0000000000002000
[27157.430757] R13: 0000000028ec6000 R14: 00007f3e45876f80 R15: 00007f3e837f0d00
[27157.431337]  </TASK>
[27157.431602] INFO: task kworker/u60:1:490807 blocked for more than 122 seconds.
[27157.432177]       Tainted: G            E     5.19.12-1.gdc.el8.x86_64 #1
[27157.432746] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[27157.433370] task:kworker/u60:1   state:D stack:    0 pid:490807 ppid:     2 flags:0x00004000
[27157.434040] Workqueue: writeback wb_workfn (flush-252:32)
[27157.434514] Call Trace:
[27157.434795]  <TASK>
[27157.435048]  __schedule+0x392/0x7e0
[27157.435398]  ? bit_wait+0x60/0x60
[27157.435736]  schedule+0x50/0xc0
[27157.436049]  io_schedule+0x12/0x40
[27157.436390]  bit_wait_io+0xd/0x60
[27157.436729]  __wait_on_bit+0x2a/0x90
[27157.437070]  ? mb_mark_used+0x29c/0x320 [ext4]
[27157.437496]  out_of_line_wait_on_bit+0x91/0xb0
[27157.437898]  ? sched_autogroup_detach+0x20/0x20
[27157.438312]  do_get_write_access+0x27e/0x3d0 [jbd2]
[27157.438754]  jbd2_journal_get_write_access+0x4c/0x80 [jbd2]
[27157.439226]  __ext4_journal_get_write_access+0x85/0x1a0 [ext4]
[27157.439751]  ext4_mb_mark_diskspace_used+0xa9/0x3b0 [ext4]
[27157.440238]  ext4_mb_new_blocks+0x46a/0xf10 [ext4]
[27157.440700]  ? ext4_find_extent+0x160/0x370 [ext4]
[27157.441133]  ext4_ext_map_blocks+0x7ac/0xc80 [ext4]
[27157.441583]  ? __pagevec_release+0x1b/0x30
[27157.441967]  ext4_map_blocks+0x165/0x590 [ext4]
[27157.442398]  ext4_writepages+0x789/0xd30 [ext4]
[27157.442831]  do_writepages+0xd2/0x1b0
[27157.443183]  __writeback_single_inode+0x41/0x360
[27157.443601]  writeback_sb_inodes+0x1f0/0x460
[27157.443992]  __writeback_inodes_wb+0x5f/0xd0
[27157.444388]  wb_writeback+0x235/0x2d0
[27157.444748]  wb_workfn+0x312/0x4a0
[27157.445077]  ? put_prev_task_fair+0x1b/0x40
[27157.445467]  ? cpumask_next+0x1f/0x30
[27157.445821]  ? __update_idle_core+0x71/0xb0
[27157.446197]  process_one_work+0x1c5/0x390
[27157.446575]  worker_thread+0x30/0x360
[27157.446925]  ? process_one_work+0x390/0x390
[27157.447314]  kthread+0xd7/0x100
[27157.447626]  ? kthread_complete_and_exit+0x20/0x20
[27157.448044]  ret_from_fork+0x1f/0x30
[27157.448393]  </TASK>
[27157.448644] INFO: task postmaster:494230 blocked for more than 122 seconds.
[27157.449195]       Tainted: G            E     5.19.12-1.gdc.el8.x86_64 #1
[27157.449771] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[27157.450385] task:postmaster      state:D stack:    0 pid:494230 ppid:  7199 flags:0x00000000
[27157.451043] Call Trace:
[27157.451337]  <TASK>
[27157.451584]  __schedule+0x392/0x7e0
[27157.451922]  ? bit_wait+0x60/0x60
[27157.452238]  schedule+0x50/0xc0
[27157.452553]  io_schedule+0x12/0x40
[27157.452883]  bit_wait_io+0xd/0x60
[27157.453194]  __wait_on_bit+0x2a/0x90
[27157.453534]  out_of_line_wait_on_bit+0x91/0xb0
[27157.453930]  ? sched_autogroup_detach+0x20/0x20
[27157.454332]  do_get_write_access+0x27e/0x3d0 [jbd2]
[27157.454762]  jbd2_journal_get_write_access+0x4c/0x80 [jbd2]
[27157.455220]  __ext4_journal_get_write_access+0x85/0x1a0 [ext4]
[27157.455729]  ext4_reserve_inode_write+0x93/0xc0 [ext4]
[27157.456184]  __ext4_mark_inode_dirty+0x59/0x220 [ext4]
[27157.456643]  ? __ext4_journal_start_sb+0x105/0x120 [ext4]
[27157.457108]  ext4_dirty_inode+0x5d/0x80 [ext4]
[27157.457524]  __mark_inode_dirty+0x137/0x380
[27157.457927]  generic_write_end+0xe9/0x120
[27157.458313]  generic_perform_write+0x139/0x1d0
[27157.458714]  ? generic_write_checks+0x2d/0x70
[27157.459098]  ext4_buffered_write_iter+0x6f/0xf0 [ext4]
[27157.459556]  ext4_file_write_iter+0x71/0x690 [ext4]
[27157.460003]  ? blk_mq_start_stopped_hw_queues+0x7a/0xb0
[27157.460461]  new_sync_write+0x106/0x190
[27157.460825]  vfs_write+0x1f6/0x280
[27157.461148]  ksys_pwrite64+0x65/0xa0
[27157.461492]  ? syscall_trace_enter.isra.19+0x126/0x1a0
[27157.461935]  do_syscall_64+0x37/0x90
[27157.462277]  entry_SYSCALL_64_after_hwframe+0x63/0xcd
[27157.462706] RIP: 0033:0x7f3e83012438
[27157.463039] RSP: 002b:00007fff70b01318 EFLAGS: 00000246 ORIG_RAX: 0000000000000012
[27157.463633] RAX: ffffffffffffffda RBX: 0000000000000ee0 RCX: 00007f3e83012438
[27157.464207] RDX: 0000000000002000 RSI: 0000000001263400 RDI: 000000000000002d
[27157.464785] RBP: 0000000000002000 R08: 000000000a000001 R09: 0000000000000001
[27157.465373] R10: 0000000013b12000 R11: 0000000000000246 R12: 0000000000002000
[27157.465943] R13: 0000000013b12000 R14: 0000000001263400 R15: 00007f3e837f0d00
[27157.466512]  </TASK>
[27157.466785] INFO: task postmaster:494251 blocked for more than 122 seconds.
[27157.467951]       Tainted: G            E     5.19.12-1.gdc.el8.x86_64 #1
[27157.468769] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[27157.469388] task:postmaster      state:D stack:    0 pid:494251 ppid:  7199 flags:0x00000000
[27157.470086] Call Trace:
[27157.470373]  <TASK>
[27157.470627]  __schedule+0x392/0x7e0
[27157.470979]  ? bit_wait+0x60/0x60
[27157.471321]  schedule+0x50/0xc0
[27157.471636]  io_schedule+0x12/0x40
[27157.471980]  bit_wait_io+0xd/0x60
[27157.472317]  __wait_on_bit+0x2a/0x90
[27157.472658]  out_of_line_wait_on_bit+0x91/0xb0
[27157.473066]  ? sched_autogroup_detach+0x20/0x20
[27157.473479]  do_get_write_access+0x27e/0x3d0 [jbd2]
[27157.473919]  jbd2_journal_get_write_access+0x4c/0x80 [jbd2]
[27157.474403]  __ext4_journal_get_write_access+0x85/0x1a0 [ext4]
[27157.474917]  ext4_reserve_inode_write+0x93/0xc0 [ext4]
[27157.475386]  __ext4_mark_inode_dirty+0x59/0x220 [ext4]
[27157.475851]  ? __ext4_journal_start_sb+0x105/0x120 [ext4]
[27157.476337]  ext4_dirty_inode+0x5d/0x80 [ext4]
[27157.476760]  __mark_inode_dirty+0x137/0x380
[27157.477149]  generic_write_end+0xe9/0x120
[27157.477525]  generic_perform_write+0x139/0x1d0
[27157.477935]  ? generic_write_checks+0x2d/0x70
[27157.478338]  ext4_buffered_write_iter+0x6f/0xf0 [ext4]
[27157.478798]  ext4_file_write_iter+0x71/0x690 [ext4]
[27157.479243]  ? set_next_entity+0xe2/0x180
[27157.479623]  new_sync_write+0x106/0x190
[27157.479992]  vfs_write+0x1f6/0x280
[27157.480336]  ksys_pwrite64+0x65/0xa0
[27157.480677]  ? syscall_trace_enter.isra.19+0x126/0x1a0
[27157.481128]  do_syscall_64+0x37/0x90
[27157.481480]  entry_SYSCALL_64_after_hwframe+0x63/0xcd
[27157.481923] RIP: 0033:0x7f3e83012438
[27157.482273] RSP: 002b:00007fff70b03488 EFLAGS: 00000246 ORIG_RAX: 0000000000000012
[27157.482871] RAX: ffffffffffffffda RBX: 00000000000010d8 RCX: 00007f3e83012438
[27157.483449] RDX: 0000000000002000 RSI: 000000000128e828 RDI: 0000000000000008
[27157.484033] RBP: 0000000000002000 R08: 000000000a000009 R09: 0000000000d47ce0
[27157.484611] R10: 000000002be82000 R11: 0000000000000246 R12: 0000000000002000
[27157.485193] R13: 000000002be82000 R14: 000000000128e828 R15: 00007f3e837f0d00
[27157.485778]  </TASK>
[27157.486050] INFO: task kworker/u60:6:509050 blocked for more than 123 seconds.
[27157.486633]       Tainted: G            E     5.19.12-1.gdc.el8.x86_64 #1
[27157.487186] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[27157.487809] task:kworker/u60:6   state:D stack:    0 pid:509050 ppid:     2 flags:0x00004000
[27157.488481] Workqueue: ext4-rsv-conversion ext4_end_io_rsv_work [ext4]
[27157.489049] Call Trace:
[27157.489337]  <TASK>
[27157.489592]  __schedule+0x392/0x7e0
[27157.489934]  ? bit_wait+0x60/0x60
[27157.490268]  schedule+0x50/0xc0
[27157.490581]  io_schedule+0x12/0x40
[27157.490912]  bit_wait_io+0xd/0x60
[27157.491235]  __wait_on_bit+0x2a/0x90
[27157.491585]  out_of_line_wait_on_bit+0x91/0xb0
[27157.491984]  ? sched_autogroup_detach+0x20/0x20
[27157.492413]  do_get_write_access+0x27e/0x3d0 [jbd2]
[27157.492852]  jbd2_journal_get_write_access+0x4c/0x80 [jbd2]
[27157.493345]  __ext4_journal_get_write_access+0x85/0x1a0 [ext4]
[27157.493850]  ? __find_get_block+0x9e/0x2e0
[27157.494237]  ext4_ext_get_access.isra.35+0x30/0x50 [ext4]
[27157.494724]  ext4_ext_handle_unwritten_extents+0xca/0xa00 [ext4]
[27157.495246]  ? __read_extent_tree_block+0x80/0x170 [ext4]
[27157.495730]  ? ext4_find_extent+0x160/0x370 [ext4]
[27157.496172]  ext4_ext_map_blocks+0x465/0xc80 [ext4]
[27157.496624]  ? __wake_up_common_lock+0x87/0xc0
[27157.497028]  ext4_map_blocks+0x165/0x590 [ext4]
[27157.497459]  ext4_convert_unwritten_extents+0x12f/0x260 [ext4]
[27157.497964]  ext4_convert_unwritten_io_end_vec+0x5f/0xe0 [ext4]
[27157.498482]  ext4_end_io_rsv_work+0xe6/0x190 [ext4]
[27157.498933]  process_one_work+0x1c5/0x390
[27157.499321]  ? process_one_work+0x390/0x390
[27157.499706]  worker_thread+0x30/0x360
[27157.500054]  ? process_one_work+0x390/0x390
[27157.500446]  kthread+0xd7/0x100
[27157.500765]  ? kthread_complete_and_exit+0x20/0x20
[27157.501197]  ret_from_fork+0x1f/0x30
[27157.501551]  </TASK>
[27157.501811] INFO: task postmaster:509340 blocked for more than 123 seconds.
[27157.502382]       Tainted: G            E     5.19.12-1.gdc.el8.x86_64 #1
[27157.502931] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[27157.503558] task:postmaster      state:D stack:    0 pid:509340 ppid:  7199 flags:0x00000000
[27157.504221] Call Trace:
[27157.504503]  <TASK>
[27157.504762]  __schedule+0x392/0x7e0
[27157.505109]  ? page_add_file_rmap+0xa6/0x2e0
[27157.505507]  schedule+0x50/0xc0
[27157.505833]  rwsem_down_write_slowpath+0x3f5/0x6f0
[27157.506269]  ext4_buffered_write_iter+0x35/0xf0 [ext4]
[27157.506744]  ext4_file_write_iter+0x71/0x690 [ext4]
[27157.507189]  ? __handle_mm_fault+0x5f1/0x810
[27157.507587]  new_sync_write+0x106/0x190
[27157.507946]  vfs_write+0x1f6/0x280
[27157.508292]  ksys_pwrite64+0x65/0xa0
[27157.508627]  ? syscall_trace_enter.isra.19+0x126/0x1a0
[27157.509064]  do_syscall_64+0x37/0x90
[27157.509412]  entry_SYSCALL_64_after_hwframe+0x63/0xcd
[27157.509844] RIP: 0033:0x7f3e83012438
[27157.510187] RSP: 002b:00007fff70b01a68 EFLAGS: 00000246 ORIG_RAX: 0000000000000012
[27157.510790] RAX: ffffffffffffffda RBX: 00000000000010d8 RCX: 00007f3e83012438
[27157.511369] RDX: 0000000000002000 RSI: 00007f3de9d80f80 RDI: 0000000000000055
[27157.511935] RBP: 0000000000002000 R08: 000000000a000010 R09: 0000000000d47ce0
[27157.512516] R10: 00000000331d6000 R11: 0000000000000246 R12: 0000000000002000
[27157.513085] R13: 00000000331d6000 R14: 00007f3de9d80f80 R15: 00007f3e837f0d00
[27157.513659]  </TASK>

Attachment: command.logs
Description: Binary data


[Index of Archives]     [Linux RAID]     [Linux SCSI]     [Linux ATA RAID]     [IDE]     [Linux Wireless]     [Linux Kernel]     [ATH6KL]     [Linux Bluetooth]     [Linux Netdev]     [Kernel Newbies]     [Security]     [Git]     [Netfilter]     [Bugtraq]     [Yosemite News]     [MIPS Linux]     [ARM Linux]     [Linux Security]     [Device Mapper]

  Powered by Linux