On Fri, Mar 15, 2019 at 12:25 AM Murphy Zhou <jencce.kernel@xxxxxxxxx> wrote: > > Hi, > > xfstests generic/013 on CIFS hangs on Linus tree now. generic/013 works on Steves for-next branch, but it contains changes in this area. We do have generic/013 in our buildbot so it should have been tested and passed. Can you describe your configuration? It could be a configuration that we do not have proper cover for. > > Bisect points to > > commit 7091bcaba9f34c83e1e6f418b6de5c6d987571da (HEAD, refs/bisect/bad) > Author: Pavel Shilovsky <pshilov@xxxxxxxxxxxxx> > Date: Wed Jan 30 16:58:09 2019 -0800 > > CIFS: Try to acquire credits at once for compound requests > > as the first bad commit. > > It should be easy to reproduce. > > Thanks, > M > > dmesg: > run fstests generic/013 at 2019-03-14 09:51:56 > INFO: task kworker/3:1:104 blocked for more than 120 seconds. > Not tainted 5.0.0-bisect-7091bcaba9f3+ #15 > "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. > kworker/3:1 D 0 104 2 0x80000000 > Workqueue: cifsiod cifs_uncached_writev_complete [cifs] > Call Trace: > ? __schedule+0x24e/0x860 > schedule+0x28/0x70 > schedule_preempt_disabled+0xa/0x10 > __mutex_lock.isra.8+0x2d0/0x4b0 > cifs_uncached_writev_complete+0xcd/0x570 [cifs] > ? __switch_to_asm+0x40/0x70 > ? __switch_to_asm+0x40/0x70 > ? __switch_to_asm+0x34/0x70 > ? __switch_to_asm+0x40/0x70 > process_one_work+0x1a1/0x3a0 > worker_thread+0x30/0x380 > ? mod_delayed_work_on+0x90/0x90 > kthread+0x112/0x130 > ? __kthread_parkme+0x70/0x70 > ret_from_fork+0x35/0x40 > INFO: task kworker/5:1:106 blocked for more than 120 seconds. > Not tainted 5.0.0-bisect-7091bcaba9f3+ #15 > "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. > kworker/5:1 D 0 106 2 0x80000000 > Workqueue: cifsiod cifs_uncached_writev_complete [cifs] > Call Trace: > ? __schedule+0x24e/0x860 > ? ttwu_do_wakeup+0x19/0x140 > schedule+0x28/0x70 > schedule_preempt_disabled+0xa/0x10 > __mutex_lock.isra.8+0x2d0/0x4b0 > cifs_uncached_writev_complete+0xcd/0x570 [cifs] > ? __switch_to_asm+0x40/0x70 > ? __switch_to_asm+0x34/0x70 > ? __switch_to_asm+0x40/0x70 > process_one_work+0x1a1/0x3a0 > worker_thread+0x30/0x380 > ? mod_delayed_work_on+0x90/0x90 > kthread+0x112/0x130 > ? __kthread_parkme+0x70/0x70 > ret_from_fork+0x35/0x40 > INFO: task kworker/7:1:108 blocked for more than 120 seconds. > Not tainted 5.0.0-bisect-7091bcaba9f3+ #15 > "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. > kworker/7:1 D 0 108 2 0x80000000 > Workqueue: cifsiod cifs_uncached_writev_complete [cifs] > Call Trace: > ? __schedule+0x24e/0x860 > ? ttwu_do_wakeup+0x19/0x140 > schedule+0x28/0x70 > schedule_preempt_disabled+0xa/0x10 > __mutex_lock.isra.8+0x2d0/0x4b0 > cifs_uncached_writev_complete+0xcd/0x570 [cifs] > ? __switch_to_asm+0x40/0x70 > ? __switch_to_asm+0x40/0x70 > ? __switch_to_asm+0x34/0x70 > ? __switch_to_asm+0x40/0x70 > process_one_work+0x1a1/0x3a0 > worker_thread+0x30/0x380 > ? mod_delayed_work_on+0x90/0x90 > kthread+0x112/0x130 > ? __kthread_parkme+0x70/0x70 > ret_from_fork+0x35/0x40 > INFO: task kworker/7:3:391 blocked for more than 120 seconds. > Not tainted 5.0.0-bisect-7091bcaba9f3+ #15 > "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. > kworker/7:3 D 0 391 2 0x80000000 > Workqueue: cifsiod cifs_uncached_writev_complete [cifs] > Call Trace: > ? __schedule+0x24e/0x860 > ? ttwu_do_wakeup+0x19/0x140 > schedule+0x28/0x70 > schedule_preempt_disabled+0xa/0x10 > __mutex_lock.isra.8+0x2d0/0x4b0 > cifs_uncached_writev_complete+0xcd/0x570 [cifs] > ? __switch_to_asm+0x40/0x70 > ? __switch_to_asm+0x40/0x70 > ? __switch_to_asm+0x34/0x70 > ? __switch_to_asm+0x40/0x70 > process_one_work+0x1a1/0x3a0 > worker_thread+0x30/0x380 > ? mod_delayed_work_on+0x90/0x90 > kthread+0x112/0x130 > ? __kthread_parkme+0x70/0x70 > ret_from_fork+0x35/0x40 > INFO: task kworker/1:3:807 blocked for more than 120 seconds. > Not tainted 5.0.0-bisect-7091bcaba9f3+ #15 > "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. > kworker/1:3 D 0 807 2 0x80000000 > Workqueue: cifsiod cifs_uncached_writev_complete [cifs] > Call Trace: > ? __schedule+0x24e/0x860 > schedule+0x28/0x70 > schedule_preempt_disabled+0xa/0x10 > __mutex_lock.isra.8+0x2d0/0x4b0 > cifs_uncached_writev_complete+0xcd/0x570 [cifs] > ? __switch_to_asm+0x40/0x70 > ? __switch_to_asm+0x40/0x70 > ? __switch_to_asm+0x34/0x70 > ? __switch_to_asm+0x40/0x70 > process_one_work+0x1a1/0x3a0 > worker_thread+0x30/0x380 > ? mod_delayed_work_on+0x90/0x90 > kthread+0x112/0x130 > ? __kthread_parkme+0x70/0x70 > ret_from_fork+0x35/0x40 > INFO: task kworker/13:2:1077 blocked for more than 120 seconds. > Not tainted 5.0.0-bisect-7091bcaba9f3+ #15 > "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. > kworker/13:2 D 0 1077 2 0x80000080 > Workqueue: cifsiod cifs_uncached_readv_complete [cifs] > Call Trace: > ? __schedule+0x24e/0x860 > schedule+0x28/0x70 > schedule_preempt_disabled+0xa/0x10 > __mutex_lock.isra.8+0x2d0/0x4b0 > ? __switch_to_asm+0x40/0x70 > cifs_uncached_readv_complete+0x78/0x4d0 [cifs] > ? __switch_to_asm+0x34/0x70 > process_one_work+0x1a1/0x3a0 > worker_thread+0x30/0x380 > ? mod_delayed_work_on+0x90/0x90 > kthread+0x112/0x130 > ? __kthread_parkme+0x70/0x70 > ret_from_fork+0x35/0x40 > INFO: task kworker/3:0:1910 blocked for more than 120 seconds. > Not tainted 5.0.0-bisect-7091bcaba9f3+ #15 > "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. > kworker/3:0 D 0 1910 2 0x80000080 > Workqueue: cifsiod cifs_uncached_writev_complete [cifs] > Call Trace: > ? __schedule+0x24e/0x860 > schedule+0x28/0x70 > schedule_preempt_disabled+0xa/0x10 > __mutex_lock.isra.8+0x2d0/0x4b0 > cifs_uncached_writev_complete+0xcd/0x570 [cifs] > ? __switch_to_asm+0x40/0x70 > ? __switch_to_asm+0x40/0x70 > ? __switch_to_asm+0x34/0x70 > ? __switch_to_asm+0x40/0x70 > process_one_work+0x1a1/0x3a0 > worker_thread+0x30/0x380 > ? mod_delayed_work_on+0x90/0x90 > kthread+0x112/0x130 > ? __kthread_parkme+0x70/0x70 > ret_from_fork+0x35/0x40 > INFO: task kworker/5:5:3930 blocked for more than 120 seconds. > Not tainted 5.0.0-bisect-7091bcaba9f3+ #15 > "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. > kworker/5:5 D 0 3930 2 0x80000080 > Workqueue: cifsiod cifs_uncached_writev_complete [cifs] > Call Trace: > ? __schedule+0x24e/0x860 > schedule+0x28/0x70 > schedule_preempt_disabled+0xa/0x10 > __mutex_lock.isra.8+0x2d0/0x4b0 > cifs_uncached_writev_complete+0xcd/0x570 [cifs] > ? __switch_to_asm+0x40/0x70 > ? __switch_to_asm+0x40/0x70 > ? __switch_to_asm+0x34/0x70 > ? __switch_to_asm+0x40/0x70 > process_one_work+0x1a1/0x3a0 > worker_thread+0x30/0x380 > ? mod_delayed_work_on+0x90/0x90 > kthread+0x112/0x130 > ? __kthread_parkme+0x70/0x70 > ret_from_fork+0x35/0x40 > INFO: task kworker/1:2:3932 blocked for more than 120 seconds. > Not tainted 5.0.0-bisect-7091bcaba9f3+ #15 > "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. > kworker/1:2 D 0 3932 2 0x80000080 > Workqueue: cifsiod cifs_uncached_readv_complete [cifs] > Call Trace: > ? __schedule+0x24e/0x860 > schedule+0x28/0x70 > schedule_preempt_disabled+0xa/0x10 > __mutex_lock.isra.8+0x2d0/0x4b0 > ? __switch_to_asm+0x40/0x70 > cifs_uncached_readv_complete+0x78/0x4d0 [cifs] > ? __switch_to_asm+0x34/0x70 > process_one_work+0x1a1/0x3a0 > worker_thread+0x30/0x380 > ? mod_delayed_work_on+0x90/0x90 > kthread+0x112/0x130 > ? __kthread_parkme+0x70/0x70 > ret_from_fork+0x35/0x40 > INFO: task kworker/1:5:3934 blocked for more than 120 seconds. > Not tainted 5.0.0-bisect-7091bcaba9f3+ #15 > "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. > kworker/1:5 D 0 3934 2 0x80000080 > Workqueue: cifsiod cifs_uncached_readv_complete [cifs] > Call Trace: > ? __schedule+0x24e/0x860 > schedule+0x28/0x70 > schedule_preempt_disabled+0xa/0x10 > __mutex_lock.isra.8+0x2d0/0x4b0 > ? __switch_to_asm+0x40/0x70 > cifs_uncached_readv_complete+0x78/0x4d0 [cifs] > ? __switch_to_asm+0x34/0x70 > process_one_work+0x1a1/0x3a0 > worker_thread+0x30/0x380 > ? mod_delayed_work_on+0x90/0x90 > kthread+0x112/0x130 > ? __kthread_parkme+0x70/0x70 > ret_from_fork+0x35/0x40
