[BUG 2.6.39-rc3] NFS spinlock recursion

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



Hi Trond,

I got these errors when testing writeback, did you see it before?
(I've removed all local changes to NFS code..)

Thanks,
Fengguang
---
[   15.463942] XFS (sda5): Mounting Filesystem
[   15.468446] XFS: Mounting Filesystem
[   15.548984] XFS (sda5): Ending clean mount
[   15.553347] XFS: Ending clean mount
[   89.917428] BUG: spinlock recursion on CPU#3, flush-0:24/2548
[   89.923647]  lock: ffff8801223c9240, .magic: dead4ead, .owner: flush-0:24/2548, .owner_cpu: 3
[   89.932677] Pid: 2548, comm: flush-0:24 Not tainted 2.6.39-rc3-dt7+ #175
[   89.939649] Call Trace:
[   89.942356]  [<ffffffff813b3d2d>] spin_bug+0x9c/0xa3
[   89.947584]  [<ffffffff813b3e1b>] do_raw_spin_lock+0x47/0x137
[   89.953600]  [<ffffffff818f97fb>] _raw_spin_lock+0x56/0x69
[   89.959345]  [<ffffffff8115d388>] ? __mark_inode_dirty+0x66/0x1d0
[   89.965734]  [<ffffffff8115d388>] __mark_inode_dirty+0x66/0x1d0
[   89.971952]  [<ffffffff81238955>] nfs_commit_inode+0xf1/0x1c1
[   89.978022]  [<ffffffff81238a63>] nfs_write_inode+0x3e/0x93
[   89.983913]  [<ffffffff818fa1a3>] ? _raw_spin_unlock+0x2b/0x2f
[   89.990068]  [<ffffffff8115c8de>] writeback_single_inode+0x17a/0x267
[   89.996739]  [<ffffffff8115cdac>] writeback_sb_inodes+0xcf/0x157
[   90.003032]  [<ffffffff8115d7a2>] writeback_inodes_wb+0x131/0x143
[   90.009415]  [<ffffffff8115da2e>] wb_writeback+0x27a/0x3c3
[   90.015166]  [<ffffffff8115dd32>] wb_do_writeback+0x1bb/0x1d6
[   90.021206]  [<ffffffff8115ddd8>] bdi_writeback_thread+0x8b/0x212
[   90.027572]  [<ffffffff8115dd4d>] ? wb_do_writeback+0x1d6/0x1d6
[   90.033758]  [<ffffffff8108c4cc>] kthread+0x8e/0x96
[   90.038906]  [<ffffffff81901ee4>] kernel_thread_helper+0x4/0x10
[   90.045115]  [<ffffffff818fa414>] ? retint_restore_args+0x13/0x13
[   90.051494]  [<ffffffff8108c43e>] ? __init_kthread_worker+0x5b/0x5b
[   90.058047]  [<ffffffff81901ee0>] ? gs_change+0x13/0x13
[  214.206745] BUG: spinlock lockup on CPU#4, cat/2538, ffff8801223c9240
[  214.213459] Pid: 2538, comm: cat Not tainted 2.6.39-rc3-dt7+ #175
[  214.219823] Call Trace:
[  214.222563]  [<ffffffff813b3ee0>] do_raw_spin_lock+0x10c/0x137
[  214.228658]  [<ffffffff818f97fb>] _raw_spin_lock+0x56/0x69
[  214.234406]  [<ffffffff81237080>] ? nfs_page_find_request+0x26/0x45
[  214.240928]  [<ffffffff81237080>] nfs_page_find_request+0x26/0x45
[  214.242705] BUG: spinlock lockup on CPU#2, kworker/2:0/12, ffff8801223c9240
[  214.242708] Pid: 12, comm: kworker/2:0 Not tainted 2.6.39-rc3-dt7+ #175
[  214.242710] Call Trace:
[  214.242717]  [<ffffffff813b3ee0>] do_raw_spin_lock+0x10c/0x137
[  214.242721]  [<ffffffff818f97fb>] _raw_spin_lock+0x56/0x69
[  214.242727]  [<ffffffff8115d388>] ? __mark_inode_dirty+0x66/0x1d0
[  214.242729]  [<ffffffff8115d388>] __mark_inode_dirty+0x66/0x1d0
[  214.242733]  [<ffffffff81237248>] nfs_mark_request_commit+0xe4/0xed
[  214.242736]  [<ffffffff81238109>] nfs_writeback_release_full+0x115/0x18f
[  214.242739]  [<ffffffff818a8067>] ? rpc_async_schedule+0x17/0x17
[  214.242742]  [<ffffffff818a7c8b>] rpc_release_calldata+0x17/0x19
[  214.242745]  [<ffffffff818a7ceb>] rpc_free_task+0x5e/0x67
[  214.242747]  [<ffffffff818a807c>] rpc_async_release+0x15/0x17
[  214.242751]  [<ffffffff81086c79>] process_one_work+0x236/0x3ea
[  214.242753]  [<ffffffff81086beb>] ? process_one_work+0x1a8/0x3ea
[  214.242756]  [<ffffffff8108714c>] worker_thread+0x17d/0x242
[  214.242758]  [<ffffffff81086fcf>] ? manage_workers+0x173/0x173
[  214.242760]  [<ffffffff81086fcf>] ? manage_workers+0x173/0x173
[  214.242763]  [<ffffffff8108c4cc>] kthread+0x8e/0x96
[  214.242767]  [<ffffffff81901ee4>] kernel_thread_helper+0x4/0x10
[  214.242770]  [<ffffffff818fa414>] ? retint_restore_args+0x13/0x13
[  214.242772]  [<ffffffff8108c43e>] ? __init_kthread_worker+0x5b/0x5b
[  214.242774]  [<ffffffff81901ee0>] ? gs_change+0x13/0x13
[  214.385858]  [<ffffffff810f3775>] ? grab_cache_page_write_begin+0x74/0xa4
[  214.392930]  [<ffffffff81239086>] nfs_flush_incompatible+0x2b/0x93
[  214.399404]  [<ffffffff8122bb7c>] nfs_write_begin+0xeb/0x1c4
[  214.405328]  [<ffffffff810f28a6>] generic_file_buffered_write+0x119/0x240
[  214.412371]  [<ffffffff8123def8>] ? nfs3_getxattr+0x52/0xc0
[  214.418195]  [<ffffffff810f4447>] ? generic_file_aio_write+0x47/0xbe
[  214.424804]  [<ffffffff810f43d0>] __generic_file_aio_write+0x334/0x364
[  214.431626]  [<ffffffff810f4463>] generic_file_aio_write+0x63/0xbe
[  214.438075]  [<ffffffff8122c557>] nfs_file_write+0xe4/0x167
[  214.443914]  [<ffffffff8113b17b>] do_sync_write+0xcb/0x108
[  214.449684]  [<ffffffff818f8940>] ? mutex_unlock+0xe/0x10
[  214.455338]  [<ffffffff8113b809>] vfs_write+0xb8/0x157
[  214.460751]  [<ffffffff8113bac0>] sys_write+0x4d/0x77
[  214.466069]  [<ffffffff81900d42>] system_call_fastpath+0x16/0x1b
[  236.471550] BUG: spinlock lockup on CPU#3, flush-0:24/2548, ffff8801223c9240
[  236.478866] Pid: 2548, comm: flush-0:24 Not tainted 2.6.39-rc3-dt7+ #175
[  236.485850] Call Trace:
[  236.488584]  [<ffffffff813b3ee0>] do_raw_spin_lock+0x10c/0x137
[  236.494668]  [<ffffffff818f97fb>] _raw_spin_lock+0x56/0x69
[  236.500439]  [<ffffffff8115d388>] ? __mark_inode_dirty+0x66/0x1d0
[  236.506795]  [<ffffffff8115d388>] __mark_inode_dirty+0x66/0x1d0
[  236.512992]  [<ffffffff81238955>] nfs_commit_inode+0xf1/0x1c1
[  236.519017]  [<ffffffff81238a63>] nfs_write_inode+0x3e/0x93
[  236.524849]  [<ffffffff818fa1a3>] ? _raw_spin_unlock+0x2b/0x2f
[  236.530956]  [<ffffffff8115c8de>] writeback_single_inode+0x17a/0x267
[  236.537584]  [<ffffffff8115cdac>] writeback_sb_inodes+0xcf/0x157
[  236.543855]  [<ffffffff8115d7a2>] writeback_inodes_wb+0x131/0x143
[  236.550210]  [<ffffffff8115da2e>] wb_writeback+0x27a/0x3c3
[  236.562384]  [<ffffffff8115dd32>] wb_do_writeback+0x1bb/0x1d6
[  236.568385]  [<ffffffff8115ddd8>] bdi_writeback_thread+0x8b/0x212
[  236.574746]  [<ffffffff8115dd4d>] ? wb_do_writeback+0x1d6/0x1d6
[  236.580930]  [<ffffffff8108c4cc>] kthread+0x8e/0x96
[  236.586092]  [<ffffffff81901ee4>] kernel_thread_helper+0x4/0x10
[  236.592268]  [<ffffffff818fa414>] ? retint_restore_args+0x13/0x13
[  236.598617]  [<ffffffff8108c43e>] ? __init_kthread_worker+0x5b/0x5b
[  236.605141]  [<ffffffff81901ee0>] ? gs_change+0x13/0x13
[  355.807574] BUG: spinlock lockup on CPU#7, test-dd.sh/3661, ffff8801223c9240
[  355.814886] Pid: 3661, comm: test-dd.sh Not tainted 2.6.39-rc3-dt7+ #175
[  355.821869] Call Trace:
[  355.824604]  [<ffffffff813b3ee0>] do_raw_spin_lock+0x10c/0x137
[  355.830696]  [<ffffffff8114ee95>] ? __d_lookup_rcu+0x14a/0x14a
[  355.836794]  [<ffffffff818f97fb>] _raw_spin_lock+0x56/0x69
[  355.842543]  [<ffffffff8122debb>] ? nfs_refresh_inode+0x2d/0x50
[  355.848729]  [<ffffffff8122debb>] nfs_refresh_inode+0x2d/0x50
[  355.854733]  [<ffffffff8122a1c4>] nfs_readdir_page_filler+0x25a/0x46f
[  355.861431]  [<ffffffff8122a5c7>] nfs_readdir_xdr_to_array+0x1ee/0x25a
[  355.868217]  [<ffffffff8122a659>] nfs_readdir_filler+0x26/0x7b
[  355.874309]  [<ffffffff810f36f9>] ? add_to_page_cache_lru+0x53/0x5b
[  355.880830]  [<ffffffff810f382a>] do_read_cache_page+0x85/0x136
[  355.887038]  [<ffffffff8122a633>] ? nfs_readdir_xdr_to_array+0x25a/0x25a
[  355.894018]  [<ffffffff810f391f>] read_cache_page_async+0x1c/0x1e
[  355.900380]  [<ffffffff810f392f>] read_cache_page+0xe/0x18
[  355.906123]  [<ffffffff8122a952>] nfs_readdir+0x139/0x42b
[  355.911770]  [<ffffffff8114a911>] ? filldir64+0xd5/0xd5
[  355.917272]  [<ffffffff8123d4c2>] ? nfs3_xdr_dec_readlink3res+0x11d/0x11d
[  355.924313]  [<ffffffff8114a911>] ? filldir64+0xd5/0xd5
[  355.929792]  [<ffffffff8114ab05>] vfs_readdir+0x6a/0xa3
[  355.935284]  [<ffffffff8114ac2a>] sys_getdents+0x85/0xd8
[  355.940862]  [<ffffffff81900d42>] system_call_fastpath+0x16/0x1b
[  617.266081] flush-8:0 used greatest stack depth: 2600 bytes left
--
To unsubscribe from this list: send the line "unsubscribe linux-fsdevel" in
the body of a message to majordomo@xxxxxxxxxxxxxxx
More majordomo info at  http://vger.kernel.org/majordomo-info.html


[Index of Archives]     [Linux Ext4 Filesystem]     [Union Filesystem]     [Filesystem Testing]     [Ceph Users]     [Ecryptfs]     [AutoFS]     [Kernel Newbies]     [Share Photos]     [Security]     [Netfilter]     [Bugtraq]     [Yosemite News]     [MIPS Linux]     [ARM Linux]     [Linux Security]     [Linux Cachefs]     [Reiser Filesystem]     [Linux RAID]     [Samba]     [Device Mapper]     [CEPH Development]
  Powered by Linux