why server hang or reset ? I expect some warning/error message like "No space left on device" and then I hope server is ok 2012/8/7 Burbidge, Simon A <s.burbidge@xxxxxxxxxxxxxx>: > Hi Kwon, > I'd suggest that the asynchronous nature of NFS means that you've got all the nfs threads on the client waiting on a response from > the NFS server. The server is in trouble because you've no free blocks and nfs has also filled up your buffer cache with data blocks and the > nfs server threads have blocked waiting on this. > While xfs might still be responsive on the server, it may very slow as it scrabbles around for the last free block. > > In my experience, in any situation with NFS where the server filesystem fills up completely, you'll get a hang. > Sometimes you can free space by removing files, sometimes the server is unresponsive and you have to reset. > > Best - Simon > > > ________________________________________ > From: xfs-bounces@xxxxxxxxxxx [xfs-bounces@xxxxxxxxxxx] on behalf of Guk-Bong, Kwon [gbkwon@xxxxxxxxx] > Sent: 07 August 2012 06:54 > To: xfs@xxxxxxxxxxx > Subject: xfs hang when filesystem filled > > HI all > > I tested xfs over nfs using bonnie++ > > xfs and nfs hang when xfs filesystem filled > > What's the problem? > > > see below > -------------------------------- > > 1. nfs server > > a. uname -a > - Linux nfs_server 2.6.32.58 #1 SMP Thu Mar 22 13:33:34 KST 2012 x86_64 > Intel(R) Xeon(R) CPU E5606 @ 2.13GHz GenuineIntel GNU/Linux > > b. lvcreate -L 90G -n test ld1 > > c. mkfs.xfs -i size=512 -l lazy-count=1 /dev/ld1/test > > d. mount /dev/ld1/test /test > - cat /proc/mounts > ================================================================================ > /dev/ld1/test /test xfs rw,relatime,attr2,noquota 0 0 > ================================================================================ > - xfs_info /test > ================================================================================ > meta-data=/dev/ld1/test isize=512 agcount=4, agsize=5898240 blks > = sectsz=512 attr=2 > data = bsize=4096 blocks=23592960, imaxpct=25 > = sunit=0 swidth=0 blks > naming =version 2 bsize=4096 > log =internal bsize=4096 blocks=11520, version=2 > = sectsz=512 sunit=0 blks, lazy-count=1 > realtime =none extsz=4096 blocks=0, rtextents=0 > ================================================================================ > > e. nfs export /test > - "/test" > 0.0.0.0/0.0.0.0(async,fsid=1342087477,insecure,no_root_squash,no_subtree_check,rw) > - cat /var/lib/nfs/etab > ================================================================================ > /test 0.0.0.0/0.0.0.0(rw,async,wdelay,hide,nocrossmnt,insecure,no_root_squash,no_all_squash,no_subtree_check,secure_locks,acl,fsid=1342087477,anonuid=65534,anongid=65534) > ================================================================================ > > > 2. nfs client > > a. uname -a > - Linux c1 3.0.31 #2 SMP Wed May 16 11:53:45 KST 2012 x86_64 > x86_64 x86_64 GNU/Linux > > b. mount nfs_server:/test /test/ > - cat /proc/mounts > ================================================================================ > nfs_server:/test/ /test nfs > rw,relatime,vers=3,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,mountaddr=192.168.100.137,mountvers=3,mountport=7446,mountproto=udp,local_lock=none,addr=192.168.100.137 > 0 0 > ================================================================================ > c. bonnie++ test > - a lot of bonnie++ process > ================================================================================ > bonnie++ -s 0 -n 200:1024000:1024000 -r 32G -d /test/ -u 0 -g 0 -q & > ================================================================================ > > > 3. server and client log when xfs and nfs hang up > > a. df -k > ================================================================================ > #df /test > Filesystem 1K-blocks Used Available Use% Mounted on > /dev/mapper/ld1-test 94325760 94325740 20 100% /test > ================================================================================ > > b. nfs server messages > ================================================================================ > Aug 2 18:17:57 anystor1 kernel: INFO: task nfsd:2387 blocked for more > than 120 seconds. > Aug 2 18:17:57 anystor1 kernel: "echo 0 > > /proc/sys/kernel/hung_task_timeout_secs" disables this message. > Aug 2 18:17:57 anystor1 kernel: nfsd D ffff88042eedda00 > 0 2387 2 0x00000000 > Aug 2 18:17:57 anystor1 kernel: ffff88042df493e0 0000000000000046 > ffff880426a6cc00 ffff88042df494f4 > Aug 2 18:17:57 anystor1 kernel: 000000000000c8e8 ffff88042df49fd8 > ffff88042eedda00 ffff88043f872d00 > Aug 2 18:17:57 anystor1 kernel: ffff88042eeddc70 000000018119ea84 > 000000002df494f8 0000000000000000 > Aug 2 18:17:57 anystor1 kernel: Call Trace: > Aug 2 18:17:57 anystor1 kernel: [<ffffffff811710e0>] ? xfs_bmapi+0x880/0x1230 > Aug 2 18:17:57 anystor1 kernel: [<ffffffff8135edad>] ? > schedule_timeout+0x1ed/0x250 > Aug 2 18:17:57 anystor1 kernel: [<ffffffff8135dfc8>] ? > wait_for_common+0xe8/0x170 > Aug 2 18:17:57 anystor1 kernel: [<ffffffff81038fb0>] ? > default_wake_function+0x0/0x10 > Aug 2 18:17:57 anystor1 kernel: [<ffffffff811b7421>] ? > xfs_flush_inodes+0x61/0x90 > Aug 2 18:17:57 anystor1 kernel: [<ffffffff81193163>] ? > xfs_iomap_write_delay+0x1a3/0x280 > Aug 2 18:17:57 anystor1 kernel: [<ffffffff81193991>] ? xfs_iomap+0x2f1/0x300 > Aug 2 18:17:57 anystor1 kernel: [<ffffffff811aba9f>] ? > __xfs_get_blocks+0x8f/0x220 > Aug 2 18:17:57 anystor1 kernel: [<ffffffff810d0e0d>] ? > alloc_buffer_head+0x3d/0x50 > Aug 2 18:17:57 anystor1 kernel: [<ffffffff810d1689>] ? > alloc_page_buffers+0x79/0xf0 > Aug 2 18:17:57 anystor1 kernel: [<ffffffff810d3594>] ? > __block_prepare_write+0x294/0x580 > Aug 2 18:17:57 anystor1 kernel: [<ffffffff811abc50>] ? xfs_get_blocks+0x0/0x10 > Aug 2 18:17:57 anystor1 kernel: [<ffffffff810d39f5>] ? > block_write_begin+0x55/0xe0 > Aug 2 18:17:57 anystor1 kernel: [<ffffffff811ad002>] ? > xfs_vm_write_begin+0x22/0x30 > Aug 2 18:17:57 anystor1 kernel: [<ffffffff811abc50>] ? xfs_get_blocks+0x0/0x10 > Aug 2 18:17:57 anystor1 kernel: [<ffffffff810770f4>] ? > generic_file_buffered_write+0x114/0x290 > Aug 2 18:17:57 anystor1 kernel: [<ffffffff812dd970>] ? > dev_queue_xmit+0x110/0x4d0 > Aug 2 18:17:57 anystor1 kernel: [<ffffffff811b41fc>] ? xfs_write+0x6cc/0x950 > Aug 2 18:17:57 anystor1 kernel: [<ffffffff8107a979>] ? > free_one_page+0x1b9/0x320 > Aug 2 18:17:57 anystor1 kernel: [<ffffffff812d76d9>] ? > skb_copy_datagram_iovec+0x49/0x230 > Aug 2 18:17:57 anystor1 kernel: [<ffffffff8118c3ef>] ? xfs_iget+0x25f/0x4d0 > Aug 2 18:17:57 anystor1 kernel: [<ffffffff811b00d0>] ? > xfs_file_aio_write+0x0/0x60 > Aug 2 18:17:57 anystor1 kernel: [<ffffffff810ab9eb>] ? > do_sync_readv_writev+0xcb/0x110 > Aug 2 18:17:57 anystor1 kernel: [<ffffffff81052cd0>] ? > autoremove_wake_function+0x0/0x30 > Aug 2 18:17:57 anystor1 kernel: [<ffffffff810ab826>] ? > rw_copy_check_uvector+0x86/0x130 > Aug 2 18:17:57 anystor1 kernel: [<ffffffff810ac0d2>] ? > do_readv_writev+0xe2/0x230 > Aug 2 18:17:57 anystor1 kernel: [<ffffffff81145eb2>] ? nfsd_setuser+0x122/0x2b0 > Aug 2 18:17:57 anystor1 kernel: [<ffffffff8113ea6c>] ? > nfsd_setuser_and_check_port+0x5c/0x70 > Aug 2 18:17:57 anystor1 kernel: [<ffffffff8113f3a3>] ? > nfsd_permission+0xf3/0x170 > Aug 2 18:17:57 anystor1 kernel: [<ffffffff811407a1>] ? > nfsd_vfs_write+0xe1/0x440 > Aug 2 18:17:57 anystor1 kernel: [<ffffffff810a9e2b>] ? > __dentry_open+0x10b/0x300 > Aug 2 18:17:57 anystor1 kernel: [<ffffffff81141187>] ? nfsd_open+0x147/0x1f0 > Aug 2 18:17:57 anystor1 kernel: [<ffffffff811415fe>] ? nfsd_write+0xfe/0x110 > Aug 2 18:17:57 anystor1 kernel: [<ffffffff81148ba6>] ? > nfsd3_proc_write+0xb6/0x160 > Aug 2 18:17:57 anystor1 kernel: [<ffffffff8113b3ca>] ? nfsd_dispatch+0xba/0x270 > Aug 2 18:17:57 anystor1 kernel: [<ffffffff81346f1a>] ? svc_process+0x4aa/0x800 > Aug 2 18:17:57 anystor1 kernel: [<ffffffff81038fb0>] ? > default_wake_function+0x0/0x10 > Aug 2 18:17:57 anystor1 kernel: [<ffffffff8113ba00>] ? nfsd+0x0/0x150 > Aug 2 18:17:57 anystor1 kernel: [<ffffffff8113bacd>] ? nfsd+0xcd/0x150 > Aug 2 18:17:57 anystor1 kernel: [<ffffffff810529d6>] ? kthread+0x96/0xb0 > Aug 2 18:17:57 anystor1 kernel: [<ffffffff8100cc7a>] ? child_rip+0xa/0x20 > Aug 2 18:17:57 anystor1 kernel: [<ffffffff8101ea10>] ? > lapic_next_event+0x0/0x20 > Aug 2 18:17:57 anystor1 kernel: [<ffffffff81052940>] ? kthread+0x0/0xb0 > Aug 2 18:17:57 anystor1 kernel: [<ffffffff8100cc70>] ? child_rip+0x0/0x20 > Aug 2 18:17:58 anystor1 kernel: INFO: task nfsd:2403 blocked for more > than 120 seconds. > Aug 2 18:17:58 anystor1 kernel: "echo 0 > > /proc/sys/kernel/hung_task_timeout_secs" disables this message. > Aug 2 18:17:58 anystor1 kernel: nfsd D ffff88042d593840 > 0 2403 2 0x00000000 > Aug 2 18:17:58 anystor1 kernel: ffff88042cfe3ad0 0000000000000046 > 0000000000000000 ffffffff8117a64b > Aug 2 18:17:58 anystor1 kernel: 000000000000c8e8 ffff88042cfe3fd8 > ffff88042d593840 ffff88043f8d8b40 > Aug 2 18:17:58 anystor1 kernel: ffff88042d593ab0 0000000500000286 > 000000010a5219d8 ffff8800282ac8e8 > Aug 2 18:17:58 anystor1 kernel: Call Trace: > Aug 2 18:17:58 anystor1 kernel: [<ffffffff8117a64b>] ? > xfs_da_do_buf+0x52b/0x700 > Aug 2 18:17:58 anystor1 kernel: [<ffffffff8135edad>] ? > schedule_timeout+0x1ed/0x250 > Aug 2 18:17:58 anystor1 kernel: [<ffffffff8135dfc8>] ? > wait_for_common+0xe8/0x170 > Aug 2 18:17:58 anystor1 kernel: [<ffffffff81038fb0>] ? > default_wake_function+0x0/0x10 > Aug 2 18:17:58 anystor1 kernel: [<ffffffff811b7421>] ? > xfs_flush_inodes+0x61/0x90 > Aug 2 18:17:58 anystor1 kernel: [<ffffffff811a83f8>] ? xfs_create+0x348/0x600 > Aug 2 18:17:58 anystor1 kernel: [<ffffffff81145eb2>] ? nfsd_setuser+0x122/0x2b0 > Aug 2 18:17:58 anystor1 kernel: [<ffffffff810b48cd>] ? > generic_permission+0x1d/0xc0 > Aug 2 18:17:58 anystor1 kernel: [<ffffffff811b2b7d>] ? xfs_vn_mknod+0x8d/0x1e0 > Aug 2 18:17:58 anystor1 kernel: [<ffffffff810b5daf>] ? vfs_create+0xef/0x160 > Aug 2 18:17:58 anystor1 kernel: [<ffffffff811420eb>] ? > nfsd_create_v3+0x45b/0x580 > Aug 2 18:17:58 anystor1 kernel: [<ffffffff81148a58>] ? > nfsd3_proc_create+0x118/0x1b0 > Aug 2 18:17:58 anystor1 kernel: [<ffffffff8113b3ca>] ? nfsd_dispatch+0xba/0x270 > Aug 2 18:17:58 anystor1 kernel: [<ffffffff81346f1a>] ? svc_process+0x4aa/0x800 > Aug 2 18:17:58 anystor1 kernel: [<ffffffff81038fb0>] ? > default_wake_function+0x0/0x10 > Aug 2 18:17:58 anystor1 kernel: [<ffffffff8113ba00>] ? nfsd+0x0/0x150 > Aug 2 18:17:58 anystor1 kernel: [<ffffffff8113bacd>] ? nfsd+0xcd/0x150 > Aug 2 18:17:58 anystor1 kernel: [<ffffffff810529d6>] ? kthread+0x96/0xb0 > Aug 2 18:17:58 anystor1 kernel: [<ffffffff8100cc7a>] ? child_rip+0xa/0x20 > Aug 2 18:17:58 anystor1 kernel: [<ffffffff8101ea10>] ? > lapic_next_event+0x0/0x20 > Aug 2 18:17:58 anystor1 kernel: [<ffffffff81052940>] ? kthread+0x0/0xb0 > Aug 2 18:17:58 anystor1 kernel: [<ffffffff8100cc70>] ? child_rip+0x0/0x20 > Aug 2 18:17:58 anystor1 kernel: INFO: task xfssyncd:10318 blocked for > more than 120 seconds. > Aug 2 18:17:58 anystor1 kernel: "echo 0 > > /proc/sys/kernel/hung_task_timeout_secs" disables this message. > Aug 2 18:17:58 anystor1 kernel: xfssyncd D ffff8802ced4ab80 > 0 10318 2 0x00000000 > Aug 2 18:17:58 anystor1 kernel: ffff880422d6d320 0000000000000046 > 0000000000000000 0000000000000286 > Aug 2 18:17:58 anystor1 kernel: 000000000000c8e8 ffff880422d6dfd8 > ffff88042c154920 ffff88043f8db840 > Aug 2 18:17:58 anystor1 kernel: ffff88042c154b90 00000007811a4b83 > 000000010a5227ce ffff8800282ec8e8 > Aug 2 18:17:58 anystor1 kernel: Call Trace: > Aug 2 18:17:58 anystor1 kernel: [<ffffffff811738ce>] ? > xfs_btree_is_lastrec+0x4e/0x60 > Aug 2 18:17:58 anystor1 kernel: [<ffffffff8135edad>] ? > schedule_timeout+0x1ed/0x250 > Aug 2 18:17:58 anystor1 kernel: [<ffffffff8135fcd1>] ? __down+0x61/0xa0 > Aug 2 18:17:58 anystor1 kernel: [<ffffffff810572d6>] ? down+0x46/0x50 > Aug 2 18:17:58 anystor1 kernel: [<ffffffff811af6a4>] ? > _xfs_buf_find+0x134/0x220 > Aug 2 18:17:58 anystor1 kernel: [<ffffffff811af7fe>] ? > xfs_buf_get_flags+0x6e/0x190 > Aug 2 18:17:58 anystor1 kernel: [<ffffffff811a525e>] ? > xfs_trans_get_buf+0x10e/0x160 > Aug 2 18:17:58 anystor1 kernel: [<ffffffff81161954>] ? > xfs_alloc_fix_freelist+0x144/0x450 > Aug 2 18:17:58 anystor1 kernel: [<ffffffff8119e597>] ? > xfs_icsb_disable_counter+0x17/0x160 > Aug 2 18:17:58 anystor1 kernel: [<ffffffff8116d2f2>] ? > xfs_bmap_add_extent_delay_real+0x8d2/0x11a0 > Aug 2 18:17:58 anystor1 kernel: [<ffffffff811a4b83>] ? > xfs_trans_log_buf+0x63/0xa0 > Aug 2 18:17:58 anystor1 kernel: [<ffffffff8119e731>] ? > xfs_icsb_balance_counter_locked+0x31/0xf0 > Aug 2 18:17:58 anystor1 kernel: [<ffffffff81161ed1>] ? > xfs_alloc_vextent+0x1b1/0x4c0 > Aug 2 18:17:58 anystor1 kernel: [<ffffffff8116e946>] ? > xfs_bmap_btalloc+0x596/0xa70 > Aug 2 18:17:58 anystor1 kernel: [<ffffffff8117125a>] ? xfs_bmapi+0x9fa/0x1230 > Aug 2 18:17:58 anystor1 kernel: [<ffffffff811965f6>] ? > xlog_state_release_iclog+0x56/0xe0 > Aug 2 18:17:58 anystor1 kernel: [<ffffffff811a3a0f>] ? > xfs_trans_reserve+0x9f/0x210 > Aug 2 18:17:58 anystor1 kernel: [<ffffffff81192d0e>] ? > xfs_iomap_write_allocate+0x24e/0x3d0 > Aug 2 18:17:58 anystor1 kernel: [<ffffffff811c29c0>] ? elv_insert+0xf0/0x260 > Aug 2 18:17:58 anystor1 kernel: [<ffffffff8119396b>] ? xfs_iomap+0x2cb/0x300 > Aug 2 18:17:58 anystor1 kernel: [<ffffffff811aba05>] ? xfs_map_blocks+0x25/0x30 > Aug 2 18:17:58 anystor1 kernel: [<ffffffff811acb64>] ? > xfs_page_state_convert+0x414/0x6d0 > Aug 2 18:17:58 anystor1 kernel: [<ffffffff811ad137>] ? > xfs_vm_writepage+0x77/0x130 > Aug 2 18:17:58 anystor1 kernel: [<ffffffff8107c8ca>] ? __writepage+0xa/0x40 > Aug 2 18:17:58 anystor1 kernel: [<ffffffff8107d0af>] ? > write_cache_pages+0x1df/0x3d0 > Aug 2 18:17:58 anystor1 kernel: [<ffffffff8107c8c0>] ? __writepage+0x0/0x40 > Aug 2 18:17:58 anystor1 kernel: [<ffffffff81076f4c>] ? > __filemap_fdatawrite_range+0x4c/0x60 > Aug 2 18:17:58 anystor1 kernel: [<ffffffff811da3a1>] ? > radix_tree_gang_lookup+0x71/0xf0 > Aug 2 18:17:58 anystor1 kernel: [<ffffffff811b029d>] ? > xfs_flush_pages+0xad/0xc0 > Aug 2 18:17:58 anystor1 kernel: [<ffffffff811b795a>] ? > xfs_sync_inode_data+0xca/0xf0 > Aug 2 18:17:58 anystor1 kernel: [<ffffffff811b7aa0>] ? > xfs_inode_ag_walk+0x80/0x140 > Aug 2 18:17:58 anystor1 kernel: [<ffffffff811b7890>] ? > xfs_sync_inode_data+0x0/0xf0 > Aug 2 18:17:58 anystor1 kernel: [<ffffffff811b7be8>] ? > xfs_inode_ag_iterator+0x88/0xd0 > Aug 2 18:17:58 anystor1 kernel: [<ffffffff811b7890>] ? > xfs_sync_inode_data+0x0/0xf0 > Aug 2 18:17:58 anystor1 kernel: [<ffffffff8135ed1d>] ? > schedule_timeout+0x15d/0x250 > Aug 2 18:17:58 anystor1 kernel: [<ffffffff811b7f40>] ? xfs_sync_data+0x30/0x60 > Aug 2 18:17:58 anystor1 kernel: [<ffffffff811b7f8e>] ? > xfs_flush_inodes_work+0x1e/0x50 > Aug 2 18:17:58 anystor1 kernel: [<ffffffff811b726c>] ? xfssyncd+0x13c/0x1d0 > Aug 2 18:17:58 anystor1 kernel: [<ffffffff811b7130>] ? xfssyncd+0x0/0x1d0 > Aug 2 18:17:58 anystor1 kernel: [<ffffffff810529d6>] ? kthread+0x96/0xb0 > Aug 2 18:17:58 anystor1 kernel: [<ffffffff8100cc7a>] ? child_rip+0xa/0x20 > Aug 2 18:17:58 anystor1 kernel: [<ffffffff8101ea10>] ? > lapic_next_event+0x0/0x20 > Aug 2 18:17:58 anystor1 kernel: [<ffffffff81052940>] ? kthread+0x0/0xb0 > Aug 2 18:17:58 anystor1 kernel: [<ffffffff8100cc70>] ? child_rip+0x0/0x20 > Aug 2 18:17:58 anystor1 kernel: INFO: task flush-254:16:24467 blocked > for more than 120 seconds. > Aug 2 18:17:58 anystor1 kernel: "echo 0 > > /proc/sys/kernel/hung_task_timeout_secs" disables this message. > Aug 2 18:17:58 anystor1 kernel: flush-254:16 D 0000000000000002 > 0 24467 2 0x00000000 > Aug 2 18:17:58 anystor1 kernel: ffff880109339ac0 0000000000000046 > 0000000000000000 ffff88043b404000 > Aug 2 18:17:58 anystor1 kernel: 000000000000c8e8 ffff880109339fd8 > ffff880358240000 ffff88043f872d00 > Aug 2 18:17:58 anystor1 kernel: ffff880358240270 000000010267d800 > 000000010a52336b ffff88002822c8e8 > Aug 2 18:17:58 anystor1 kernel: Call Trace: > Aug 2 18:17:58 anystor1 kernel: [<ffffffff81263464>] ? > scsi_request_fn+0xa4/0x430 > Aug 2 18:17:58 anystor1 kernel: [<ffffffff81076120>] ? sync_page+0x0/0x70 > Aug 2 18:17:58 anystor1 kernel: [<ffffffff8135eabd>] ? io_schedule+0x4d/0x70 > Aug 2 18:17:58 anystor1 kernel: [<ffffffff81076155>] ? sync_page+0x35/0x70 > Aug 2 18:17:58 anystor1 kernel: [<ffffffff8135eeba>] ? > __wait_on_bit_lock+0x4a/0xa0 > Aug 2 18:17:58 anystor1 kernel: [<ffffffff810760fe>] ? __lock_page+0x5e/0x70 > Aug 2 18:17:58 anystor1 kernel: [<ffffffff81052d00>] ? > wake_bit_function+0x0/0x30 > Aug 2 18:17:58 anystor1 kernel: [<ffffffff8107e96a>] ? > pagevec_lookup_tag+0x1a/0x30 > Aug 2 18:17:58 anystor1 kernel: [<ffffffff8107d094>] ? > write_cache_pages+0x1c4/0x3d0 > Aug 2 18:17:58 anystor1 kernel: [<ffffffff8107c8c0>] ? __writepage+0x0/0x40 > Aug 2 18:17:58 anystor1 kernel: [<ffffffff810caf22>] ? > writeback_single_inode+0xd2/0x390 > Aug 2 18:17:58 anystor1 kernel: [<ffffffff810cbe1d>] ? > writeback_inodes_wb+0x40d/0x5f0 > Aug 2 18:17:58 anystor1 kernel: [<ffffffff810cc11e>] ? wb_writeback+0x11e/0x1f0 > Aug 2 18:17:58 anystor1 kernel: [<ffffffff810cc464>] ? > wb_do_writeback+0x184/0x190 > Aug 2 18:17:58 anystor1 kernel: [<ffffffff810cc4ab>] ? > bdi_writeback_task+0x3b/0xc0 > Aug 2 18:17:58 anystor1 kernel: [<ffffffff81089370>] ? bdi_start_fn+0x0/0xf0 > Aug 2 18:17:58 anystor1 kernel: [<ffffffff810893ee>] ? bdi_start_fn+0x7e/0xf0 > Aug 2 18:17:58 anystor1 kernel: [<ffffffff81089370>] ? bdi_start_fn+0x0/0xf0 > Aug 2 18:17:58 anystor1 kernel: [<ffffffff810529d6>] ? kthread+0x96/0xb0 > Aug 2 18:17:58 anystor1 kernel: [<ffffffff8100cc7a>] ? child_rip+0xa/0x20 > Aug 2 18:17:58 anystor1 kernel: [<ffffffff8101ea10>] ? > lapic_next_event+0x0/0x20 > Aug 2 18:17:58 anystor1 kernel: [<ffffffff81052940>] ? kthread+0x0/0xb0 > Aug 2 18:17:58 anystor1 kernel: [<ffffffff8100cc70>] ? child_rip+0x0/0x20 > Aug 2 18:19:58 anystor1 kernel: INFO: task nfsd:2377 blocked for more > than 120 seconds. > Aug 2 18:19:58 anystor1 kernel: "echo 0 > > /proc/sys/kernel/hung_task_timeout_secs" disables this message. > Aug 2 18:19:58 anystor1 kernel: nfsd D ffff88042eeda1c0 > 0 2377 2 0x00000000 > Aug 2 18:19:58 anystor1 kernel: ffff88042e519938 0000000000000046 > 0000000000000000 0000000000000000 > Aug 2 18:19:58 anystor1 kernel: 000000000000c8e8 ffff88042e519fd8 > ffff88042eeda1c0 ffffffff814a7840 > Aug 2 18:19:58 anystor1 kernel: ffff88042eeda430 0000000000000000 > 0000000000000000 0000000000000000 > Aug 2 18:19:58 anystor1 kernel: Call Trace: > Aug 2 18:19:58 anystor1 kernel: [<ffffffff8135f2ae>] ? > __mutex_lock_slowpath+0xee/0x170 > Aug 2 18:19:58 anystor1 kernel: [<ffffffff8135f0ea>] ? mutex_lock+0x1a/0x40 > Aug 2 18:19:58 anystor1 kernel: [<ffffffff811b4014>] ? xfs_write+0x4e4/0x950 > Aug 2 18:19:58 anystor1 kernel: [<ffffffff8107a979>] ? > free_one_page+0x1b9/0x320 > Aug 2 18:19:58 anystor1 kernel: [<ffffffff8118c3ef>] ? xfs_iget+0x25f/0x4d0 > Aug 2 18:19:58 anystor1 kernel: [<ffffffff811b00d0>] ? > xfs_file_aio_write+0x0/0x60 > Aug 2 18:19:58 anystor1 kernel: [<ffffffff810ab9eb>] ? > do_sync_readv_writev+0xcb/0x110 > Aug 2 18:19:58 anystor1 kernel: [<ffffffff81052cd0>] ? > autoremove_wake_function+0x0/0x30 > Aug 2 18:19:58 anystor1 kernel: [<ffffffff810ab826>] ? > rw_copy_check_uvector+0x86/0x130 > Aug 2 18:19:58 anystor1 kernel: [<ffffffff810ac0d2>] ? > do_readv_writev+0xe2/0x230 > Aug 2 18:19:58 anystor1 kernel: [<ffffffff81145eb2>] ? nfsd_setuser+0x122/0x2b0 > Aug 2 18:19:58 anystor1 kernel: [<ffffffff8113ea6c>] ? > nfsd_setuser_and_check_port+0x5c/0x70 > Aug 2 18:19:58 anystor1 kernel: [<ffffffff8113f3a3>] ? > nfsd_permission+0xf3/0x170 > Aug 2 18:19:58 anystor1 kernel: [<ffffffff811407a1>] ? > nfsd_vfs_write+0xe1/0x440 > Aug 2 18:19:58 anystor1 kernel: [<ffffffff810a9e2b>] ? > __dentry_open+0x10b/0x300 > Aug 2 18:19:58 anystor1 kernel: [<ffffffff81141187>] ? nfsd_open+0x147/0x1f0 > Aug 2 18:19:58 anystor1 kernel: [<ffffffff811415fe>] ? nfsd_write+0xfe/0x110 > Aug 2 18:19:58 anystor1 kernel: [<ffffffff81148ba6>] ? > nfsd3_proc_write+0xb6/0x160 > Aug 2 18:19:58 anystor1 kernel: [<ffffffff8113b3ca>] ? nfsd_dispatch+0xba/0x270 > Aug 2 18:19:58 anystor1 kernel: [<ffffffff81346f1a>] ? svc_process+0x4aa/0x800 > Aug 2 18:19:58 anystor1 kernel: [<ffffffff81038fb0>] ? > default_wake_function+0x0/0x10 > Aug 2 18:19:58 anystor1 kernel: [<ffffffff8113ba00>] ? nfsd+0x0/0x150 > Aug 2 18:19:58 anystor1 kernel: [<ffffffff8113bacd>] ? nfsd+0xcd/0x150 > Aug 2 18:19:58 anystor1 kernel: [<ffffffff810529d6>] ? kthread+0x96/0xb0 > Aug 2 18:19:58 anystor1 kernel: [<ffffffff8100cc7a>] ? child_rip+0xa/0x20 > Aug 2 18:19:58 anystor1 kernel: [<ffffffff8101ea10>] ? > lapic_next_event+0x0/0x20 > Aug 2 18:19:58 anystor1 kernel: [<ffffffff81052940>] ? kthread+0x0/0xb0 > Aug 2 18:19:58 anystor1 kernel: [<ffffffff8100cc70>] ? child_rip+0x0/0x20 > Aug 2 18:19:58 anystor1 kernel: INFO: task nfsd:2387 blocked for more > than 120 seconds. > Aug 2 18:19:58 anystor1 kernel: "echo 0 > > /proc/sys/kernel/hung_task_timeout_secs" disables this message. > Aug 2 18:19:58 anystor1 kernel: nfsd D ffff88042eedda00 > 0 2387 2 0x00000000 > Aug 2 18:19:58 anystor1 kernel: ffff88042df493e0 0000000000000046 > ffff880426a6cc00 ffff88042df494f4 > Aug 2 18:19:58 anystor1 kernel: 000000000000c8e8 ffff88042df49fd8 > ffff88042eedda00 ffff88043f872d00 > Aug 2 18:19:58 anystor1 kernel: ffff88042eeddc70 000000018119ea84 > 000000002df494f8 0000000000000000 > Aug 2 18:19:58 anystor1 kernel: Call Trace: > Aug 2 18:19:58 anystor1 kernel: [<ffffffff811710e0>] ? xfs_bmapi+0x880/0x1230 > Aug 2 18:19:58 anystor1 kernel: [<ffffffff8135edad>] ? > schedule_timeout+0x1ed/0x250 > Aug 2 18:19:58 anystor1 kernel: [<ffffffff8135dfc8>] ? > wait_for_common+0xe8/0x170 > Aug 2 18:19:58 anystor1 kernel: [<ffffffff81038fb0>] ? > default_wake_function+0x0/0x10 > Aug 2 18:19:58 anystor1 kernel: [<ffffffff811b7421>] ? > xfs_flush_inodes+0x61/0x90 > Aug 2 18:19:58 anystor1 kernel: [<ffffffff81193163>] ? > xfs_iomap_write_delay+0x1a3/0x280 > Aug 2 18:19:58 anystor1 kernel: [<ffffffff81193991>] ? xfs_iomap+0x2f1/0x300 > Aug 2 18:19:58 anystor1 kernel: [<ffffffff811aba9f>] ? > __xfs_get_blocks+0x8f/0x220 > Aug 2 18:19:58 anystor1 kernel: [<ffffffff810d0e0d>] ? > alloc_buffer_head+0x3d/0x50 > Aug 2 18:19:58 anystor1 kernel: [<ffffffff810d1689>] ? > alloc_page_buffers+0x79/0xf0 > Aug 2 18:19:58 anystor1 kernel: [<ffffffff810d3594>] ? > __block_prepare_write+0x294/0x580 > Aug 2 18:19:58 anystor1 kernel: [<ffffffff811abc50>] ? xfs_get_blocks+0x0/0x10 > Aug 2 18:19:58 anystor1 kernel: [<ffffffff810d39f5>] ? > block_write_begin+0x55/0xe0 > Aug 2 18:19:59 anystor1 kernel: [<ffffffff811ad002>] ? > xfs_vm_write_begin+0x22/0x30 > Aug 2 18:19:59 anystor1 kernel: [<ffffffff811abc50>] ? xfs_get_blocks+0x0/0x10 > Aug 2 18:19:59 anystor1 kernel: [<ffffffff810770f4>] ? > generic_file_buffered_write+0x114/0x290 > Aug 2 18:19:59 anystor1 kernel: [<ffffffff812dd970>] ? > dev_queue_xmit+0x110/0x4d0 > Aug 2 18:19:59 anystor1 kernel: [<ffffffff811b41fc>] ? xfs_write+0x6cc/0x950 > Aug 2 18:19:59 anystor1 kernel: [<ffffffff8107a979>] ? > free_one_page+0x1b9/0x320 > Aug 2 18:19:59 anystor1 kernel: [<ffffffff812d76d9>] ? > skb_copy_datagram_iovec+0x49/0x230 > Aug 2 18:19:59 anystor1 kernel: [<ffffffff8118c3ef>] ? xfs_iget+0x25f/0x4d0 > Aug 2 18:19:59 anystor1 kernel: [<ffffffff811b00d0>] ? > xfs_file_aio_write+0x0/0x60 > Aug 2 18:19:59 anystor1 kernel: [<ffffffff810ab9eb>] ? > do_sync_readv_writev+0xcb/0x110 > Aug 2 18:19:59 anystor1 kernel: [<ffffffff81052cd0>] ? > autoremove_wake_function+0x0/0x30 > Aug 2 18:19:59 anystor1 kernel: [<ffffffff810ab826>] ? > rw_copy_check_uvector+0x86/0x130 > Aug 2 18:19:59 anystor1 kernel: [<ffffffff810ac0d2>] ? > do_readv_writev+0xe2/0x230 > Aug 2 18:19:59 anystor1 kernel: [<ffffffff81145eb2>] ? nfsd_setuser+0x122/0x2b0 > Aug 2 18:19:59 anystor1 kernel: [<ffffffff8113ea6c>] ? > nfsd_setuser_and_check_port+0x5c/0x70 > Aug 2 18:19:59 anystor1 kernel: [<ffffffff8113f3a3>] ? > nfsd_permission+0xf3/0x170 > Aug 2 18:19:59 anystor1 kernel: [<ffffffff811407a1>] ? > nfsd_vfs_write+0xe1/0x440 > Aug 2 18:19:59 anystor1 kernel: [<ffffffff810a9e2b>] ? > __dentry_open+0x10b/0x300 > Aug 2 18:19:59 anystor1 kernel: [<ffffffff81141187>] ? nfsd_open+0x147/0x1f0 > Aug 2 18:19:59 anystor1 kernel: [<ffffffff811415fe>] ? nfsd_write+0xfe/0x110 > Aug 2 18:19:59 anystor1 kernel: [<ffffffff81148ba6>] ? > nfsd3_proc_write+0xb6/0x160 > Aug 2 18:19:59 anystor1 kernel: [<ffffffff8113b3ca>] ? nfsd_dispatch+0xba/0x270 > Aug 2 18:19:59 anystor1 kernel: [<ffffffff81346f1a>] ? svc_process+0x4aa/0x800 > Aug 2 18:19:59 anystor1 kernel: [<ffffffff81038fb0>] ? > default_wake_function+0x0/0x10 > Aug 2 18:19:59 anystor1 kernel: [<ffffffff8113ba00>] ? nfsd+0x0/0x150 > Aug 2 18:19:59 anystor1 kernel: [<ffffffff8113bacd>] ? nfsd+0xcd/0x150 > Aug 2 18:19:59 anystor1 kernel: [<ffffffff810529d6>] ? kthread+0x96/0xb0 > Aug 2 18:19:59 anystor1 kernel: [<ffffffff8100cc7a>] ? child_rip+0xa/0x20 > Aug 2 18:19:59 anystor1 kernel: [<ffffffff8101ea10>] ? > lapic_next_event+0x0/0x20 > Aug 2 18:19:59 anystor1 kernel: [<ffffffff81052940>] ? kthread+0x0/0xb0 > Aug 2 18:19:59 anystor1 kernel: [<ffffffff8100cc70>] ? child_rip+0x0/0x20 > Aug 2 18:19:59 anystor1 kernel: INFO: task nfsd:2389 blocked for more > than 120 seconds. > Aug 2 18:19:59 anystor1 kernel: "echo 0 > > /proc/sys/kernel/hung_task_timeout_secs" disables this message. > Aug 2 18:19:59 anystor1 kernel: nfsd D ffff88042eede540 > 0 2389 2 0x00000000 > Aug 2 18:19:59 anystor1 kernel: ffff88042d9653e0 0000000000000046 > ffff880426afe000 ffff88042d9654f4 > Aug 2 18:19:59 anystor1 kernel: 000000000000c8e8 ffff88042d965fd8 > ffff88042eede540 ffff88043f8d8b40 > Aug 2 18:19:59 anystor1 kernel: ffff88042eede7b0 000000058119ea84 > 000000002d9654f8 0000000000000000 > Aug 2 18:19:59 anystor1 kernel: Call Trace: > Aug 2 18:19:59 anystor1 kernel: [<ffffffff811710e0>] ? xfs_bmapi+0x880/0x1230 > Aug 2 18:19:59 anystor1 kernel: [<ffffffff8135edad>] ? > schedule_timeout+0x1ed/0x250 > Aug 2 18:19:59 anystor1 kernel: [<ffffffff81035200>] ? > enqueue_task_fair+0x1b0/0x210 > Aug 2 18:19:59 anystor1 kernel: [<ffffffff8135dfc8>] ? > wait_for_common+0xe8/0x170 > Aug 2 18:19:59 anystor1 kernel: [<ffffffff81038fb0>] ? > default_wake_function+0x0/0x10 > Aug 2 18:19:59 anystor1 kernel: [<ffffffff811b7421>] ? > xfs_flush_inodes+0x61/0x90 > Aug 2 18:19:59 anystor1 kernel: [<ffffffff81193163>] ? > xfs_iomap_write_delay+0x1a3/0x280 > Aug 2 18:19:59 anystor1 kernel: [<ffffffff81193991>] ? xfs_iomap+0x2f1/0x300 > Aug 2 18:19:59 anystor1 kernel: [<ffffffff811aba9f>] ? > __xfs_get_blocks+0x8f/0x220 > Aug 2 18:19:59 anystor1 kernel: [<ffffffff810d0e0d>] ? > alloc_buffer_head+0x3d/0x50 > Aug 2 18:19:59 anystor1 kernel: [<ffffffff810d1689>] ? > alloc_page_buffers+0x79/0xf0 > Aug 2 18:19:59 anystor1 kernel: [<ffffffff810d3594>] ? > __block_prepare_write+0x294/0x580 > Aug 2 18:19:59 anystor1 kernel: [<ffffffff811abc50>] ? xfs_get_blocks+0x0/0x10 > Aug 2 18:19:59 anystor1 kernel: [<ffffffff810d39f5>] ? > block_write_begin+0x55/0xe0 > Aug 2 18:19:59 anystor1 kernel: [<ffffffff811ad002>] ? > xfs_vm_write_begin+0x22/0x30 > Aug 2 18:19:59 anystor1 kernel: [<ffffffff811abc50>] ? xfs_get_blocks+0x0/0x10 > Aug 2 18:19:59 anystor1 kernel: [<ffffffff810770f4>] ? > generic_file_buffered_write+0x114/0x290 > Aug 2 18:19:59 anystor1 kernel: [<ffffffff811b41fc>] ? xfs_write+0x6cc/0x950 > Aug 2 18:19:59 anystor1 kernel: [<ffffffff8107a979>] ? > free_one_page+0x1b9/0x320 > Aug 2 18:19:59 anystor1 kernel: [<ffffffff8118c3ef>] ? xfs_iget+0x25f/0x4d0 > Aug 2 18:19:59 anystor1 kernel: [<ffffffff811b00d0>] ? > xfs_file_aio_write+0x0/0x60 > Aug 2 18:19:59 anystor1 kernel: [<ffffffff810ab9eb>] ? > do_sync_readv_writev+0xcb/0x110 > Aug 2 18:19:59 anystor1 kernel: [<ffffffff81052cd0>] ? > autoremove_wake_function+0x0/0x30 > Aug 2 18:19:59 anystor1 kernel: [<ffffffff810ab826>] ? > rw_copy_check_uvector+0x86/0x130 > Aug 2 18:19:59 anystor1 kernel: [<ffffffff810ac0d2>] ? > do_readv_writev+0xe2/0x230 > Aug 2 18:19:59 anystor1 kernel: [<ffffffff81145eb2>] ? nfsd_setuser+0x122/0x2b0 > Aug 2 18:19:59 anystor1 kernel: [<ffffffff8113ea6c>] ? > nfsd_setuser_and_check_port+0x5c/0x70 > Aug 2 18:19:59 anystor1 kernel: [<ffffffff8113f3a3>] ? > nfsd_permission+0xf3/0x170 > Aug 2 18:19:59 anystor1 kernel: [<ffffffff811407a1>] ? > nfsd_vfs_write+0xe1/0x440 > Aug 2 18:19:59 anystor1 kernel: [<ffffffff810a9e2b>] ? > __dentry_open+0x10b/0x300 > Aug 2 18:19:59 anystor1 kernel: [<ffffffff81141187>] ? nfsd_open+0x147/0x1f0 > Aug 2 18:19:59 anystor1 kernel: [<ffffffff811415fe>] ? nfsd_write+0xfe/0x110 > Aug 2 18:19:59 anystor1 kernel: [<ffffffff81148ba6>] ? > nfsd3_proc_write+0xb6/0x160 > Aug 2 18:19:59 anystor1 kernel: [<ffffffff8113b3ca>] ? nfsd_dispatch+0xba/0x270 > Aug 2 18:19:59 anystor1 kernel: [<ffffffff81346f1a>] ? svc_process+0x4aa/0x800 > Aug 2 18:19:59 anystor1 kernel: [<ffffffff81038fb0>] ? > default_wake_function+0x0/0x10 > Aug 2 18:19:59 anystor1 kernel: [<ffffffff8113ba00>] ? nfsd+0x0/0x150 > Aug 2 18:19:59 anystor1 kernel: [<ffffffff8113bacd>] ? nfsd+0xcd/0x150 > Aug 2 18:19:59 anystor1 kernel: [<ffffffff810529d6>] ? kthread+0x96/0xb0 > Aug 2 18:19:59 anystor1 kernel: [<ffffffff8100cc7a>] ? child_rip+0xa/0x20 > Aug 2 18:19:59 anystor1 kernel: [<ffffffff8101ea10>] ? > lapic_next_event+0x0/0x20 > Aug 2 18:19:59 anystor1 kernel: [<ffffffff81052940>] ? kthread+0x0/0xb0 > Aug 2 18:19:59 anystor1 kernel: [<ffffffff8100cc70>] ? child_rip+0x0/0x20 > Aug 2 18:19:59 anystor1 kernel: INFO: task nfsd:2395 blocked for more > than 120 seconds. > Aug 2 18:19:59 anystor1 kernel: "echo 0 > > /proc/sys/kernel/hung_task_timeout_secs" disables this message. > Aug 2 18:19:59 anystor1 kernel: nfsd D ffff88042d590b40 > 0 2395 2 0x00000000 > Aug 2 18:19:59 anystor1 kernel: ffff88042d7a7ce8 0000000000000046 > 0000000000000000 ffff880109e0ab00 > Aug 2 18:19:59 anystor1 kernel: 000000000000c8e8 ffff88042d7a7fd8 > ffff88042d590b40 ffffffff814a7840 > Aug 2 18:19:59 anystor1 kernel: ffff88042d590db0 000000002d97ac08 > 000000010a54da62 ffff88002820c8e8 > Aug 2 18:19:59 anystor1 kernel: Call Trace: > Aug 2 18:19:59 anystor1 kernel: [<ffffffff810b48cd>] ? > generic_permission+0x1d/0xc0 > Aug 2 18:19:59 anystor1 kernel: [<ffffffff8113f331>] ? > nfsd_permission+0x81/0x170 > Aug 2 18:19:59 anystor1 kernel: [<ffffffff8135f2ae>] ? > __mutex_lock_slowpath+0xee/0x170 > Aug 2 18:19:59 anystor1 kernel: [<ffffffff8135f0ea>] ? mutex_lock+0x1a/0x40 > Aug 2 18:19:59 anystor1 kernel: [<ffffffff81141d81>] ? > nfsd_create_v3+0xf1/0x580 > Aug 2 18:19:59 anystor1 kernel: [<ffffffff81148a58>] ? > nfsd3_proc_create+0x118/0x1b0 > Aug 2 18:19:59 anystor1 kernel: [<ffffffff8113b3ca>] ? nfsd_dispatch+0xba/0x270 > Aug 2 18:19:59 anystor1 kernel: [<ffffffff81346f1a>] ? svc_process+0x4aa/0x800 > Aug 2 18:19:59 anystor1 kernel: [<ffffffff81038fb0>] ? > default_wake_function+0x0/0x10 > Aug 2 18:19:59 anystor1 kernel: [<ffffffff8113ba00>] ? nfsd+0x0/0x150 > Aug 2 18:19:59 anystor1 kernel: [<ffffffff8113bacd>] ? nfsd+0xcd/0x150 > Aug 2 18:19:59 anystor1 kernel: [<ffffffff810529d6>] ? kthread+0x96/0xb0 > Aug 2 18:19:59 anystor1 kernel: [<ffffffff8100cc7a>] ? child_rip+0xa/0x20 > Aug 2 18:19:59 anystor1 kernel: [<ffffffff8101ea10>] ? > lapic_next_event+0x0/0x20 > Aug 2 18:19:59 anystor1 kernel: [<ffffffff81052940>] ? kthread+0x0/0xb0 > Aug 2 18:19:59 anystor1 kernel: [<ffffffff8100cc70>] ? child_rip+0x0/0x20 > Aug 2 18:19:59 anystor1 kernel: INFO: task nfsd:2403 blocked for more > than 120 seconds. > Aug 2 18:19:59 anystor1 kernel: "echo 0 > > /proc/sys/kernel/hung_task_timeout_secs" disables this message. > Aug 2 18:19:59 anystor1 kernel: nfsd D ffff88042d593840 > 0 2403 2 0x00000000 > Aug 2 18:19:59 anystor1 kernel: ffff88042cfe3ad0 0000000000000046 > 0000000000000000 ffffffff8117a64b > Aug 2 18:19:59 anystor1 kernel: 000000000000c8e8 ffff88042cfe3fd8 > ffff88042d593840 ffff88043f8d8b40 > Aug 2 18:19:59 anystor1 kernel: ffff88042d593ab0 0000000500000286 > 000000010a5219d8 ffff8800282ac8e8 > Aug 2 18:19:59 anystor1 kernel: Call Trace: > Aug 2 18:19:59 anystor1 kernel: [<ffffffff8117a64b>] ? > xfs_da_do_buf+0x52b/0x700 > Aug 2 18:19:59 anystor1 kernel: [<ffffffff8135edad>] ? > schedule_timeout+0x1ed/0x250 > Aug 2 18:19:59 anystor1 kernel: [<ffffffff8135dfc8>] ? > wait_for_common+0xe8/0x170 > Aug 2 18:19:59 anystor1 kernel: [<ffffffff81038fb0>] ? > default_wake_function+0x0/0x10 > Aug 2 18:19:59 anystor1 kernel: [<ffffffff811b7421>] ? > xfs_flush_inodes+0x61/0x90 > Aug 2 18:19:59 anystor1 kernel: [<ffffffff811a83f8>] ? xfs_create+0x348/0x600 > Aug 2 18:19:59 anystor1 kernel: [<ffffffff81145eb2>] ? nfsd_setuser+0x122/0x2b0 > Aug 2 18:19:59 anystor1 kernel: [<ffffffff810b48cd>] ? > generic_permission+0x1d/0xc0 > Aug 2 18:19:59 anystor1 kernel: [<ffffffff811b2b7d>] ? xfs_vn_mknod+0x8d/0x1e0 > Aug 2 18:19:59 anystor1 kernel: [<ffffffff810b5daf>] ? vfs_create+0xef/0x160 > Aug 2 18:19:59 anystor1 kernel: [<ffffffff811420eb>] ? > nfsd_create_v3+0x45b/0x580 > Aug 2 18:19:59 anystor1 kernel: [<ffffffff81148a58>] ? > nfsd3_proc_create+0x118/0x1b0 > Aug 2 18:19:59 anystor1 kernel: [<ffffffff8113b3ca>] ? nfsd_dispatch+0xba/0x270 > Aug 2 18:19:59 anystor1 kernel: [<ffffffff81346f1a>] ? svc_process+0x4aa/0x800 > Aug 2 18:19:59 anystor1 kernel: [<ffffffff81038fb0>] ? > default_wake_function+0x0/0x10 > Aug 2 18:19:59 anystor1 kernel: [<ffffffff8113ba00>] ? nfsd+0x0/0x150 > Aug 2 18:19:59 anystor1 kernel: [<ffffffff8113bacd>] ? nfsd+0xcd/0x150 > Aug 2 18:19:59 anystor1 kernel: [<ffffffff810529d6>] ? kthread+0x96/0xb0 > Aug 2 18:19:59 anystor1 kernel: [<ffffffff8100cc7a>] ? child_rip+0xa/0x20 > Aug 2 18:19:59 anystor1 kernel: [<ffffffff8101ea10>] ? > lapic_next_event+0x0/0x20 > Aug 2 18:19:59 anystor1 kernel: [<ffffffff81052940>] ? kthread+0x0/0xb0 > Aug 2 18:19:59 anystor1 kernel: [<ffffffff8100cc70>] ? child_rip+0x0/0x20 > Aug 2 19:04:54 anystor1 kernel: nfsd: peername failed (err 107)! > Aug 2 19:04:54 anystor1 kernel: nfsd: peername failed (err 107)! > Aug 2 19:04:54 anystor1 kernel: nfsd: peername failed (err 107)! > Aug 2 19:04:54 anystor1 kernel: nfsd: peername failed (err 107)! > Aug 2 19:04:54 anystor1 kernel: nfsd: peername failed (err 107)! > Aug 2 19:04:54 anystor1 kernel: nfsd: peername failed (err 107)! > Aug 2 19:04:54 anystor1 kernel: nfsd: peername failed (err 107)! > Aug 2 19:04:54 anystor1 kernel: nfsd: peername failed (err 107)! > Aug 2 19:04:54 anystor1 kernel: nfsd: peername failed (err 107)! > Aug 2 19:04:54 anystor1 kernel: nfsd: peername failed (err 107)! > Aug 2 19:17:48 anystor1 kernel: __ratelimit: 12 callbacks suppressed > Aug 2 19:17:48 anystor1 kernel: nfsd: peername failed (err 107)! > Aug 2 19:17:48 anystor1 kernel: nfsd: peername failed (err 107)! > ================================================================================ > > c. nfs client messages > > ================================================================================ > Aug 2 18:15:53 c1 kernel: INFO: task bonnie++:8007 blocked for more > than 120 seconds. > Aug 2 18:15:53 c1 kernel: "echo 0 > > /proc/sys/kernel/hung_task_timeout_secs" disables this message. > Aug 2 18:15:53 c1 kernel: bonnie++ D 0000000000000001 0 > 8007 29681 0x00000000 > Aug 2 18:15:53 c1 kernel: INFO: task bonnie++:8014 blocked for more > than 120 seconds. > Aug 2 18:15:53 c1 kernel: "echo 0 > > /proc/sys/kernel/hung_task_timeout_secs" disables this message. > Aug 2 18:15:53 c1 kernel: bonnie++ D 0000000000000001 0 > 8014 6567 0x00000000 > Aug 2 18:16:41 c1 kernel: nfs: server nfs_server not responding, still trying > Aug 2 18:16:41 c1 kernel: nfs: server nfs_server not responding, still trying > Aug 2 18:16:44 c1 kernel: nfs: server nfs_server not responding, still trying > Aug 2 18:17:53 c1 kernel: INFO: task bonnie++:8007 blocked for more > than 120 seconds. > Aug 2 18:17:53 c1 kernel: "echo 0 > > /proc/sys/kernel/hung_task_timeout_secs" disables this message. > Aug 2 18:17:53 c1 kernel: bonnie++ D 0000000000000001 0 > 8007 29681 0x00000000 > Aug 2 18:17:53 c1 kernel: INFO: task bonnie++:8014 blocked for more > than 120 seconds. > Aug 2 18:17:53 c1 kernel: "echo 0 > > /proc/sys/kernel/hung_task_timeout_secs" disables this message. > Aug 2 18:17:53 c1 kernel: bonnie++ D 0000000000000001 0 > 8014 6567 0x00000000 > Aug 2 18:19:53 c1 kernel: INFO: task bonnie++:8007 blocked for more > than 120 seconds. > Aug 2 18:19:53 c1 kernel: "echo 0 > > /proc/sys/kernel/hung_task_timeout_secs" disables this message. > Aug 2 18:19:53 c1 kernel: bonnie++ D 0000000000000001 0 > 8007 29681 0x00000000 > Aug 2 18:19:53 c1 kernel: INFO: task bonnie++:8014 blocked for more > than 120 seconds. > Aug 2 18:19:53 c1 kernel: "echo 0 > > /proc/sys/kernel/hung_task_timeout_secs" disables this message. > Aug 2 18:19:53 c1 kernel: bonnie++ D 0000000000000001 0 > 8014 6567 0x00000000 > Aug 2 18:21:53 c1 kernel: INFO: task bonnie++:8007 blocked for more > than 120 seconds. > Aug 2 18:21:53 c1 kernel: "echo 0 > > /proc/sys/kernel/hung_task_timeout_secs" disables this message. > Aug 2 18:21:53 c1 kernel: bonnie++ D 0000000000000001 0 > 8007 29681 0x00000000 > Aug 2 18:21:53 c1 kernel: INFO: task bonnie++:8014 blocked for more > than 120 seconds. > Aug 2 18:21:53 c1 kernel: "echo 0 > > /proc/sys/kernel/hung_task_timeout_secs" disables this message. > Aug 2 18:21:53 c1 kernel: bonnie++ D 0000000000000001 0 > 8014 6567 0x00000000 > Aug 2 18:23:53 c1 kernel: INFO: task bonnie++:8007 blocked for more > than 120 seconds. > Aug 2 18:23:53 c1 kernel: "echo 0 > > /proc/sys/kernel/hung_task_timeout_secs" disables this message. > Aug 2 18:23:53 c1 kernel: bonnie++ D 0000000000000001 0 > 8007 29681 0x00000000 > Aug 2 18:23:53 c1 kernel: INFO: task bonnie++:8014 blocked for more > than 120 seconds. > Aug 2 18:23:53 c1 kernel: "echo 0 > > /proc/sys/kernel/hung_task_timeout_secs" disables this message. > Aug 2 18:23:53 c1 kernel: bonnie++ D 0000000000000001 0 > 8014 6567 0x00000000 > Aug 2 19:03:49 c1 kernel: nfs: server nfs_server OK > Aug 2 19:03:49 c1 kernel: nfs: server nfs_server OK > Aug 2 19:06:54 c1 kernel: nfs: server nfs_server not responding, still trying > Aug 2 19:06:54 c1 kernel: nfs: server nfs_server not responding, still trying > ================================================================================ > > _______________________________________________ > xfs mailing list > xfs@xxxxxxxxxxx > http://oss.sgi.com/mailman/listinfo/xfs _______________________________________________ xfs mailing list xfs@xxxxxxxxxxx http://oss.sgi.com/mailman/listinfo/xfs
