On Jul 23, 2010, at 7:39 PM, Dave Chinner wrote: > On Fri, Jul 23, 2010 at 06:08:08PM -0700, Eli Morris wrote: >> On Jul 23, 2010, at 5:54 PM, Dave Chinner wrote: >>> On Fri, Jul 23, 2010 at 01:30:40AM -0700, Eli Morris wrote: >>>> I think the raid tech support and me found and corrected the >>>> hardware problems associated with the RAID. I'm still having the >>>> same problem though. I expanded the filesystem to use the space of >>>> the now corrected RAID and that seems to work OK. I can write >>>> files to the new space OK. But then, if I run xfs_repair on the >>>> volume, the newly added space disappears and there are tons of >>>> error messages from xfs_repair (listed below). >>> >>> Can you post the full output of the xfs_repair? The superblock is >>> the first thing that is checked and repaired, so if it is being >>> "repaired" to reduce the size of the volume then all the other errors >>> are just a result of that. e.g. the grow could be leaving stale >>> secndary superblocks around and repair is seeing a primary/secondary >>> mismatch and restoring the secondary which has the size parameter >>> prior to the grow.... >>> >>> Also, the output of 'cat /proc/partitions' would be interesting >>> from before the grow, after the grow (when everything is working), >>> and again after the xfs_repair when everything goes bad.... >> >> Thanks for replying. Here is the output I think you're looking for.... > > Sure is. The underlying device does not change configuration, and: > >> [root@nimbus /]# xfs_repair /dev/mapper/vg1-vol5 >> Phase 1 - find and verify superblock... >> writing modified primary superblock >> Phase 2 - using internal log > > There's a smoking gun - the primary superblock was modified in some > way. Looks like the only way we can get this occurring without an > error or warning being emitted is if repair found more superblocks > with the old geometry in it them than the new geometry. > > With a current kernel, growfs is supposed to update every single > secondary superblock, so I can't see how this could be occurring. > However, can you remind me what kernel your are running and gather > the following information? > > Run this before the grow: > > # echo 3 > /proc/sys/vm/drop-caches > # for ag in `seq 0 1 125`; do >> xfs_db -r -c "sb $ag" -c "p agcount" -c "p dblocks" <device> >> done > > Then run the grow, sync, and unmount the filesystem. After that, > re-run the above xfs_db command and post the output of both so I can > see what growfs is actually doing to the secondary superblocks? > > Cheers, > > Dave. > -- > Dave Chinner > david@xxxxxxxxxxxxx Hi Dave and everyone, Here is the output from the commands you asked that I run.... Thanks so much for the help. I'm definitely not an expert on filesystems, so I really appreciate the help from you and everyone. Eli [root@nimbus ~]# uname -a Linux nimbus.pmc.ucsc.edu 2.6.18-128.1.14.el5 #1 SMP Wed Jun 17 06:38:05 EDT 2009 x86_64 x86_64 x86_64 GNU/Linux [root@nimbus vm]# echo 3 > /proc/sys/vm/drop_caches [root@nimbus vm]# for ag in `seq 0 1 125`; do > xfs_db -r -c "sb $ag" -c "p agcount" -c "p dblocks" /dev/vg1/vol5 > done agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 [root@nimbus vm]# [root@nimbus vm]# sync [root@nimbus vm]# df -h Filesystem Size Used Avail Use% Mounted on /dev/sdb2 24G 7.6G 15G 34% / /dev/sda5 1.7T 1.3T 391G 77% /export /dev/sda2 3.8G 1.4G 2.3G 37% /var tmpfs 16G 0 16G 0% /dev/shm /dev/sdb1 995G 946G 19G 99% /storage tmpfs 7.7G 7.9M 7.7G 1% /var/lib/ganglia/rrds /dev/mapper/vg1-vol5 51T 51T 90M 100% /export/vol5 [root@nimbus vm]# umount /export/vol5 [root@nimbus vm]# echo 3 > /proc/sys/vm/drop_caches [root@nimbus vm]# for ag in `seq 0 1 125`; do > xfs_db -r -c "sb $ag" -c "p agcount" -c "p dblocks" /dev/vg1/vol5 > done agcount = 156 dblocks = 16601554944 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 agcount = 126 dblocks = 13427728384 [root@nimbus vm]# _______________________________________________ xfs mailing list xfs@xxxxxxxxxxx http://oss.sgi.com/mailman/listinfo/xfs
