>> We run a 14TB XFS fileserver on our cluster and want to add quota >> support. This is running 3.9.2-1.el6.elrepo.x86_64 kernel under CentOS >> 6.3 (Final). > > How many files in the filesystem? 8,339,620 files. 11TB used / 14TB total. 8MB Used / 11GB inodes. (on a different server below) 8,878,507 files. 2.1TB used / 5.5TB total. 9.3MB Used / 1.1GB inodes. Not that many compared to our larger file systems (already have quotas enabled). But still a lot of files. > You can't. quotacheck relies on exclusive access to the filesystem, > and so the mount cannot process until it completes. Quotas need to > be consistent before you can start using the filesystem.... > > Now, there's the possibility that we could parallelise quotacheck > because it uses bulkstat for iteration, but somebody would have to > find the time to do that and it won't solve your immediate problem. > > Hence I suggest just waiting for it to complete - if you have > millions of inodes it could hours to complete, so just let it go > overnight... Okay. Thanks for the information Dave! The servers we have are critical in that having downtime causes a lot of unhappy users. Since the XFS mount point is not accessible, everything that depends on it needs to be taken offline -- for example users's home directories. I was trying to research a way to avoid such a thing, but doesn't seem like I can. I would be interested to know, and maybe others on the listsrv can chime in, on what sort of time period I can expect for the quota check to run with 8 million files. Performing some martian math I get something like 4 hours? Maybe I should switch planets :-) -- Adam Brenner Computer Science, Undergraduate Student Donald Bren School of Information and Computer Sciences Research Computing Support Office of Information Technology http://www.oit.uci.edu/rcs/ University of California, Irvine www.ics.uci.edu/~aebrenne/ aebrenne@xxxxxxx On Thu, Jun 6, 2013 at 8:50 PM, Dave Chinner <david@xxxxxxxxxxxxx> wrote: > On Thu, Jun 06, 2013 at 07:59:34PM -0700, Adam Brenner wrote: >> Howdy XFS Devs, >> >> We run a 14TB XFS fileserver on our cluster and want to add quota >> support. This is running 3.9.2-1.el6.elrepo.x86_64 kernel under CentOS >> 6.3 (Final). > > How many files in the filesystem? > >> The issue is when we unmount the XFS RAID, and re-mount it adding >> quota support, the mount command hangs. > > It won't have hung, it will just be busy doing a quotacheck. > >> Sever IS responsive and the >> XFS mount point is not accessible. Reverting our changes in /etc/fstab >> to remove the quota options does not have mount hang. > > Because it doesn't do a quotacheck. > >> I suspect that upon re-mount, XFS is running a quota check on the 14TB >> RAID. My question is: how do I disable the initial quota check so it >> can mount it properly and have quota check run in the background? > > You can't. quotacheck relies on exclusive access to the filesystem, > and so the mount cannot process until it completes. Quotas need to > be consistent before you can start using the filesystem.... > > Now, there's the possibility that we could parallelise quotacheck > because it uses bulkstat for iteration, but somebody would have to > find the time to do that and it won't solve your immediate problem. > > Hence I suggest just waiting for it to complete - if you have > millions of inodes it could hours to complete, so just let it go > overnight... > > Cheers, > > Dave. > -- > Dave Chinner > david@xxxxxxxxxxxxx _______________________________________________ xfs mailing list xfs@xxxxxxxxxxx http://oss.sgi.com/mailman/listinfo/xfs
