On Fri, Apr 29, 2011 at 04:00:35PM +0100, Peter Grandi wrote: > > [ ... ] > > > On my raid-1 ext3, extracting a kernel archive: > [ ... ] > > real 0m21.769s > [ ... ] > > real 2m20.522s > > > This is of course with delaylog enabled. I don't think a > > difference of a factor 7 is normal, given that writing to a > > raid-0 (xfs numbers) is supposed to be faster than writing to > > raid-1 (ext3 numbers) > > Indeed, and as some other commenters have tried to explain, in > most cases the wrong number is the one for 'ext3' on RAID1 (way > too small). Even the number for XFS and RAID0 'delaylog' is a > wrong number (somewhat small) in many cases. > > There are 38000 files in 440MB in 'linux-2.6.38.tar', ~40% of > them are smaller than 4KiB and ~60% smaller than 8KiB. Also you > didn't flush caches, and you don't say whether the filesystems > are empty or full or at the same position on the disk. > > Can 'ext3' really commit 1900 small files per second (including > directory updates) to a filesystem on a RAID1 that probably can > do around 100 IOPS? That would be amazing news. Of course it can. Why? Because the allocator is optimised to pack small files written at the same time together on disk, and the elevator will merge them into one large IO when they are finally written to disk. With a typical 512k max IO size, that's 128 <=4k files packed into each IO, In a perfect world, we're talking about ~13000 4k files a second being written to disk @ 100 IOPS. In the real world, writing an order of magnitude less files per second is quite obtainable. Even XFS enables that same optimisation by truncating away speculative allocation when the file is closed so that when writeback comes along delayed allocation packs the data blocks belonging to different files tightly within the AG. Such optimisations are not new - they've been used in some form for as long as spinning media has been around.... > Despite decades of seeing it happen, I keep being astonished by > how many people (some with decades of "experience") just don't > understand IOPS and metadata and commits and caching and who Oh, the irony.... :) Cheers, Dave. -- Dave Chinner david@xxxxxxxxxxxxx _______________________________________________ xfs mailing list xfs@xxxxxxxxxxx http://oss.sgi.com/mailman/listinfo/xfs
