Re: [PATCH] generic/038: speed up file creation

[Date Prev] [Date Next] [Thread Prev] [Thread Next] [Date Index] [Thread Index]



On Thu, Aug 06, 2015 at 10:27:28AM +1000, Dave Chinner wrote:
> From: Dave Chinner <dchinner@xxxxxxxxxx>
> 
> Now that generic/038 is running on my test machine, I notice how
> slow it is:
> 
> generic/038      692s
> 
> 11-12 minutes for a single test is way too long.
> The test is creating
> 400,000 single block files, which can be easily parallelised and
> hence run much faster than the test is currently doing.
> 
> Split the file creation up into 4 threads that create 100,000 files
> each. 4 is chosen because XFS defaults to 4AGs, ext4 still has decent
> speedups at 4 concurrent creates, and other filesystems aren't hurt
> by excessive concurrency. The result:
> 
> generic/038      237s
> 
> on the same machine, which is roughly 3x faster and so it (just)
> fast enough to to be considered acceptible.

I got a speedup from 5663s to 639s, and confirmed the test could
fail the test on unpatched btrfs (btrfsck failed, not every time).

Reviewed-by: Eryu Guan <eguan@xxxxxxxxxx>
--
To unsubscribe from this list: send the line "unsubscribe fstests" in
the body of a message to majordomo@xxxxxxxxxxxxxxx
More majordomo info at  http://vger.kernel.org/majordomo-info.html



[Index of Archives]     [Linux Filesystems Development]     [Linux NFS]     [Linux NILFS]     [Linux USB Devel]     [Linux Audio Users]     [Yosemite News]     [Linux Kernel]     [Linux SCSI]

  Powered by Linux