Josef Bacik wrote:
On Fri, Mar 07, 2008 at 03:45:58PM -0500, Ric Wheeler wrote:
Josef Bacik wrote:
On Friday 07 March 2008 3:08:32 pm Ric Wheeler wrote:
Josef Bacik wrote:
On Wednesday 05 March 2008 2:19:48 pm Ric Wheeler wrote:
After the IO/FS workshop last week, I posted some details on the slow
down we see with ext3 when we have a low latency back end instead of a
normal local disk (SCSI/S-ATA/etc).
...
...
Note that this spreads the files across 64 subdirectories, each thread
writes 50 files and then moves on to the next in a round robin.
I'm starting to wonder about the disks I have, because my files/second is
spanking yours, and its just a local samsung 3gb/s sata drive. With those
commands I'm consistently getting over 700 files/sec. I'm seeing about a
1-5% increase in speed locally with my patch. I guess I'll start looking
around for some other hardware and check on there in case this box is more
badass than I think it is. Thanks much,
Josef
Sounds like you might be running with write cache on & barriers off ;-)
Make sure you have write cache & barriers enabled on the drive. With a good
S-ATA drive, you should be seeing about 35-50 files/sec with a single
threaded writer.
The local disk that I tested on is a relatively slow s-ata disk that is
more laptop quality/performance than server.
One thought I had about the results is that we might be flipping the IO
sequence with the local disk case. It is the only device of the three that
I tested which is seek/head movement sensitive for small files.
Ahh yes turning off write cache off and barriers on I get your numbers, however
I'm not seeing the slowdown that you are, with and without my patch I'm seeing
the same performance. Its just a plane jane intel sata controller with a
samsung sata disk set at 1.5gbps. Same thing with an nvidia sata controller.
I'll think about this some more and see if there is something better that could
be done that may help you. Thanks much,
Josef
Thanks - you should see the numbers with write cache enabled and
barriers on as well, but for small files, write cache disabled is quite
close ;-)
I am happy to rerun the tests at any point, I have a variety of disk
types and controllers (lots of Intel AHCI boxes) to use.
ric
--
To unsubscribe from this list: send the line "unsubscribe linux-scsi" in
the body of a message to majordomo@xxxxxxxxxxxxxxx
More majordomo info at http://vger.kernel.org/majordomo-info.html
