Re: Performance question, RAID5

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



On 30 January 2011 12:15, Roman Mamedov <rm@xxxxxxxxxx> wrote:
> On Sun, 30 Jan 2011 12:09:02 +0000
> Mathias BurÃn <mathias.buren@xxxxxxxxx> wrote:
>
>> Right, it's just that I don't want to destroy my data. I've ran a few
>> bonnie++ benchmarks with different mount options though. You can find
>> them here: http://stuff.dyndns.org/logs/bonnie_results.html
>> It actually looks like stripe=384 helped performance a bit. Currently
>> retrying the same mount options but with 32MB stripe cache instead of
>> 8MB.
>
> Be aware that it's not just 32MB of RAM, it's
>
> Â"stripe_cache_size * 4096 (page size) * number of disks".
>
> In other words on 6 disks this stripe cache will consume 768 MB of RAM.
>
> --
> With respect,
> Roman
>

Thanks. New results up for those interested:
http://stuff.dyndns.org/logs/bonnie_results.html

It looks like the best performance (for me) is gained using
rw,noatime,nouser_xattr,data=writeback,stripe=384 , 8192
stripe_cache_size, NCQ turned on (31), md0 readahead of 65536. I did
switch place between the SSD and a HDD so there's only 2 HDDs on the
PCI-E controller now, that are part of the RAID. The other 4 are on
the internal SATA controller.

csv format:

"Host","Chunk size","Sequential Output",,,,,,"Sequential
Input",,,,"Random Seeks",,"Files","Sequential Create",,,,,,"Random
Create",,,,,,"Mount options","stripe_cache_size","NCQ","md0
readahead","Comment"
,,"Per Chr",,"Block",,"Rewrite",,"Per
Chr",,"Block",,"Seeks",,,"Create",,"Read",,"Delete",,"Create",,"Read",,"Delete",,,,,,
,,"K/sec","CPU","K/sec","CPU","K/sec","CPU","K/sec","CPU","K/sec","CPU","/sec","CPU",,"/sec","CPU","/sec","CPU","/sec","CPU","/sec","CPU","/sec","CPU","/sec","CPU",,,,,
"ion","7G",13916,98,158905,91,71718,39,14539,99,295079,57,482.8,3,16,20747,99,"+++++","+++",24077,93,21249,99,"+++++","+++",25854,99,"rw,noatime,nouser_xattr,data=writeback,stripe=384",8192,31,65536,"4
on host 2 on pci-e"

A bit messy.

I did find another PCI-E SATA controller that is generation 2.0, and
looks like it may do the trick. This one:
http://www.newegg.com/Product/Product.aspx?Item=N82E16816115053
"HighPoint RocketRAID 2640x1 PCI-Express x1 Four-Port SATA and SAS
RAID Controller Card".

It's ~â110 on eBay, a bit hefty. I might just save up and build a NAS
box from scratch, with some mainboard which has 8 SATA from the start
etc.

// Mathias
--
To unsubscribe from this list: send the line "unsubscribe linux-raid" in
the body of a message to majordomo@xxxxxxxxxxxxxxx
More majordomo info at  http://vger.kernel.org/majordomo-info.html


[Index of Archives]     [Linux RAID Wiki]     [ATA RAID]     [Linux SCSI Target Infrastructure]     [Linux Block]     [Linux IDE]     [Linux SCSI]     [Linux Hams]     [Device Mapper]     [Device Mapper Cryptographics]     [Kernel]     [Linux Admin]     [Linux Net]     [GFS]     [RPM]     [git]     [Yosemite Forum]


  Powered by Linux