On Fri, 28 Jul 2006, Mikael Carneholm wrote:
Luke,
Yeah, I read those results, and I'm very disappointed with my results
from the MSA1500. I would however be interested in other people's
bonnie++ and benchmarksql results using a similar machine (2 cpu dual
core opteron) with other "off the shelf" storage systems
(EMC/Netapp/Xyratex/../). Could you run benchmarksql against that
machine with the 16 SATA disk and 3Ware 9550SX SATA RAID adapters? It
would be *very* interesting to see how the I/O performance correlates to
benchmarksql (postgres) transaction throughout.
FWIW, once our vendor gets all the pieces (having some issues with
figuring out which multilane sata cables to get), I'll have a dual-core
opteron box with a 3Ware 9500SX-12MI and 8 drives. I need to benchmark to
compare this to our xeon/adaptec/scsi build we've been using.
I've also got a 1U with a 9500SX-4 and 4 drives. I like how the 3Ware
card scales there - started with 2 drives and got "drive speed" mirroring.
Added two more and most of the bonnie numbers doubled. This is not what
I'm used to with the Adaptec SCSI junk.
These SATA RAID controllers 3Ware is making seem to be leaps and bounds
beyond what the "old guard" is churning out (at much higher prices).
Charles
/Mikael
-----Original Message-----
From: Luke Lonergan [mailto:LLonergan@xxxxxxxxxxxxx]
Sent: den 28 juli 2006 11:17
To: Mikael Carneholm; Kjell Tore Fossbakk;
pgsql-performance@xxxxxxxxxxxxxx
Subject: RE: [PERFORM] Performance with 2 AMD/Opteron 2.6Ghz and 8gig
Mikael,
-----Original Message-----
From: Mikael Carneholm [mailto:Mikael.Carneholm@xxxxxxxxxxxxxxx]
Sent: Friday, July 28, 2006 2:05 AM
My bonnie++ results are found in this message:
http://archives.postgresql.org/pgsql-performance/2006-07/msg00164.php
Apologies if I've already said this, but those bonnie++ results are very
disappointing. The sequential transfer rates between 20MB/s and 57MB/s
are slower than a single SATA disk, and your SCSI disks might even do
80MB/s sequential transfer rate each.
Random access is also very poor, though perhaps equal to 5 disk drives
at 500/second.
By comparison, we routinely get 950MB/s sequential transfer rate using
16 SATA disks and 3Ware 9550SX SATA RAID adapters on Linux.
On Solaris ZFS on an X4500, we recently got this bonnie++ result on 36
SATA disk drives in RAID10 (single thread first):
Version 1.03 ------Sequential Output------ --Sequential Input-
--Random-
-Per Chr- --Block-- -Rewrite- -Per Chr-
--Block-- --Seeks--
Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec
%CP /sec %CP
thumperdw-i-1 32G 120453 99 467814 98 290391 58 109371 99 993344
94 1801 4
------Sequential Create------ --------Random
Create--------
-Create-- --Read--- -Delete-- -Create-- --Read---
-Delete--
files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP
/sec %CP
16 +++++ +++ +++++ +++ +++++ +++ 30850 99 +++++ +++
+++++ +++
Bumping up the number of concurrent processes to 2, we get about 1.5x
speed reads of RAID10 with a concurrent workload (you have to add the
rates together):
Version 1.03 ------Sequential Output------ --Sequential Input-
--Random-
-Per Chr- --Block-- -Rewrite- -Per Chr- --Block--
--Seeks--
Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec
%CP /sec %CP
thumperdw-i-1 32G 111441 95 212536 54 171798 51 106184 98 719472
88 1233 2
------Sequential Create------ --------Random
Create--------
-Create-- --Read--- -Delete-- -Create-- --Read---
-Delete--
files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP
/sec %CP
16 26085 90 +++++ +++ 5700 98 21448 97 +++++ +++
4381 97
Version 1.03 ------Sequential Output------ --Sequential Input-
--Random-
-Per Chr- --Block-- -Rewrite- -Per Chr-
--Block-- --Seeks--
Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec
%CP /sec %CP
thumperdw-i-1 32G 116355 99 212509 54 171647 50 106112 98 715030
87 1274 3
------Sequential Create------ --------Random
Create--------
-Create-- --Read--- -Delete-- -Create-- --Read---
-Delete--
files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP
/sec %CP
16 26082 99 +++++ +++ 5588 98 21399 88 +++++ +++
4272 97
So that's 2500 seeks per second, 1440MB/s sequential block read, 212MB/s
per character sequential read.
- Luke
---------------------------(end of broadcast)---------------------------
TIP 6: explain analyze is your friend
