Re: 10K vs 15k rpm for analytics

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



Scott Marlowe wrote:
On Tue, Mar 2, 2010 at 1:51 PM, Yeb Havinga <yebhavinga@xxxxxxxxx> wrote:
With 24 drives it'll probably be the controller that is the limiting factor
of bandwidth. Our HP SAN controller with 28 15K drives delivers 170MB/s at
maximum with raid 0 and about 155MB/s with raid 1+0. So I'd go for the 10K
drives and put the saved money towards the controller (or maybe more than
one controller).

That's horrifically bad numbers for that many drives.  I can get those
numbers for write performance on a RAID-6 on our office server.  I
wonder what's making your SAN setup so slow?
Pre scriptum:
A few minutes ago I mailed detailed information in the same thread but as reply to an earlier response - it tells more about setup and gives results of a raid1+0 test.

I just have to react to "horrifically bad" and "slow" :-) : The HP san can do raid5 on 28 disks also on about 155MBps:

28 disks devided into 7 logical units with raid5, orion results are below. Please note that this time I did sequential large io. The mixed read/write MBps maximum here is comparable: around 155MBps.

regards,
Yeb Havinga


ORION VERSION 10.2.0.1.0

Commandline:
-run advanced -testname msa -num_disks 24 -size_small 4 -size_large 1024 -type seq -simulate concat -verbose -write 50 -duration 15 -matrix detailed -cache_size 256

This maps to this test:
Test: msa
Small IO size: 4 KB
Large IO size: 1024 KB
IO Types: Small Random IOs, Large Sequential Streams
Number of Concurrent IOs Per Stream: 4
Force streams to separate disks: No
Simulated Array Type: CONCAT
Write: 50%
Cache Size: 256 MB
Duration for each Data Point: 15 seconds
Small Columns:, 0, 1, 2, 3, 4, 5, 6, 12, 18, 24, 30, 36, 42, 48, 54, 60, 66, 72, 78, 84, 90, 96, 102, 108, 114, 120 Large Columns:, 0, 1, 2, 3, 4, 8, 12, 16, 20, 24, 28, 32, 36, 40, 44, 48
Total Data Points: 416

Name: /dev/sda1 Size: 109256361984
Name: /dev/sdb1 Size: 109256361984
Name: /dev/sdc1 Size: 109256361984
Name: /dev/sdd1 Size: 109256361984
Name: /dev/sde1 Size: 109256361984
Name: /dev/sdf1 Size: 109256361984
Name: /dev/sdg1 Size: 109256361984
7 FILEs found.

Maximum Large MBPS=157.75 @ Small=0 and Large=1
Maximum Small IOPS=3595 @ Small=66 and Large=1
Minimum Small Latency=2.81 @ Small=1 and Large=0

MBPS matrix

Large/Small, 0, 1, 2, 3, 4, 5, 6, 12, 18, 24, 30, 36, 42, 48, 54, 60, 66, 72, 78, 84, 90, 96, 102, 108, 114, 120 1, 157.75, 156.47, 153.56, 153.45, 144.87, 141.78, 140.60, 112.45, 95.23, 72.80, 80.59, 36.91, 29.76, 42.86, 41.82, 33.87, 34.07, 45.62, 42.97, 26.37, 42.85, 45.49, 44.47, 37.26, 45.67, 36.18 2, 137.58, 128.48, 125.78, 133.85, 120.12, 127.86, 127.05, 119.26, 121.23, 115.00, 117.88, 114.35, 108.61, 106.55, 83.50, 78.61, 92.67, 96.01, 44.02, 70.60, 62.84, 46.52, 69.18, 51.84, 57.19, 59.62 3, 143.10, 134.92, 139.30, 138.62, 137.85, 146.17, 140.41, 138.48, 76.00, 138.17, 123.48, 137.45, 126.51, 137.11, 91.94, 90.33, 129.97, 45.35, 115.92, 89.60, 137.22, 72.46, 89.95, 77.40, 119.17, 82.09 4, 138.47, 133.74, 129.99, 122.33, 126.75, 125.22, 132.30, 120.41, 125.88, 132.21, 96.92, 115.70, 131.65, 66.34, 114.06, 113.62, 116.91, 96.97, 98.69, 127.16, 116.67, 111.53, 128.97, 92.38, 118.14, 78.31 8, 126.59, 127.92, 115.51, 125.02, 123.29, 111.94, 124.31, 125.71, 134.48, 126.40, 127.93, 125.36, 121.75, 121.75, 127.17, 116.51, 121.44, 121.12, 112.32, 121.55, 127.93, 124.86, 118.04, 114.59, 121.72, 114.79 12, 112.40, 122.58, 107.61, 125.42, 128.04, 123.80, 127.17, 127.70, 122.37, 96.52, 115.36, 124.49, 124.07, 129.31, 124.62, 124.23, 105.58, 123.55, 115.67, 120.59, 125.61, 123.57, 121.43, 121.45, 121.44, 113.64 16, 108.88, 119.79, 123.80, 120.55, 120.02, 121.66, 125.71, 122.19, 125.77, 122.27, 119.55, 118.44, 120.51, 104.66, 97.55, 115.43, 101.45, 108.99, 122.30, 100.45, 105.82, 119.56, 121.26, 126.59, 119.54, 115.09 20, 103.88, 122.95, 115.86, 114.59, 121.13, 108.52, 116.90, 121.10, 113.91, 108.20, 111.51, 125.64, 117.57, 120.86, 117.66, 100.40, 104.88, 103.15, 98.10, 104.86, 104.69, 102.99, 121.81, 107.22, 122.68, 106.43 24, 102.64, 102.33, 112.95, 110.63, 108.00, 111.53, 124.33, 103.17, 108.16, 112.63, 97.42, 106.22, 102.54, 117.46, 100.66, 99.01, 104.46, 99.02, 116.02, 112.49, 119.05, 104.03, 102.40, 102.44, 111.15, 99.51 28, 101.12, 102.76, 114.14, 109.72, 120.63, 118.09, 119.85, 113.80, 116.58, 110.24, 101.45, 110.31, 116.06, 112.04, 121.63, 91.26, 98.88, 101.55, 104.51, 116.43, 112.98, 119.46, 120.08, 109.46, 106.29, 96.69 32, 103.41, 117.33, 101.33, 102.29, 102.58, 116.18, 107.12, 114.63, 121.84, 95.14, 108.83, 99.82, 103.11, 99.36, 117.80, 94.91, 103.46, 103.97, 117.35, 100.51, 100.18, 101.98, 118.26, 115.03, 100.45, 107.90 36, 99.90, 97.98, 100.94, 95.56, 118.76, 99.05, 114.02, 93.61, 117.68, 115.22, 114.40, 116.38, 100.38, 99.15, 108.66, 101.67, 106.64, 98.69, 111.99, 108.28, 99.62, 112.67, 118.80, 110.40, 118.86, 108.46 40, 101.51, 103.38, 93.73, 121.69, 106.27, 104.09, 110.81, 105.83, 95.81, 101.47, 105.96, 113.26, 103.61, 114.26, 100.49, 102.35, 111.44, 95.09, 103.02, 106.21, 104.39, 118.31, 96.73, 109.79, 103.71, 99.70 44, 101.17, 107.22, 107.50, 115.19, 104.16, 108.93, 101.62, 111.82, 110.66, 104.13, 109.68, 103.20, 92.04, 104.70, 102.30, 117.28, 106.37, 100.42, 107.81, 105.31, 110.21, 108.66, 116.05, 105.55, 100.64, 106.67 48, 101.00, 104.13, 114.00, 99.55, 107.46, 113.29, 114.32, 108.75, 100.11, 99.89, 104.81, 107.36, 102.93, 106.43, 101.98, 103.15, 101.30, 113.94, 103.07, 102.40, 95.38, 111.33, 93.89, 112.30, 103.58, 101.82

iops matrix

Large/Small, 1, 2, 3, 4, 5, 6, 12, 18, 24, 30, 36, 42, 48, 54, 60, 66, 72, 78, 84, 90, 96, 102, 108, 114, 120 0, 355, 639, 875, 1063, 1230, 1366, 1933, 2297, 2571, 2750, 2981, 3394, 3027, 3045, 3036, 3139, 3218, 3081, 3151, 3203, 3128, 3179, 3093, 3141, 3135 1, 37, 99, 144, 298, 398, 488, 1183, 1637, 2069, 2268, 2613, 2729, 2860, 2983, 3119, 3595, 3065, 3077, 3036, 3008, 3039, 3030, 3067, 3138, 3041 2, 22, 36, 44, 130, 112, 92, 271, 378, 579, 673, 903, 1091, 1131, 1735, 1612, 1809, 1236, 2316, 2302, 1410, 2467, 2526, 2692, 2606, 2625 3, 5, 13, 18, 21, 27, 27, 56, 92, 162, 196, 209, 239, 309, 595, 1551, 611, 2408, 1034, 488, 401, 1226, 1700, 2490, 1516, 2435 4, 8, 10, 33, 38, 53, 38, 137, 191, 165, 502, 369, 212, 1127, 654, 1069, 721, 643, 1046, 537, 803, 1093, 497, 1669, 1120, 1945 8, 3, 8, 6, 15, 24, 19, 61, 47, 90, 139, 109, 174, 184, 154, 261, 294, 289, 460, 338, 199, 425, 433, 633, 475, 599 12, 3, 7, 7, 10, 11, 12, 32, 74, 67, 91, 93, 120, 157, 158, 201, 191, 143, 220, 327, 217, 283, 276, 297, 336, 365 16, 2, 3, 6, 6, 10, 11, 27, 35, 56, 52, 80, 100, 89, 118, 102, 140, 178, 158, 174, 188, 185, 243, 168, 235, 249 20, 1, 3, 5, 6, 8, 11, 15, 30, 30, 54, 44, 70, 76, 87, 104, 79, 121, 115, 128, 135, 147, 158, 194, 184, 250 24, 1, 2, 4, 5, 8, 6, 14, 21, 29, 36, 42, 50, 58, 61, 70, 64, 85, 102, 117, 120, 111, 126, 129, 170, 159 28, 1, 2, 4, 3, 7, 7, 16, 19, 23, 30, 37, 51, 60, 58, 59, 65, 75, 76, 91, 83, 107, 103, 113, 120, 135 32, 1, 2, 3, 3, 6, 6, 12, 17, 19, 28, 30, 31, 32, 44, 49, 57, 53, 82, 87, 80, 84, 106, 106, 96, 93 36, 1, 2, 4, 5, 4, 7, 9, 15, 22, 27, 30, 32, 35, 43, 46, 48, 52, 67, 69, 54, 78, 87, 98, 92, 114 40, 0, 2, 2, 3, 4, 5, 12, 12, 16, 24, 25, 29, 35, 36, 42, 51, 45, 55, 60, 61, 71, 67, 72, 77, 67 44, 0, 2, 2, 3, 4, 4, 10, 12, 19, 20, 24, 24, 25, 32, 34, 40, 43, 58, 62, 60, 71, 75, 75, 68, 81 48, 0, 1, 2, 5, 4, 4, 10, 14, 16, 18, 21, 23, 27, 31, 34, 37, 44, 42, 54, 48, 59, 54, 69, 65, 67




--
Sent via pgsql-performance mailing list (pgsql-performance@xxxxxxxxxxxxxx)
To make changes to your subscription:
http://www.postgresql.org/mailpref/pgsql-performance

[Postgresql General]     [Postgresql PHP]     [PHP Users]     [PHP Home]     [PHP on Windows]     [Kernel Newbies]     [PHP Classes]     [PHP Books]     [PHP Databases]     [Yosemite]

  Powered by Linux