RE: Looking for the cause of poor I/O performance

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



My disks...
My system has 14 disk drives.  At 65Meg per second they are only doing about
5 meg per second each.  6 of the disks are on a 40MB/second SCSI bus, this
limits my overall speed.  During a re-sync I get about 6 Meg/second per
disk.

My system...
2 CPUs help.  It's a Dell.  :)  It is what they call a workstation.  The
chipset is Intel 440BX (going from memory, so not 100% sure).  In its day it
was a high end system.  It has SD ram.  100 Mhz system bus.  All memory
slots are full with the same size DIMMs, so it can interleave if the chipset
supports that.  The chipset has 3 PCI buses.  Since my overall speed is not
exceeding the speed of 1 PCI bus, I don't think this helps me, but maybe it
does.  Everything is SCSI, I don't know if that helps.  My disks are on 3
different SCSI busses, 2 Adaptec cards and 1 built-in Adaptec chipset.

This may help, it is a Dell Precision Workstation 410.
http://support.dell.com/support/edocs/systems/deqkmt/specs.htm

If my system is so much faster because of the motherboard design, then cool!
I did not know motherboard design could make such a difference.

The test "hdparm -tT /dev/md2" used about 35% of both CPU's.  The test is so
quick it is hard to be sure about the cpu load.  I have 17 disks overall, so
I tried hdparm of all of my disks at the same time.  This uses 100% of my
CPUs.  I don't understand how this can report such high speeds on my 6 disks
on the slow SCSI bus.
Timing buffer-cache reads:
128 MB in 11.18 seconds = 11.45 MB/sec
128 MB in 11.03 seconds = 11.60 MB/sec
128 MB in 10.97 seconds = 11.67 MB/sec
128 MB in 10.91 seconds = 11.73 MB/sec
128 MB in 11.43 seconds = 11.20 MB/sec
128 MB in 11.37 seconds = 11.26 MB/sec
128 MB in 11.35 seconds = 11.28 MB/sec
128 MB in 11.37 seconds = 11.26 MB/sec
128 MB in 11.45 seconds = 11.18 MB/sec
128 MB in 11.97 seconds = 10.69 MB/sec
128 MB in 11.78 seconds = 10.87 MB/sec
128 MB in 11.99 seconds = 10.68 MB/sec
128 MB in 12.26 seconds = 10.44 MB/sec
128 MB in 12.18 seconds = 10.51 MB/sec
128 MB in 11.84 seconds = 10.81 MB/sec
128 MB in 11.84 seconds = 10.81 MB/sec
128 MB in 12.43 seconds = 10.30 MB/sec

Timing buffered disk reads:
64 MB in  9.42 seconds =  6.79 MB/sec
64 MB in  9.62 seconds =  6.65 MB/sec
64 MB in  9.95 seconds =  6.43 MB/sec
64 MB in  9.71 seconds =  6.59 MB/sec
64 MB in 10.17 seconds =  6.29 MB/sec
64 MB in 11.00 seconds =  5.82 MB/sec
64 MB in 11.45 seconds =  5.59 MB/sec
64 MB in 10.81 seconds =  5.92 MB/sec
64 MB in 11.20 seconds =  5.71 MB/sec
64 MB in 11.57 seconds =  5.53 MB/sec
64 MB in 10.89 seconds =  5.88 MB/sec
64 MB in 11.73 seconds =  5.46 MB/sec
64 MB in 11.27 seconds =  5.68 MB/sec
64 MB in 11.20 seconds =  5.71 MB/sec
64 MB in 12.18 seconds =  5.25 MB/sec
64 MB in 11.41 seconds =  5.61 MB/sec
64 MB in 11.91 seconds =  5.37 MB/sec

This is from a single disk:
Timing buffer-cache reads:   128 MB in  0.87 seconds =147.13 MB/sec
Timing buffered disk reads:  64 MB in  3.51 seconds = 18.23 MB/sec

When I test a single disk, they all perform about the same.

A single disk "buffer-cache" performs better than any of my SCSI buses.  I
have 2 at 80 Meg/sec and 1 at 40 Meg/sec.  The speed exceeds the speed of
the PCI bus.  Ok, I understand.  I was thinking buffer-cache was the disk
drive's on-board cache, but buffer-cache is the Linux disk cache.  I think!
Now I wonder why it is so slow!  :)

Anyway, I hope I gave you too much information!  :)

Guy

-----Original Message-----
From: TJ [mailto:systemloc@xxxxxxxxxxxxx] 
Sent: Saturday, December 04, 2004 10:24 AM
To: linux-raid@xxxxxxxxxxxxxxx
Cc: Guy
Subject: Re: Looking for the cause of poor I/O performance

On Thursday 02 December 2004 10:54 pm, Guy wrote:
> My linux system is a P3-500 with 2 CPUs and 512 Meg RAM.  My system is
much
> faster than my network.  I don't know how your K6-500 compares to my
> P3-500. 

> My array gives about 60MB /second.

Now I'm extremely curious to know why your box does so much better than
mine. 
Does the bus run at 100? 133? I'm guessing it's SDRAM, not DDR. Also, does
it 
have a stock PCI bus, or something special?

TJ Harrell

-
To unsubscribe from this list: send the line "unsubscribe linux-raid" in
the body of a message to majordomo@xxxxxxxxxxxxxxx
More majordomo info at  http://vger.kernel.org/majordomo-info.html

[Index of Archives]     [Linux RAID Wiki]     [ATA RAID]     [Linux SCSI Target Infrastructure]     [Linux Block]     [Linux IDE]     [Linux SCSI]     [Linux Hams]     [Device Mapper]     [Device Mapper Cryptographics]     [Kernel]     [Linux Admin]     [Linux Net]     [GFS]     [RPM]     [git]     [Yosemite Forum]


  Powered by Linux