Re: unbelievably bad performance: 2.6.27.37 and raid6

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



Jon Nelson wrote:
I have a 4 disk raid6. The disks are individually capable of (at
least) 75MB/s on average.
The raid6 looks like this:

md0 : active raid6 sda4[0] sdc4[5] sdd4[4] sdb4[6]
      613409536 blocks super 1.1 level 6, 64k chunk, algorithm 2 [4/4] [UUUU]

The raid serves basically as an lvm physical volume.

While rsyncing a file from an ext3 filesystem to a jfs filesystem, I
am observing speeds in the 10-15MB/s range.
That seems really really slow.

It is really slow, recent kernels seem to be unsuitable for use as large file servers, as the performance is, as you described it, "unbelievably bad."
Using vmstat, I see similar numbers (I'm averaging a bit, I'll see
lows of 6MB/s and highs of 18-20MB/s, but these are infrequent.)
The system is, for the most part, otherwise unloaded.

I looked at stripe_cache_size and increased it to 384 - no difference.
blockdev --getra reports 256 for all involved raid components.
I'm using the deadline I/O scheduler.

Push is to 8192 or so (assuming enough memory), but pretty much minimal improvement. I don't know what problems were solved in recent kernels, but they are simply not worth the 300% loss of performance. Linux has been getting slower over time as features were added, and faster hardware has overcome the issues, but this one needs SSD to make the server useful, and I can't afford it.

Am I crazy?  Is 12.5MB/s (average) what I should expect, here?  What
might I look at here?



--
Bill Davidsen <davidsen@xxxxxxx>
 Unintended results are the well-earned reward for incompetence.

--
To unsubscribe from this list: send the line "unsubscribe linux-raid" in
the body of a message to majordomo@xxxxxxxxxxxxxxx
More majordomo info at  http://vger.kernel.org/majordomo-info.html

[Index of Archives]     [Linux RAID Wiki]     [ATA RAID]     [Linux SCSI Target Infrastructure]     [Linux Block]     [Linux IDE]     [Linux SCSI]     [Linux Hams]     [Device Mapper]     [Device Mapper Cryptographics]     [Kernel]     [Linux Admin]     [Linux Net]     [GFS]     [RPM]     [git]     [Yosemite Forum]


  Powered by Linux