RE: Correct RAID options

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



OK - sorry but I will have to get someone else to chip in re the XFS situation.

I would say though that is sounds like you are painting yourself into a very tight corner and you might want to find a Hosted site that offers more options than you appear to have available.

Craig

-----Original Message-----
From: cknipe@xxxxxxxxxxxxx [mailto:cknipe@xxxxxxxxxxxxx] On Behalf Of Chris Knipe
Sent: Wednesday, 20 August 2014 1:06 PM
To: Craig Curtin
Cc: linux-raid@xxxxxxxxxxxxxxx
Subject: Re: Correct RAID options

On Wed, Aug 20, 2014 at 4:38 AM, Craig Curtin <craigc@xxxxxxxxxxxxx> wrote:

> I assume that your application will handle it OK if the Archive is offline ? I understand you have throughput issues now, but if you lose the RAID5 setup it is going to take a long time to recover really need to rebuild that as RAID6 ASAP - particularly if it is only under light load now.

Correct.  I will however lose data as I would need to delete old data off the front end servers instead of archiving it in order not run out of disk space (which will be catastrophic).  It's not an ideal situation, but it's not a major loss either at this point in time.  Up to a day or three ago, we deleted anyways.  So yes, I am more than likely trashing the archive server and rebuilding it (or not using it at all and rather expanding on the front end servers - against my better judgement).


> Now that you have clarified what your servers are and how they are performing - I would suggest another option would be an external SATA storage system - for cost you can not go past the Promise equipment. You could whack additional SATA drives in one of these on your front end servers (they have models with different connection options - ESATA, SAS, FC etc etc) and this would give you more space on the front end as well as more spindles to handle the writing etc - it would also give you the ability to mess around with different file systems etc.

I really don't want to be a PITA, but these are leased servers (sorry if I haven't been clear). We do not even have physical access to the servers, frankly, they are half way around the world from where I am
:-)  Hardware changes in any way or form is not going to happen.  The provider is simply not going to play - we've tried before. We've tried so badly before that it was easier / quicker to cancel a server and order a new one, instead of having them fix something.  Yes, it's sad, but that's what is there and that's unfortunately the way it currently is.

I really do not need a 'blue sky' here.  I know what I am doing is
-insanely- resource intensive and frankly speaking, I am -amazed- at how well these front end servers are coping up to now.  There are limits, and sure we are hitting those limits.  The question really is what can be done to achieve the best performance with what we have?
RAID10/EXT4 isn't working now that we are reading and writing extensively at the same time - it was more than likely a bad / uneducated / inexperienced choice.  I understand that, I accept that.

Will XFS give any amount of reasonable increases in performance to justify a format / reinstall (let's forget about backups and downtime now), or would the only viable option be the expensive one, and get more servers (touch wood - the load balancers thankfully are nowhere near max capacity)?  I don't have the experience or the tools to properly bench servers simulating our current IO load, so I'm really hoping that someone more experienced will be able to chip in here with some definitive answers (if that is even possible).  If what I have currently is as good as it is going to, reasonably, get then so be it as well.  If that's the case I have no option but to increase the amount of front end servers and I can close my eyes and accept that too.

--
Chris.

Disclaimer

CONFIDENTIAL

This message contains confidential information and is intended only for the intended recipients. If you are not the named addressee you should not disseminate, distribute or copy this e-mail. Please notify the sender immediately by e-mail if you have received this e-mail by mistake and delete this e-mail from your system.

Disclaimer

CONFIDENTIAL

This message contains confidential information and is intended only for the intended recipients. If you are not the named addressee you should not disseminate, distribute or copy this e-mail. Please notify the sender immediately by e-mail if you have received this e-mail by mistake and delete this e-mail from your system.
��.n��������+%������w��{.n�����{����w��ܨ}���Ơz�j:+v�����w����ޙ��&�)ߡ�a����z�ޗ���ݢj��w�f





[Index of Archives]     [Linux RAID Wiki]     [ATA RAID]     [Linux SCSI Target Infrastructure]     [Linux Block]     [Linux IDE]     [Linux SCSI]     [Linux Hams]     [Device Mapper]     [Device Mapper Cryptographics]     [Kernel]     [Linux Admin]     [Linux Net]     [GFS]     [RPM]     [git]     [Yosemite Forum]


  Powered by Linux