Re: OSD nodes with >=8 spinners, SSD-backed journals, and their performance impact

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



On 01/15/2013 03:31 AM, Gandalf Corvotempesta wrote:
2013/1/14 Mark Nelson <mark.nelson@xxxxxxxxxxx>:
The advice that I usually give people is that if performance is a big
concern, try to match filestore disk and journal performance is nearly
matched.  In my test setup, I use 1 intel 520 SSD to host 3 journals for
7200rpm enterprise SATA disks.  A 1:4 ratio or even 1:6 ratio may also work
fine depending on various factors.  So far the limits I've hit with very
minimal tuning seem to be around 15 spinning disks and 5 SSDs for around
1.4GB/s (2.8GB/s including journal writes) to one node.

Is this a ratio based on OSDs/SSDs or on OSDs/Server ?
For example, a server with 12 spinning disks plus 2 internal SSD should be used
for 12 OSDs. The first 6 will have journal on SSD1, the latest 6 will use SSD2.

In this case, ratio is 1:6, right?
Or are you referring to the whole server?


OSDS/SSD I think if I understand you correctly. Basically you just want to match OSD and Journal (and network) throughput to be relatively similar. That's not always easy given budgets and whether you are more interested in sequential throughput or IOPs.

I think the 12 bay supermicro 2U "A" chassis with 12 spinning disks, 10GbE, and two controllers is potentially a really nice balanced combination. You could go cheap controllers plus 2 fast SSDs (like 400-500MB/s seq) or more expensive controllers with WB cache and just use the 12 spinning disks for data and journals (and keep the rear drives for OS/logs/etc). Either could potentially be good solutions with slightly different performance characteristics.

Of course if you are going all out for IOPs, you probably would be looking at a somewhat different kind of solution anyway.

Mark
--
To unsubscribe from this list: send the line "unsubscribe ceph-devel" in
the body of a message to majordomo@xxxxxxxxxxxxxxx
More majordomo info at  http://vger.kernel.org/majordomo-info.html


[Index of Archives]     [CEPH Users]     [Ceph Large]     [Information on CEPH]     [Linux BTRFS]     [Linux USB Devel]     [Video for Linux]     [Linux Audio Users]     [Yosemite News]     [Linux Kernel]     [Linux SCSI]
  Powered by Linux