We are using Dell R730XD's with 2 x Internal SAS in Raid 1 for OS. 24 x
400GB SSD.
PERC H730P Mini is being used with non-RAID passthrough for the SSD's.
CPU and RAM specs aren't really needed to be known as you can do
whatever you want, however I would recommend minimum of 2 x quad's and
at least 48GB of RAM.
NICS are 4 x 10G (2 x 10 bonded for cluster, 2 x bonded for public).
Naturally, you have the 4 x 1G on-board too.
Performance is very good for us.
Coupled with CentOS 7, OMSA, Zabbix (custom scripts) and Ceph Dash; you
can get some nice metrics and real time alerting.
Cheers,
Matt.
On 10/02/2016 13:21, Alexandre DERUMIER wrote:
Hi,
I'm using dell r630 (8 disks, no expander backplane) with PERC H330 RAID Controller (supports for non-RAID passthrough)
Full ssd nodes, 2x raid1 (s3700 100GB) for os + mon, passthrough for 6x osd (intel s3610 1,6TB)
64GB ram, 2x intel E5-2687W v3 @ 3.10GHz (10C/20T)
H330 controller work very will with ssd (no NV cache). (benched 600k iops 4k read with 3 nodes)
----- Mail original -----
De: "Michael" <mabarkdoll@xxxxxxxxx>
À: "ceph-users" <ceph-users@xxxxxxxxxxxxxx>
Envoyé: Mardi 9 Février 2016 22:49:14
Objet: Dell Ceph Hardware recommendations
Hello,
I'm looking at purchasing Qty 3-4, Dell PowerEdge T630 or R730xd for my OSD
nodes in a Ceph cluster.
Hardware:
Qty x 1, E5-2630v3 2.4Ghz 8C/16T
128 GB DDR4 Ram
QLogic 57810 DP 10Gb DA/SFP+ Converged Network Adapter
I'm trying to determine which RAID controller to use, since I've read JBOD
is pretty suitable for software defined storage.
Raid Controllers options (series 9 controllers supposedly support JBOD,
http://www.dell.com/learn/us/en/04/campaigns/dell-raid-controllers):
PERC H330 RAID Controller (supports for non-RAID passthrough
configuration options)
PERC H730 RAID Controller (LSI SAS 3108), 1GB NV Cache Selected +$210.00
PERC H730P RAID Controller (LSI SAS 3108), 2GB NV Cache +$420.00
Dual PERC H730P RAID Controllers (LSI SAS 3108), 2GB NV Cache +$1235.30
PERC HBA330 12GB Controller Minicard -($12.90)
I was told by a Dell Technical Associate today the the H330 could support
12 disks and I'm currently leaning toward using it. Any suggestions on the
tradeoffs would be greatly appreciated.
As far as connected storage, I'm looking to use:
Intel S3700 128GB for every 4-6 Drives
HGST 7K4000 4 TB Drives, Qty x 12-16
---------------------
This would essentially mean that 4-5 HGST 7K4000 4 TB Drives per each OSD
node and one SSD for each node as well. We're looking for a basic Ceph
cluster that will allow us to virtualize a large number of (300-400) VMs
that are thinly provisioned. Any feedback from similar use cases, is much
appreciated. The Dell computers appear to have some type of plate in-
between the SAS connections and cables to the front of the hard drive hot
swap caddy area on my existing servers.. I'm not sure if this limits me in
my ability to swap out the H330 raid controller that is provided by Dell.
We have bulk pricing discounts through dell, though I'm open to other
options that work best for the Ceph deployment.
_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
