Hi, I'm using dell r630 (8 disks, no expander backplane) with PERC H330 RAID Controller (supports for non-RAID passthrough) Full ssd nodes, 2x raid1 (s3700 100GB) for os + mon, passthrough for 6x osd (intel s3610 1,6TB) 64GB ram, 2x intel E5-2687W v3 @ 3.10GHz (10C/20T) H330 controller work very will with ssd (no NV cache). (benched 600k iops 4k read with 3 nodes) ----- Mail original ----- De: "Michael" <mabarkdoll@xxxxxxxxx> À: "ceph-users" <ceph-users@xxxxxxxxxxxxxx> Envoyé: Mardi 9 Février 2016 22:49:14 Objet: Dell Ceph Hardware recommendations Hello, I'm looking at purchasing Qty 3-4, Dell PowerEdge T630 or R730xd for my OSD nodes in a Ceph cluster. Hardware: Qty x 1, E5-2630v3 2.4Ghz 8C/16T 128 GB DDR4 Ram QLogic 57810 DP 10Gb DA/SFP+ Converged Network Adapter I'm trying to determine which RAID controller to use, since I've read JBOD is pretty suitable for software defined storage. Raid Controllers options (series 9 controllers supposedly support JBOD, http://www.dell.com/learn/us/en/04/campaigns/dell-raid-controllers): PERC H330 RAID Controller (supports for non-RAID passthrough configuration options) PERC H730 RAID Controller (LSI SAS 3108), 1GB NV Cache Selected +$210.00 PERC H730P RAID Controller (LSI SAS 3108), 2GB NV Cache +$420.00 Dual PERC H730P RAID Controllers (LSI SAS 3108), 2GB NV Cache +$1235.30 PERC HBA330 12GB Controller Minicard -($12.90) I was told by a Dell Technical Associate today the the H330 could support 12 disks and I'm currently leaning toward using it. Any suggestions on the tradeoffs would be greatly appreciated. As far as connected storage, I'm looking to use: Intel S3700 128GB for every 4-6 Drives HGST 7K4000 4 TB Drives, Qty x 12-16 --------------------- This would essentially mean that 4-5 HGST 7K4000 4 TB Drives per each OSD node and one SSD for each node as well. We're looking for a basic Ceph cluster that will allow us to virtualize a large number of (300-400) VMs that are thinly provisioned. Any feedback from similar use cases, is much appreciated. The Dell computers appear to have some type of plate in- between the SAS connections and cables to the front of the hard drive hot swap caddy area on my existing servers.. I'm not sure if this limits me in my ability to swap out the H330 raid controller that is provided by Dell. We have bulk pricing discounts through dell, though I'm open to other options that work best for the Ceph deployment. _______________________________________________ ceph-users mailing list ceph-users@xxxxxxxxxxxxxx http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com _______________________________________________ ceph-users mailing list ceph-users@xxxxxxxxxxxxxx http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com