It's funny cause in my mind, such dense servers seems like a bad idea to me for exactly the reason you mention, what if it fails. Losing 400+TB of storage is going to have quite some impact, 40G interfaces or not and no matter what options you tweak. Sure it'll be cost effective per TB, but that isn't the only aspect to look at (for production use anyways). But I'd also be curious about real world feedback. Cheers Kris The 09/03/2015 16:01, Gurvinder Singh wrote: > Hi, > > I am wondering if anybody in the community is running ceph cluster with > high density machines e.g. Supermicro SYS-F618H-OSD288P (288 TB), > Supermicro SSG-6048R-OSD432 (432 TB) or some other high density > machines. I am assuming that the installation will be of petabyte scale > as you would want to have at least 3 of these boxes. > > It would be good to hear their experiences in terms of reliability, > performance (specially during node failures). As these machines have > 40Gbit network connection it can be ok, but experience from real users > would be great to hear. As these are mentioned in the reference > architecture published by red hat and supermicro. > > Thanks for your time. > _______________________________________________ > ceph-users mailing list > ceph-users@xxxxxxxxxxxxxx > http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com De informatie verzonden met dit e-mailbericht is uitsluitend bestemd voor de geadresseerde. Gebruik van deze informatie door anderen dan de geadresseerde is uitdrukkelijk verboden. Indien u dit bericht per vergissing heeft ontvangen, verzoeken wij u ons onmiddelijk hiervan op de hoogte te stellen en het bericht te vernietigen. Openbaarmaking, vermenigvuldiging, verspreiding en/of verstrekking van deze informatie aan derden is niet toegestaan. Bol.com b.v. staat niet in voor de juiste en volledige overbrenging van de inhoud van een verzonden e-mail, noch voor tijdige ontvangst daarvan en aanvaardt geen aansprakelijkheid in dezen. The information contained in this communication is confidential and may be legally privileged. It is intended solely for the use of the individual or entity to whom it is addressed and others authorised to receive it. If you are not the intended recipient please notify the sender and destroy this message. Any disclosure, copying, distribution or taking any action in reliance on the contents of this information is strictly prohibited and may be unlawful. Bol.com b.v. is neither liable for the proper and complete transmission of the information contained in this communication nor for delay in its receipt. _______________________________________________ ceph-users mailing list ceph-users@xxxxxxxxxxxxxx http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com