Hi Christian, Am 13.04.15 um 12:54 schrieb Christian Balzer: > > Hello, > > On Mon, 13 Apr 2015 11:03:24 +0200 Götz Reinicke - IT Koordinator wrote: > >> Dear ceph users, >> >> we are planing a ceph storage cluster from scratch. Might be up to 1 PB >> within the next 3 years, multiple buildings, new network infrastructure >> for the cluster etc. <...> > So at your storage node density of 12 HDDs (16 HDD chassis are not space > efficient), 40GbE is overkill with a single link/network, insanely so with > 2 networks. What would you think, if we go with 20 OSDs, may be 22 OSd (24 HDD chassis with 2 or 4 SSD (OS / Journal)) From the "Questions about an example of ceph infrastructure" topic ! got the calculation of HDDs x expected spped per disk = Max Performance => 20 x 70 MB/s = 1400 MB/s ie 1.4 GB/s => 14 Gb/s redundant => 28 Gb/s I like the suggestion from Robert LeBlanc, using two 40Gb ports with VLANs. Currently we have to extend our LAN anyway, all 10Gb ports are in use. Upgrading 10Gb ports costs more than buying new 10Gb hardware in our case. (Good old Cisco 6500 vs. modern 4500x challenge :) ) Furthermore we will see a lot of more traffic and requirements regarding speed within next year and than an other rise within the next 5 years. (e.g. 4K/8K video realtime playback for some workstations. 4K is about 9 Gb/s ! per Workstation.) Long story short, we have/will/should/and can start with 40Gb. The question is how big :) I'd say, after some more internal discussions to, redundant switches are mandatory in our case, and the 40Gb-VLANs a good balance regarding redundancy, cost and performance. Thumbs up or down, your vote :D. Seriously what you think? Thanks for your feedback and best regards . Götz -- Götz Reinicke IT-Koordinator Tel. +49 7141 969 82 420 E-Mail goetz.reinicke@xxxxxxxxxxxxxxx Filmakademie Baden-Württemberg GmbH Akademiehof 10 71638 Ludwigsburg www.filmakademie.de Eintragung Amtsgericht Stuttgart HRB 205016 Vorsitzender des Aufsichtsrats: Jürgen Walter MdL Staatssekretär im Ministerium für Wissenschaft, Forschung und Kunst Baden-Württemberg Geschäftsführer: Prof. Thomas Schadt
Attachment:
smime.p7s
Description: S/MIME Cryptographic Signature
_______________________________________________ ceph-users mailing list ceph-users@xxxxxxxxxxxxxx http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
