Re: Public network faster than cluster network

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



On Wed, 09 May 2018 20:46:19 +0000 Gandalf Corvotempesta wrote:

> As subject, what would happen ?
>

This cosmic imbalance would clearly lead to the end of the universe. 

Seriously, think it through, what do you _think_ will happen?

Depending on the actual networks in question, the configuration and
capabilities of your servers/OSDs and your clients the answer for a
typical use case may be "nothing much".

Though a slower cluster network usually implies higher latencies and
_that_ part would hurt you more for smallish IOPS than any bandwidth
differences.

Again, you need to be more specific to get useful answers here.
For example a cluster with nodes that have 8 HDDs, a 10Gb/s cluster and a
25Gb/s public network. A single node can't even saturate the cluster
network so the "nothing much" answer applies. 

If you change the speeds to 1Gb/s and 10Gb/s respectively you're now
limited to the 100MB/s speed of the cluster network during large writes
and recovery/rebalancing traffic. 
But with a typical VMs on RBD use case you're unlikely to run into that
limitation and will be more hobbled by the significantly larger latencies
introduced by the 1Gb/s links. 

Lastly, more often than not segregated networks are not needed, add
unnecessary complexity and the resources spent on them would be better
used to have just one fast and redundant network instead. 

Christian
-- 
Christian Balzer        Network/Systems Engineer                
chibi@xxxxxxx   	Rakuten Communications
_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com



[Index of Archives]     [Information on CEPH]     [Linux Filesystem Development]     [Ceph Development]     [Ceph Large]     [Ceph Dev]     [Linux USB Development]     [Video for Linux]     [Linux Audio Users]     [Yosemite News]     [Linux Kernel]     [Linux SCSI]     [xfs]


  Powered by Linux