Re: Proper Ceph network configuration

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 




On 23-10-15 14:58, Jon Heese wrote:
> Hello,
> 
>  
> 
> We have two separate networks in our Ceph cluster design:
> 
>  
> 
> 10.197.5.0/24 - The "front end" network, "skinny pipe", all 1Gbe,
> intended to be a management or control plane network
> 
> 10.174.1.0/24 - The "back end" network, "fat pipe", all OSD nodes use 2x
> bonded 10Gbe, intended to be the data network
> 
>  
> 
> So we want all of the OSD traffic to go over the "back end", and the MON
> traffic to go over the "front end".  We thought the following would do that:
> 
>  
> 
> public network = 10.197.5.0/24   # skinny pipe, mgmt & MON traffic
> 
> cluster network = 10.174.1.0/24  # fat pipe, OSD traffic
> 
>  
> 
> But that doesn't seem to be the case -- iftop and netstat show that
> little/no OSD communication is happening over the 10.174.1 network and
> it's all happening over the 10.197.5 network.
> 
>  
> 
> What configuration should we be running to enforce the networks per our
> design?  Thanks!
> 
> 

Do the OSD nodes have a IP in 10.174.1.0/24? And are you sure this is in
ceph.conf?

What does 'ip a' show on the OSD nodes?


> 
> /Jon Heese/
> /Systems Engineer/
> *INetU Managed Hosting*
> P: 610.266.7441 x 261
> F: 610.266.7434
> www.inetu.net <https://www.inetu.net>
> 
> /** This message contains confidential information, which also may be
> privileged, and is intended only for the person(s) addressed above. Any
> unauthorized use, distribution, copying or disclosure of confidential
> and/or privileged information is strictly prohibited. If you have
> received this communication in error, please erase all copies of the
> message and its attachments and notify the sender immediately via reply
> e-mail. **/
> 
> 
> 
> _______________________________________________
> ceph-users mailing list
> ceph-users@xxxxxxxxxxxxxx
> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
> 
_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com



[Index of Archives]     [Information on CEPH]     [Linux Filesystem Development]     [Ceph Development]     [Ceph Large]     [Ceph Dev]     [Linux USB Development]     [Video for Linux]     [Linux Audio Users]     [Yosemite News]     [Linux Kernel]     [Linux SCSI]     [xfs]


  Powered by Linux