The daemons bind to *, so adding the 3rd interface to the machine will allow you to talk to the daemons on that IP.
I'm not really sure how you'd setup the management network though. I'd start by setting the ceph.conf public network on the management nodes to have the public network 10.0.2.0/24, and an /etc/hosts file with the monitor's names on the 10.0.2.0/24 network.
Make sure the management nodes can't route to the 10.0.1.0/24 network, and see what happens.
Do you really plan on having enough traffic creating and deleting RDB images that you need a dedicated network? It seems like setting up link aggregation on 10.0.1.0/24 would be simpler and less error prone.
On Thu, Dec 18, 2014 at 4:19 PM, Francois Lafont <flafdivers@xxxxxxx> wrote:
Hi,
Is it possible to have 2 different public networks in a Ceph cluster?
I explain my question below.
Currently, I have 3 identical nodes in my Ceph cluster. Each node has:
- only 1 monitor;
- n osds (we don't care about the value n here);
- and 3 interfaces.
One interface for the "cluster" network (10.0.0.0/24):
- node1 -> 10.0.0.1
- node2 -> 10.0.0.2
- node3 -> 10.0.0.3
One interface for the "public" network (10.0.1.0/24):
- node1 -> [mon.1] mon addr = 10.0.1.1
- node2 -> [mon.2] mon addr = 10.0.1.2
- node3 -> [mon.3] mon addr = 10.0.1.3
And one interface not used yet (see below).
With this configuration, if I have a Ceph client in the
"public" network, I can use rbd images etc. No problem,
it works.
But now I would like to use the third interface of the
nodes for a *different* plublic network -> 10.0.2.0/24.
The Ceph clients in this network will not really use the
storage but will create and delete rbd images in a pool.
In fact it's just a network for *Ceph management*.
So, I want to have 2 different public networks:
- 10.0.1.0/24 (already exists)
- *and* 10.0.2.0/24
Am I wrong if I say that mon.1, mon.2 and mon.3
must have one more IP address? Is it possible to
have a monitor that listens on 2 addresses? Something
like that:
- node1 -> [mon.1] mon addr = 10.0.1.1 *and* 10.0.2.1
- node2 -> [mon.2] mon addr = 10.0.1.2 *and* 10.0.2.2
- node3 -> [mon.3] mon addr = 10.0.1.3 *and* 10.0.2.3
My environment is not a production environment, just a
lab. So, if necessary I can reinstall everything, no
problem.
Thanks for your help.
--
François Lafont
_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
_______________________________________________ ceph-users mailing list ceph-users@xxxxxxxxxxxxxx http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
