Hello, thank you very much for advices. Now I have two public networks. I've tried to set cluster to use both public addresses, but I've not successful. # ceph config global public_network 192.168.1.0/24,192.168.2.0/24 # ceph config mon public_network 192.168.1.0/24,192.168.2.0/24 - everythink OK, when I've tried 'ceph config dump', I see this values are set. But when I tried reboot monitor on the first machine, I see, that it is bound only on one interface: # netstat -tpln tcp 0 0 192.168.1.180:3300 0.0.0.0:* LISTENING 745299/ceph-mon ... I've tried to remove mon on this host, and then recreate it: # ceph orch rm mon.host1 --force then: # ceph orch add mon host1:192.168.2.0/24,192.168.1.0/24 - this didn't work, complain about non-allowed characters # ceph orch add mon host1:192.168.2.0/24 - this run monitor _only_ on interface 192.168.2.180 # ceph orch add mon host1:0.0.0.0 - this didn't complain, but it didn't run mon on host1 at all # ceph orch add mon host1 - run only on the first network. How I can bind mon daemon to both of public interfaces? Update - I've found it: # ceph orch daemon add mon --placement="host1:[v2:192.168.1.180:3300,v2:192.168.2.180:3300,v1:192.168.1.180:6789,v1:192.168.2.180:6789]=host1" Ufff! It is not very easy to set, by the way... And the second: There is not connection on cluster network - it cannot be made, because daemons are bound only on public network!!! And another questions: Is command: # ceph orch daemon add mon --placement="host1:[v2:192.168.1.180:3300,v2:192.168.2.180:3300,v1:192.168.1.180:6789,v1:192.168.2.180:6789]=host1" "compatible" with: # ceph orch apply mon ? Because when I've tried: # ceph orch ps I've not mon.host1 in listing and mon.host1 is in the stray daemons? :-( And how it can be written in YAML file for ceph orch apply? Sincerely Jna Marek Dne Po, lis 28, 2022 at 02:36:11 CET napsal Jan Marek: > Hello, > > I have a CEPH cluster with 3 MONs and 6 OSD nodes with 72 OSDs. > > I would like to have multiple client and backed networks. I have > now 2x 10Gbps and 2x25Gbps NIC in the nodes and my idea is to > have: > > - 2 client network, for example 192.168.1.0/24 on 10Gbps NICs and > 192.168.2.0/24 on 25Gbps NICs. One for my clients, one for asynchronous > syncing to another cluster > > - 2 backend networks, say 10.0.1.0/24 on 10Gbps NICs and > 10.0.2.0/24 on 25Gbps NICs to have multiple backend paths and/or > more throughput. > > Is this scenario real? If my clients will be on 192.168.1.0/24 > network, will mon give them a addresses of OSD nodes from > 192.168.1.0/24 network, or it will give them addresses randomly? > > Please, have someone advice, how to set this networking > optimally? > > Thanks a lot. > > Sincerely > Jan Marek > -- > Ing. Jan Marek > University of South Bohemia > Academic Computer Centre > Phone: +420389032080 > http://www.gnu.org/philosophy/no-word-attachments.cs.html > _______________________________________________ > ceph-users mailing list -- ceph-users@xxxxxxx > To unsubscribe send an email to ceph-users-leave@xxxxxxx -- Ing. Jan Marek University of South Bohemia Academic Computer Centre Phone: +420389032080 http://www.gnu.org/philosophy/no-word-attachments.cs.html
_______________________________________________ ceph-users mailing list -- ceph-users@xxxxxxx To unsubscribe send an email to ceph-users-leave@xxxxxxx
