Re: Ceph networking

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



Hello,

thank you very much for advices.

Now I have two public networks.

I've tried to set cluster to use both public addresses, but I've
not successful.

# ceph config global public_network 192.168.1.0/24,192.168.2.0/24

# ceph config mon public_network 192.168.1.0/24,192.168.2.0/24

- everythink OK, when I've tried 'ceph config dump', I see this
values are set.

But when I tried reboot monitor on the first machine, I see, that
it is bound only on one interface:

# netstat -tpln
tcp        0      0 192.168.1.180:3300      0.0.0.0:* LISTENING  745299/ceph-mon
...


I've tried to remove mon on this host, and then recreate it:

# ceph orch rm mon.host1 --force

then:

# ceph orch add mon host1:192.168.2.0/24,192.168.1.0/24
- this didn't work, complain about non-allowed characters

# ceph orch add mon host1:192.168.2.0/24
- this run monitor _only_ on interface 192.168.2.180

# ceph orch add mon host1:0.0.0.0
- this didn't complain, but it didn't run mon on host1 at all

# ceph orch add mon host1
- run only on the first network.

How I can bind mon daemon to both of public interfaces?

Update - I've found it:

# ceph orch daemon add mon --placement="host1:[v2:192.168.1.180:3300,v2:192.168.2.180:3300,v1:192.168.1.180:6789,v1:192.168.2.180:6789]=host1"

Ufff!

It is not very easy to set, by the way...

And the second: There is not connection on cluster network - it
cannot be made, because daemons are bound only on public
network!!!

And another questions:

Is command:

# ceph orch daemon add mon --placement="host1:[v2:192.168.1.180:3300,v2:192.168.2.180:3300,v1:192.168.1.180:6789,v1:192.168.2.180:6789]=host1"

"compatible" with:

# ceph orch apply mon ?

Because when I've tried:

# ceph orch ps

I've not mon.host1 in listing and mon.host1 is in the stray daemons? :-(

And how it can be written in YAML file for ceph orch apply?

Sincerely
Jna Marek

Dne Po, lis 28, 2022 at 02:36:11 CET napsal Jan Marek:
> Hello,
> 
> I have a CEPH cluster with 3 MONs and 6 OSD nodes with 72 OSDs.
> 
> I would like to have multiple client and backed networks. I have
> now 2x 10Gbps and 2x25Gbps NIC in the nodes and my idea is to
> have:
> 
> - 2 client network, for example 192.168.1.0/24 on 10Gbps NICs and
> 192.168.2.0/24 on 25Gbps NICs. One for my clients, one for asynchronous
> syncing to another cluster
> 
> - 2 backend networks, say 10.0.1.0/24 on 10Gbps NICs and
> 10.0.2.0/24 on 25Gbps NICs to have multiple backend paths and/or
> more throughput.
> 
> Is this scenario real? If my clients will be on 192.168.1.0/24
> network, will mon give them a addresses of OSD nodes from
> 192.168.1.0/24 network, or it will give them addresses randomly?
> 
> Please, have someone advice, how to set this networking
> optimally?
> 
> Thanks a lot.
> 
> Sincerely
> Jan Marek
> -- 
> Ing. Jan Marek
> University of South Bohemia
> Academic Computer Centre
> Phone: +420389032080
> http://www.gnu.org/philosophy/no-word-attachments.cs.html


> _______________________________________________
> ceph-users mailing list -- ceph-users@xxxxxxx
> To unsubscribe send an email to ceph-users-leave@xxxxxxx


-- 
Ing. Jan Marek
University of South Bohemia
Academic Computer Centre
Phone: +420389032080
http://www.gnu.org/philosophy/no-word-attachments.cs.html
_______________________________________________
ceph-users mailing list -- ceph-users@xxxxxxx
To unsubscribe send an email to ceph-users-leave@xxxxxxx

[Index of Archives]     [Information on CEPH]     [Linux Filesystem Development]     [Ceph Development]     [Ceph Large]     [Ceph Dev]     [Linux USB Development]     [Video for Linux]     [Linux Audio Users]     [Yosemite News]     [Linux Kernel]     [Linux SCSI]     [xfs]


  Powered by Linux