Re: Change OSD Address after IB/Ethernet switch

[Dominik Baack <dominik.baack@xxxxxxxxxxxxxxxxxx>]

Hi,

> min_mon_release 17 (quincy)
> election_strategy: 1
> 0: [v2:129.217.31.189:3300/0,v1:129.217.31.189:6789/0] mon.ml2rsn06
> 1: [v2:129.217.31.186:3300/0,v1:129.217.31.186:6789/0] mon.ml2rsn03
> 2: [v2:129.217.31.188:3300/0,v1:129.217.31.188:6789/0] mon.ml2rsn05
> 3: [v2:129.217.31.190:3300/0,v1:129.217.31.190:6789/0] mon.ml2rsn07
> dumped monmap epoch 21

seems fine for me (with the exception that there is an even number of mons).

> ceph osd metadata 18
>
>  "back_addr": 
> "[v2:129.217.31.173:6817/1187092418,v1:129.217.31.173:6819/1187092418]",

Still shows an old address after restarting of ceph.target.


Cheers
Dominik

Am 19.12.2022 um 09:24 schrieb Eugen Block:
> If you did it "the right way" then 'ceph mon dump' should reflect the 
> changes. Does that output show the new IP addresses?
>
>
> Zitat von Dominik Baack <dominik.baack@xxxxxxxxxxxxxxxxxx>:
>
> > Hi,
> >
> > I removed/added the new mons as explained in:
> >
> > https://docs.ceph.com/en/latest/rados/operations/add-or-rm-mons/#changing-a-monitor-s-ip-address-the-right-way 
> >
> >
> > but did not change the mon map manually.
> >
> >
> > I can retry the manual way as well and report afterwards:
> >
> > https://docs.ceph.com/en/latest/rados/operations/add-or-rm-mons/#changing-a-monitor-s-ip-address-the-messy-way 
> >
> >
> >
> > Cheers
> > Dominik Baack
> >
> >
> > Am 17.12.2022 um 10:06 schrieb Eugen Block:
> > > Hi,
> > >
> > > did you also change the monmap as described in the docs [1]? There 
> > > have been multiple threads in this list with the same topic. Simply 
> > > changing the IP address of the MONs is not sufficient, but after 
> > > fixing the monmap the OSDs should connect successfully.
> > >
> > > [1] 
> > > https://docs.ceph.com/en/quincy/rados/operations/add-or-rm-mons.html
> > >
> > > Zitat von Dominik Baack <dominik.baack@xxxxxxxxxxxxxxxxxx>:
> > >
> > > > Hi,
> > > >
> > > > we have switched our network from IP over IB to an Ethernet 
> > > > configuration.
> > > >
> > > > I could move the mons over to the new address range and they 
> > > > connect into the cluster network. The OSD create more of a problem, 
> > > > even after setting
> > > >
> > > > public_network129.217.31.176/29
> > > > cluster_network 129.217.31.184/29
> > > >
> > > > to their values and restarting ceph.target on all nodes but they 
> > > > still report the wrong information when checked with ceph osd 
> > > > metadata :
> > > >
> > > > back_addr
> > > > front_addr
> > > > hb_back_addr
> > > > hb_front_addr
> > > >
> > > > and are therefore not able to connect.
> > > >
> > > > Where do I need to modify the address to get them connecting again?
> > > >
> > > > Cheers
> > > > Dominik
> > > >
> > > > _______________________________________________
> > > > ceph-users mailing list -- ceph-users@xxxxxxx
> > > > To unsubscribe send an email to ceph-users-leave@xxxxxxx
> > >
> > >
> > >
> > > _______________________________________________
> > > ceph-users mailing list -- ceph-users@xxxxxxx
> > > To unsubscribe send an email to ceph-users-leave@xxxxxxx
> > _______________________________________________
> > ceph-users mailing list -- ceph-users@xxxxxxx
> > To unsubscribe send an email to ceph-users-leave@xxxxxxx
>
>
>
> _______________________________________________
> ceph-users mailing list -- ceph-users@xxxxxxx
> To unsubscribe send an email to ceph-users-leave@xxxxxxx
_______________________________________________
ceph-users mailing list -- ceph-users@xxxxxxx
To unsubscribe send an email to ceph-users-leave@xxxxxxx