You're supposed to upgrade the mons first... https://docs.ceph.com/en/quincy/releases/pacific/#upgrading-non-cephadm-clusters Maybe try downgrading the mgrs back to Octopus? That's a bit of a scary situation. Tyler On Wed, Jul 27, 2022, 1:24 PM <kevin@xxxxxxxxxx> wrote: > Currently running Octopus 15.2.16, trying to upgrade to Pacific using > cephadm. > > 3 mon nodes running 15.2.16 > 2 mgr nodes running 16.2.9 > 15 OSD's running 15.2.16 > > The mon/mgr nodes are running in lxc containers on Ubuntu running docker > from the docker repo (not the Ubuntu repo). Using cephadm to remove one of > the monitor nodes, and then re-add it back with a 16.2.9 version. The > monitor node runs but never joins the cluster. Also, this causes the other > 2 mon nodes to start flapping. Also tried adding 2 mon nodes (for a total > of 5 mons) on bare metal running Ubuntu (with docker running from the > docker repo) and the mon's won't join and won't even show up in 'ceph > status' > > Can't find anything in the logs regarding why it's failing. The docker > container starts and seems to try to join the cluster but just sits and > doesn't join. The other two start flapping and then eventually I have to > stop the new mon. I can add the monitor back by changing the > container_image to 15.2.16 and it will re-join the cluster as expected. > > The cluster was previously running nautilus installed using ceph-deploy > > Tried setting 'mon_mds_skip_sanity true' from reading another post but it > doesn't appear to help. > _______________________________________________ > ceph-users mailing list -- ceph-users@xxxxxxx > To unsubscribe send an email to ceph-users-leave@xxxxxxx > _______________________________________________ ceph-users mailing list -- ceph-users@xxxxxxx To unsubscribe send an email to ceph-users-leave@xxxxxxx
 |