Hey there, so I went to upgrade my ceph from 18.2.2 to 18.2.4 and have encountered a problem with my managers. After they had been upgraded, my ceph orch module broke because the cephadm module would not load. This obviously halted the update because you can't really update without the orchestrator. Here are the logs related to why the cephadm module fails to start: https://pastebin.com/SzHbEDVA and the relevent part here: "backtrace": [ " File \"/usr/share/ceph/mgr/cephadm/module.py\", line 591, in __init__\n self.to_remove_osds.load_from_store()", " File \"/usr/share/ceph/mgr/cephadm/services/osd.py\", line 918, in load_from_store\n osd_obj = OSD.from_json(osd, rm_util=self.rm_util)", " File \"/usr/share/ceph/mgr/cephadm/services/osd.py\", line 783, in from_json\n return cls(**inp)", "TypeError: __init__() got an unexpected keyword argument 'original_weight'" ] Unfortunately, I am at a loss to what passes this the original weight argument. I have attempted to migrate back to 18.2.2 and successfully redeployed a manager of that version, but it also has the same issue with the cephadm module. I believe this may be because I recently started several OSD drains, then canceled them, causing this to manifest once the managers restarted. I've attempted to dig into this myself a bit and found the associated function in the ceph repo: https://github.com/ceph/ceph/blob/e0dd396793b679922e487332a2a4bc48e024a42f/src/pybind/mgr/cephadm/services/osd.py#L779 My issue may also have to do with this PR: https://github.com/ceph/ceph/commit/ba7fac074fb5ad072fcad10862f75c0a26a7591d I unfortunately do not have enough familiarity with the source to see where these values are being set, or to know what keys to remove from the ceph config. Hopefully someone who knows about this will see this and take a look for me! Thanks! _______________________________________________ ceph-users mailing list -- ceph-users@xxxxxxx To unsubscribe send an email to ceph-users-leave@xxxxxxx
 |