Ceph does not support downgrading OSDs. When you removed the single OSD, it was probably trying to move data onto the other OSDs in the node with Infernalis OSDs. I would recommend stopping every OSD in that node and marking them out so the cluster will rebalance without them. Assuming your cluster is able to get healthy after that, we'll see where things are.
Also, please stop opening so many email threads about this same issue. It makes tracking this in the archives impossible.
On Mon, Aug 20, 2018 at 9:45 PM Kees Meijs <kees@xxxxxxxx> wrote:
Hi there,
A few hours ago I started the given OSD again and gave it weight 1.00000. Backfilling started and more PGs became active+clean.
After a while the same crashing behaviour started to act up so I stopped the backfilling.
Running with noout,nobackfill,norebalance,noscrub,nodeep-scrub flags now but at least it seems the cluster seems stable (fingers crossed...)
Possible plan of attack:
- Stopping all Infernalis OSDs.
- Remove Ceph Infernalis packages from OSD node.
- Install Hammer packages.
- Start the OSDs (or maybe the package installation does this already.)
Effectively this is an OSD downgrade. Is this supported or does Ceph "upgrade" data structures on disk as well?
Recap: this would imply going from Infernalis back to Hammer.
Any thoughts are more than welcome (maybe a completely different approach makes sense...) Meanwhile, I'll try to catch some sleep.
Thanks, thanks!
Best regards,
Kees
_______________________________________________On 20-08-18 21:46, Kees Meijs wrote:
Other than restarting the "out" and stopped OSD for the time being (haven't tried that yet) I'm quite lost.
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
_______________________________________________ ceph-users mailing list ceph-users@xxxxxxxxxxxxxx http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
