|
Dear Ceph experts, I'm a very new Ceph user. I made a blunder that I removed some OSDs (and all files in the related directories) before Ceph finished rebalancing datas and migrating pgs. Not to mention the data loss, I meet the problem that: 1) There are always stale pgs showing in ceph status (with heath warning). Say one of the stale pg 17.a2: # ceph -v where osd.15 had already been removed. It seems to map to the existing OSDs ([27, 3]). Can this pg finally get recovered by changing to the existing OSDs? If not, how can I do about this kind of stale pg? 2) I tried to solve the problem above by creating OSDs back but failed. The reason was I cannot create an OSD with the same ID to that I removed, say osd.15 (or change the id of an OSD). Is there any way to change the id of an OSD? (By the way, I'm suprised that this issue can hardly be found on the internet.) 3) I tried another thing: to dump the crushmap and remove everything (including devices and buckets sections) related to the OSDs I removed. However, after I set the crushmap and dumped it out again, I found the OSDs's line still appear in the devices section (not in the buckets section though), such as: # devices Is there anyway to remove them? Does it matters when I want to add new OSDs? Please inform me if you have any comments. Thank you. Best Regards, FaHui |
_______________________________________________ ceph-users mailing list ceph-users@xxxxxxxxxxxxxx http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
