I have some problem with adding a new mon to existing ceph cluster. Now cluster contains a 3 mon's, but i started with only one in one machine. Then adding a second, and third machine, with new mon's, and OSD. Adding, a new OSD is quiet simple, but adding, a new mon is compilation of some pieces in old doc of ceph, new doc, and a group mails. This -> http://ceph.newdream.net/docs/latest/ops/manage/grow/mon/ - not working properly in section (Adding a monitor) Maybe this will be useful for someone: 1. Create a new mon structure with existing one working mon instance, maybe created with mkcepfs in init of cluster. a) edit ceph.conf, and add new mon definition in mon part of conf in whole cluster. b) ceph auth get mon. -o /tmp/monkey c) fsid=`ceph fsid --concise` d) ceph-mon -i <new-mon-id> --mkfs -k /tmp/monkey --fsid $fsid 2. Before you start new mon (check if new mon is not working - in my case it's not starting even if i try :)), some things musts be done before. It's based on http://ceph.newdream.net/docs/latest/ops/manage/grow/mon/ (Removing a monitor from an unhealthy or down cluster) a) On a surviving monitor node, find the most recent monmap in mon dir, like in doc about removing monitor. b) On a surviving monitor node: $ cp $mon_data/monmap/<latest-monmap-id> /tmp/foo $ monmaptool /tmp/foo --add <new-mon-id> <new-mon-ip>:<new-mon-port> c) Inject a new monmap to working ceph mon. ceph-mon -i <surviving-mon-id> --inject-monmap /tmp/foo ceph -s will show new number of mons. d) copy /tmp/foo, and inject this monmap, to every mon, that works in existing cluster, even on machine with new mon to update, a monmap in new mon directory. e) Start new mon: service ceph start mon then mon_status will show a new list of mon in ceph cluster. ceph mon_status Now new mon works perfect. Maybe it's not a supported way to insert a new mon to cluster, but for me now it's only way that works :) -- ----- Pozdrawiam Sławek "sZiBis" Skowron -- To unsubscribe from this list: send the line "unsubscribe ceph-devel" in the body of a message to majordomo@xxxxxxxxxxxxxxx More majordomo info at http://vger.kernel.org/majordomo-info.html
