Hi, I had a successful ceph cluster that I am rebuilding. I have completely uninstalled ceph and any remnants and directories and config files. While setting up the new cluster, I follow the Ceph-deploy documentation as described before. I seem to get an error now (tried many times) : ceph-deploy mon create-initial command fails in gather keys step. This never happened before, and I’m not sure why its failing now.
cephuser@ceph1:~/my-cluster$ ceph-deploy mon create-initial [ceph_deploy.cli][INFO ] Invoked (1.4.0): /usr/bin/ceph-deploy mon create-initial [ceph_deploy.mon][DEBUG ] Deploying mon, cluster ceph hosts ceph1 [ceph_deploy.mon][DEBUG ] detecting platform for host ceph1 ... [ceph1][DEBUG ] connected to host: ceph1 [ceph1][DEBUG ] detect platform information from remote host [ceph1][DEBUG ] detect machine type [ceph_deploy.mon][INFO ] distro info: Ubuntu 14.04 trusty [ceph1][DEBUG ] determining if provided host has same hostname in remote [ceph1][DEBUG ] get remote short hostname [ceph1][DEBUG ] deploying mon to ceph1 [ceph1][DEBUG ] get remote short hostname [ceph1][DEBUG ] remote hostname: ceph1 [ceph1][DEBUG ] write cluster configuration to /etc/ceph/{cluster}.conf [ceph1][DEBUG ] create the mon path if it does not exist [ceph1][DEBUG ] checking for done path: /var/lib/ceph/mon/ceph-ceph1/done [ceph1][DEBUG ] done path does not exist: /var/lib/ceph/mon/ceph-ceph1/done [ceph1][INFO ] creating keyring file: /var/lib/ceph/tmp/ceph-ceph1.mon.keyring [ceph1][DEBUG ] create the monitor keyring file [ceph1][INFO ] Running command: sudo ceph-mon --cluster ceph --mkfs -i ceph1 --keyring /var/lib/ceph/tmp/ceph-ceph1.mon.keyring [ceph1][DEBUG ] ceph-mon: set fsid to 099013d5-126d-45b4-a98e-5f0c386805a4 [ceph1][DEBUG ] ceph-mon: created monfs at /var/lib/ceph/mon/ceph-ceph1 for mon.ceph1 [ceph1][INFO ] unlinking keyring file /var/lib/ceph/tmp/ceph-ceph1.mon.keyring [ceph1][DEBUG ] create a done file to avoid re-doing the mon deployment [ceph1][DEBUG ] create the init path if it does not exist [ceph1][DEBUG ] locating the `service` executable... [ceph1][INFO ] Running command: sudo initctl emit ceph-mon cluster=ceph id=ceph1 [ceph1][INFO ] Running command: sudo ceph --cluster=ceph --admin-daemon /var/run/ceph/ceph-mon.ceph1.asok mon_status [ceph1][DEBUG ] ******************************************************************************** [ceph1][DEBUG ] status for monitor: mon.ceph1 [ceph1][DEBUG ] { [ceph1][DEBUG ] "election_epoch": 2, [ceph1][DEBUG ] "extra_probe_peers": [ [ceph1][DEBUG ] "192.168.240.101:6789/0" [ceph1][DEBUG ] ], [ceph1][DEBUG ] "monmap": { [ceph1][DEBUG ] "created": "0.000000", [ceph1][DEBUG ] "epoch": 1, [ceph1][DEBUG ] "fsid": "099013d5-126d-45b4-a98e-5f0c386805a4", [ceph1][DEBUG ] "modified": "0.000000", [ceph1][DEBUG ] "mons": [ [ceph1][DEBUG ] { [ceph1][DEBUG ] "addr": "10.18.240.101:6789/0", [ceph1][DEBUG ] "name": "ceph1", [ceph1][DEBUG ] "rank": 0 [ceph1][DEBUG ] } [ceph1][DEBUG ] ] [ceph1][DEBUG ] }, [ceph1][DEBUG ] "name": "ceph1", [ceph1][DEBUG ] "outside_quorum": [], [ceph1][DEBUG ] "quorum": [ [ceph1][DEBUG ] 0 [ceph1][DEBUG ] ], [ceph1][DEBUG ] "rank": 0, [ceph1][DEBUG ] "state": "leader", [ceph1][DEBUG ] "sync_provider": [] [ceph1][DEBUG ] } [ceph1][DEBUG ] ******************************************************************************** [ceph1][INFO ] monitor: mon.ceph1 is running [ceph1][INFO ] Running command: sudo ceph --cluster=ceph --admin-daemon /var/run/ceph/ceph-mon.ceph1.asok mon_status [ceph_deploy.mon][INFO ] processing monitor mon.ceph1 [ceph1][DEBUG ] connected to host: ceph1 [ceph1][INFO ] Running command: sudo ceph --cluster=ceph --admin-daemon /var/run/ceph/ceph-mon.ceph1.asok mon_status [ceph_deploy.mon][INFO ] mon.ceph1 monitor has reached quorum! [ceph_deploy.mon][INFO ] all initial monitors are running and have formed quorum [ceph_deploy.mon][INFO ] Running gatherkeys... [ceph_deploy.gatherkeys][DEBUG ] Checking ceph1 for /etc/ceph/ceph.client.admin.keyring [ceph1][DEBUG ] connected to host: ceph1 [ceph1][DEBUG ] detect platform information from remote host [ceph1][DEBUG ] detect machine type [ceph1][DEBUG ] fetch remote file [ceph_deploy.gatherkeys][WARNIN] Unable to find /etc/ceph/ceph.client.admin.keyring on ['ceph1'] [ceph_deploy.gatherkeys][DEBUG ] Have ceph.mon.keyring [ceph_deploy.gatherkeys][DEBUG ] Checking ceph1 for /var/lib/ceph/bootstrap-osd/ceph.keyring [ceph1][DEBUG ] connected to host: ceph1 [ceph1][DEBUG ] detect platform information from remote host [ceph1][DEBUG ] detect machine type [ceph1][DEBUG ] fetch remote file [ceph_deploy.gatherkeys][WARNIN] Unable to find /var/lib/ceph/bootstrap-osd/ceph.keyring on ['ceph1'] [ceph_deploy.gatherkeys][DEBUG ] Checking ceph1 for /var/lib/ceph/bootstrap-mds/ceph.keyring [ceph1][DEBUG ] connected to host: ceph1 [ceph1][DEBUG ] detect platform information from remote host [ceph1][DEBUG ] detect machine type [ceph1][DEBUG ] fetch remote file [ceph_deploy.gatherkeys][WARNIN] Unable to find /var/lib/ceph/bootstrap-mds/ceph.keyring on ['ceph1'] Any help is appreciated. Thanks Pankaj |
_______________________________________________ ceph-users mailing list ceph-users@xxxxxxxxxxxxxx http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com