Hi Pankaj, I can't say that it will fix the issue, but the first thing I would encourage is to use the latest ceph-deploy. you are using 1.4.0, which is quite old. The latest is 1.5.21. - Travis On Wed, Feb 25, 2015 at 3:38 PM, Garg, Pankaj <Pankaj.Garg@xxxxxxxxxxxxxxxxxx> wrote: > Hi, > > I had a successful ceph cluster that I am rebuilding. I have completely > uninstalled ceph and any remnants and directories and config files. > > While setting up the new cluster, I follow the Ceph-deploy documentation as > described before. I seem to get an error now (tried many times) : > > > > ceph-deploy mon create-initial command fails in gather keys step. This never > happened before, and I’m not sure why its failing now. > > > > > > > > cephuser@ceph1:~/my-cluster$ ceph-deploy mon create-initial > > [ceph_deploy.cli][INFO ] Invoked (1.4.0): /usr/bin/ceph-deploy mon > create-initial > > [ceph_deploy.mon][DEBUG ] Deploying mon, cluster ceph hosts ceph1 > > [ceph_deploy.mon][DEBUG ] detecting platform for host ceph1 ... > > [ceph1][DEBUG ] connected to host: ceph1 > > [ceph1][DEBUG ] detect platform information from remote host > > [ceph1][DEBUG ] detect machine type > > [ceph_deploy.mon][INFO ] distro info: Ubuntu 14.04 trusty > > [ceph1][DEBUG ] determining if provided host has same hostname in remote > > [ceph1][DEBUG ] get remote short hostname > > [ceph1][DEBUG ] deploying mon to ceph1 > > [ceph1][DEBUG ] get remote short hostname > > [ceph1][DEBUG ] remote hostname: ceph1 > > [ceph1][DEBUG ] write cluster configuration to /etc/ceph/{cluster}.conf > > [ceph1][DEBUG ] create the mon path if it does not exist > > [ceph1][DEBUG ] checking for done path: /var/lib/ceph/mon/ceph-ceph1/done > > [ceph1][DEBUG ] done path does not exist: /var/lib/ceph/mon/ceph-ceph1/done > > [ceph1][INFO ] creating keyring file: > /var/lib/ceph/tmp/ceph-ceph1.mon.keyring > > [ceph1][DEBUG ] create the monitor keyring file > > [ceph1][INFO ] Running command: sudo ceph-mon --cluster ceph --mkfs -i > ceph1 --keyring /var/lib/ceph/tmp/ceph-ceph1.mon.keyring > > [ceph1][DEBUG ] ceph-mon: set fsid to 099013d5-126d-45b4-a98e-5f0c386805a4 > > [ceph1][DEBUG ] ceph-mon: created monfs at /var/lib/ceph/mon/ceph-ceph1 for > mon.ceph1 > > [ceph1][INFO ] unlinking keyring file > /var/lib/ceph/tmp/ceph-ceph1.mon.keyring > > [ceph1][DEBUG ] create a done file to avoid re-doing the mon deployment > > [ceph1][DEBUG ] create the init path if it does not exist > > [ceph1][DEBUG ] locating the `service` executable... > > [ceph1][INFO ] Running command: sudo initctl emit ceph-mon cluster=ceph > id=ceph1 > > [ceph1][INFO ] Running command: sudo ceph --cluster=ceph --admin-daemon > /var/run/ceph/ceph-mon.ceph1.asok mon_status > > [ceph1][DEBUG ] > ******************************************************************************** > > [ceph1][DEBUG ] status for monitor: mon.ceph1 > > [ceph1][DEBUG ] { > > [ceph1][DEBUG ] "election_epoch": 2, > > [ceph1][DEBUG ] "extra_probe_peers": [ > > [ceph1][DEBUG ] "192.168.240.101:6789/0" > > [ceph1][DEBUG ] ], > > [ceph1][DEBUG ] "monmap": { > > [ceph1][DEBUG ] "created": "0.000000", > > [ceph1][DEBUG ] "epoch": 1, > > [ceph1][DEBUG ] "fsid": "099013d5-126d-45b4-a98e-5f0c386805a4", > > [ceph1][DEBUG ] "modified": "0.000000", > > [ceph1][DEBUG ] "mons": [ > > [ceph1][DEBUG ] { > > [ceph1][DEBUG ] "addr": "10.18.240.101:6789/0", > > [ceph1][DEBUG ] "name": "ceph1", > > [ceph1][DEBUG ] "rank": 0 > > [ceph1][DEBUG ] } > > [ceph1][DEBUG ] ] > > [ceph1][DEBUG ] }, > > [ceph1][DEBUG ] "name": "ceph1", > > [ceph1][DEBUG ] "outside_quorum": [], > > [ceph1][DEBUG ] "quorum": [ > > [ceph1][DEBUG ] 0 > > [ceph1][DEBUG ] ], > > [ceph1][DEBUG ] "rank": 0, > > [ceph1][DEBUG ] "state": "leader", > > [ceph1][DEBUG ] "sync_provider": [] > > [ceph1][DEBUG ] } > > [ceph1][DEBUG ] > ******************************************************************************** > > [ceph1][INFO ] monitor: mon.ceph1 is running > > [ceph1][INFO ] Running command: sudo ceph --cluster=ceph --admin-daemon > /var/run/ceph/ceph-mon.ceph1.asok mon_status > > [ceph_deploy.mon][INFO ] processing monitor mon.ceph1 > > [ceph1][DEBUG ] connected to host: ceph1 > > [ceph1][INFO ] Running command: sudo ceph --cluster=ceph --admin-daemon > /var/run/ceph/ceph-mon.ceph1.asok mon_status > > [ceph_deploy.mon][INFO ] mon.ceph1 monitor has reached quorum! > > [ceph_deploy.mon][INFO ] all initial monitors are running and have formed > quorum > > [ceph_deploy.mon][INFO ] Running gatherkeys... > > [ceph_deploy.gatherkeys][DEBUG ] Checking ceph1 for > /etc/ceph/ceph.client.admin.keyring > > [ceph1][DEBUG ] connected to host: ceph1 > > [ceph1][DEBUG ] detect platform information from remote host > > [ceph1][DEBUG ] detect machine type > > [ceph1][DEBUG ] fetch remote file > > [ceph_deploy.gatherkeys][WARNIN] Unable to find > /etc/ceph/ceph.client.admin.keyring on ['ceph1'] > > [ceph_deploy.gatherkeys][DEBUG ] Have ceph.mon.keyring > > [ceph_deploy.gatherkeys][DEBUG ] Checking ceph1 for > /var/lib/ceph/bootstrap-osd/ceph.keyring > > [ceph1][DEBUG ] connected to host: ceph1 > > [ceph1][DEBUG ] detect platform information from remote host > > [ceph1][DEBUG ] detect machine type > > [ceph1][DEBUG ] fetch remote file > > [ceph_deploy.gatherkeys][WARNIN] Unable to find > /var/lib/ceph/bootstrap-osd/ceph.keyring on ['ceph1'] > > [ceph_deploy.gatherkeys][DEBUG ] Checking ceph1 for > /var/lib/ceph/bootstrap-mds/ceph.keyring > > [ceph1][DEBUG ] connected to host: ceph1 > > [ceph1][DEBUG ] detect platform information from remote host > > [ceph1][DEBUG ] detect machine type > > [ceph1][DEBUG ] fetch remote file > > [ceph_deploy.gatherkeys][WARNIN] Unable to find > /var/lib/ceph/bootstrap-mds/ceph.keyring on ['ceph1'] > > > > > > Any help is appreciated. > > > > Thanks > > Pankaj > > > _______________________________________________ > ceph-users mailing list > ceph-users@xxxxxxxxxxxxxx > http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com > _______________________________________________ ceph-users mailing list ceph-users@xxxxxxxxxxxxxx http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com