Hi Alan, Thanks. Worked like magic. Why did this happen though? I have deployed on the same machine using same ceph-deploy and it was fine. Not sure if anything is different this time, except my network, which shouldn’t affect this. Thakns Pankaj -----Original Message----- From: Alan Johnson [mailto:alanj@xxxxxxxxxxxxxx] Sent: Wednesday, February 25, 2015 4:24 PM To: Garg, Pankaj; Travis Rhoden Cc: ceph-users@xxxxxxxxxxxxxx Subject: RE: Ceph-deploy issues Try sudo chmod +r /etc/ceph/ceph.client.admin.keyring for the error below? -----Original Message----- From: ceph-users [mailto:ceph-users-bounces@xxxxxxxxxxxxxx] On Behalf Of Garg, Pankaj Sent: Wednesday, February 25, 2015 4:04 PM To: Travis Rhoden Cc: ceph-users@xxxxxxxxxxxxxx Subject: Re: Ceph-deploy issues I figured it out.....at least first hurdle. I have 2 networks, 10.18.240.x. and 192.168.240.xx. I was specifying different public and cluster addresses. Somehow it doesn’t like it. Maybe the issue really is the ceph-deploy is old. I am on ARM64 and this is the latest I have for Ubuntu. After I got past the first hurdle, now I get this message : 2015-02-26 00:03:31.642166 3ff94c7f1f0 -1 monclient(hunting): ERROR: missing keyring, cannot use cephx for authentication 2015-02-26 00:03:31.642390 3ff94c7f1f0 0 librados: client.admin initialization error (2) No such file or directory Error connecting to cluster: ObjectNotFound Thanks Pankaj -----Original Message----- From: Travis Rhoden [mailto:trhoden@xxxxxxxxx] Sent: Wednesday, February 25, 2015 3:55 PM To: Garg, Pankaj Cc: ceph-users@xxxxxxxxxxxxxx Subject: Re: Ceph-deploy issues Hi Pankaj, I can't say that it will fix the issue, but the first thing I would encourage is to use the latest ceph-deploy. you are using 1.4.0, which is quite old. The latest is 1.5.21. - Travis On Wed, Feb 25, 2015 at 3:38 PM, Garg, Pankaj <Pankaj.Garg@xxxxxxxxxxxxxxxxxx> wrote: > Hi, > > I had a successful ceph cluster that I am rebuilding. I have > completely uninstalled ceph and any remnants and directories and config files. > > While setting up the new cluster, I follow the Ceph-deploy > documentation as described before. I seem to get an error now (tried many times) : > > > > ceph-deploy mon create-initial command fails in gather keys step. This > never happened before, and I’m not sure why its failing now. > > > > > > > > cephuser@ceph1:~/my-cluster$ ceph-deploy mon create-initial > > [ceph_deploy.cli][INFO ] Invoked (1.4.0): /usr/bin/ceph-deploy mon > create-initial > > [ceph_deploy.mon][DEBUG ] Deploying mon, cluster ceph hosts ceph1 > > [ceph_deploy.mon][DEBUG ] detecting platform for host ceph1 ... > > [ceph1][DEBUG ] connected to host: ceph1 > > [ceph1][DEBUG ] detect platform information from remote host > > [ceph1][DEBUG ] detect machine type > > [ceph_deploy.mon][INFO ] distro info: Ubuntu 14.04 trusty > > [ceph1][DEBUG ] determining if provided host has same hostname in > remote > > [ceph1][DEBUG ] get remote short hostname > > [ceph1][DEBUG ] deploying mon to ceph1 > > [ceph1][DEBUG ] get remote short hostname > > [ceph1][DEBUG ] remote hostname: ceph1 > > [ceph1][DEBUG ] write cluster configuration to > /etc/ceph/{cluster}.conf > > [ceph1][DEBUG ] create the mon path if it does not exist > > [ceph1][DEBUG ] checking for done path: > /var/lib/ceph/mon/ceph-ceph1/done > > [ceph1][DEBUG ] done path does not exist: > /var/lib/ceph/mon/ceph-ceph1/done > > [ceph1][INFO ] creating keyring file: > /var/lib/ceph/tmp/ceph-ceph1.mon.keyring > > [ceph1][DEBUG ] create the monitor keyring file > > [ceph1][INFO ] Running command: sudo ceph-mon --cluster ceph --mkfs > -i > ceph1 --keyring /var/lib/ceph/tmp/ceph-ceph1.mon.keyring > > [ceph1][DEBUG ] ceph-mon: set fsid to > 099013d5-126d-45b4-a98e-5f0c386805a4 > > [ceph1][DEBUG ] ceph-mon: created monfs at > /var/lib/ceph/mon/ceph-ceph1 for > mon.ceph1 > > [ceph1][INFO ] unlinking keyring file > /var/lib/ceph/tmp/ceph-ceph1.mon.keyring > > [ceph1][DEBUG ] create a done file to avoid re-doing the mon > deployment > > [ceph1][DEBUG ] create the init path if it does not exist > > [ceph1][DEBUG ] locating the `service` executable... > > [ceph1][INFO ] Running command: sudo initctl emit ceph-mon > cluster=ceph > id=ceph1 > > [ceph1][INFO ] Running command: sudo ceph --cluster=ceph > --admin-daemon /var/run/ceph/ceph-mon.ceph1.asok mon_status > > [ceph1][DEBUG ] > ********************************************************************** > ********** > > [ceph1][DEBUG ] status for monitor: mon.ceph1 > > [ceph1][DEBUG ] { > > [ceph1][DEBUG ] "election_epoch": 2, > > [ceph1][DEBUG ] "extra_probe_peers": [ > > [ceph1][DEBUG ] "192.168.240.101:6789/0" > > [ceph1][DEBUG ] ], > > [ceph1][DEBUG ] "monmap": { > > [ceph1][DEBUG ] "created": "0.000000", > > [ceph1][DEBUG ] "epoch": 1, > > [ceph1][DEBUG ] "fsid": "099013d5-126d-45b4-a98e-5f0c386805a4", > > [ceph1][DEBUG ] "modified": "0.000000", > > [ceph1][DEBUG ] "mons": [ > > [ceph1][DEBUG ] { > > [ceph1][DEBUG ] "addr": "10.18.240.101:6789/0", > > [ceph1][DEBUG ] "name": "ceph1", > > [ceph1][DEBUG ] "rank": 0 > > [ceph1][DEBUG ] } > > [ceph1][DEBUG ] ] > > [ceph1][DEBUG ] }, > > [ceph1][DEBUG ] "name": "ceph1", > > [ceph1][DEBUG ] "outside_quorum": [], > > [ceph1][DEBUG ] "quorum": [ > > [ceph1][DEBUG ] 0 > > [ceph1][DEBUG ] ], > > [ceph1][DEBUG ] "rank": 0, > > [ceph1][DEBUG ] "state": "leader", > > [ceph1][DEBUG ] "sync_provider": [] > > [ceph1][DEBUG ] } > > [ceph1][DEBUG ] > ********************************************************************** > ********** > > [ceph1][INFO ] monitor: mon.ceph1 is running > > [ceph1][INFO ] Running command: sudo ceph --cluster=ceph > --admin-daemon /var/run/ceph/ceph-mon.ceph1.asok mon_status > > [ceph_deploy.mon][INFO ] processing monitor mon.ceph1 > > [ceph1][DEBUG ] connected to host: ceph1 > > [ceph1][INFO ] Running command: sudo ceph --cluster=ceph > --admin-daemon /var/run/ceph/ceph-mon.ceph1.asok mon_status > > [ceph_deploy.mon][INFO ] mon.ceph1 monitor has reached quorum! > > [ceph_deploy.mon][INFO ] all initial monitors are running and have > formed quorum > > [ceph_deploy.mon][INFO ] Running gatherkeys... > > [ceph_deploy.gatherkeys][DEBUG ] Checking ceph1 for > /etc/ceph/ceph.client.admin.keyring > > [ceph1][DEBUG ] connected to host: ceph1 > > [ceph1][DEBUG ] detect platform information from remote host > > [ceph1][DEBUG ] detect machine type > > [ceph1][DEBUG ] fetch remote file > > [ceph_deploy.gatherkeys][WARNIN] Unable to find > /etc/ceph/ceph.client.admin.keyring on ['ceph1'] > > [ceph_deploy.gatherkeys][DEBUG ] Have ceph.mon.keyring > > [ceph_deploy.gatherkeys][DEBUG ] Checking ceph1 for > /var/lib/ceph/bootstrap-osd/ceph.keyring > > [ceph1][DEBUG ] connected to host: ceph1 > > [ceph1][DEBUG ] detect platform information from remote host > > [ceph1][DEBUG ] detect machine type > > [ceph1][DEBUG ] fetch remote file > > [ceph_deploy.gatherkeys][WARNIN] Unable to find > /var/lib/ceph/bootstrap-osd/ceph.keyring on ['ceph1'] > > [ceph_deploy.gatherkeys][DEBUG ] Checking ceph1 for > /var/lib/ceph/bootstrap-mds/ceph.keyring > > [ceph1][DEBUG ] connected to host: ceph1 > > [ceph1][DEBUG ] detect platform information from remote host > > [ceph1][DEBUG ] detect machine type > > [ceph1][DEBUG ] fetch remote file > > [ceph_deploy.gatherkeys][WARNIN] Unable to find > /var/lib/ceph/bootstrap-mds/ceph.keyring on ['ceph1'] > > > > > > Any help is appreciated. > > > > Thanks > > Pankaj > > > _______________________________________________ > ceph-users mailing list > ceph-users@xxxxxxxxxxxxxx > http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com > _______________________________________________ ceph-users mailing list ceph-users@xxxxxxxxxxxxxx http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com _______________________________________________ ceph-users mailing list ceph-users@xxxxxxxxxxxxxx http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
 |