Re: Ceph-deploy issues

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



Hi Alan,
Thanks. Worked like magic.
Why did this happen though? I have deployed on the same machine using same ceph-deploy and it was fine. 
Not sure if anything is different this time, except my network, which shouldn’t affect this.

Thakns
Pankaj

-----Original Message-----
From: Alan Johnson [mailto:alanj@xxxxxxxxxxxxxx] 
Sent: Wednesday, February 25, 2015 4:24 PM
To: Garg, Pankaj; Travis Rhoden
Cc: ceph-users@xxxxxxxxxxxxxx
Subject: RE:  Ceph-deploy issues

Try sudo chmod +r /etc/ceph/ceph.client.admin.keyring for the error below?

-----Original Message-----
From: ceph-users [mailto:ceph-users-bounces@xxxxxxxxxxxxxx] On Behalf Of Garg, Pankaj
Sent: Wednesday, February 25, 2015 4:04 PM
To: Travis Rhoden
Cc: ceph-users@xxxxxxxxxxxxxx
Subject: Re:  Ceph-deploy issues

I figured it out.....at least first hurdle.
I have 2 networks, 10.18.240.x. and 192.168.240.xx.
I was specifying different public and cluster addresses. Somehow it doesn’t like it.
Maybe the issue really is the ceph-deploy is old. I am on ARM64 and this is the latest I have for Ubuntu.

After I got past the first hurdle, now I get this message :

2015-02-26 00:03:31.642166 3ff94c7f1f0 -1 monclient(hunting): ERROR: missing keyring, cannot use cephx for authentication
2015-02-26 00:03:31.642390 3ff94c7f1f0  0 librados: client.admin initialization error (2) No such file or directory Error connecting to cluster: ObjectNotFound


Thanks
Pankaj

-----Original Message-----
From: Travis Rhoden [mailto:trhoden@xxxxxxxxx]
Sent: Wednesday, February 25, 2015 3:55 PM
To: Garg, Pankaj
Cc: ceph-users@xxxxxxxxxxxxxx
Subject: Re:  Ceph-deploy issues

Hi Pankaj,

I can't say that it will fix the issue, but the first thing I would encourage is to use the latest ceph-deploy.

you are using 1.4.0, which is quite old.  The latest is 1.5.21.

 - Travis

On Wed, Feb 25, 2015 at 3:38 PM, Garg, Pankaj <Pankaj.Garg@xxxxxxxxxxxxxxxxxx> wrote:
> Hi,
>
> I had a successful ceph cluster that I am rebuilding. I have 
> completely uninstalled ceph and any remnants and directories and config files.
>
> While setting up the new cluster, I follow the Ceph-deploy 
> documentation as described before. I seem to get an error now (tried many times) :
>
>
>
> ceph-deploy mon create-initial command fails in gather keys step. This 
> never happened before, and I’m not sure why its failing now.
>
>
>
>
>
>
>
> cephuser@ceph1:~/my-cluster$ ceph-deploy mon create-initial
>
> [ceph_deploy.cli][INFO  ] Invoked (1.4.0): /usr/bin/ceph-deploy mon 
> create-initial
>
> [ceph_deploy.mon][DEBUG ] Deploying mon, cluster ceph hosts ceph1
>
> [ceph_deploy.mon][DEBUG ] detecting platform for host ceph1 ...
>
> [ceph1][DEBUG ] connected to host: ceph1
>
> [ceph1][DEBUG ] detect platform information from remote host
>
> [ceph1][DEBUG ] detect machine type
>
> [ceph_deploy.mon][INFO  ] distro info: Ubuntu 14.04 trusty
>
> [ceph1][DEBUG ] determining if provided host has same hostname in 
> remote
>
> [ceph1][DEBUG ] get remote short hostname
>
> [ceph1][DEBUG ] deploying mon to ceph1
>
> [ceph1][DEBUG ] get remote short hostname
>
> [ceph1][DEBUG ] remote hostname: ceph1
>
> [ceph1][DEBUG ] write cluster configuration to 
> /etc/ceph/{cluster}.conf
>
> [ceph1][DEBUG ] create the mon path if it does not exist
>
> [ceph1][DEBUG ] checking for done path: 
> /var/lib/ceph/mon/ceph-ceph1/done
>
> [ceph1][DEBUG ] done path does not exist: 
> /var/lib/ceph/mon/ceph-ceph1/done
>
> [ceph1][INFO  ] creating keyring file:
> /var/lib/ceph/tmp/ceph-ceph1.mon.keyring
>
> [ceph1][DEBUG ] create the monitor keyring file
>
> [ceph1][INFO  ] Running command: sudo ceph-mon --cluster ceph --mkfs 
> -i
> ceph1 --keyring /var/lib/ceph/tmp/ceph-ceph1.mon.keyring
>
> [ceph1][DEBUG ] ceph-mon: set fsid to
> 099013d5-126d-45b4-a98e-5f0c386805a4
>
> [ceph1][DEBUG ] ceph-mon: created monfs at
> /var/lib/ceph/mon/ceph-ceph1 for
> mon.ceph1
>
> [ceph1][INFO  ] unlinking keyring file 
> /var/lib/ceph/tmp/ceph-ceph1.mon.keyring
>
> [ceph1][DEBUG ] create a done file to avoid re-doing the mon 
> deployment
>
> [ceph1][DEBUG ] create the init path if it does not exist
>
> [ceph1][DEBUG ] locating the `service` executable...
>
> [ceph1][INFO  ] Running command: sudo initctl emit ceph-mon 
> cluster=ceph
> id=ceph1
>
> [ceph1][INFO  ] Running command: sudo ceph --cluster=ceph 
> --admin-daemon /var/run/ceph/ceph-mon.ceph1.asok mon_status
>
> [ceph1][DEBUG ]
> **********************************************************************
> **********
>
> [ceph1][DEBUG ] status for monitor: mon.ceph1
>
> [ceph1][DEBUG ] {
>
> [ceph1][DEBUG ]   "election_epoch": 2,
>
> [ceph1][DEBUG ]   "extra_probe_peers": [
>
> [ceph1][DEBUG ]     "192.168.240.101:6789/0"
>
> [ceph1][DEBUG ]   ],
>
> [ceph1][DEBUG ]   "monmap": {
>
> [ceph1][DEBUG ]     "created": "0.000000",
>
> [ceph1][DEBUG ]     "epoch": 1,
>
> [ceph1][DEBUG ]     "fsid": "099013d5-126d-45b4-a98e-5f0c386805a4",
>
> [ceph1][DEBUG ]     "modified": "0.000000",
>
> [ceph1][DEBUG ]     "mons": [
>
> [ceph1][DEBUG ]       {
>
> [ceph1][DEBUG ]         "addr": "10.18.240.101:6789/0",
>
> [ceph1][DEBUG ]         "name": "ceph1",
>
> [ceph1][DEBUG ]         "rank": 0
>
> [ceph1][DEBUG ]       }
>
> [ceph1][DEBUG ]     ]
>
> [ceph1][DEBUG ]   },
>
> [ceph1][DEBUG ]   "name": "ceph1",
>
> [ceph1][DEBUG ]   "outside_quorum": [],
>
> [ceph1][DEBUG ]   "quorum": [
>
> [ceph1][DEBUG ]     0
>
> [ceph1][DEBUG ]   ],
>
> [ceph1][DEBUG ]   "rank": 0,
>
> [ceph1][DEBUG ]   "state": "leader",
>
> [ceph1][DEBUG ]   "sync_provider": []
>
> [ceph1][DEBUG ] }
>
> [ceph1][DEBUG ]
> **********************************************************************
> **********
>
> [ceph1][INFO  ] monitor: mon.ceph1 is running
>
> [ceph1][INFO  ] Running command: sudo ceph --cluster=ceph 
> --admin-daemon /var/run/ceph/ceph-mon.ceph1.asok mon_status
>
> [ceph_deploy.mon][INFO  ] processing monitor mon.ceph1
>
> [ceph1][DEBUG ] connected to host: ceph1
>
> [ceph1][INFO  ] Running command: sudo ceph --cluster=ceph 
> --admin-daemon /var/run/ceph/ceph-mon.ceph1.asok mon_status
>
> [ceph_deploy.mon][INFO  ] mon.ceph1 monitor has reached quorum!
>
> [ceph_deploy.mon][INFO  ] all initial monitors are running and have 
> formed quorum
>
> [ceph_deploy.mon][INFO  ] Running gatherkeys...
>
> [ceph_deploy.gatherkeys][DEBUG ] Checking ceph1 for 
> /etc/ceph/ceph.client.admin.keyring
>
> [ceph1][DEBUG ] connected to host: ceph1
>
> [ceph1][DEBUG ] detect platform information from remote host
>
> [ceph1][DEBUG ] detect machine type
>
> [ceph1][DEBUG ] fetch remote file
>
> [ceph_deploy.gatherkeys][WARNIN] Unable to find 
> /etc/ceph/ceph.client.admin.keyring on ['ceph1']
>
> [ceph_deploy.gatherkeys][DEBUG ] Have ceph.mon.keyring
>
> [ceph_deploy.gatherkeys][DEBUG ] Checking ceph1 for 
> /var/lib/ceph/bootstrap-osd/ceph.keyring
>
> [ceph1][DEBUG ] connected to host: ceph1
>
> [ceph1][DEBUG ] detect platform information from remote host
>
> [ceph1][DEBUG ] detect machine type
>
> [ceph1][DEBUG ] fetch remote file
>
> [ceph_deploy.gatherkeys][WARNIN] Unable to find 
> /var/lib/ceph/bootstrap-osd/ceph.keyring on ['ceph1']
>
> [ceph_deploy.gatherkeys][DEBUG ] Checking ceph1 for 
> /var/lib/ceph/bootstrap-mds/ceph.keyring
>
> [ceph1][DEBUG ] connected to host: ceph1
>
> [ceph1][DEBUG ] detect platform information from remote host
>
> [ceph1][DEBUG ] detect machine type
>
> [ceph1][DEBUG ] fetch remote file
>
> [ceph_deploy.gatherkeys][WARNIN] Unable to find 
> /var/lib/ceph/bootstrap-mds/ceph.keyring on ['ceph1']
>
>
>
>
>
> Any help is appreciated.
>
>
>
> Thanks
>
> Pankaj
>
>
> _______________________________________________
> ceph-users mailing list
> ceph-users@xxxxxxxxxxxxxx
> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
>
_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com





[Index of Archives]     [Information on CEPH]     [Linux Filesystem Development]     [Ceph Development]     [Ceph Large]     [Ceph Dev]     [Linux USB Development]     [Video for Linux]     [Linux Audio Users]     [Yosemite News]     [Linux Kernel]     [Linux SCSI]     [xfs]


  Powered by Linux