Re: ceph-deploy issues

John Wilkins <john.wilkins@xxxxxxxxxxx> · Mon, 6 May 2013 09:57:39 -0700

James, 
In the quick start section, there is a link to the mkcephfs method of deploying for Argonaut and Bobtail.  See: http://ceph.com/docs/master/start/quick-start/

ceph-deploy is new with the Cuttlefish release. I tried something similar with Bobtail, and I got just a bit further on Ubuntu. I was able to deploy the OSD, but it didn't find the bootstrap-mds on my system. I believe that has been filed as a bug. An alternate approach, if you want to live on the edge a bit, is to use a more recent version of Ceph. See http://ceph.com/docs/master/rados/deployment/ceph-deploy-install/ to install a --dev branch (e.g., next, master).

Also, I'd like to get your feedback on setting up ceph-deploy on CentOS. I understand there are a few additional steps I may not have covered in my preflight doc from the clone step onward: http://ceph.com/docs/master/start/quick-start-preflight/#clone-ceph-deploy

Regards,

John

On Mon, May 6, 2013 at 9:26 AM, Finlayson, James <jmfinla@xxxxxxxxxxx> wrote:

Also,
Is there a current cookbook for installing ceph without ceph-deploy or might it be better to switch to a Ubuntu distro instead of CentOS?  My SA skills are better on the RedHat distros, as I don’t have debian experience. 
Thanks,
Jim

From: ceph-users-bounces@xxxxxxxxxxxxxx [mailto:ceph-users-bounces@xxxxxxxxxxxxxx] On Behalf Of Finlayson, James

Sent: Monday, May 06, 2013 12:17 PM
To: ceph-users@xxxxxxxxxxxxxx
Subject:  ceph-deploy issues

All,
Trying to run ceph bobtail on CentOS 6.3 and am having issues with ceph-deploy.
ceph-deploy new es-sv01
  630  ceph-deploy mon create
  634  ceph-deploy gatherkeys es-sv01

I can get a monitor up and running, after doing  a “new” and a “mon create” however when I go to gatherkeys,
I get the following messages

Unable to find /etc/ceph/ceph.client.admin.keyring on ['es-sv01']
Unable to find /var/lib/ceph/bootstrap-osd/ceph.keyring on ['es-sv01']
Unable to find /var/lib/ceph/bootstrap-mds/ceph.keyring on ['es-sv01']

I’ve confirmed on the requisite server that those files do not exist.   Which step actually creates them?  It looks like maybe ceph-deploy isn’t doing mkdir –p on some things as I’ve had to help things along with a mkdir –p /var/lib/ceph/mon  and a /var/lib/ceph/tmp   to get things to work.   I’ve tried to help it with a mkdir /var/lib/ceph/bootstrap-osd and bootstrap.mds but to no avail.   

I  can confirm that the monitor is actually running:
[root@es-sv01 tmp]# ps -ef | grep ceph
root      8035     1  0 11:52 ?        00:00:00 /usr/bin/ceph-mon -i es-sv01 --pid-file /var/run/ceph/mon.es-sv01.pid -c /etc/ceph/ceph.conf

Is there anyway to have ceph-deploy show exactly what it is doing to help me debug?

Here is the ceph.log from this attempt.
ceph@s-cl01:~/my-cluster$ cat ceph.log

2013-05-06 12:10:56,067 ceph_deploy.new DEBUG Creating new cluster named ceph
2013-05-06 12:10:56,067 ceph_deploy.new DEBUG Resolving host es-sv01
2013-05-06 12:10:56,070 ceph_deploy.new DEBUG Monitor es-sv01 at 10.10.30.33

2013-05-06 12:10:56,070 ceph_deploy.new DEBUG Monitor initial members are ['es-sv01']

2013-05-06 12:10:56,070 ceph_deploy.new DEBUG Monitor addrs are ['10.10.30.33']

2013-05-06 12:10:56,070 ceph_deploy.new DEBUG Creating a random mon key...
2013-05-06 12:10:56,070 ceph_deploy.new DEBUG Writing initial config to ceph.conf...
2013-05-06 12:10:56,097 ceph_deploy.new DEBUG Writing monitor keyring to ceph.conf...
2013-05-06 12:11:20,616 ceph_deploy.mon DEBUG Deploying mon, cluster ceph hosts es-sv01
2013-05-06 12:11:20,616 ceph_deploy.mon DEBUG Deploying mon to es-sv01

2013-05-06 12:11:21,250 ceph_deploy.mon DEBUG Distro CentOS codename Final, will use sysvinit

2013-05-06 12:11:46,345 ceph_deploy.mon DEBUG Deploying mon, cluster ceph hosts es-sv01

2013-05-06 12:11:46,345 ceph_deploy.mon DEBUG Deploying mon to es-sv01
2013-05-06 12:11:46,972 ceph_deploy.mon DEBUG Distro CentOS codename Final, will use sysvinit
2013-05-06 12:12:20,783 ceph_deploy.mon DEBUG Deploying mon, cluster ceph hosts es-sv01
2013-05-06 12:12:20,783 ceph_deploy.mon DEBUG Deploying mon to es-sv01

2013-05-06 12:12:21,410 ceph_deploy.mon DEBUG Distro CentOS codename Final, will use sysvinit

2013-05-06 12:12:40,296 ceph_deploy.mon DEBUG Deploying mon, cluster ceph hosts es-sv01

2013-05-06 12:12:40,296 ceph_deploy.mon DEBUG Deploying mon to es-sv01
2013-05-06 12:12:40,919 ceph_deploy.mon DEBUG Distro CentOS codename Final, will use sysvinit
2013-05-06 12:13:30,432 ceph_deploy.mon DEBUG Deploying mon, cluster ceph hosts es-sv01
2013-05-06 12:13:30,433 ceph_deploy.mon DEBUG Deploying mon to es-sv01

2013-05-06 12:13:31,066 ceph_deploy.mon DEBUG Distro CentOS codename Final, will use sysvinit

2013-05-06 12:14:15,139 ceph_deploy.gatherkeys DEBUG Checking es-sv01 for /etc/ceph/ceph.client.admin.keyring

2013-05-06 12:14:15,682 ceph_deploy.gatherkeys WARNING Unable to find /etc/ceph/ceph.client.admin.keyring on ['es-sv01']
2013-05-06 12:14:15,683 ceph_deploy.gatherkeys DEBUG Have ceph.mon.keyring

2013-05-06 12:14:15,683 ceph_deploy.gatherkeys DEBUG Checking es-sv01 for /var/lib/ceph/bootstrap-osd/ceph.keyring

2013-05-06 12:14:16,233 ceph_deploy.gatherkeys WARNING Unable to find /var/lib/ceph/bootstrap-osd/ceph.keyring on ['es-sv01']
2013-05-06 12:14:16,233 ceph_deploy.gatherkeys DEBUG Checking es-sv01 for /var/lib/ceph/bootstrap-mds/ceph.keyring
2013-05-06 12:14:16,783 ceph_deploy.gatherkeys WARNING Unable to find /var/lib/ceph/bootstrap-mds/ceph.keyring on ['es-sv01']

Thanks,
Jim

_______________________________________________

ceph-users mailing list

ceph-users@xxxxxxxxxxxxxx

http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

-- 
John Wilkins
Senior Technical Writer
Intank
john.wilkins@xxxxxxxxxxx
(415) 425-9599

http://inktank.com

_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com