On Mon, Aug 19, 2013 at 4:26 AM, Nico Massenberg <nico.massenberg@xxxxxxxxxxx> wrote: > Hi Alfredo, > > thanks for your response. I updated ceph-deploy to v1.2.1 and got the v0.5.2 > of pushy from: > https://launchpad.net/pushy/+download Ah, there *should* not be need for that as the packages we publish also have pushy listed. > > I then ran the pushy setup.py script with --build and --install, came back > with no errors. > > Still, when trying to create a second mon, ceph-deploy gives me the > following: > > ceph@vl0181:~/konkluster$ ceph-deploy mon create ceph02 > [ceph_deploy.mon][DEBUG ] Deploying mon, cluster ceph hosts ceph02 > [ceph_deploy.mon][DEBUG ] detecting platform for host ceph02 ... > [ceph_deploy.mon][INFO ] distro info: Debian 7.1 wheezy > [ceph02][DEBUG ] deploying mon to ceph02 > [ceph02][DEBUG ] remote hostname: ceph02 > [ceph02][INFO ] write cluster configuration to /etc/ceph/{cluster}.conf > [ceph02][DEBUG ] checking for done path: /var/lib/ceph/mon/ceph-ceph02/done > [ceph02][INFO ] create a done file to avoid re-doing the mon deployment > [ceph02][INFO ] create the init path if it does not exist > [ceph02][INFO ] locating `service` executable... > [ceph02][INFO ] found `service` executable: /usr/sbin/service > [ceph02][INFO ] Running command: /usr/sbin/service ceph start mon.ceph02 > [ceph02][ERROR ] Traceback (most recent call last): > [ceph02][ERROR ] File > "/usr/lib/python2.7/dist-packages/ceph_deploy/hosts/debian/mon/create.py", > line 35, in create > [ceph02][ERROR ] File > "/usr/lib/python2.7/dist-packages/ceph_deploy/util/decorators.py", line 10, > in inner > [ceph02][ERROR ] File > "/usr/lib/python2.7/dist-packages/ceph_deploy/util/wrappers.py", line 6, in > remote_call > [ceph02][ERROR ] File "/usr/lib/python2.7/subprocess.py", line 511, in > check_call > [ceph02][ERROR ] raise CalledProcessError(retcode, cmd) > [ceph02][ERROR ] CalledProcessError: Command '['/usr/sbin/service', 'ceph', > 'start', 'mon.ceph02']' returned non-zero exit status 1 > [ceph_deploy.mon][ERROR ] Failed to execute command: /usr/sbin/service ceph > start mon.ceph02 > [ceph_deploy][ERROR ] GenericError: Failed to create 1 monitors > > It is unfortunate that I can't tell why this is failing by this log output. However, it does tell you the last command attempted. Have you tried that failing command (`sudo service ceph start mon.ceph02`) in the ceph02 host to see what is going on? > Any more ideas? Thanks. > > > Am 15.08.2013 um 14:40 schrieb Alfredo Deza <alfredo.deza@xxxxxxxxxxx>: > > > > > On Thu, Aug 15, 2013 at 7:45 AM, Nico Massenberg > <nico.massenberg@xxxxxxxxxxx> wrote: >> >> Hello there, >> >> I am deploying a development system with 3 hosts. I want to deploy a >> monitor on each of those hosts and several osds, 1 per disk. >> In addition I have an admin machine to use ceph-deploy from. So far I have >> 1 mon on ceph01 and a total of 6 osds on ceph01 and ceph02 in a healthy >> cluster: >> >> ceph@vl0181:~/konkluster$ ceph -s -k ceph.client.admin.keyring >> health HEALTH_OK >> monmap e1: 1 mons at {ceph01=192.168.111.10:6789/0}, election epoch 1, >> quorum 0 ceph01 >> osdmap e78: 6 osds: 6 up, 6 in >> pgmap v248: 192 pgs: 192 active+clean; 0 bytes data, 211 MB used, 3854 >> GB / 3854 GB avail >> mdsmap e1: 0/0/1 up >> >> When trying to add mon2 and mon3 to ceph02 and ceph03 I am confronted with >> the following error: >> >> ceph@vl0181:~/konkluster$ ceph-deploy mon create ceph02 >> ceph-mon: set fsid to 3dad736b-a9fc-42bf-a2fb-399cb8cbb880 >> ceph-mon: created monfs at /var/lib/ceph/mon/ceph-ceph03 for mon.ceph02 >> === mon.ceph02 === >> Starting Ceph mon.ceph02 on ceph02... >> failed: 'ulimit -n 8192; /usr/bin/ceph-mon -i ceph02 --pid-file >> /var/run/ceph/mon.ceph03.pid -c /etc/ceph/ceph.conf ' >> Starting ceph-create-keys on ceph02... >> Traceback (most recent call last): >> File "/usr/bin/ceph-deploy", line 21, in <module> >> >> >> ps aux | grep ceph on the target afterwards shows a quiet unusual output: >> >> root@ceph02:~# ps aux |grep ceph >> root 2501 0.1 0.0 26652 6952 ? S 11:47 0:08 >> /usr/bin/python /usr/sbin/ceph-create-keys -i ceph02 >> root 2677 0.0 0.1 413448 17324 ? Ssl 11:47 0:04 >> /usr/bin/ceph-osd -i 5 --pid-file /var/run/ceph/osd.5.pid -c >> /etc/ceph/ceph.conf >> root 2684 0.0 0.0 4096 612 ? Ss 11:47 0:00 startpar >> -f -- ceph >> root 4069 0.0 0.0 71172 3564 ? Ss 11:53 0:00 sshd: >> ceph [priv] >> ceph 4071 0.0 0.0 71536 1804 ? S 11:53 0:00 sshd: >> ceph@notty >> ceph 4072 0.0 0.0 4176 580 ? Ss 11:53 0:00 sh -c >> "sudo" "python" "-u" "-c" "exec reduce(lambda a,b: a+b, map(chr, >> (105,109,112,111,114,116,32,95,95,98,117,105,108,116,105,110,95,95,44,32,111,115,44,32,109,97,114,115,104,97,108,44,32,115,121,115,10,116,114,121,58,10,32,32,32,32,105,109,112,111,114,116,32,104,97,115,104,108,105,98,10,101,120,99,101,112,116,32,73,109,112,111,114,116,69,114,114,111,114,58,10,32,32,32,32,105,109,112,111,114,116,32,109,100,53,32,97,115,32,104,97,115,104,108,105,98,10,10,35,32,66,97,99,107,32,117,112,32,111,108,100,32,115,116,100,105,110,47,115,116,100,111,117,116,46,10,115,116,100,111,117,116,32,61,32,111,115,46,102,100,111,112,101,110,40,111,115,46,100,117,112,40,115,121,115,46,115,116,100,111,117,116,46,102,105,108,101,110,111,40,41,41,44,32,34,119,98,34,44,32,48,41,10,115,116,100,105,110,32,61,32,111,115,46,102,100,111,112,101,110,40,111,115,46,100,117,112,40,115,121,115,46,115,116,100,105,110,46,102,105,108,101,110,111,40, >> >> 41,41,44,32,34,114,98,34,44,32,48,41,10,116,114,121,58,10,32,32,32,32,105,109,112,111,114,116,32,109,115,118,99,114,116,10,32,32,32,32,109,115,118,99,114,116,46,115,101,116,109,111,100,101,40,115,116,100,111,117,116,46,102,105,108,101,110,111,40,41,44,32,111,115,46,79,95,66,73,78,65,82,89,41,10,32,32,32,32,109,115,118,99,114,116,46,115,101,116,109,111,100,101,40,115,116,100,105,110,46,102,105,108,101,110,111,40,41,44,32,111,115,46,79,95,66,73,78,65,82,89,41,10,101,120,99,101,112,116,32,73,109,112,111,114,116,69,114,114,111,114,58,32,112,97,115,115,10,115,121,115,46,115,116,100,111,117,116,46,99,108,111,115,101,40,41,10,115,121,115,46,115,116,100,105,110,46,99,108,111,115,101,40,41,10,10,115,101,114,118,101,114,83,111,117,114,99,101,76,101,110,103,116,104,32,61,32,50,48,48,49,57,10,115,101,114,118,101,114,83,111,117,114,99,101,32,61,32,115,116,100,105,110,46,114,101,97,100,40,115,101,114,118,101,114,83,111,117,114,99,101,76,101,110,103,116,104,41,10,119,104,105,108,101,32,1 08 >> >> ,101,110,40,115,101,114,118,101,114,83,111,117,114,99,101,41,32,60,32,115,101,114,118,101,114,83,111,117,114,99,101,76,101,110,103,116,104,58,10,32,32,32,32,115,101,114,118,101,114,83,111,117,114,99,101,32,43,61,32,115,116,100,105,110,46,114,101,97,100,40,115,101,114,118,101,114,83,111,117,114,99,101,76,101,110,103,116,104,32,45,32,108,101,110,40,115,101,114,118,101,114,83,111,117,114,99,101,41,41,10,10,116,114,121,58,10,32,32,32,32,97,115,115,101,114,116,32,104,97,115,104,108,105,98,46,109,100,53,40,115,101,114,118,101,114,83,111,117,114,99,101,41,46,100,105,103,101,115,116,40,41,32,61,61,32,39,92,120,97,99,92,120,100,49,57,92,120,98,51,92,120,100,48,92,120,101,97,100,92,120,100,54,108,92,120,56,100,92,120,101,48,75,47,92,120,57,99,41,105,39,10,32,32,32,32,95,95,98,117,105,108,116,105,110,95,95,46,112,117,115,104,121,95,115,111,117,114,99,101,32,61,32,115,101,114,118,101,114,83,111,117,114,99,101,10,32,32,32,32,115,101,114,118,101,114,67,111,100,101,32,61,32,109,97,114,11 5, >> >> 104,97,108,46,108,111,97,100,115,40,115,101,114,118,101,114,83,111,117,114,99,101,41,10,32,32,32,32,101,120,101,99,32,115,101,114,118,101,114,67,111,100,101,10,32,32,32,32,112,117,115,104,121,95,115,101,114,118,101,114,40,115,116,100,105,110,44,32,115,116,100,111,117,116,41,10,101,120,99,101,112,116,58,10,32,32,32,32,105,109,112,111,114,116,32,116,114,97,99,101,98,97,99,107,10,32,32,32,32,35,32,85,110,99,111,109,109,101,110,116,32,102,111,114,32,100,101,98,117,103,103,105,110,103,10,32,32,32,32,35,32,116,114,97,99,101,98,97,99,107,46,112,114,105,110,116,95,101,120,99,40,102,105,108,101,61,111,112,101,110,40,34,115,116,100,101,114,114,46,116,120,116,34,44,32,34,119,34,41,41,10,32,32,32,32,114,97,105,115,101)))" >> root 4190 0.1 0.0 36608 7176 ? S 11:53 0:07 >> /usr/bin/python /usr/sbin/ceph-create-keys -i ceph02 >> >> No problems occurred on initial mon setup. >> All hosts run on Debian Squeeze with a 3.6 Kernel. Cuttlefish stable >> release. >> Any ideas would be highly appreciated! > > > Hi Nico, > > We are currently dealing with this issue directly, (see ticket: > http://tracker.ceph.com/issues/5895). We are having problems with the > upstream library ceph-deploy uses to do remote calls. > > I'm sure however, that the process to create the mon completes correctly, > except that `ceph-create-keys` might take a while to complete. > > We should have a resolution for this specific problem today and a following > ceph-deploy release soon after. > > Thanks for letting us know! >> >> Thanks, Nico >> _______________________________________________ >> ceph-users mailing list >> ceph-users@xxxxxxxxxxxxxx >> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com > > > _______________________________________________ ceph-users mailing list ceph-users@xxxxxxxxxxxxxx http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
 |