To start over is easier to do it from scratch to avoid configuration
problems and other things that might bite you back
like stale keyrings.
It has happened to me more than once :)
When I need to start from scratch I call 'ceph-deploy purge NODE &&
ceph-deploy purge-data'
And then remove all the files in the current working directory and
then start again.
On Mon, Feb 24, 2014 at 7:31 PM, 常乐 <changlecsu@xxxxxxxxx> wrote:
> hi Alfredo,
>
> I tried manual before but get stuck creating osd. Now i decide to fix all
> these problems. I google d for these problems but there seems to be no sign
> on the internet. I also attached the log here. I didnt see any sign that
> these keys are created.
> I am using ceph 0.72, and ubuntu servet lts 12.04.
>
> Btw, do i have to do extra work than in the ceph doc? Could you pls provide
> some refs? Thanks!
>
>
> [ceph_deploy.cli][INFO ] Invoked (1.3.5): /usr/bin/ceph-deploy mon
> create-initial[ceph_deploy.mon][DEBUG ] Deploying mon, cluster ceph hosts
> compute1
>
> [ceph_deploy.mon][DEBUG ] detecting platform for host compute1 ...
>
> [compute1][DEBUG ] connected to host: compute1
>
> [compute1][DEBUG ] detect platform information from remote host
>
> [compute1][DEBUG ] detect machine type[ceph_deploy.mon][INFO ] distro info:
> Ubuntu 12.04 precise
>
> [compute1][DEBUG ] determining if provided host has same hostname in remote
>
> [compute1][DEBUG ] get remote short hostname[compute1][DEBUG ] deploying mon
> to compute1
>
> [compute1][DEBUG ] get remote short hostname
>
> [compute1][DEBUG ] remote hostname: compute1
>
> [compute1][DEBUG ] write cluster configuration to /etc/ceph/{cluster}.conf
>
> [compute1][DEBUG ] create the mon path if it does not exist
>
> [compute1][DEBUG ] checking for done path:
> /var/lib/ceph/mon/ceph-compute1/done[compute1][DEBUG ] done path does not
> exist: /var/lib/ceph/mon/ceph-compute1/done[compute1][INFO ] creating
> keyring file: /var/lib/ceph/tmp/ceph-compute1.mon.keyring
>
> [compute1][DEBUG ] create the monitor keyring file[compute1][INFO ] Running
> command: sudo ceph-mon --cluster ceph --mkfs -i compute1 --keyring
> /var/lib/ceph/tmp/ceph-compute1.mon.keyring[compute1][DEBUG ] ceph-mon: set
> fsid to 42b3c138-b0fb-49a9-b9c4-13a7841fe68b[compute1][DEBUG ] ceph-mon:
> created monfs at /var/lib/ceph/mon/ceph-compute1 for
> mon.compute1[compute1][INFO ] unlinking keyring file
> /var/lib/ceph/tmp/ceph-compute1.mon.keyring
>
> [compute1][DEBUG ] create a done file to avoid re-doing the mon deployment
>
> [compute1][DEBUG ] create the init path if it does not exist
>
> [compute1][DEBUG ] locating the `service` executable...[compute1][INFO ]
> Running command: sudo initctl emit ceph-mon cluster=ceph id=compute1
>
> [compute1][INFO ] unlinking keyring file
> /var/lib/ceph/tmp/ceph-compute1.mon.keyring
>
> [compute1][DEBUG ] create a done file to avoid re-doing the mon deployment
>
> [compute1][DEBUG ] create the init path if it does not exist
>
> [compute1][DEBUG ] locating the `service` executable...
>
> [compute1][INFO ] Running command: sudo initctl emit ceph-mon cluster=ceph
> id=compute1[compute1][INFO ] Running command: sudo ceph --cluster=ceph
> --admin-daemon /var/run/ceph/ceph-mon.compute1.asok
> mon_status[compute1][DEBUG ]
> ********************************************************************************
>
> [compute1][DEBUG ] status for monitor: mon.compute1
>
> [compute1][DEBUG ] {[compute1][DEBUG ] "election_epoch": 2,
>
> [compute1][DEBUG ] "extra_probe_peers": [[compute1][DEBUG ]
> "192.168.2.23:6789/0"
>
> [compute1][DEBUG ] ],
>
> [compute1][DEBUG ] "monmap": {[compute1][DEBUG ] "created":
> "0.000000",
>
> [compute1][DEBUG ] "epoch": 1,
>
> [compute1][DEBUG ] "fsid":
> "42b3c138-b0fb-49a9-b9c4-13a7841fe68b",[compute1][DEBUG ] "modified":
> "0.000000",
>
> [compute1][DEBUG ] "mons": [
>
> 550,1
> 92%
>
> [compute1][DEBUG ] create the monitor keyring file
>
> [compute1][INFO ] Running command: sudo ceph-mon --cluster ceph --mkfs -i
> compute1 --keyring /var/lib/ceph/tmp/ceph-compute1.mon.keyring
>
> [compute1][DEBUG ] ceph-mon: set fsid to
> 42b3c138-b0fb-49a9-b9c4-13a7841fe68b
>
> [compute1][DEBUG ] ceph-mon: created monfs at
> /var/lib/ceph/mon/ceph-compute1 for mon.compute1
>
> [compute1][INFO ] unlinking keyring file
> /var/lib/ceph/tmp/ceph-compute1.mon.keyring
>
> [compute1][DEBUG ] create a done file to avoid re-doing the mon deployment
>
> [compute1][DEBUG ] create the init path if it does not exist
>
> [compute1][DEBUG ] locating the `service` executable...
>
> [compute1][INFO ] Running command: sudo initctl emit ceph-mon cluster=ceph
> id=compute1
>
> [compute1][INFO ] Running command: sudo ceph --cluster=ceph --admin-daemon
> /var/run/ceph/ceph-mon.compute1.asok mon_status
>
> [compute1][DEBUG ]
> ********************************************************************************
>
> [compute1][DEBUG ] status for monitor: mon.compute1
>
> [compute1][DEBUG ] {
>
> [compute1][DEBUG ] "election_epoch": 2,
>
> [compute1][DEBUG ] "extra_probe_peers": [
>
> [compute1][DEBUG ] "192.168.2.23:6789/0"
>
> [compute1][DEBUG ] ],
>
> [compute1][DEBUG ] "monmap": {
>
> [compute1][DEBUG ] "created": "0.000000",
>
> [compute1][DEBUG ] "epoch": 1,
>
> [compute1][DEBUG ] "fsid": "42b3c138-b0fb-49a9-b9c4-13a7841fe68b",
>
> [compute1][DEBUG ] "modified": "0.000000",
>
> [compute1][DEBUG ] "mons": [
>
> [compute1][DEBUG ] {
>
> [compute1][DEBUG ] "addr": "10.71.149.23:6789/0",
>
> [compute1][DEBUG ] "name": "compute1",
>
> [compute1][DEBUG ] "rank": 0
>
> [compute1][DEBUG ] }
>
> [compute1][DEBUG ] ]
>
> [compute1][DEBUG ] },
>
> [compute1][DEBUG ] "name": "compute1",
>
> [compute1][DEBUG ] "outside_quorum": [],
>
> [compute1][DEBUG ] "quorum": [
>
> [compute1][DEBUG ] 0
>
> [compute1][DEBUG ] ],
>
> [compute1][DEBUG ] "rank": 0,
>
> [compute1][DEBUG ] "state": "leader",
>
> [compute1][DEBUG ] "sync_provider": []
>
> [compute1][DEBUG ] }
>
> [compute1][DEBUG ]
> ********************************************************************************
>
> [compute1][INFO ] monitor: mon.compute1 is running
>
> [compute1][INFO ] Running command: sudo ceph --cluster=ceph --admin-daemon
> /var/run/ceph/ceph-mon.compute1.asok mon_status
>
> [ceph_deploy.mon][INFO ] processing monitor mon.compute1
>
> [compute1][DEBUG ] connected to host: compute1
>
> [compute1][INFO ] Running command: sudo ceph --cluster=ceph --admin-daemon
> /var/run/ceph/ceph-mon.compute1.asok mon_status
>
> [ceph_deploy.mon][INFO ] mon.compute1 monitor has reached quorum!
>
> [ceph_deploy.mon][INFO ] all initial monitors are running and have formed
> quorum
>
> [ceph_deploy.mon][INFO ] Running gatherkeys...
>
> [ceph_deploy.gatherkeys][DEBUG ] Checking compute1 for
> /etc/ceph/ceph.client.admin.keyring
>
> [compute1][DEBUG ] connected to host: compute1
>
> [compute1][DEBUG ] detect platform information from remote host
>
> [compute1][DEBUG ] detect machine type
>
> [compute1][DEBUG ] fetch remote file
>
> [ceph_deploy.gatherkeys][WARNING] Unable to find
> /etc/ceph/ceph.client.admin.keyring on ['compute1']
>
> [ceph_deploy.gatherkeys][DEBUG ] Have ceph.mon.keyring
>
> [ceph_deploy.gatherkeys][DEBUG ] Checking compute1 for
> /var/lib/ceph/bootstrap-osd/ceph.keyring
>
> [compute1][DEBUG ] connected to host: compute1
>
> [compute1][DEBUG ] detect platform information from remote host
>
> [compute1][DEBUG ] detect machine type
>
> [compute1][DEBUG ] fetch remote file
>
> [ceph_deploy.gatherkeys][WARNING] Unable to find
> /var/lib/ceph/bootstrap-osd/ceph.keyring on ['compute1']
>
> [ceph_deploy.gatherkeys][DEBUG ] Checking compute1 for
> /var/lib/ceph/bootstrap-mds/ceph.keyring
>
> [compute1][DEBUG ] connected to host: compute1
>
> [compute1][DEBUG ] detect platform information from remote host
>
> [compute1][DEBUG ] detect machine type
>
> [compute1][DEBUG ] fetch remote file
>
> [ceph_deploy.gatherkeys][WARNING] Unable to find
> /var/lib/ceph/bootstrap-mds/ceph.keyring on ['compute1']
>
> On Feb 24, 2014 11:39 PM, "Alfredo Deza" <alfredo.deza@xxxxxxxxxxx> wrote:
>>
>> On Mon, Feb 24, 2014 at 9:22 AM, 常乐 <changlecsu@xxxxxxxxx> wrote:
>> > Hi,
>> >
>> >
>> > I tried to follow the instructions here to set up my Ceph cluster:
>> >
>> > http://ceph.com/docs/master/start/quick-ceph-deploy/
>> >
>> >
>> > However, I get into stuck in step 4.
>> >
>> > It seems that some keys are missing (I also checked those folders). But
>> > I
>> > don't know in which step are these keys created. Is it in step 1
>> > (ceph-deploy new) or step 2 (ceph-deploy install)? Thanks in advance.
>>
>> Keys get created when your monitors have started and formed quorum. It
>> does seem like
>> that is the case for your monitor. Have you tried starting it manually
>> and see if it complains? I would
>> also check the logs to see if they are mentioning something useful.
>>
>>
>> >
>> >
>> >
>> > The command line output is as follows. compute1 is my ceph monitor.
>> >
>> >
>> > [ceph_deploy.mon][INFO ] processing monitor mon.compute1
>> >
>> > [compute1][DEBUG ] connected to host: compute1
>> >
>> > [compute1][INFO ] Running command: sudo ceph --cluster=ceph
>> > --admin-daemon
>> > /var/run/ceph/ceph-mon.compute1.asok mon_status
>> >
>> > [ceph_deploy.mon][INFO ] mon.compute1 monitor has reached quorum!
>> >
>> > [ceph_deploy.mon][INFO ] all initial monitors are running and have
>> > formed
>> > quorum
>> >
>> > [ceph_deploy.mon][INFO ] Running gatherkeys...
>> >
>> > [ceph_deploy.gatherkeys][DEBUG ] Checking compute1 for
>> > /etc/ceph/ceph.client.admin.keyring
>> >
>> > [compute1][DEBUG ] connected to host: compute1
>> >
>> > [compute1][DEBUG ] detect platform information from remote host
>> >
>> > [compute1][DEBUG ] detect machine type
>> >
>> > [compute1][DEBUG ] fetch remote file
>> >
>> > [ceph_deploy.gatherkeys][WARNIN] Unable to find
>> > /etc/ceph/ceph.client.admin.keyring on ['compute1']
>> >
>> > [ceph_deploy.gatherkeys][DEBUG ] Have ceph.mon.keyring
>> >
>> > [ceph_deploy.gatherkeys][DEBUG ] Checking compute1 for
>> > /var/lib/ceph/bootstrap-osd/ceph.keyring
>> >
>> > [compute1][DEBUG ] connected to host: compute1
>> >
>> > [compute1][DEBUG ] detect platform information from remote host
>> >
>> > [compute1][DEBUG ] detect machine type
>> >
>> > [compute1][DEBUG ] fetch remote file
>> >
>> > [ceph_deploy.gatherkeys][WARNIN] Unable to find
>> > /var/lib/ceph/bootstrap-osd/ceph.keyring on ['compute1']
>> >
>> > [ceph_deploy.gatherkeys][DEBUG ] Checking compute1 for
>> > /var/lib/ceph/bootstrap-mds/ceph.keyring
>> >
>> > [compute1][DEBUG ] connected to host: compute1
>> >
>> > [compute1][DEBUG ] detect platform information from remote host
>> >
>> > [compute1][DEBUG ] detect machine type
>> >
>> > [compute1][DEBUG ] fetch remote file
>> >
>> > [ceph_deploy.gatherkeys][WARNIN] Unable to find
>> > /var/lib/ceph/bootstrap-mds/ceph.keyring on ['compute1']
>> >
>> >
>> > --
>> > Bill Chang
>> >
>> > _______________________________________________
>> > ceph-users mailing list
>> > ceph-users@xxxxxxxxxxxxxx
>> > http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
>> >
_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
