Re: Unable to find bootstrap-osd and bootstrap-mds ceph.keyring

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



On Fri, Nov 8, 2013 at 7:41 AM, Vikrant Verma <vikrantverma99@xxxxxxxxx> wrote:
> Hi All,
>
> I am able to Add a Ceph Monitor (step 3) as per the link
> http://ceph.com/docs/master/start/quick-ceph-deploy/  (Setting Up Ceph
> Storage Cluster)
>
>
>
> But when I am executing the gatherkey command, I am getting the
> warnings(highlighted in yellow). Please find the details –
>
>
>
> Command – “ceph-deploy gatherkeys vikrant”    (vikrant is the hostname of
> the ceph-node1)
>
> Output –
>
> [ceph_deploy.cli][INFO  ] Invoked (1.3.1): /usr/bin/ceph-deploy gatherkeys
> vikrant
> [ceph_deploy.gatherkeys][DEBUG ] Have ceph.client.admin.keyring
> [ceph_deploy.gatherkeys][DEBUG ] Have ceph.mon.keyring
> [ceph_deploy.gatherkeys][DEBUG ] Checking vikrant for
> /var/lib/ceph/bootstrap-osd/ceph.keyring
> [vikrant][DEBUG ] connected to host: vikrant
> [vikrant][DEBUG ] detect platform information from remote host
> [vikrant][DEBUG ] detect machine type
> [vikrant][DEBUG ] fetch remote file
> [ceph_deploy.gatherkeys][WARNIN] Unable to find
> /var/lib/ceph/bootstrap-osd/ceph.keyring on ['vikrant']
> [ceph_deploy.gatherkeys][DEBUG ] Checking vikrant for
> /var/lib/ceph/bootstrap-mds/ceph.keyring
> [vikrant][DEBUG ] connected to host: vikrant
> [vikrant][DEBUG ] detect platform information from remote host
> [vikrant][DEBUG ] detect machine type
> [vikrant][DEBUG ] fetch remote file
> [ceph_deploy.gatherkeys][WARNIN] Unable to find
> /var/lib/ceph/bootstrap-mds/ceph.keyring on ['vikrant']
>
>
>
> I checked ceph.keyring is not generated for bootstrap-osd and bootstrap-mds
> in ceph-node1, due to which the next command “ceph-deploy osd prepare
> ceph-node2” is giving error.
>
>
>
> Please find the setup details –
>
> One Admin Node – from where I am executing ceph-deploy commands
>
> Ceph-node1 – this is the ceph monitor, (hostname is vikrant)
>
> Ceph-node2 – Ceph OSD, this is on a separate machine ( as of now I am trying
> to configure one OSD, in the link they have mentioned the example for two
> OSD)

I think this Ceph-node2 is the problem. If I am understanding this
correctly, there is no monitor in that node correct?

When you start a monitor in a host, that monitor will also create the
keys for you with `ceph-create-keys`. Running only one monitor in one
host
and not in the other one is something I am not familiar with, but I
guess you could run that manually?

>
>
>
> Content of ceph.conf (this is same for admin node and ceph-node1)
>
> [global]
> fsid = eb4099a6-d2ab-437c-94f2-f3b43b3170d1
> mon_initial_members = vikrant
> mon_host = 10.XX.XX.XX
> auth_supported = cephx
> osd_journal_size = 1024
> filestore_xattr_use_omap = true
>
>
>
>
>
> Output of “ceph-deploy mon create vikrant” command (vikrant is the hostname
> of the ceph-node1)  --
>
> ---------------------------------------------ceph-deploy mon create vikrant
> -----o/p--------------------------
>
> [ceph_deploy.cli][INFO  ] Invoked (1.3.1): /usr/bin/ceph-deploy mon create
> vikrant
>
> [ceph_deploy.mon][DEBUG ] Deploying mon, cluster ceph hosts vikrant
>
> [ceph_deploy.mon][DEBUG ] detecting platform for host vikrant ...
>
> [vikrant][DEBUG ] connected to host: vikrant
>
> [vikrant][DEBUG ] detect platform information from remote host
>
> [vikrant][DEBUG ] detect machine type
>
> [ceph_deploy.mon][INFO  ] distro info: Ubuntu 12.04 precise
>
> [vikrant][DEBUG ] determining if provided host has same hostname in remote
>
> [vikrant][DEBUG ] get remote short hostname
>
> [vikrant][DEBUG ] deploying mon to vikrant
>
> [vikrant][DEBUG ] get remote short hostname
>
> [vikrant][DEBUG ] remote hostname: vikrant
>
> [vikrant][DEBUG ] write cluster configuration to /etc/ceph/{cluster}.conf
>
> [vikrant][DEBUG ] create the mon path if it does not exist
>
> [vikrant][DEBUG ] checking for done path:
> /var/lib/ceph/mon/ceph-vikrant/done
>
> [vikrant][DEBUG ] done path does not exist:
> /var/lib/ceph/mon/ceph-vikrant/done
>
> [vikrant][INFO  ] creating tmp path: /var/lib/ceph/tmp
>
> [vikrant][INFO  ] creating keyring file:
> /var/lib/ceph/tmp/ceph-vikrant.mon.keyring
>
> [vikrant][DEBUG ] create the monitor keyring file
>
> [vikrant][INFO  ] Running command: sudo ceph-mon --cluster ceph --mkfs -i
> vikrant --keyring /var/lib/ceph/tmp/ceph-vikrant.mon.keyring
>
> [vikrant][DEBUG ] ceph-mon: mon.noname-a 10.XX.XX.XX:6789/0 is local,
> renaming to mon.vikrant
>
> [vikrant][DEBUG ] ceph-mon: set fsid to eb4099a6-d2ab-437c-94f2-f3b43b3170d1
>
> [vikrant][DEBUG ] ceph-mon: created monfs at /var/lib/ceph/mon/ceph-vikrant
> for mon.vikrant
>
> [vikrant][INFO  ] unlinking keyring file
> /var/lib/ceph/tmp/ceph-vikrant.mon.keyring
>
> [vikrant][DEBUG ] create a done file to avoid re-doing the mon deployment
>
> [vikrant][DEBUG ] create the init path if it does not exist
>
> [vikrant][DEBUG ] locating the `service` executable...
>
> [vikrant][INFO  ] Running command: sudo initctl emit ceph-mon cluster=ceph
> id=vikrant
>
> [vikrant][INFO  ] Running command: sudo ceph --cluster=ceph --admin-daemon
> /var/run/ceph/ceph-mon.vikrant.asok mon_status
>
> [vikrant][DEBUG ]
> ********************************************************************************
>
> [vikrant][DEBUG ] status for monitor: mon.vikrant
>
> [vikrant][DEBUG ] {
>
> [vikrant][DEBUG ]   "election_epoch": 2,
>
> [vikrant][DEBUG ]   "extra_probe_peers": [],
>
> [vikrant][DEBUG ]   "monmap": {
>
> [vikrant][DEBUG ]     "created": "0.000000",
>
> [vikrant][DEBUG ]     "epoch": 1,
>
> [vikrant][DEBUG ]     "fsid": "eb4099a6-d2ab-437c-94f2-f3b43b3170d1",
>
> [vikrant][DEBUG ]     "modified": "0.000000",
>
> [vikrant][DEBUG ]     "mons": [
>
> [vikrant][DEBUG ]       {
>
> [vikrant][DEBUG ]         "addr": "10.XX.XX.XX:6789/0",
>
> [vikrant][DEBUG ]         "name": "vikrant",
>
> [vikrant][DEBUG ]         "rank": 0
>
> [vikrant][DEBUG ]       }
>
> [vikrant][DEBUG ]     ]
>
> [vikrant][DEBUG ]   },
>
> [vikrant][DEBUG ]   "name": "vikrant",
>
> [vikrant][DEBUG ]   "outside_quorum": [],
>
> [vikrant][DEBUG ]   "quorum": [
>
> [vikrant][DEBUG ]     0
>
> [vikrant][DEBUG ]   ],
>
> [vikrant][DEBUG ]   "rank": 0,
>
> [vikrant][DEBUG ]   "state": "leader"
>
> [vikrant][DEBUG ] }
>
> [vikrant][DEBUG ]
> ********************************************************************************
>
> [vikrant][INFO  ] monitor: mon.vikrant is running
>
> [vikrant][INFO  ] Running command: sudo ceph --cluster=ceph --admin-daemon
> /var/run/ceph/ceph-mon.vikrant.asok mon_status
>
>
>
> Please let me know if you need any further information.
>
>
>
> The intention is to setup a Ceph Block Device as per the link
> http://ceph.com/docs/master/start/quick-rbd/ , and it is mentioned in the
> link that Ceph Storage Cluster needs to be setup first before working with
> Ceph Block Device.
>
>
>
> Please let me know your inputs on the above.
>
>
>
> Regards,
>
> Vikrant
>
> _______________________________________________
> ceph-users mailing list
> ceph-users@xxxxxxxxxxxxxx
> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
>
_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com





[Index of Archives]     [Information on CEPH]     [Linux Filesystem Development]     [Ceph Development]     [Ceph Large]     [Ceph Dev]     [Linux USB Development]     [Video for Linux]     [Linux Audio Users]     [Yosemite News]     [Linux Kernel]     [Linux SCSI]     [xfs]


  Powered by Linux