mkdir -p /var/lib/ceph/{tmp,mon,mds,bootstrap-osd}- Important Do not call ceph-deploy with sudo or run it as root if you are logged in as a different user, because it will not issue sudo commands needed on the remote host.
Karan Singh
To: ceph-users@xxxxxxxxxxxxxx
Sent: Friday, 8 November, 2013 2:41:36 PM
Subject: Unable to find bootstrap-osd and bootstrap-mds ceph.keyring
I am able to Add a Ceph Monitor (step 3) as per the link http://ceph.com/docs/master/start/quick-ceph-deploy/ (Setting Up Ceph Storage Cluster)
But when I am executing the gatherkey command, I am getting the warnings(highlighted in yellow). Please find the details –
Command – “ceph-deploy gatherkeys vikrant” (vikrant is the hostname of the ceph-node1)
Output –
[ceph_deploy.cli][INFO ] Invoked (1.3.1):
/usr/bin/ceph-deploy gatherkeys vikrant
[ceph_deploy.gatherkeys][DEBUG ] Have
ceph.client.admin.keyring
[ceph_deploy.gatherkeys][DEBUG ] Have
ceph.mon.keyring
[ceph_deploy.gatherkeys][DEBUG ] Checking
vikrant for /var/lib/ceph/bootstrap-osd/ceph.keyring
[vikrant][DEBUG ] connected to host: vikrant
[vikrant][DEBUG ] detect platform information
from remote host
[vikrant][DEBUG ] detect machine type
[vikrant][DEBUG ] fetch remote file
[ceph_deploy.gatherkeys][WARNIN]
Unable to find /var/lib/ceph/bootstrap-osd/ceph.keyring on ['vikrant']
[ceph_deploy.gatherkeys][DEBUG ] Checking
vikrant for /var/lib/ceph/bootstrap-mds/ceph.keyring
[vikrant][DEBUG ] connected to host: vikrant
[vikrant][DEBUG ] detect platform information
from remote host
[vikrant][DEBUG ] detect machine type
[vikrant][DEBUG ] fetch remote file
[ceph_deploy.gatherkeys][WARNIN]
Unable to find /var/lib/ceph/bootstrap-mds/ceph.keyring on ['vikrant']
I checked ceph.keyring is not generated for bootstrap-osd and bootstrap-mds in ceph-node1, due to which the next command “ceph-deploy osd prepare ceph-node2” is giving error.
Please find the setup details –
One Admin Node – from where I am executing ceph-deploy commands
Ceph-node1 – this is the ceph monitor, (hostname is vikrant)
Ceph-node2 – Ceph OSD, this is on a separate machine ( as of now I am trying to configure one OSD, in the link they have mentioned the example for two OSD)
Content of ceph.conf (this is same for admin node and ceph-node1)
[global]
fsid = eb4099a6-d2ab-437c-94f2-f3b43b3170d1
mon_initial_members = vikrant
mon_host = 10.XX.XX.XX
auth_supported = cephx
osd_journal_size = 1024
filestore_xattr_use_omap = true
Output of “ceph-deploy mon create vikrant” command (vikrant is the hostname of the ceph-node1) --
---------------------------------------------ceph-deploy mon create vikrant -----o/p--------------------------
[ceph_deploy.cli][INFO ] Invoked (1.3.1): /usr/bin/ceph-deploy mon create vikrant
[ceph_deploy.mon][DEBUG ] Deploying mon, cluster ceph hosts vikrant
[ceph_deploy.mon][DEBUG ] detecting platform for host vikrant ...
[vikrant][DEBUG ] connected to host: vikrant
[vikrant][DEBUG ] detect platform information from remote host
[vikrant][DEBUG ] detect machine type
[ceph_deploy.mon][INFO ] distro info: Ubuntu 12.04 precise
[vikrant][DEBUG ] determining if provided host has same hostname in remote
[vikrant][DEBUG ] get remote short hostname
[vikrant][DEBUG ] deploying mon to vikrant
[vikrant][DEBUG ] get remote short hostname
[vikrant][DEBUG ] remote hostname: vikrant
[vikrant][DEBUG ] write cluster configuration to /etc/ceph/{cluster}.conf
[vikrant][DEBUG ] create the mon path if it does not exist
[vikrant][DEBUG ] checking for done path: /var/lib/ceph/mon/ceph-vikrant/done
[vikrant][DEBUG ] done path does not exist: /var/lib/ceph/mon/ceph-vikrant/done
[vikrant][INFO ] creating tmp path: /var/lib/ceph/tmp
[vikrant][INFO ] creating keyring file: /var/lib/ceph/tmp/ceph-vikrant.mon.keyring
[vikrant][DEBUG ] create the monitor keyring file
[vikrant][INFO ] Running command: sudo ceph-mon --cluster ceph --mkfs -i vikrant --keyring /var/lib/ceph/tmp/ceph-vikrant.mon.keyring
[vikrant][DEBUG ] ceph-mon: mon.noname-a 10.XX.XX.XX:6789/0 is local, renaming to mon.vikrant
[vikrant][DEBUG ] ceph-mon: set fsid to eb4099a6-d2ab-437c-94f2-f3b43b3170d1
[vikrant][DEBUG ] ceph-mon: created monfs at /var/lib/ceph/mon/ceph-vikrant for mon.vikrant
[vikrant][INFO ] unlinking keyring file /var/lib/ceph/tmp/ceph-vikrant.mon.keyring
[vikrant][DEBUG ] create a done file to avoid re-doing the mon deployment
[vikrant][DEBUG ] create the init path if it does not exist
[vikrant][DEBUG ] locating the `service` executable...
[vikrant][INFO ] Running command: sudo initctl emit ceph-mon cluster=ceph id=vikrant
[vikrant][INFO ] Running command: sudo ceph --cluster=ceph --admin-daemon /var/run/ceph/ceph-mon.vikrant.asok mon_status
[vikrant][DEBUG ] ********************************************************************************
[vikrant][DEBUG ] status for monitor: mon.vikrant
[vikrant][DEBUG ] {
[vikrant][DEBUG ] "election_epoch": 2,
[vikrant][DEBUG ] "extra_probe_peers": [],
[vikrant][DEBUG ] "monmap": {
[vikrant][DEBUG ] "created": "0.000000",
[vikrant][DEBUG ] "epoch": 1,
[vikrant][DEBUG ] "fsid": "eb4099a6-d2ab-437c-94f2-f3b43b3170d1",
[vikrant][DEBUG ] "modified": "0.000000",
[vikrant][DEBUG ] "mons": [
[vikrant][DEBUG ] {
[vikrant][DEBUG ] "addr": "10.XX.XX.XX:6789/0",
[vikrant][DEBUG ] "name": "vikrant",
[vikrant][DEBUG ] "rank": 0
[vikrant][DEBUG ] }
[vikrant][DEBUG ] ]
[vikrant][DEBUG ] },
[vikrant][DEBUG ] "name": "vikrant",
[vikrant][DEBUG ] "outside_quorum": [],
[vikrant][DEBUG ] "quorum": [
[vikrant][DEBUG ] 0
[vikrant][DEBUG ] ],
[vikrant][DEBUG ] "rank": 0,
[vikrant][DEBUG ] "state": "leader"
[vikrant][DEBUG ] }
[vikrant][DEBUG ] ********************************************************************************
[vikrant][INFO ] monitor: mon.vikrant is running
[vikrant][INFO ] Running command: sudo ceph --cluster=ceph --admin-daemon /var/run/ceph/ceph-mon.vikrant.asok mon_status
Please let me know if you need any further information.
The intention is to setup a Ceph Block Device as per the link http://ceph.com/docs/master/start/quick-rbd/ , and it is mentioned in the link that Ceph Storage Cluster needs to be setup first before working with Ceph Block Device.
Please let me know your inputs on the above.
Regards,
Vikrant_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
_______________________________________________ ceph-users mailing list ceph-users@xxxxxxxxxxxxxx http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
