On Fri, Nov 8, 2013 at 7:41 AM, Vikrant Verma <vikrantverma99@xxxxxxxxx> wrote: > Hi All, > > I am able to Add a Ceph Monitor (step 3) as per the link > http://ceph.com/docs/master/start/quick-ceph-deploy/ (Setting Up Ceph > Storage Cluster) > > > > But when I am executing the gatherkey command, I am getting the > warnings(highlighted in yellow). Please find the details – > > > > Command – “ceph-deploy gatherkeys vikrant” (vikrant is the hostname of > the ceph-node1) > > Output – > > [ceph_deploy.cli][INFO ] Invoked (1.3.1): /usr/bin/ceph-deploy gatherkeys > vikrant > [ceph_deploy.gatherkeys][DEBUG ] Have ceph.client.admin.keyring > [ceph_deploy.gatherkeys][DEBUG ] Have ceph.mon.keyring > [ceph_deploy.gatherkeys][DEBUG ] Checking vikrant for > /var/lib/ceph/bootstrap-osd/ceph.keyring > [vikrant][DEBUG ] connected to host: vikrant > [vikrant][DEBUG ] detect platform information from remote host > [vikrant][DEBUG ] detect machine type > [vikrant][DEBUG ] fetch remote file > [ceph_deploy.gatherkeys][WARNIN] Unable to find > /var/lib/ceph/bootstrap-osd/ceph.keyring on ['vikrant'] > [ceph_deploy.gatherkeys][DEBUG ] Checking vikrant for > /var/lib/ceph/bootstrap-mds/ceph.keyring > [vikrant][DEBUG ] connected to host: vikrant > [vikrant][DEBUG ] detect platform information from remote host > [vikrant][DEBUG ] detect machine type > [vikrant][DEBUG ] fetch remote file > [ceph_deploy.gatherkeys][WARNIN] Unable to find > /var/lib/ceph/bootstrap-mds/ceph.keyring on ['vikrant'] > > > > I checked ceph.keyring is not generated for bootstrap-osd and bootstrap-mds > in ceph-node1, due to which the next command “ceph-deploy osd prepare > ceph-node2” is giving error. > > > > Please find the setup details – > > One Admin Node – from where I am executing ceph-deploy commands > > Ceph-node1 – this is the ceph monitor, (hostname is vikrant) > > Ceph-node2 – Ceph OSD, this is on a separate machine ( as of now I am trying > to configure one OSD, in the link they have mentioned the example for two > OSD) I think this Ceph-node2 is the problem. If I am understanding this correctly, there is no monitor in that node correct? When you start a monitor in a host, that monitor will also create the keys for you with `ceph-create-keys`. Running only one monitor in one host and not in the other one is something I am not familiar with, but I guess you could run that manually? > > > > Content of ceph.conf (this is same for admin node and ceph-node1) > > [global] > fsid = eb4099a6-d2ab-437c-94f2-f3b43b3170d1 > mon_initial_members = vikrant > mon_host = 10.XX.XX.XX > auth_supported = cephx > osd_journal_size = 1024 > filestore_xattr_use_omap = true > > > > > > Output of “ceph-deploy mon create vikrant” command (vikrant is the hostname > of the ceph-node1) -- > > ---------------------------------------------ceph-deploy mon create vikrant > -----o/p-------------------------- > > [ceph_deploy.cli][INFO ] Invoked (1.3.1): /usr/bin/ceph-deploy mon create > vikrant > > [ceph_deploy.mon][DEBUG ] Deploying mon, cluster ceph hosts vikrant > > [ceph_deploy.mon][DEBUG ] detecting platform for host vikrant ... > > [vikrant][DEBUG ] connected to host: vikrant > > [vikrant][DEBUG ] detect platform information from remote host > > [vikrant][DEBUG ] detect machine type > > [ceph_deploy.mon][INFO ] distro info: Ubuntu 12.04 precise > > [vikrant][DEBUG ] determining if provided host has same hostname in remote > > [vikrant][DEBUG ] get remote short hostname > > [vikrant][DEBUG ] deploying mon to vikrant > > [vikrant][DEBUG ] get remote short hostname > > [vikrant][DEBUG ] remote hostname: vikrant > > [vikrant][DEBUG ] write cluster configuration to /etc/ceph/{cluster}.conf > > [vikrant][DEBUG ] create the mon path if it does not exist > > [vikrant][DEBUG ] checking for done path: > /var/lib/ceph/mon/ceph-vikrant/done > > [vikrant][DEBUG ] done path does not exist: > /var/lib/ceph/mon/ceph-vikrant/done > > [vikrant][INFO ] creating tmp path: /var/lib/ceph/tmp > > [vikrant][INFO ] creating keyring file: > /var/lib/ceph/tmp/ceph-vikrant.mon.keyring > > [vikrant][DEBUG ] create the monitor keyring file > > [vikrant][INFO ] Running command: sudo ceph-mon --cluster ceph --mkfs -i > vikrant --keyring /var/lib/ceph/tmp/ceph-vikrant.mon.keyring > > [vikrant][DEBUG ] ceph-mon: mon.noname-a 10.XX.XX.XX:6789/0 is local, > renaming to mon.vikrant > > [vikrant][DEBUG ] ceph-mon: set fsid to eb4099a6-d2ab-437c-94f2-f3b43b3170d1 > > [vikrant][DEBUG ] ceph-mon: created monfs at /var/lib/ceph/mon/ceph-vikrant > for mon.vikrant > > [vikrant][INFO ] unlinking keyring file > /var/lib/ceph/tmp/ceph-vikrant.mon.keyring > > [vikrant][DEBUG ] create a done file to avoid re-doing the mon deployment > > [vikrant][DEBUG ] create the init path if it does not exist > > [vikrant][DEBUG ] locating the `service` executable... > > [vikrant][INFO ] Running command: sudo initctl emit ceph-mon cluster=ceph > id=vikrant > > [vikrant][INFO ] Running command: sudo ceph --cluster=ceph --admin-daemon > /var/run/ceph/ceph-mon.vikrant.asok mon_status > > [vikrant][DEBUG ] > ******************************************************************************** > > [vikrant][DEBUG ] status for monitor: mon.vikrant > > [vikrant][DEBUG ] { > > [vikrant][DEBUG ] "election_epoch": 2, > > [vikrant][DEBUG ] "extra_probe_peers": [], > > [vikrant][DEBUG ] "monmap": { > > [vikrant][DEBUG ] "created": "0.000000", > > [vikrant][DEBUG ] "epoch": 1, > > [vikrant][DEBUG ] "fsid": "eb4099a6-d2ab-437c-94f2-f3b43b3170d1", > > [vikrant][DEBUG ] "modified": "0.000000", > > [vikrant][DEBUG ] "mons": [ > > [vikrant][DEBUG ] { > > [vikrant][DEBUG ] "addr": "10.XX.XX.XX:6789/0", > > [vikrant][DEBUG ] "name": "vikrant", > > [vikrant][DEBUG ] "rank": 0 > > [vikrant][DEBUG ] } > > [vikrant][DEBUG ] ] > > [vikrant][DEBUG ] }, > > [vikrant][DEBUG ] "name": "vikrant", > > [vikrant][DEBUG ] "outside_quorum": [], > > [vikrant][DEBUG ] "quorum": [ > > [vikrant][DEBUG ] 0 > > [vikrant][DEBUG ] ], > > [vikrant][DEBUG ] "rank": 0, > > [vikrant][DEBUG ] "state": "leader" > > [vikrant][DEBUG ] } > > [vikrant][DEBUG ] > ******************************************************************************** > > [vikrant][INFO ] monitor: mon.vikrant is running > > [vikrant][INFO ] Running command: sudo ceph --cluster=ceph --admin-daemon > /var/run/ceph/ceph-mon.vikrant.asok mon_status > > > > Please let me know if you need any further information. > > > > The intention is to setup a Ceph Block Device as per the link > http://ceph.com/docs/master/start/quick-rbd/ , and it is mentioned in the > link that Ceph Storage Cluster needs to be setup first before working with > Ceph Block Device. > > > > Please let me know your inputs on the above. > > > > Regards, > > Vikrant > > _______________________________________________ > ceph-users mailing list > ceph-users@xxxxxxxxxxxxxx > http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com > _______________________________________________ ceph-users mailing list ceph-users@xxxxxxxxxxxxxx http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com