The original documentation was written with a script called mkcephfs in mind. Then, we began including some documentation for Chef and Crowbar. We actually only had developer documentation for doing things manually. We're working on providing manual steps now. While it's not in the deployment section, there are some docs that may help you understand what's going on when you deploy manually. First you have to bootstrap a monitor. So we have some developer documentation on that here: http://ceph.com/docs/master/dev/mon-bootstrap/ There are also some docs for manually adding monitors and OSDs to an existing cluster here: http://ceph.com/docs/master/rados/operations/add-or-rm-mons/ http://ceph.com/docs/master/rados/operations/add-or-rm-osds/ There are also some documents for creating and modifying CRUSH maps here: http://ceph.com/docs/master/rados/operations/crush-map/ There's a high level discussion of why we use the maps here: http://ceph.com/docs/master/architecture/#scalability-and-high-availability These procedural docs need some updating too, and we should have a manual deploy section up soon. John On Sun, Oct 6, 2013 at 8:45 PM, Harvey Skinner <hpmpec2a@xxxxxxxxx> wrote: > hi John, thank you for the reply on this. > > From further experimentation, it is the ceph-deploy v1.2.6 package for > Cuttlefish that is broken or incorrectly defined/packaged. I cleaned > up the broken packages and tried again multiple times with same > results. You can install ceph-deploy from the ceph repo for > Cuttlefish still, but as mentioned previously it is only v1.0-1 and > full of known issues. > > For fun I reset my repo links for: > deb http://ceph.com/debian-dumpling/ raring main > deb http://ceph.com/packages/ceph-extras/debian/ raring main > > to check the dumpling version of ceph-deploy ... and it installed > without problem. The differece being that the ceph-deploy package in > the ceph-extras has a specific python-pushy package called > 'python-pushy_0.5.3-1raring.ceph_amd64.deb', apparently put together > by ceph folks for deployment with ceph-deploy v1.2.6 w/ Dumpling & > Raring. The problem is the same was not done for Cuttlefish & > Raring. So trying to install ceph-deploy for use with Cuttlefish(?) > or at least on Raring is a waste of time. > > So even though I had not planned to, I am going with Dumpling release. > But I have ran into additional problems with ceph-deploy v1.2.6 and > cannot use 'ceph-deploy install' to install ceph on my ceph nodes. > It tries to install the ceph release key as one of the first steps and > hangs. From further experimentation, it is hanging because the > command to retrieve the release key and add it is missing a 'sudo' > command in it for the 'apt-key add' part of the command: > > Running command: wget -q -O- > 'https://ceph.com/git/?p=ceph.git;a=blob_plain;f=keys/release.asc' | > apt-key add – > > When you reissue the above command with a 'sudo' preceding the > 'apt-key add -' it works fine. So I ended up installing ceph bits on > all my ceph nodes by hand. > > I could now create a 'new' cluster with ceph-deploy and thought I > would try using a cluster name different than the default of 'ceph' to > see how that works, I saw an e-mail saying you can have multiple > clusters on same h/w and wanted to try it. But it seems that > ceph-deploy doesn't like working with clusters that aren't using the > defalt cluster name of 'ceph'. When I tried to add MONs it couldn't > find 'ceph.conf' because it was named '<cluster-name>.conf' and > errored out. > > SO there are still issues with ceph-deploy that cause a lot of > investigation and workaround time & effort and still have to accept > its limitations. The bad part of this is all the current online > documentation is being changed to reference use of ceph-deploy only > and any documentation of how to do tasks without ceph-deploy (to get > around ceph-deploy limitations) is missing. > > Harvey > > On Thu, Oct 3, 2013 at 10:17 AM, John Wilkins <john.wilkins@xxxxxxxxxxx> wrote: >> I've run into this before too. I think with broken packages, you have to >> uninstall the previous version and do apt-get autoremove as well. Sometimes >> you have to manually uninstall whatever it lists as the broken packages and >> then do autoremove. Then, reinstall. >> >> >> On Thu, Oct 3, 2013 at 12:20 AM, Harvey Skinner <hpmpec2a@xxxxxxxxx> wrote: >>> >>> I am also having problems getting the latest version of ceph-deploy to >>> install on Raring. >>> I was able to install the updated ceph-deploy about two months ago for >>> Ubuntu 12.04 and Cuttlefish using the following two lines in the >>> '/etc/apt/sources.list.d/ceph.list' apt sources file on my 'Admin' node: >>> >>> deb http://ceph.com/debian-cuttlefish/ precise main >>> deb http://ceph.com/packages/ceph-extras/debian/ precise main >>> >>> This worked to download the latest version of ceph-deploy, I believe it >>> was 1.2-0 or something like that. >>> >>> I have now re-imaged my servers to Ubuntu 13.04 and going through the >>> steps to deploy a new Ceph cluster using Cuttlefish on Raring. Sounds >>> simple, so ensure I have the following two lines in >>> '/etc/apt/sources.list.d/ceph.list' : >>> >>> deb http://ceph.com/debian-cuttlefish/ raring main >>> >>> deb http://ceph.com/packages/ceph-extras/debian/ raring main >>> >>> Problem is when I try to 'sudo apt-get install ceph-deploy' I get an error >>> saying I have broken packages. >>> >>> ceph@S01:~$ sudo apt-get install ceph-deploy >>> >>> Reading package lists... Done >>> Building dependency tree >>> Reading state information... Done >>> Some packages could not be installed. This may mean that you have >>> requested an impossible situation or if you are using the unstable >>> distribution that some required packages have not yet been created >>> or been moved out of Incoming. >>> The following information may help to resolve the situation: >>> >>> The following packages have unmet dependencies: >>> >>> ceph-deploy : Depends: python-pushy (>= 0.5.3) but 0.5.1-1 is to be >>> installed >>> E: Unable to correct problems, you have held broken packages. >>> >>> Am I getting the correct version of ceph-deploy from the right repo >>> location? Also since updated versions of ceph-deploy are no longer in the >>> main Ceph repo (and I thought someone said ceph-deploy would not be in the >>> main Ceph repo in the future), why isn't there a documentation update as >>> part of the Quick Start and other doc pages telling users what lines to add >>> to the apt source list? >>> >>> When I tried the still 'documented' method for installing ceph-deploy: >>> >>> >>> wget -q -O- >>> 'https://ceph.com/git/?p=ceph.git;a=blob_plain;f=keys/release.asc' | sudo >>> apt-key add - >>> echo deb http://ceph.com/debian-dumpling/ $(lsb_release -sc) main | sudo >>> tee /etc/apt/sources.list.d/ceph.list >>> sudo apt-get update >>> sudo apt-get install ceph-deploy >>> >>> I ended up with ceph-deploy v 1.0-1 on my Admin node, and I already >>> suffered through that version enough previously. >>> >>> thank you, >>> Harvey >>> >>> From: ceph-users-bounces@xxxxxxxxxxxxxx >>> [mailto:ceph-users-bounces@xxxxxxxxxxxxxx] On Behalf Of Alfredo Deza >>> >>> Sent: Monday, September 23, 2013 12:57 PM >>> To: Bernhard Glomm >>> Cc: ceph-users@xxxxxxxx >>> Subject: Re: ceph-deploy again >>> >>> >>> >>> >>> >>> >>> >>> On Mon, Sep 23, 2013 at 11:23 AM, Bernhard Glomm >>> <bernhard.glomm@xxxxxxxxxxx> wrote: >>> >>> Hi all, >>> >>> >>> something with ceph-deploy doesen't work at all anymore. >>> After an upgrade ceph-depoly failed to roll out a new monitor >>> with "permission denied. are you root?" >>> (obviously there shouldn't be a root login so I had another user >>> for ceph-deploy before which worked perfectly, why not now?) >>> >>> ceph_deploy.install][DEBUG ] Purging host ping ... >>> Traceback (most recent call last): >>> E: Could not open lock file /var/lib/dpkg/lock - open (13: Permission >>> denied) >>> E: Unable to lock the administration directory (/var/lib/dpkg/), are you >>> root? >>> >>> Does this mean I have to let root log into my Cluster with a passwordless >>> key? >>> I would rather like to use another log in, like so far, if possible. >>> >>> Can you paste here the exact command you are running (and with what user) >>> ? >>> >>> >>> >>> The howto on ceph.com doesn't say anything about it, >>> the changelog.Debian.gz isn't very helpful either and >>> another changelog isn't (provided nor a README) >>> >>> ceph-deploy is version 1.2.6 >>> system is freshly installed raring >>> >>> got this both lines in my sources.list >>> deb http://192.168.242.91:3142/ceph.com/debian/ raring main >>> deb http://192.168.242.91:3142/ceph.com/packages/ceph-extras/debian/ >>> raring main >>> >>> since this both didn't work >>> #deb http://gitbuilder.ceph.com/ceph-deb-raring-x86_64-basic/ref/dumpling/ >>> raring main >>> #deb http://gitbuilder.ceph.com/cdep-deb-raring-x86_64-basic/ref/master/ >>> raring main >>> (couldn't find the python-pushy version ceph-deploy depends on) >>> >>> TIA >>> >>> Bernhard >>> >>> -- >>> ________________________________ >>> >>> Bernhard Glomm >>> >>> IT Administration >>> >>> Phone: >>> >>> +49 (30) 86880 134 >>> >>> Fax: >>> >>> +49 (30) 86880 100 >>> >>> Skype: >>> >>> bernhard.glomm.ecologic >>> >>> Ecologic Institut gemeinnützige GmbH | Pfalzburger Str. 43/44 | 10717 >>> Berlin | Germany >>> >>> GF: R. Andreas Kraemer | AG: Charlottenburg HRB 57947 | USt/VAT-IdNr.: >>> DE811963464 >>> Ecologic™ is a Trade Mark (TM) of Ecologic Institut gemeinnützige GmbH >>> >>> ________________________________ >>> >>> _______________________________________________ >>> ceph-users mailing list >>> ceph-users@xxxxxxxxxxxxxx >>> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com >>> >>> >>> >>> >>> >>> _______________________________________________ >>> ceph-users mailing list >>> ceph-users@xxxxxxxxxxxxxx >>> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com >>> >> >> >> >> -- >> John Wilkins >> Senior Technical Writer >> Intank >> john.wilkins@xxxxxxxxxxx >> (415) 425-9599 >> http://inktank.com -- John Wilkins Senior Technical Writer Intank john.wilkins@xxxxxxxxxxx (415) 425-9599 http://inktank.com _______________________________________________ ceph-users mailing list ceph-users@xxxxxxxxxxxxxx http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
 |