Re: My first CEPH cluster

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



Hello,

On Mon, 29 Aug 2016 09:46:53 +0800 Rob Gunther wrote:

> I learned of Ceph only a few weeks ago, think the concept is really cool.
> 
> I wanted to try my hand at it, but did not want to try setting it all up
> with VM boxes.
> 
> So I put together a system using 7 physical nodes, using little ARM based
> computers.
> 
> I got four Banana Pi <http://www.bananapi.org/p/product.html>, which have
> one SATA port, 1gb of ram.  Boots of 8gb SD card.  These are Ceph OSD nodes
> with 3tb hard drives.
> 
> I got three ODROID-C2
> <http://www.hardkernel.com/main/products/prdt_info.php> units to use as
> Ceph mon, 2gb of ram, 8gb SD cards for booting and 64gb of eMMC memory.
> 
> I got a basic cluster up, but things go bad quick.  I can't keep the OSD
> nodes up, the OSD logs look like mumbo jumbo to me for the most part.
> 
> Photo of the little setup available here if you are interested.
> 
> https://dl.dropboxusercontent.com/u/12473059/Ceph/1stCluster.jpg
> 
> I learned a few things and am going to blow everything away and start again.
> 
> One question I have for the group is this.
> 
> Do you really need to make an entry in ceph.conf telling the cluster of the
> location of each osd.X ?
> 
> [osd.1]
>         host    =       node-01
> 
> [osd.2]
>         host    =       node-02
> 
> [osd.3]
>         host    =       node-03
> 
> 
> I used ceph-deploy to set everything up and it did not add these entries.
> I have seen online some people mention it, some people do not.  I looked up
> some sample ceph.conf and some have it and some do not.
> 

Like with so many things, the answer is "it depends". 

If ceph-deploy works for you, count yourself lucky and don't bother with
the OSD details in the conf file. 
ceph-deploy uses "magic" to do these things.

> Seems like adding that would be a major PITA anytime you make a change to
> the cluster you would need to update that file on all nodes.
Not really, the OSD part is only relevant for the respective node, so only
changes (additions/removals) of OSDs that are pertinent to the local node
would need to be reflected in the ceph.conf of that host.

Christian 
-- 
Christian Balzer        Network/Systems Engineer                
chibi@xxxxxxx   	Global OnLine Japan/Rakuten Communications
http://www.gol.com/
_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com



[Index of Archives]     [Information on CEPH]     [Linux Filesystem Development]     [Ceph Development]     [Ceph Large]     [Linux USB Development]     [Video for Linux]     [Linux Audio Users]     [Yosemite News]     [Linux Kernel]     [Linux SCSI]     [xfs]


  Powered by Linux