What do you mean by osd level? Pool has size 4 and min_size 1. On Tue, Nov 18, 2014 at 10:32:11AM +0000, Anand Bhat wrote: > What are the setting for min_size and size at OSD level in your Ceph configuration ? Looks like size is set to 2 which halves your total storage as two copies of the data needs to be stored. > > Regards, > Anand > > -----Original Message----- > From: ceph-users [mailto:ceph-users-bounces@xxxxxxxxxxxxxx] On Behalf Of houmles > Sent: Tuesday, November 18, 2014 3:31 PM > To: ceph-users@xxxxxxxxxxxxxx > Subject: Re: incorrect pool size, wrong ruleset? > > Nobody knows where should be problem? > > > On Wed, Nov 12, 2014 at 10:41:36PM +0100, houmles wrote: > > Hi, > > > > I have 2 hosts with 8 2TB drive in each. > > I want to have 2 replicas between both hosts and then 2 replicas between osds on each host. That way even when I lost one host I still have 2 replicas. > > > > Currently I have this ruleset: > > > > rule repl { > > ruleset 5 > > type replicated > > min_size 1 > > max_size 10 > > step take asterix > > step choose firstn -2 type osd > > step emit > > step take obelix > > step choose firstn 2 type osd > > step emit > > } > > > > Which works ok. I have 4 replicas as I want and PGs are distributed perfectly but when I run ceph df I have only 1/2 of my capacity which I should have. > > In total it's 32TB, 16TB in each host. If there is a 2 replicas on each host it should report around 8TB, right? It's reporting only 4TB in pool which is 1/8 of total capacity. > > Can anyone tell me what is wrong? > > > > Thanks > > > > _______________________________________________ > > ceph-users mailing list > > ceph-users@xxxxxxxxxxxxxx > > http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com > _______________________________________________ > ceph-users mailing list > ceph-users@xxxxxxxxxxxxxx > http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com > > ________________________________ > > PLEASE NOTE: The information contained in this electronic mail message is intended only for the use of the designated recipient(s) named above. If the reader of this message is not the intended recipient, you are hereby notified that you have received this message in error and that any review, dissemination, distribution, or copying of this message is strictly prohibited. If you have received this communication in error, please notify the sender by telephone or e-mail (as shown above) immediately and destroy any and all copies of this message in your possession (whether hard copies or electronically stored copies). > _______________________________________________ ceph-users mailing list ceph-users@xxxxxxxxxxxxxx http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com