Re: pool size 1 RBD distribution

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



> On 12/05/2013 10:52 AM, Wolfgang Hennerbichler wrote:
>> Now I do an rbd import of an RBD Image (which is 1G in size), and I would expect that RBD image to stripe across the two OSD’s. Well, this is just not happening, everything sits on OSD2 (osd1 and osd0 have been removed in the mean time, they have been part of the first test):
> 
> Could you run this against your crushmap?
> 
> $ ceph osd getcrushmap -o crushmap
> $ crushtool --test -i crushmap --num-rep 1 --rule 0 --show-statistics

# crushtool --test -i crushmap --num-rep 1 --rule 0 --show-statistics
rule 0 (data), x = 0..1023, numrep = 1..1
CRUSH rule 0 x 0 [2]
CRUSH rule 0 x 1 [2]
CRUSH rule 0 x 2 [2]
CRUSH rule 0 x 3 [2]
CRUSH rule 0 x 4 [2]
… 
CRUSH rule 0 x 1022 [2]
CRUSH rule 0 x 1023 [2]
rule 0 (data) num_rep 1 result size == 1:       1024/1024


> I tried that locally and gave me a result like:
> 
> rule 0 (data), x = 0..1023, numrep = 1..1
> CRUSH rule 0 x 0 [0]
> ..
> ..
> CRUSH rule 0 x 1019 [1]
> CRUSH rule 0 x 1020 [0]
> CRUSH rule 0 x 1021 [1]
> CRUSH rule 0 x 1022 [1]
> CRUSH rule 0 x 1023 [0]
> rule 0 (data) num_rep 1 result size == 1:	1024/1024
> 
> My plain-text crushmap is attached and there you see it works. So I'm curious to what output you have?

I don’t know how to interpret my output. I have a [2] at all the lines of my crushtest. 

after running a diff between your and my crushmap, it turned out that this differed: 
-       step choose firstn 0 type osd
+       step chooseleaf firstn 0 type osd

that didn’t make a difference after adjusting, but having the OSD’s in my crushmap with a weight of 0 did. I reweighted them, and now things are balancing out. thanks a lot. 

> Wido

Wolfgang
_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com





[Index of Archives]     [Information on CEPH]     [Linux Filesystem Development]     [Ceph Development]     [Ceph Large]     [Ceph Dev]     [Linux USB Development]     [Video for Linux]     [Linux Audio Users]     [Yosemite News]     [Linux Kernel]     [Linux SCSI]     [xfs]


  Powered by Linux