Re: Problem with data distribution

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



On Mon, Jul 1, 2013 at 8:49 AM, Pierre BLONDEAU
<pierre.blondeau@xxxxxxxxxx> wrote:
> Hy,
>
> I use the 0.64.1 version of CEPH on debian wheezy for serveur and ubuntu
> precise ( with raring kernel 3.8.0-25 ) as client.
>
> My problem is the distribution of data on the cluster. I have 3 servers each
> with 6 osd, but the distribution is very heterogeneous :
> 86% /var/lib/ceph/osd/ceph-15
> 67% /var/lib/ceph/osd/ceph-13
> 95% /var/lib/ceph/osd/ceph-14
> 92% /var/lib/ceph/osd/ceph-17
> 86% /var/lib/ceph/osd/ceph-12
> 20% /var/lib/ceph/osd/ceph-16
> 47% /var/lib/ceph/osd/ceph-10
> 85% /var/lib/ceph/osd/ceph-11
> 67% /var/lib/ceph/osd/ceph-6
> 86% /var/lib/ceph/osd/ceph-8
> 29% /var/lib/ceph/osd/ceph-9
> 64% /var/lib/ceph/osd/ceph-2
> 68% /var/lib/ceph/osd/ceph-0
> 86% /var/lib/ceph/osd/ceph-3
> 67% /var/lib/ceph/osd/ceph-4
> 79% /var/lib/ceph/osd/ceph-1
> 58% /var/lib/ceph/osd/ceph-18
>
> Friday, one of my OSD was 95%. I could not write. I was advised on IRC to
> change the weight of the OSD. I put it at 0.8. The data were migrated to
> another OSD, but the distribution is still very heterogeneous. A few hours
> later, I had the same problem with another OSD.
>
> I tried to change the weights depending on the place occupied, but it is not
> much better. For example: 16 OSD is very empty.
>
> Do you have any idea to solve my problem ?

It looks like probably your PG counts are too low for the number of
OSDs you have.
http://ceph.com/docs/master/rados/operations/placement-groups/
-Greg
Software Engineer #42 @ http://inktank.com | http://ceph.com
_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com




[Index of Archives]     [Information on CEPH]     [Linux Filesystem Development]     [Ceph Development]     [Ceph Large]     [Ceph Dev]     [Linux USB Development]     [Video for Linux]     [Linux Audio Users]     [Yosemite News]     [Linux Kernel]     [Linux SCSI]     [xfs]


  Powered by Linux