On Wed, Apr 8, 2015 at 11:40 AM, Gregory Farnum <greg@xxxxxxxxxxx> wrote: > "ceph pg dump" will output the size of each pg, among other things. Among many other things. :) Here is the raw output, in case I'm misinterpreting it: http://pastebin.com/j4ySNBdQ It *looks* like the pg's are roughly uniform in size. They range from 2.27GiB to 2.91GiB with an average of 2.58GiB and a standard deviation of only 0.1GiB, and it looks like about 95% are within two standard deviations. The difference between the least used and most used OSDs is on the order of 100+GB. A few placement groups being a few hundred megs bigger or smaller doesn't seem like it would account for that. Breaking out the placement groups per OSD was a bit trickier, but this seems to do the trick: egrep '^2\.' ceph-pg-dump.txt | awk '{print$14}' | tr -d '[]' | awk -F, '{print$1"\n"$2}' | sort | uniq -c | sort -n | awk '{print$2" "$1}' | sort -n That showed that the OSD with the fewest PG's has 85 (and indeed that is the lowest space-utilized OSD), and the OSD with the most PG's has 118. That's not the OSD with the highest utiization, but the OSD with the highest utilization does check in with 117 PG's. So it does seem more of an issue of allocating placement groups unevenly between OSDs than it does of unevenly sized placement groups. Thanks! _______________________________________________ ceph-users mailing list ceph-users@xxxxxxxxxxxxxx http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
 |