number of PGs (global vs per pool)

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



On 09/09/2014 10:42 AM, Luis Periquito wrote:
> I was reading on the number of PGs we should have for a cluster, and I
> found the formula to place 100 PGs in each OSD
> (http://ceph.com/docs/master/rados/operations/placement-groups/).
>
> Now this formula has generated some discussion as to how many PGs we
> should have in each pool.
>
> Currently our main cluster is being used for S3, cephFS and RBD data
> type usage. So we have 3 very big pools (data, .rgw.buckets and rbd) and
> 9 small pools (all the remaining ones).
>
> As we have a total of 60 OSDs we've been discussing how many PGs we
> should really have. We are using a replication of 4.
>
> Should we have a total around 1500 PGs distributed over all the pools
> (total PGs) or should we have the big pools each with 1500 PGs for a
> total around 5000 PGs on the cluster?
>

Balance it a bit. Give the big pools 1024 PGs and the smaller PGs 256 
for example.

Each PG will consume memory, so you have to make sure the total amount 
of PGs isn't to high.

> thanks,
>
>
> _______________________________________________
> ceph-users mailing list
> ceph-users at lists.ceph.com
> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
>


-- 
Wido den Hollander
Ceph consultant and trainer
42on B.V.

Phone: +31 (0)20 700 9902
Skype: contact42on


[Index of Archives]     [Information on CEPH]     [Linux Filesystem Development]     [Ceph Development]     [Ceph Large]     [Linux USB Development]     [Video for Linux]     [Linux Audio Users]     [Yosemite News]     [Linux Kernel]     [Linux SCSI]     [xfs]


  Powered by Linux