We have OSD and RGW processes collocated on all Ceph nodes. There is and Apache load balancer towards them. Currently we have something like 18 million objects in RGW and each OSD consumes 2.5 GB of memory in average. And yes, RGW data is stored in EC pool. Ceph version is 10.2.1. 2016-06-20 19:37 GMT+03:00 Abhishek Varshney <abhishek.varshney@xxxxxxxxxxxx>: > Hi, > > Is the memory issue seen on OSD nodes or on the RGW nodes? We > encountered memory issues on OSD nodes with EC pools. Here is the mail > thread : http://www.spinics.net/lists/ceph-devel/msg30597.html > > Hope this helps. > > Thanks > Abhishek > > On Mon, Jun 20, 2016 at 9:59 PM, Василий Ангапов <angapov@xxxxxxxxx> wrote: >> Hello, >> >> I'm sorry, can anyone share something on this matter? >> >> Regards, Vasily. >> >> 2016-06-09 16:14 GMT+03:00 Василий Ангапов <angapov@xxxxxxxxx>: >>> Hello! >>> >>> I have a question regarding Ceph RGW memory usage. >>> We currently have 10 node 1.5 PB raw space cluster with EC profile >>> 6+3. Every node has 29x6TB OSDs and 64 GB of RAM. >>> Recently I've noticed that nodes are starting to suffer from RAM >>> insufficiency. There is currently about 2.6 million files in RGW. >>> Each OSD consumes 1-2 GB of RAM. >>> >>> Our plan is to store something like 200-300 million files of average >>> size about 5 MB. How much RAM may I need approximately? >>> Do somebody else having such cluster with many files? >>> >>> Thanks for help! >> _______________________________________________ >> ceph-users mailing list >> ceph-users@xxxxxxxxxxxxxx >> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com _______________________________________________ ceph-users mailing list ceph-users@xxxxxxxxxxxxxx http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
 |