Re: MDS memory sizing

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



Hi Dietmar,

it all depends how many inodes have caps on the mds. I have run a very similar configuration with 0.5 TB raw and about 200 million files, mds collocated with mon and 32 GB RAM. When rsyncing files from other servers onto cephfs I have observed that the mds sometimes runs out of memory and hangs.
All on hammer 0.94.

Regards,

Mike

On 3/1/16 8:13 AM, Yan, Zheng wrote:
On Tue, Mar 1, 2016 at 7:28 PM, Dietmar Rieder
<dietmar.rieder@xxxxxxxxxxx> wrote:
Dear ceph users,


I'm in the very initial phase of planning a ceph cluster an have a
question regarding the RAM recommendation for an MDS.

According to the ceph docs the minimum amount of RAM should be "1 GB
minimum per daemon". Is this per OSD in the cluster or per MDS in the
cluster?

I plan to run 3 ceph-mon on 3 dedicated machines and would like to run 3
ceph-msd on these  machines as well. The raw capacity of the cluster
should be ~1.9PB. Would 64GB of RAM then be enough for the
ceph-mon/ceph-msd nodes?


Each file inode in MDS uses about 2k memory (It's not relevant to file
size).  MDS memory usage depends on how large active file set are.

Regards
Yan, Zheng

Thanks
  Dietmar

--
_________________________________________
D i e t m a r  R i e d e r


_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com



[Index of Archives]     [Information on CEPH]     [Linux Filesystem Development]     [Ceph Development]     [Ceph Large]     [Ceph Dev]     [Linux USB Development]     [Video for Linux]     [Linux Audio Users]     [Yosemite News]     [Linux Kernel]     [Linux SCSI]     [xfs]


  Powered by Linux