On Wed, Oct 3, 2012 at 3:22 PM, Tren Blackburn <tren@xxxxxxxxxxxxxxx> wrote: > Hi List; > > I was advised to use the "mds cache size" option to limit the memory > that the mds process will take. I have it set to "32768". However it > the ceph-mds process is now at 50GB and still growing. > > fern ceph # ps wwaux | grep ceph-mds > root 895 4.3 26.6 53269304 52725820 ? Ssl Sep28 312:29 > /usr/bin/ceph-mds -i fern --pid-file /var/run/ceph/mds.fern.pid -c > /etc/ceph/ceph.conf > > Have I specified the limit incorrectly? How far will it go? Oof. That looks correct; it sounds like we have a leak or some other kind of bug. I believe you're on Gentoo; did you build with tcmalloc? If so, can you run "ceph -w" in one window and then "ceph mds tell 0 heap stats" and send back the output? If you didn't build with tcmalloc, can you do so and try again? We have noticed fragmentation issues with the default memory allocator, which is why we switched (though I can't imagine it'd balloon that far — but tcmalloc will give us some better options to diagnose it). Sorry I didn't mention this before! -Greg -- To unsubscribe from this list: send the line "unsubscribe ceph-devel" in the body of a message to majordomo@xxxxxxxxxxxxxxx More majordomo info at http://vger.kernel.org/majordomo-info.html