Mike, I'm guessing that HBase is creating and deleting its blocks, but that the deletes are delayed: http://ceph.com/docs/master/dev/delayed-delete/ which would explain the correct reporting at the file system level, but not the actual 'data' pool. I'm not as familiar with this level of detail, and copied Greg who can probably answer easily. Thanks, Noah On May 9, 2013, at 4:29 AM, Mike Bryant <mike.bryant@xxxxxxxxx> wrote: > Hi, > I'm experimenting with running hbase using the hadoop-ceph java > filesystem implementation, and I'm having an issue with space usage. > > With the hbase daemons running, The amount of data in the 'data' pool > grows continuously, at a much higher rate than expected. Doing a du, > or ls -lh on a mounted copy shows a usage of ~16GB. But the data pool > has grown to consume ~160GB at times. When I restart the daemons, > shortly thereafter the data pool shrinks rapidly. If I restart all of > them it comes down to match the actual space usage. > > My current hypothesis is that the MDS isn't deleting the objects for > some reason, possibly because there's still an open filehandle? > > My question is, how can I get a report from the MDS on which objects > aren't visible from the filesystem / why it's not deleted them yet / > what open filehandles there are etc. > > Cheers > Mike > > -- > Mike Bryant | Systems Administrator | Ocado Technology > mike.bryant@xxxxxxxxx | 01707 382148 | www.ocado.com > > -- > Notice: This email is confidential and may contain copyright material of > Ocado Limited (the "Company"). Opinions and views expressed in this message > may not necessarily reflect the opinions and views of the Company. > > If you are not the intended recipient, please notify us immediately and > delete all copies of this message. Please note that it is your > responsibility to scan this message for viruses. > > Company reg. no. 3875000. > > Ocado Limited > Titan Court > 3 Bishops Square > Hatfield Business Park > Hatfield > Herts > AL10 9NE > _______________________________________________ > ceph-users mailing list > ceph-users@xxxxxxxxxxxxxx > http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com _______________________________________________ ceph-users mailing list ceph-users@xxxxxxxxxxxxxx http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
 |