----- Original Message ----- > From: "Abhishek L" <abhishek.lekshmanan@xxxxxxxxx> > To: "Yehuda Sadeh-Weinraub" <yehuda@xxxxxxxxxx> > Cc: "Ben" <b@benjackson.email>, "ceph-users" <ceph-users@xxxxxxxx> > Sent: Wednesday, March 18, 2015 10:54:37 AM > Subject: Re: Shadow files > > > Yehuda Sadeh-Weinraub writes: > > >> Is there a quick way to see which shadow files are safe to delete > >> easily? > > > > There's no easy process. If you know that a lot of the removed data is on > > buckets that shouldn't exist anymore then you could start by trying to > > identify that. You could do that by: > > > > $ radosgw-admin metadata list bucket > > > > then, for each bucket: > > > > $ radosgw-admin metadata get bucket:<bucket name> > > > > This will give you the bucket markers of all existing buckets. Each data > > object (head and shadow objects) is prefixed by bucket markers. Objects > > that don't have valid bucket markers can be removed. Note that I would > > first list all objects, then get the list of valid bucket markers, as the > > operation is racy and new buckets can be created in the mean time. > > > > We did discuss a new garbage cleanup tool that will address your specific > > issue, and we have a design for it, but it's not there yet. > > > > Could you share the design/ideas for making the cleanup tool. After an > initial search I could only find two issues > [1] http://tracker.ceph.com/issues/10342 It is sketched in here (10342), probably needs to be better formatted and documented. Yehuda > [2] http://tracker.ceph.com/issues/9604 > > though not much details are there to get started. > -- > Abhishek > > _______________________________________________ > ceph-users mailing list > ceph-users@xxxxxxxxxxxxxx > http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com > _______________________________________________ ceph-users mailing list ceph-users@xxxxxxxxxxxxxx http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
 |