On 2014-12-02 15:03, Yehuda Sadeh wrote:
On Mon, Dec 1, 2014 at 4:26 PM, Ben <b@benjackson.email> wrote:
On 2014-12-02 11:25, Yehuda Sadeh wrote:
On Mon, Dec 1, 2014 at 4:23 PM, Ben <b@benjackson.email> wrote:
...
How can I tell if the shard has an object in it from the logs?
Search for a different sequence (e.g., search for rgw.gc_remove).
Yehuda
0 Results in the logs for rgw.gc_remove
Well, something is modifying the gc log. Do you happen to have more
than one radosgw running on the same cluster?
Yehuda
We have 2 radosgw servers
obj01 and obj02
Are both of them pointing at the same zone?
Yes, they are load balanced
Well, the gc log show entries, and then it doesn't, so something
clears these up. Try reproducing again with logs on, see if you see
new entries in the rgw logs. If you don't see these, maybe try turning
on 'debug ms = 1' on your osds (ceph tell osd.* injectargs '--debug_ms
1'), and look in your osd logs for such messages. These might give you
some hint for their origin.
Also, could it be that you ran 'radosgw-admin gc process', instead of
waiting for the gc cycle to complete?
Yehuda
I did anohter test, this time with a 600mb file. I uploaded it, then
deleted the file and did a gc list --include all.
It displayed around 143 _shadow_ files. I let GC process itself (I did
not force this process) and I checked the pool afterward by running
'rados ls -p .rgw.buckets | grep "<gc-listed-shadowfiles>"' and they no
longer exist.
I've added the debug ms to the OSDs, I'll do another test with the 600mb
file.
Also worth noting, I have started clearing out files from the
.rgw.buckets pool that are from a bucket which has been deleted and no
longer visible by running 'rados -p .rgw.gc rm' over all the _shadow_
files contained in that bucket prefix default.4804.14__shadow_
Is this alright to do, or is there a better way to clear out files?
_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
