Re: Ceph delete files and status

[Hans van den Bogert <hansbogert@xxxxxxxxx>]

My experience with RGW is that actual freeing up of space is asynchronous to the a S3 client’s command to delete an object. I.e., it might take a while before it’s actually freed up.

Can you redo your little experiment and simply wait for an hour to let the garbage collector to do its thing, or force the garbage collector with something like:

    $ radosgw-admin gc process

I haven’t used this command to actually test if this would have the intended result of freeing up space. But it wouldn’t hurt anything.

Regards,

Hans

On Oct 19, 2017, at 11:06 PM, nigel davies <nigdav007@xxxxxxxxx> wrote:

I am using RGW, with an S3 bucket setup. 

The live vershion also uses rbd as well 

On 19 Oct 2017 10:04 pm, "David Turner" <drakonstein@xxxxxxxxx> wrote:

How are you uploading a file?  RGW, librados, CephFS, or RBD?  There are multiple reasons that the space might not be updating or cleaning itself up.  The more information you can give us about how you're testing, the more we can help you.

On Thu, Oct 19, 2017 at 5:00 PM nigel davies <nigdav007@xxxxxxxxx> wrote:

Hay

I some how got the space back, by tweeking the reweights. 

but i am a tad confused i uploaded a file (200MB) then removed the file and the space is not changed. i am not sure why that happens and what i can do

On Thu, Oct 19, 2017 at 6:42 PM, nigel davies <nigdav007@xxxxxxxxx> wrote:

PS was not aware of fstrim

On 19 Oct 2017 6:41 pm, "nigel davies" <nigdav007@xxxxxxxxx> wrote:

Hay

My ceph cluster is connted to ceph gateway for a S3 server I was uploading the file and removing it from the bucket using s3cmd.

I upload and removed the file a few times now the cluster so close to full. 

I was told their is a way to clear the any deleted files out or something.

On 19 Oct 2017 5:09 pm, "Jamie Fargen" <jfargen@xxxxxxxxxx> wrote:

Nigel-

What method did you use to upload and delete the file? How did you check the space utilization? I believe the reason that you are still seeing the space being utilized when you issue your ceph -df is because even after the file is deleted, the file system doesn't actually delete the file, it just removes the file inode entry pointing to the file. The file will still be on the disk until the blocks are re-allocated to another file.

-Jamie

On Thu, Oct 19, 2017 at 11:54 AM, nigel davies <nigdav007@xxxxxxxxx> wrote:

Hay all

I am looking at my small test Ceph cluster, i have uploaded a 200MB iso and checked the space on "ceph status" and see it incress.

But when i delete the file the space used does not go down. 

Have i missed a configuration somewhere or something?

_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

--

Jamie Fargen

Consultant

jfargen@xxxxxxxxxx

813-817-4430

_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com