I ran the command no luck and waited hour still no luck
i rebuild my cluster and looked at RBD (incase its an s3 thing) and i am having the same issue.
I tired to scrub but no luck also.
its just odd, i dont want to be addig disks when i dont need to
On Fri, Oct 20, 2017 at 11:25 AM, nigel davies <nigdav007@xxxxxxxxx> wrote:
Thanks i am running the command now. i did get a message"2017-10-20 11:23:24.291921 7f6485a8ba00 0 client.75274.objecter FULL, paused modify 0x55b1a8476820 tid 0"On Fri, Oct 20, 2017 at 10:28 AM, Hans van den Bogert <hansbogert@xxxxxxxxx> wrote:My experience with RGW is that actual freeing up of space is asynchronous to the a S3 client’s command to delete an object. I.e., it might take a while before it’s actually freed up.Can you redo your little experiment and simply wait for an hour to let the garbage collector to do its thing, or force the garbage collector with something like:$ radosgw-admin gc processI haven’t used this command to actually test if this would have the intended result of freeing up space. But it wouldn’t hurt anything.Regards,HansOn Oct 19, 2017, at 11:06 PM, nigel davies <nigdav007@xxxxxxxxx> wrote:I am using RGW, with an S3 bucket setup.The live vershion also uses rbd as well______________________________On 19 Oct 2017 10:04 pm, "David Turner" <drakonstein@xxxxxxxxx> wrote:How are you uploading a file? RGW, librados, CephFS, or RBD? There are multiple reasons that the space might not be updating or cleaning itself up. The more information you can give us about how you're testing, the more we can help you.On Thu, Oct 19, 2017 at 5:00 PM nigel davies <nigdav007@xxxxxxxxx> wrote:HayI some how got the space back, by tweeking the reweights.but i am a tad confused i uploaded a file (200MB) then removed the file and the space is not changed. i am not sure why that happens and what i can doOn Thu, Oct 19, 2017 at 6:42 PM, nigel davies <nigdav007@xxxxxxxxx> wrote:PS was not aware of fstrimOn 19 Oct 2017 6:41 pm, "nigel davies" <nigdav007@xxxxxxxxx> wrote:HayMy ceph cluster is connted to ceph gateway for a S3 server I was uploading the file and removing it from the bucket using s3cmd.I upload and removed the file a few times now the cluster so close to full.I was told their is a way to clear the any deleted files out or something.______________________________On 19 Oct 2017 5:09 pm, "Jamie Fargen" <jfargen@xxxxxxxxxx> wrote:Nigel-What method did you use to upload and delete the file? How did you check the space utilization? I believe the reason that you are still seeing the space being utilized when you issue your ceph -df is because even after the file is deleted, the file system doesn't actually delete the file, it just removes the file inode entry pointing to the file. The file will still be on the disk until the blocks are re-allocated to another file.-JamieOn Thu, Oct 19, 2017 at 11:54 AM, nigel davies <nigdav007@xxxxxxxxx> wrote:Hay allI am looking at my small test Ceph cluster, i have uploaded a 200MB iso and checked the space on "ceph status" and see it incress.But when i delete the file the space used does not go down.Have i missed a configuration somewhere or something?
_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
--_________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
_________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
_______________________________________________ ceph-users mailing list ceph-users@xxxxxxxxxxxxxx http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
