Re: RGW quota

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



On 3/17/16 1:41 PM, Marius Vaitiekunas wrote:
> It's possible that somebody changed the owner of some bucket. But all
> objects in that bucket still belongs to this user. That way you can get
> quota exceeded. We had the same situation.

Well the user says he didn't write to any other buckets than his own.
The usage shows that he did have two other buckets boston_bombing,
charlie_hebdo and the buckets no longer exist (and we have apache logs
for the DELETE for them) but from the usage they were never deleted.  I
am concerned that since the delete never shows up that this is where the
quota is being lost to.

ceph-access.log:192.168.79.51 - - [16/Mar/2016:02:50:01 -0400] "DELETE
/boston_bombing/ HTTP/1.1" 204 - "-" "Boto/2.34.0 Python/2.6.6
Linux/2.6.32-573.18.1.el6.x86_64"

ceph-access.log:192.168.79.51 - - [16/Mar/2016:02:51:47 -0400] "DELETE
/charlie_hebdo/ HTTP/1.1" 204 - "-" "Boto/2.34.0 Python/2.6.6
Linux/2.6.32-573.18.1.el6.x86_64"

# radosgw-admin usage show --uid=username --start-date=2015-01-01
--end-date=2016-03-16
...
{
                    "bucket": "boston",
                    "time": "2016-03-07 23:00:00.000000Z",
                    "epoch": 1457391600,
                    "categories": [
                        {
                            "category": "create_bucket",
                            "bytes_sent": 19,
                            "bytes_received": 0,
                            "ops": 1,
                            "successful_ops": 1
                        },
                        {
                            "category": "get_acls",
                            "bytes_sent": 174400,
                            "bytes_received": 0,
                            "ops": 352,
                            "successful_ops": 352
                        },
                        {
                            "category": "get_obj",
                            "bytes_sent": 86170638,
                            "bytes_received": 0,
                            "ops": 14,
                            "successful_ops": 10
                        },
                        {
                            "category": "list_bucket",
                            "bytes_sent": 381327,
                            "bytes_received": 0,
                            "ops": 10,
                            "successful_ops": 10
                        },
                        {
                            "category": "put_acls",
                            "bytes_sent": 3230,
                            "bytes_received": 73031,
                            "ops": 170,
                            "successful_ops": 170
                        },
                        {
                            "category": "put_obj",
                            "bytes_sent": 0,
                            "bytes_received": 14041021516,
                            "ops": 169,
                            "successful_ops": 169
                        },
                        {
                            "category": "stat_bucket",
                            "bytes_sent": 6688,
                            "bytes_received": 0,
                            "ops": 353,
                            "successful_ops": 352
                        }
                    ]
                }
,
	{
                    "bucket": "charlie_hebdo",
                    "time": "2016-03-07 23:00:00.000000Z",
                    "epoch": 1457391600,
                    "categories": [
                        {
                            "category": "create_bucket",
                            "bytes_sent": 19,
                            "bytes_received": 0,
                            "ops": 1,
                            "successful_ops": 1
                        },
                        {
                            "category": "get_acls",
                            "bytes_sent": 79062,
                            "bytes_received": 0,
                            "ops": 159,
                            "successful_ops": 159
                        },
                        {
                            "category": "get_obj",
                            "bytes_sent": 1096,
                            "bytes_received": 0,
                            "ops": 9,
                            "successful_ops": 4
                        },
                        {
                            "category": "list_bucket",
                            "bytes_sent": 84129,
                            "bytes_received": 0,
                            "ops": 6,
                            "successful_ops": 6
                        },
                        {
                            "category": "put_acls",
                            "bytes_sent": 1406,
                            "bytes_received": 31655,
                            "ops": 74,
                            "successful_ops": 74
                        },
                        {
                            "category": "put_obj",
                            "bytes_sent": 0,
                            "bytes_received": 6920262020,
                            "ops": 73,
                            "successful_ops": 73
                        },
                        {
                            "category": "stat_bucket",
                            "bytes_sent": 3021,
                            "bytes_received": 0,
                            "ops": 160,
                            "successful_ops": 159
                        }
                    ]
                }
,
                {
                    "bucket": "start",
                    "time": "2016-02-05 03:00:00.000000Z",
                    "epoch": 1454641200,
                    "categories": [
                        {
                            "category": "create_bucket",
                            "bytes_sent": 38,
                            "bytes_received": 0,
                            "ops": 2,
                            "successful_ops": 2
                        },
                        {
                            "category": "delete_bucket",
                            "bytes_sent": 19,
                            "bytes_received": 0,
                            "ops": 1,
                            "successful_ops": 1
                        },
                        {
                            "category": "delete_obj",
                            "bytes_sent": 1387,
                            "bytes_received": 0,
                            "ops": 73,
                            "successful_ops": 73
                        },
                        {
                            "category": "get_acls",
                            "bytes_sent": 204482,
                            "bytes_received": 0,
                            "ops": 413,
                            "successful_ops": 413
                        },
                        {
                            "category": "get_obj",
                            "bytes_sent": 16340862938,
                            "bytes_received": 0,
                            "ops": 225,
                            "successful_ops": 187
                        },
                        {
                            "category": "list_bucket",
                            "bytes_sent": 746235,
                            "bytes_received": 0,
                            "ops": 30,
                            "successful_ops": 30
                        },
                        {
                            "category": "put_acls",
                            "bytes_sent": 3705,
                            "bytes_received": 83375,
                            "ops": 195,
                            "successful_ops": 195
                        },
                        {
                            "category": "put_obj",
                            "bytes_sent": 0,
                            "bytes_received": 17571802879,
                            "ops": 194,
                            "successful_ops": 194
                        },
                        {
                            "category": "stat_bucket",
                            "bytes_sent": 9329,
                            "bytes_received": 0,
                            "ops": 493,
                            "successful_ops": 491
                        }
                    ]
                }

-- 
Derek T. Yarnell
University of Maryland
Institute for Advanced Computer Studies
_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com



[Index of Archives]     [Information on CEPH]     [Linux Filesystem Development]     [Ceph Development]     [Ceph Large]     [Linux USB Development]     [Video for Linux]     [Linux Audio Users]     [Yosemite News]     [Linux Kernel]     [Linux SCSI]     [xfs]


  Powered by Linux