Confusing bucket stats output compared to users stat

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



Hi,

>From ceph side the user's bucket is like 90GB, however the user said he has only 10GB data inside. How is this possible?
I'ce checked multipart uploads, I don't see huge list at all, 3-4 files but not in this size.

This is the bucket stats:
{
  "bucket": "streaming",
  "num_shards": 11,
  "tenant": "",
  "zonegroup": "31a5ea05-c87a-436d-9ca0-ccfcbad481e3",
  "placement_rule": "default-placement",
  "explicit_placement": {
    "data_pool": "",
    "data_extra_pool": "",
    "index_pool": ""
  },
  "id": "9213182a-14ba-48ad-bde9-289a1c0c0de8.21813595.2",
  "marker": "9213182a-14ba-48ad-bde9-289a1c0c0de8.21813595.2",
  "index_type": "Normal",
  "owner": "feature-store",
  "ver": "0#295579852,1#295189457,2#295196723,3#295259566,4#295170032,5#295186965,6#295215380,7#295170351,8#295203793,9#295145202,10#295169382",
  "master_ver": "0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0",
  "mtime": "2021-03-12T10:02:54.036536Z",
  "creation_time": "2021-03-12T10:02:54.033355Z",
  "max_marker": "0#00295579851.704655497.5,1#00295189456.693354678.5,2#00295196722.699807930.5,3#00295259565.701252119.5,4#00295170031.694694192.5,5#00295186964.694255385.5,6#00295215379.694197070.5,7#00295170350.698729452.5,8#00295203792.697883775.5,9#00295145201.697569736.5,10#00295169381.699009454.5",
  "usage": {
    "rgw.none": {
      "size": 0,
      "size_actual": 0,
      "size_utilized": 0,
      "size_kb": 0,
      "size_kb_actual": 0,
      "size_kb_utilized": 0,
      "num_objects": 18446744073709552000
    },
    "rgw.main": {
      "size": 90347885663,
      "size_actual": 90461605888,
      "size_utilized": 90347885663,
      "size_kb": 88230358,
      "size_kb_actual": 88341412,
      "size_kb_utilized": 88230358,
      "num_objects": 38264
    },
    "rgw.multimeta": {
      "size": 0,
      "size_actual": 0,
      "size_utilized": 108,
      "size_kb": 0,
      "size_kb_actual": 0,
      "size_kb_utilized": 1,
      "num_objects": 4
    }
  },
  "bucket_quota": {
    "enabled": false,
    "check_on_raw": false,
    "max_size": -1,
    "max_size_kb": 0,
    "max_objects": -1
  }
}

Not sure what is that super huge number in rgw none, I ignored it, however s3mcd reported this:
s3cmd du -H
    0       0 objects s3://feature-store-prod-artifacts/
    0       0 objects s3://feature-store-prod-sparkstate/
    0       0 objects s3://feature-store-qa-artifacts/
    0       0 objects s3://feature-store-qa-sparkstate/
   9G   36845 objects s3://streaming/
------------
9G           Total


Istvan Szabo
Senior Infrastructure Engineer
---------------------------------------------------
Agoda Services Co., Ltd.
e: istvan.szabo@xxxxxxxxx<mailto:istvan.szabo@xxxxxxxxx>
---------------------------------------------------

_______________________________________________
ceph-users mailing list -- ceph-users@xxxxxxx
To unsubscribe send an email to ceph-users-leave@xxxxxxx



[Index of Archives]     [Information on CEPH]     [Linux Filesystem Development]     [Ceph Development]     [Ceph Large]     [Ceph Dev]     [Linux USB Development]     [Video for Linux]     [Linux Audio Users]     [Yosemite News]     [Linux Kernel]     [Linux SCSI]     [xfs]


  Powered by Linux