Re: RGW listing users' quota and usage painfully slow

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



On 09/03/17 10:45, Abhishek Lekshmanan wrote:

On 03/09/2017 11:26 AM, Matthew Vernon wrote:

I'm using Jewel / 10.2.3-0ubuntu0.16.04.2 . We want to keep track of our
S3 users' quota and usage. Even with a relatively small number of users
(23) it's taking ~23 seconds.

What we do is (in outline):
radosgw-admin metadata list user
for each user X:
  radosgw-admin user info --uid=X  #has quota details
  radosgw-admin user stats --uid=X #has usage details

None of these calls is particularly slow (~0.5s), but the net result is
not very satisfactory.

What am I doing wrong? :)

Is this a single site or a multisite cluster? If you're only trying to
read info you could try disabling the cache (it is not recommended to
use this if you're trying to write/modify info) for eg:

It's a single site.

$ radosgw-admin user info --uid=x --rgw-cache-enabled=false

That doesn't noticably change the execution time (perhaps it improves it a little)

also you could run the info command with higher debug (--debug-rgw=20
--debug-ms=1) and paste that somewhere (its very verbose) to help
identify where we're slowing down

https://drive.google.com/drive/folders/0B4TV1iNptBAdMEdUaGJIa3U1QVE?usp=sharing

Should let you see the output from running this with that cache-disabling option (and without).

Naiively, I find myself wondering if some sort of all-users flag to the info and stats command or a "tell me usage and quota with one call" command would be quicker.

Thanks,

Matthew


--
The Wellcome Trust Sanger Institute is operated by Genome Research Limited, a charity registered in England with number 1021457 and a company registered in England with number 2742969, whose registered office is 215 Euston Road, London, NW1 2BE. _______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com



[Index of Archives]     [Information on CEPH]     [Linux Filesystem Development]     [Ceph Development]     [Ceph Large]     [Linux USB Development]     [Video for Linux]     [Linux Audio Users]     [Yosemite News]     [Linux Kernel]     [Linux SCSI]     [xfs]


  Powered by Linux