Hi Eric,
This looks like something the software developer must do, not something than Storage provider must allow no?
Strange behavior is that sometimes bucket is list fast in less than 30 secs and other time it timeout after 600 secs, the bucket contains 875 folders with a total object number of 6Millions.
I don’t know how a simple list of 875 folder can timeout after 600 secs
We bought several NVMe Optane for do 4 partitions in each PCIe card and get up 1.000.000 IOPS for Index. Quite expensive because we calc that our index is just 4GB (100-200M objects),waiting those cards. Any more idea?
Regards
-----Mensaje original-----
De: J. Eric Ivancich <ivancich@xxxxxxxxxx>
Enviado el: martes, 7 de mayo de 2019 23:53
Para: EDH - Manuel Rios Fernandez <mriosfer@xxxxxxxxxxxxxxxx>; 'Casey Bodley' <cbodley@xxxxxxxxxx>; ceph-users@xxxxxxxxxxxxxx
Asunto: Re: Ceph Bucket strange issues rgw.none + id and marker diferent.
On 5/7/19 11:24 AM, EDH - Manuel Rios Fernandez wrote:
> Hi Casey
>
> ceph version 13.2.5 (cbff874f9007f1869bfd3821b7e33b2a6ffd4988) mimic
> (stable)
>
> Reshard is something than don’t allow us customer to list index?
>
> Regards
Listing of buckets with a large number of buckets is notoriously slow, because the entries are not stored in lexical order but the default behavior is to list the objects in lexical order.
If your use case allows for an unordered listing it would likely perform better. You can see some documentation here under the S3 API / GET BUCKET:
http://docs.ceph.com/docs/mimic/radosgw/s3/bucketops/
Are you using S3?
Eric
_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
