Re: Ceph very slow bucket listing performance! how to deal with it.

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



Is the bucket sharded? Did you tell the rgw's that listing unordered is allowed?

https://docs.ceph.com/en/latest/radosgw/s3/bucketops/#get-bucket

Den fre 15 okt. 2021 kl 10:52 skrev Xianqiang Jing <jingxianqiang11@xxxxxxx>:
>
> I have a ceph cluster with 3 rgws.  I created a few buckets, then put 5800000 object in one bucket. when i use “s3cmd ls s3://adasupload/parsed/" it will take a long time to response, sometimes it will response a timeout error.
> root@mon1 ~]# s3cmd -c s3cfg-adasupload ls s3://adasupload/parsed
> WARNING: Retrying failed request: /?delimiter=%2F&prefix=parsed (timed out)
> WARNING: Waiting 3 sec...
> WARNING: Retrying failed request: /?delimiter=%2F&prefix=parsed (timed out)
> WARNING: Waiting 6 sec...
> WARNING: Retrying failed request: /?delimiter=%2F&prefix=parsed (timed out)
> WARNING: Waiting 9 sec...
> WARNING: Retrying failed request: /?delimiter=%2F&prefix=parsed (timed out)
> WARNING: Waiting 12 sec...
>
>
> Anyone can give me some suggestion???
>
>
>
> xjing@xxxxxxxxxx
> _______________________________________________
> ceph-users mailing list -- ceph-users@xxxxxxx
> To unsubscribe send an email to ceph-users-leave@xxxxxxx



-- 
May the most significant bit of your life be positive.
_______________________________________________
ceph-users mailing list -- ceph-users@xxxxxxx
To unsubscribe send an email to ceph-users-leave@xxxxxxx




[Index of Archives]     [Information on CEPH]     [Linux Filesystem Development]     [Ceph Development]     [Ceph Large]     [Ceph Dev]     [Linux USB Development]     [Video for Linux]     [Linux Audio Users]     [Yosemite News]     [Linux Kernel]     [Linux SCSI]     [xfs]


  Powered by Linux