Re: Stat speed for objects in ceph

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



BTW, why you need to iterate so much objects..... I think it should be
done by other ways to achieve the goal.

On Wed, Sep 21, 2016 at 11:23 PM, Iain Buclaw <ibuclaw@xxxxxxxxx> wrote:
> On 20 September 2016 at 19:27, Gregory Farnum <gfarnum@xxxxxxxxxx> wrote:
>> In librados getting a stat is basically equivalent to reading a small
>> object; there's not an index or anything so FileStore needs to descend its
>> folder hierarchy. If looking at metadata for all the objects in the system
>> efficiently is important you'll want to layer an index in somewhere.
>> -Greg
>>
>
> Yeah, that's not particularly good to hear.  Is this slowness also
> inherent in list_nobjects too?  It looks like I can iterate all
> objects at a rate no faster than 25K per second.  No chance at
> speeding this up either by having two or more instances starting at
> different pg offsets.
>
> For this particular operation, it's only looking for orphaned objects.
> This wouldn't be needed if a mechanism for TTLs existed and set on all
> objects.  But that would mean finding out how RGW gets away with it,
> and I assume with another very large index and actively keeping track
> of all set destruction times.
>
> --
> Iain Buclaw
> _______________________________________________
> ceph-users mailing list
> ceph-users@xxxxxxxxxxxxxx
> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com



[Index of Archives]     [Information on CEPH]     [Linux Filesystem Development]     [Ceph Development]     [Ceph Large]     [Ceph Dev]     [Linux USB Development]     [Video for Linux]     [Linux Audio Users]     [Yosemite News]     [Linux Kernel]     [Linux SCSI]     [xfs]


  Powered by Linux