negative list operation causing degradation in performance

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]


In Ceph version 17.2.5, a notable performance drop is observed when executing list operations on non-existent objects, especially for large buckets undergoing high concurrency with frequent updates.

For the context, initiating concurrent PUT/DELETE/LIST operations on 4 buckets, each containing ~10 million objects, initially yields satisfactory latencies.  However, as updates continue to accumulate, the efficiency of the `negative list` operation diminishes notably.  I suspect that over time, with many object insertions and deletions, the bucket index gets fragmented. While this affects all operations, negative lookups appear to be particularly hampered, possibly because they necessitate a comprehensive scan of the fragmented index.

With the LIST arguments defined as $prefix=xxx $max-keys=2, are there any recommendations to optimize the Ceph configuration to enhance the performance of negative list operations?
ceph-users mailing list -- ceph-users@xxxxxxx
To unsubscribe send an email to ceph-users-leave@xxxxxxx

[Index of Archives]     [Information on CEPH]     [Linux Filesystem Development]     [Ceph Development]     [Ceph Large]     [Ceph Dev]     [Linux USB Development]     [Video for Linux]     [Linux Audio Users]     [Yosemite News]     [Linux Kernel]     [Linux SCSI]     [xfs]

  Powered by Linux