Re: S3 Partial Reads from Erasure Pool

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



I think it depends what you mean by rados objects and s3 objects here. If
you're talking about an object that was uploaded via MPU, and thus may
comprise many rados objects, I don't think there's a difference in read
behaviors based on pool type. If you're talking about reading a subset byte
range from a single rados object stored on an EC pool, yes, the whole
object is read from the pool in order to serve that subset read, something
that https://github.com/ceph/ceph/pull/55196 endeavours to address.

Josh

On Mon, Mar 25, 2024, 4:27 p.m. <E3GH75@xxxxxxxxx> wrote:

> I am dealing with a cluster that is having terrible performance with
> partial reads from an erasure coded pool. Warp tests and s3bench tests
> result in acceptable performance but when the application hits the data,
> performance plummets. Can anyone clear this up for me, When radosgw gets a
> partial read does it have to assemble all the rados objects that make up
> the s3 object before returning the range? With a replicated poll i am
> seeing 6 to 7 GiB/s of read performance and only 1GiB/s of read from the
> erasure coded pool which leads me to believe that the replicated pool is
> returning just the rados objects for the partial s3 object and the erasure
> coded pool is not.
> _______________________________________________
> ceph-users mailing list -- ceph-users@xxxxxxx
> To unsubscribe send an email to ceph-users-leave@xxxxxxx
>
_______________________________________________
ceph-users mailing list -- ceph-users@xxxxxxx
To unsubscribe send an email to ceph-users-leave@xxxxxxx




[Index of Archives]     [Information on CEPH]     [Linux Filesystem Development]     [Ceph Development]     [Ceph Large]     [Ceph Dev]     [Linux USB Development]     [Video for Linux]     [Linux Audio Users]     [Yosemite News]     [Linux Kernel]     [Linux SCSI]     [xfs]


  Powered by Linux