Thank you for the explanation. Very helpful. The docs are somewhat confusing as they did not make this obvious or clear. I presume the concept of stripe count and width are applicable when using RBD. On Tue, Jun 13, 2023 at 7:48 AM Casey Bodley <cbodley@xxxxxxxxxx> wrote: > radosgw's object striping does not repeat, so there is no concept of > 'stripe width'. rgw_obj_stripe_size just controls the maximum size of > each rados object, so the 'stripe count' is essentially just the total > s3 object size divided by rgw_obj_stripe_size > > On Tue, Jun 13, 2023 at 10:22 AM Teja A <tejaseattle@xxxxxxxxx> wrote: > > > > Hello > > > > I am working on an application that uses rados gateway to store objects > > onto a ceph cluster. I am currently working on optimizing the latency for > > storing/retrieving objects from the cluster. > > > > My goal to improve read/write latencies is to have RGW write/read > multiple > > rados objects in parallel as described here > > <https://docs.ceph.com/en/latest/architecture/#data-striping> - > > "Significant write performance occurs when the client writes the stripe > > units to their corresponding objects in parallel.". Just like with RAID0, > > by having a large number of rados objects that each radosgw object gets > > mapped to, we can achieve lower latencies as we are not bound by the > > throughput of a single disk. > > > > That documentation suggests that we can configure the stripe count as > well > > as stripe width which would let us indirectly control how many rados > > objects each radosgw object gets mapped to. I want to be able to change > > these parameters and run benchmarks against my pools. > > > > The key parameter I am therefore interested in controlling is the stripe > > count (i.e. the number of distinct objects each radosgw object is mapped > > to). More specifically, in the diagram > > < > https://docs.ceph.com/en/latest/_images/ditaa-96a6fc80dad17fb53f161987ed64f0779930ffe1.png > > > > attached to those docs, I see that the stripe_count is 4 (4 rados objects > > being written to for a single RGW object). I want to be able to > experiment > > with varying numbers for that stripe_count. > > > > I am having trouble figuring out what configuration parameters exist in > > radosgw that lets me control this. I see that there is a stripe_width > > < > https://github.com/ceph/ceph/blob/714cdc4e8767a153f825e857efdc28bb481528a1/src/common/options/rgw.yaml.in#L1736 > > > > and > > a rgw_max_chunk_size > > < > https://docs.ceph.com/en/latest/radosgw/config-ref/#confval-rgw_max_chunk_size > > > > but > > did not find anything for stripe_count. Configuring the stripe_width > alone > > is not sufficient as I would need to set the stripe_unit size as well to > > get the desired number for stripe_count, but I did not find either. > > > > Am I understanding that correctly? If so, can someone please point me to > > where and how this configuration should be set? > > > > I appreciate your help! > > _______________________________________________ > > ceph-users mailing list -- ceph-users@xxxxxxx > > To unsubscribe send an email to ceph-users-leave@xxxxxxx > > > > _______________________________________________ ceph-users mailing list -- ceph-users@xxxxxxx To unsubscribe send an email to ceph-users-leave@xxxxxxx
 |