Re: osd max write size and large objects

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 




 Thanks.  Does this mean that I can send >90MB objects to my RGWs and they will break it up into manageable (<=90MB) chunks before storing them?  Or if I'm going to store objects > 90MB do I need to change this parameter?

 I don't know if we'll be able to use libradosstriper, but thanks for bringing it to my attention.  We are using the S3 interface of RGW exclusively (nothing custom in there).


On Thu, Nov 16, 2017 at 9:41 AM, Wido den Hollander <wido@xxxxxxxx> wrote:

> Op 16 november 2017 om 16:32 schreef Robert Stanford <rstanford8896@xxxxxxxxx>:
>
>
>  Once 'osd max write size' (90MB by default I believe) is exceeded, does
> Ceph reject the object (which is coming in through RGW), or does it break
> it up into smaller objects (of max 'osd  max write size' size)?  If it
> breaks them up, does it read the fragments in parallel when they're
> requested by RGW?
>

The OSD rejects the write. However, RGW already does striping over RADOS objects.

Usually you don't need to worry about this setting unless you are talking to RADOS directly.

However, 90MB objects are big and you should look into libradosstriper.

Wido

>  Thanks
> _______________________________________________
> ceph-users mailing list
> ceph-users@xxxxxxxxxxxxxx
> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

[Index of Archives]     [Information on CEPH]     [Linux Filesystem Development]     [Ceph Development]     [Ceph Large]     [Ceph Dev]     [Linux USB Development]     [Video for Linux]     [Linux Audio Users]     [Yosemite News]     [Linux Kernel]     [Linux SCSI]     [xfs]


  Powered by Linux