Re: Can I limit buffering for each object in radosgw?

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



On Thu, Nov 20, 2014 at 8:03 PM, Yehuda Sadeh <yehuda@xxxxxxxxxx> wrote:
> On Thu, Nov 20, 2014 at 1:03 AM, Mustafa Muhammad
> <mustafaa.alhamdaani@xxxxxxxxx> wrote:
>> I am using radosgw, I have a large number of connections with huge
>> files, the memory usage keeps getting higher until killed by the
>> kernel, I *think* because of buffering for each request.
>> Is the a way to limit the buffer size for each object (or for each
>> connection)? and What do you suggest?\\\
>
>
> These are main two factors that would affect your memory consumption
>  - number of threads (rgw thread pool size)
>  - window size (rgw_get_obj_window_size)

Thank you for replying, in the configuration reference:
http://ceph.com/docs/master/radosgw/config-ref/
rgw get obj window size is 16 << 20, in bytes

I couldn't understand this "16 << 20", could you please explain how to
read this in bytes?


>
> There's also the chunk size, but the window size should supersede it.

Also I couldn't find "chunk size" in the configuration reference.

Regards
Mustafa

>
> Yehuda
--
To unsubscribe from this list: send the line "unsubscribe ceph-devel" in
the body of a message to majordomo@xxxxxxxxxxxxxxx
More majordomo info at  http://vger.kernel.org/majordomo-info.html




[Index of Archives]     [CEPH Users]     [Ceph Large]     [Information on CEPH]     [Linux BTRFS]     [Linux USB Devel]     [Video for Linux]     [Linux Audio Users]     [Yosemite News]     [Linux Kernel]     [Linux SCSI]
  Powered by Linux