Re: Basic object storage question

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



On Thu, Sep 24, 2015 at 2:06 AM, Ilya Dryomov <idryomov@xxxxxxxxx> wrote:
> On Thu, Sep 24, 2015 at 7:05 AM, Robert LeBlanc <robert@xxxxxxxxxxxxx> wrote:
>> -----BEGIN PGP SIGNED MESSAGE-----
>> Hash: SHA256
>>
>> If you use RADOS gateway, RBD or CephFS, then you don't need to worry
>> about striping. If you write your own application that uses librados,
>> then you have to worry about it. I understand that there is a
>> radosstriper library that should help with that. There is also a limit
>> to the size of an object that can be stored. I think I've seen the
>> number of 100GB thrown around.
>
> Just for the sake of archives, it's 90M by default.

Yeah, despite being *able* to create objects larger than this, you
definitely don't want to create a 100GB object on any storage devices
existing today. I've no idea what the (arbitrary) actual limit is (if
we have one), but you want to have a lot of objects of each size and
you want them to not be an appreciable fraction of a single storage
device. The Hadoop bindings default to 64MB and that seems to be fine
but I wouldn't go past 256MB or something, and then only if you have a
really good reason...
-Greg
_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com



[Index of Archives]     [Information on CEPH]     [Linux Filesystem Development]     [Ceph Development]     [Ceph Large]     [Ceph Dev]     [Linux USB Development]     [Video for Linux]     [Linux Audio Users]     [Yosemite News]     [Linux Kernel]     [Linux SCSI]     [xfs]


  Powered by Linux