Re: Is object name used by CRUSH algorithm?

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



Gregory and Paul,

Thank you for sharing the information.

Jin.

On Mon, Oct 1, 2018 at 4:08 PM Paul Emmerich <paul.emmerich@xxxxxxxx> wrote:
You are probably thinking of Amazon's S3 where adding a random prefix
to object names was a common performance optimization in the past, but
I think they fixed that recently.

Anyways, common prefixes are very common in Ceph and no problem. For
example, all objects within an rbd imge have the same prefix.

Paul
Am Do., 27. Sep. 2018 um 21:09 Uhr schrieb Jin Mao <jin@xxxxxxxxxxxxxxxxxx>:
>
> I am running luminous and the objects were copied from Isilon with a long and similar prefix in path like /dir1/dir2/dir3/yyyy/mm/dd. The objects are copied to various buckets like bucket_YYYYMMDD/dir1/dir2/dir3/yyyy/mm/dd. This setup minimize some internal code change when moving from NFS to object store.
>
> I heard that CRUSH may NOT evenly balance OSDs if there are many common leading characters in the object name? However, I couldn't find any evidence to support this.
>
> Does anyone know further details about this?
>
> Thank you.
>
> Jin.
> _______________________________________________
> ceph-users mailing list
> ceph-users@xxxxxxxxxxxxxx
> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com



--
Paul Emmerich

Looking for help with your Ceph cluster? Contact us at https://croit.io

croit GmbH
Freseniusstr. 31h
81247 München
www.croit.io
Tel: +49 89 1896585 90
_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

[Index of Archives]     [Information on CEPH]     [Linux Filesystem Development]     [Ceph Development]     [Ceph Large]     [Ceph Dev]     [Linux USB Development]     [Video for Linux]     [Linux Audio Users]     [Yosemite News]     [Linux Kernel]     [Linux SCSI]     [xfs]


  Powered by Linux