Re: Auto-striping feature

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



On Tue, Jan 25, 2011 at 3:53 AM, Tatsuya Kawano <tatsuya6502@xxxxxxxxx> wrote:
>
> Hi,
>
> I have some questions about auto-striping feature in Ceph.
>
> - What is the default striping size?
The default is to stripe the file across 4MB objects, 4MB at a time.
You can also define your own striping strategy using cephfs. Make sure
that "stripe_unit" * "stripe_count" equals "object_size".

> - How can I specify the striping size for a specific file (via libceph and kernel driver)?
In the kernel, use the cephfs tool. It lets you use ioctls to specify
a single file layout or to define the default layout for newly created
files in a subtree of the fs. You can't do it in cfuse, unfortunately.
(Although you can set the default using the kernel client and cfuse
will follow that setting correctly.) If you're writing your own
application using libceph, you can also set it; use the cephfs source
as a model.

> - How many PGs will be involved on striping one file.
That depends on how large the file is, and is pseudorandom.
>
>
> I'm writing several files to Ceph and the size of each file will be about 64MB. There will be 10 to 20 OSDs in the cluster. I wonder how each file will be divided into objects and how these objects will be distributed in the cluster.
Well, the files will be divided into objects on 4MB blocks. (The last
block may be short.) The objects will be distributed pseudorandomly
into "placement groups" and those placement groups will be
pseudorandomly distributed across the OSDs in the cluster. If you're
interested in the specifics of how this works, I'd recommend reading
Sage's thesis, available on the Ceph website.
-Greg
--
To unsubscribe from this list: send the line "unsubscribe ceph-devel" in
the body of a message to majordomo@xxxxxxxxxxxxxxx
More majordomo info at  http://vger.kernel.org/majordomo-info.html


[Index of Archives]     [CEPH Users]     [Ceph Large]     [Information on CEPH]     [Linux BTRFS]     [Linux USB Devel]     [Video for Linux]     [Linux Audio Users]     [Yosemite News]     [Linux Kernel]     [Linux SCSI]

  Powered by Linux