Re: Parallel reads with CephFS

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



Hi...

Are you actually playing with file layout?

    http://docs.ceph.com/docs/jewel/cephfs/file-layouts/

By increasing the stripe count and tuning the stripe unit to your application block size, you may have an increase of performance.

Cheers

Goncalo




On 12/08/2016 12:45 PM, Andreas Gerstmayr wrote:
Hi,

does the CephFS kernel module (as of kernel version 4.8.8) support
parallel reads of file stripes?
When an application requests a 500MB block from a file (which is
splitted into multiple objects and stripes on different OSDs) at once,
does the CephFS kernel client request these blocks in parallel?

My benchmarks suggest it does not (there is no significant difference
in throughput whether I'm reading a file in chunks of 64 KB, 500 MB or
1 GB blocks).
In the architecture docs [1] under the protocol section data striping
and the resulting performance gains are explained - but I'm not sure
if this means that this optimization is already implemented in the
current CephFS kernel module or not.


[1] http://docs.ceph.com/docs/master/architecture/#data-striping

Thanks,
Andreas
_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com


--
Goncalo Borges
Research Computing
ARC Centre of Excellence for Particle Physics at the Terascale
School of Physics A28 | University of Sydney, NSW  2006
T: +61 2 93511937

_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com



[Index of Archives]     [Information on CEPH]     [Linux Filesystem Development]     [Ceph Development]     [Ceph Large]     [Linux USB Development]     [Video for Linux]     [Linux Audio Users]     [Yosemite News]     [Linux Kernel]     [Linux SCSI]     [xfs]


  Powered by Linux