Re: Small files

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



On 01/29/2015 09:54 PM, John_Salinas@xxxxxxxx wrote:
I suppose some of it may depend on what you consider a small file and
how many of them there are and the operation read/write/sequential/etc
as well as the performance expectations are.


Agree, performance is subjective and expectation,behavior varies across deployments. It would be good to understand from various deployments the operations that seem to be slower for small files. In my experience and tests, performance problems seem to be associated more with create/write & readdir operations. Are there other operations that have been slow for you?

I had looked at zfs replication also but redhat support was a problem.

Does anyone know if a beta is available for:
http://www.gluster.org/community/documentation/index.php/Features/Feature_Smallfile_Perf


Some enhancements listed are going to land in 3.7. Once 3.7 feature freeze happens in February, you should be able to try out the improvements. What enhancements from the list would you consider important for your use case?


Are there any benchmarks published comparing nfs client mount vs.
gluster fuse vs. boost (for apache)?   I know this is very current but
https://s3.amazonaws.com/aws001/guided_trek/Performance_in_a_Gluster_Systemv6F.pdf
pages 19-20
<https://s3.amazonaws.com/aws001/guided_trek/Performance_in_a_Gluster_Systemv6F.pdf%20pages%2019-20>
has some data for small files – from that doc “As can be seen in Figure
8 below, Gluster delivers good single storage node performance for a
variety of small file operations. Generally speaking, Gluster Native
FUSE will deliver better small file performance than Gluster NFS,
although Gluster NFS is often better for very small block sizes. Perhaps
most important, IOPS performance in Gluster scales out just as
throughput performance scales out.”  This is from 2013 and has a few
suggestions to try:
https://rhsummit.files.wordpress.com/2013/07/england_th_0450_rhs_perf_practices-4_neependra.pdf.

There is a similar presentation from the 2014 Red Hat Summit at [1].

Regards,
Vijay

[1] https://rhsummit.files.wordpress.com/2014/04/bengland_h_1100_rhs_performance.pdf


_______________________________________________
Gluster-users mailing list
Gluster-users@xxxxxxxxxxx
http://www.gluster.org/mailman/listinfo/gluster-users





[Index of Archives]     [Gluster Development]     [Linux Filesytems Development]     [Linux ARM Kernel]     [Linux ARM]     [Linux Omap]     [Fedora ARM]     [IETF Annouce]     [Bugtraq]     [Linux OMAP]     [Linux MIPS]     [eCos]     [Asterisk Internet PBX]     [Linux API]

  Powered by Linux