very bad performance on small files

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



On 01/15/2011 10:31 AM, Pan, Henry wrote:
> Hello Gluster Gurus,
>
> I'm trying to find out what performance data you could get while
> trying eDiscovery searching application in a namespace with over 3
> billins small files on GlusterFS...

Hmmm ... are you searching within the files or the file names for patterns?

Gluster does have some pretty good caching facilities, with the downside 
being that we seem to catch lots of bugs in this layer.  There are 
pre-fetch capabilities as well.

The issue is that this is going to be a *very* seeky load.  The 
underlying system IOP rate will be one of the bounding elements.

-- 
Joseph Landman, Ph.D
Founder and CEO
Scalable Informatics, Inc.
email: landman at scalableinformatics.com
web  : http://scalableinformatics.com
        http://scalableinformatics.com/sicluster
phone: +1 734 786 8423 x121
fax  : +1 866 888 3112
cell : +1 734 612 4615


[Index of Archives]     [Gluster Development]     [Linux Filesytems Development]     [Linux ARM Kernel]     [Linux ARM]     [Linux Omap]     [Fedora ARM]     [IETF Annouce]     [Bugtraq]     [Linux OMAP]     [Linux MIPS]     [eCos]     [Asterisk Internet PBX]     [Linux API]

  Powered by Linux