local caching of file across global cluster

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



Is there any value / way to tell all the gluster nodes to make a file
highly available, potentially at the cost of consistency (i.e. forget about
locks for all files named XXXX and cache them in local disk)?

Scenario: Imagine I have a workflow of processing 1 million files, and I
want to compare all 1 billion files to all the words in , say, a set of ten
files, each of which are 10MB.

It would be easy to cache the ten files (100MB of data) on every local
gluster node.   Or even in memory for that matter.

Admittedly...Im not an expert on disk caching so, maybe, this is already
done using heuristics for us... and its just a matter of time for
FUSE/Underlying filesystem/Gluster mount to figure out that a file is
important before it starts caching it in some magical sort of way.

-- 
Jay Vyas
http://jayunit100.blogspot.com
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://supercolony.gluster.org/pipermail/gluster-users/attachments/20130531/0741388a/attachment.html>


[Index of Archives]     [Gluster Development]     [Linux Filesytems Development]     [Linux ARM Kernel]     [Linux ARM]     [Linux Omap]     [Fedora ARM]     [IETF Annouce]     [Bugtraq]     [Linux OMAP]     [Linux MIPS]     [eCos]     [Asterisk Internet PBX]     [Linux API]

  Powered by Linux