On Fri, 16 Nov 2007, Anand Avati wrote:
Very simple iozone call
iozone -aN -r 32k -s 131072k
Now what I probably should be doing is testing this against the actual
load, the real image processing code to be used. Did look at io
caching. That would possibly help if a number of jobs on the cluster
were to crunch the same file at the same time. If that were not the
case I'm not sure what io caching would give me.
The config? You can't get much simpler than this, maybe by
pulling the read-ahead and write-behind which weren't there
originally.
volume brick1
type storage/posix
option directory /home/sdm1
end-volume
volume server
type protocol/server
subvolumes brick1
option transport-type tcp/server # For TCP/IP transport
# option client-volume-filename /etc/glusterfs/glusterfs-client.vol
option auth.ip.brick1.allow *
end-volume
volume writebehind
type performance/write-behind
option aggregate-size 131072 # in bytes
subvolumes brick1
end-volume
volume readahead
type performance/read-ahead
option page-size 65536 ### in bytes
option page-count 16 ### memory cache size is page-count x page-size per file
subvolumes brick1
end-volume
Performance is still way below NFS. I have turned on
write-behind and read-ahead. And with fuse it's a little faster. but
not significantly.
What is your IO pattern? what are the tests you are running? what is your
interconnect? NFS can provide really good re-read performance which you can
get out of glusterfs using io-cache on the client side.
Can we have a discussion on whether I'm heading in the right
direction and what order things go in for the config files?
Can you paste your config files on pastebin and link it and also tell us the
kind of application/IOtests you are running?
thanks,
avati
--
It always takes longer than you expect, even when you take into account
Hofstadter's Law.
-- Hofstadter's Law
-------------------------------------------------------------------------------
Chris Johnson |Internet: johnson@xxxxxxxxxxxxxxxxxxx
Systems Administrator |Web: http://www.nmr.mgh.harvard.edu/~johnson
NMR Center |Voice: 617.726.0949
Mass. General Hospital |FAX: 617.726.7422
149 (2301) 13th Street |Do not meddle in the affairs of wizards, for
Charlestown, MA., 02129 USA |you are crunchy and good with ketchup.
-------------------------------------------------------------------------------
