It's obviously been a while since I brought this issue up, but it has cropped up again for us. We're now on 3.0.3 and I've included my glusterfs*.vol files below. We end up with file i/o errors like the ones below: forrtl: File exists forrtl: severe (10): cannot overwrite existing file, unit 18, file /work/b/brs/vdWSi/CHGCAR Even if the file existed, it shouldn't really be a problem. Other file systems work just fine. I'll get some more verbose logging going and share my output. glusterfsd.vol is the same in the referenced e-mails below. Thanks in advance, -Brian ## file auto generated by /usr/bin/glusterfs-volgen (mount.vol) # Cmd line: # $ /usr/bin/glusterfs-volgen --name work pvfs0:/pvfs/glusterfs pvfs1:/pvfs/glusterfs # TRANSPORT-TYPE tcp volume pvfs0-1 type protocol/client option transport-type tcp option remote-host pvfs0 option remote-port 6996 option transport.socket.nodelay on option remote-subvolume brick1 end-volume volume pvfs1-1 type protocol/client option transport-type tcp option remote-host pvfs1 option remote-port 6996 option transport.socket.nodelay on option remote-subvolume brick1 end-volume volume distribute type cluster/distribute subvolumes pvfs0-1 pvfs1-1 end-volume volume writebehind type performance/write-behind option cache-size 4MB subvolumes distribute end-volume volume readahead type performance/read-ahead option page-count 4 subvolumes writebehind end-volume #volume iocache # type performance/io-cache # option cache-size 1GB # option cache-timeout 1 # subvolumes readahead #end-volume #volume quickread # type performance/quick-read # option cache-timeout 1 # option max-file-size 64kB # subvolumes iocache #end-volume #volume statprefetch # type performance/stat-prefetch # subvolumes quickread #end-volume ========================== * replies inline * On Fri, Feb 12, 2010 at 9:52 PM, Brian Smith <brs at usf.edu> wrote: > Hi, Harshavardhana, > > Thanks for the reply. My volume files are below. Unfortunately, there > is no helpful information in the logs as it seems the log verbosity is > set too low. I'll update that and hopefully get some more information. > I'm using distribute and not NUFA. > > Perfect. > ## file auto generated by /usr/bin/glusterfs-volgen (export.vol) > # Cmd line: > # $ /usr/bin/glusterfs-volgen --name work pvfs0:/pvfs/glusterfs > pvfs1:/pvfs/glusterfs > > volume posix1 > type storage/posix > option directory /pvfs/glusterfs > end-volume > > volume locks1 > type features/locks > subvolumes posix1 > option mandatory-locks on > end-volume > > volume brick1 > type performance/io-threads > option thread-count 8 > subvolumes locks1 > end-volume > > volume server-tcp > type protocol/server > option transport-type tcp > option auth.addr.brick1.allow * > option transport.socket.listen-port 6996 > option transport.socket.nodelay on > subvolumes brick1 > end-volume > > ## file auto generated by /usr/bin/glusterfs-volgen (mount.vol) > # Cmd line: > # $ /usr/bin/glusterfs-volgen --name work pvfs0:/pvfs/glusterfs > pvfs1:/pvfs/glusterfs > > # TRANSPORT-TYPE tcp > volume pvfs0-1 > type protocol/client > option transport-type tcp > option remote-host pvfs0 > option transport.socket.nodelay on > option transport.remote-port 6996 > option remote-subvolume brick1 > end-volume > > volume pvfs1-1 > type protocol/client > option transport-type tcp > option remote-host pvfs1 > option transport.socket.nodelay on > option transport.remote-port 6996 > option remote-subvolume brick1 > end-volume > > volume distribute > type cluster/distribute > subvolumes pvfs0-1 pvfs1-1 > end-volume > > volume writebehind > type performance/write-behind > option cache-size 4MB > subvolumes distribute > end-volume > > volume readahead > type performance/read-ahead > option page-count 4 > subvolumes writebehind > end-volume > > volume iocache > type performance/io-cache > option cache-size 1GB > option cache-timeout 1 > subvolumes readahead > end-volume > > volume quickread > type performance/quick-read > option cache-timeout 1 > option max-file-size 64kB > subvolumes iocache > end-volume > > volume statprefetch > type performance/stat-prefetch > subvolumes quickread > end-volume > > > Could you remove the above "quickread", stat-prefetch, io-cache and test again. Also could you state the version you are using?. > -- > Brian Smith > Senior Systems Administrator > IT Research Computing, University of South Florida > 4202 E. Fowler Ave. ENB204 > Office Phone: +1 813 974-1467 > Organization URL: http://rc.usf.edu > >