This is highly frustrating and we notice that uploaded images disappear after users upload images. Background: Latest version of Gluster running on CentOS 64bit We have two replicated bricks The volume is mounted via NFS on our image servers (10.0.0.210:/shared_images /data nfs defaults,_netdev 0 0 / 10.0.0.211:/shared_images /data nfs defaults,_netdev 0 0) The image servers run CentOS 64bit and use Apache HTTP and Tomcat as the application server Users upload images via the web and Tomcat writes the file with a unique name to the NFS file-system We use ImageMagick mogrify to resize the image. This takes a few milliseconds (see log-file entry below) In certain instances images go missing some time after the upload (the users typically check their uploads and the images seem to disappear hours afterwards) Gluster configuration: Type: Replicate Status: Started Number of Bricks: 2 Transport-type: tcp Bricks: Brick1: 10.0.0.210:/data Brick2: 10.0.0.211:/data Options Reconfigured: performance.cache-size: 1000MB performance.cache-refresh-timeout: 5 performance.io-cache: on performance.read-ahead: off performance.io-thread-count: 16 performance.stat-prefetch: on performance.write-behind: off performance.quick-read: on http://images.bidorbuy.co.za/user_images/974/931974_110412195059_RSA_REDCross.jpg M/M 12/04/11 19:51:12 ajp-127.0.0.1-8009-2 ImageUploadInterface Optimised Image with : mogrify -resize 500 -quality 75% /home/prodza/webapp/user_images/974/931974_110412195059_RSA_REDCross.jpg M/M 12/04/11 19:51:12 ajp-127.0.0.1-8009-2 IMAGEUPLOAD:uploadms:12812:compressms:160:uploadbytes:169494:compressbytes:26924:filepath:/home/prodza/webapp/user_images/974/931974_110412195059_RSA_REDCross.jpg M/M 12/04/11 19:51:12 ajp-127.0.0.1-8009-2 ImageUploadInterface Loaded Image:User:931974:Size:169494:Time:12975:http://images.bidorbuy.co.za/user_images/974/931974_110412195059_RSA_REDCross.jpg http://images.bidorbuy.co.za/user_images/974/931974_110412223337_VerwoerdFS.jpg M/M 12/04/11 22:33:53 ajp-127.0.0.1-8009-1 ImageUploadInterface Optimised Image with : mogrify -resize 500 -quality 75% /home/prodza/webapp/user_images/974/931974_110412223337_VerwoerdFS.jpg M/M 12/04/11 22:33:53 ajp-127.0.0.1-8009-1 IMAGEUPLOAD:uploadms:16245:compressms:320:uploadbytes:218430:compressbytes:168941:filepath:/home/prodza/webapp/user_images/974/931974_110412223337_VerwoerdFS.jpg M/M 12/04/11 22:33:53 ajp-127.0.0.1-8009-1 ImageUploadInterface Loaded Image:User:931974:Size:218430:Time:16569:http://images.bidorbuy.co.za/user_images/974/931974_110412223337_VerwoerdFS.jpg