On Friday 21 January 2011 07:46 PM, Marcus Bointon wrote: > On 21 Jan 2011, at 14:37, Vijay Bellur wrote: > >> Can you please elaborate a bit more about the rsync problem? > I'm keeping user-uploaded/created web content on a gluster volume. On one of the gluster nodes I run an hourly script to rsync the entire contents to another server. I get errors like this: > > /etc/cron.hourly/content-backup: > file has vanished: "/var/www/mysite/content/username/images/image.gif" > rsync warning: some files vanished before they could be transferred (code 24) at main.c(1060) [sender=3.0.7] > run-parts: /etc/cron.hourly/content-backup exited with return code 24 Dont think this is a gluster problem . but its rsync thats not finding some files that already existed the last time on the remote directory . Too many temp files created/destroyed on the remote directory ? i faced a similar issue and wrote a simple wrapper to ignore code 24 and just continue the rsync rather than stopping it . hope this helps > (the gluster volume is mounted at /var/www/mysite/content) > > The errors are intermittent - some hours it works, other hours it doesn't. When I hit the URL that points at it, it seems to be fine. To fix it, I copy the file from its location on the gluster volume to somewhere else, then copy it back. So far this has always fixed the problem. I originally started seeing this with gluster 3.0 and it's persisted with 3.1.x. > > It's possible that some files have indeed vanished between rsync creating its list and actually copying it (for example cache files created by wp-supercache are often very short-lived), however, this is mostly not the case - I'll often get the same error for the same file for several consecutive hours. > > I suspect this could be a metadata issue of some kind - if you can tell me how, I can grab some kind of metadata dump from the affected files on both my backing stores and through the mounted gluster volume. > > Marcus > _______________________________________________ > Gluster-users mailing list > Gluster-users at gluster.org > http://gluster.org/cgi-bin/mailman/listinfo/gluster-users
