2008-06-09 11:04:49 E [posix.c:1984:posix_setdents] backupbrick-ns: Error creating file /var/lib/gluster/ns//hosting/****-databases/***/databases/mysql/db_iis_enfo_en/iis_mylinks_cat.MY with mode (0100660) This is a wrong error level for error. The error is EEXIST, and it comes when unify does self-heal of a directory. Fixed in tla repo, will be coming out with new release. Working on rsync/rdiff creating multiple files. Yet to corner it down. Will have 1.3.10 with this fix this week. > > dom0r1:~# head > > /backup/hosting/****-databases/****/databases/mysql/db_iis_enfo_en/iis_informer.MYI > head: cannot open > > `/backup/hosting/****-databases/****/databases/mysql/db_iis_enfo_en/iis_informer.MYI' > for reading: Input/output error > > glusterfs.log contains: > 2008-06-09 11:04:49 E [unify.c:873:unify_open] backup-unify: > > /hosting/****-databases/***/databases/mysql/db_iis_enfo_en/iis_informer.MYI: > entry_count is 3 > 2008-06-09 11:04:49 E [unify.c:876:unify_open] backup-unify: > > /hosting/****-databases/***/databases/mysql/db_iis_enfo_en/iis_informer.MYI: > found on bbrick2 > 2008-06-09 11:04:49 E [unify.c:876:unify_open] backup-unify: > > /hosting/****-databases/***/databases/mysql/db_iis_enfo_en/iis_informer.MYI: > found on bbrick1 > 2008-06-09 11:04:49 E [unify.c:876:unify_open] backup-unify: > > /hosting/****-databases/***/databases/mysql/db_iis_enfo_en/iis_informer.MYI: > found on afr-ns > 2008-06-09 11:04:49 E [fuse-bridge.c:692:fuse_fd_cbk] glusterfs-fuse: > 61894193: (12) > /hosting/****-databases/***/databases/mysql/db_iis_enfo_en/iis_informer.MYI > => -1 (5) > > We use rdiff-backup to backup data from our servers. After 2-5 backup > cycles > we get the situation. > > Storage systems are placed over ext3fs mounted with attributes > rw,noatime,user_xattr. > > In the same time I tried to 'head' the file, glusterfsd.log got a lot of > error messages like: > Thanks for the report, we will try to reproduce it locally. Regards, Amar -- Amar Tumballi Gluster/GlusterFS Hacker [bulde on #gluster/irc.gnu.org] http://www.zresearch.com - Commoditizing Super Storage!