The cp -av behavior I am seeing worked in patch-368. I am also seeing some other issues. 1. my tar test slowed down after 368. 366 is still fast. 2. running tar -cf immediately after restarting the client results is a failure: bad descriptor. tar -cvf runs. rerunning tar -cf runs as well. It is difficult to test this further because slowing it down makes the error go away. It also does not happen every time. Harris ----- Original Message ----- From: "Anand Babu Periasamy" <ab@xxxxxxxxxx> To: "Harris Landgarten" <harrisl@xxxxxxxxxxxxx> Cc: "Brent A Nelson" <brent@xxxxxxxxxxxx>, gluster-devel@xxxxxxxxxx Sent: Thursday, July 26, 2007 7:48:12 PM (GMT-0500) America/New_York Subject: Re: copy glitch, latest TLA You are correct, Brent's strace confirms it. ls gets the file listing from name space, but stat on it is performed on actual file. It looks like only name space entries are made, but files were not copied. We are looking into it. -- Anand Babu GPG Key ID: 0x62E15A31 Blog [http://ab.freeshell.org] The GNU Operating System [http://www.gnu.org] Z RESEARCH Inc [http://www.zresearch.com] Harris Landgarten wrote: > I can verify that something is wrong. > > cp -av /usr/share/zoneinfo /mnt/glusterfs/test/ > > completed without error. > > Then: > > ls -lh /mnt/glusterfs/test/zoneinfo/ > ls: cannot access /mnt/glusterfs/test/zoneinfo/Hongkong: No such file or directory > ls: cannot access /mnt/glusterfs/test/zoneinfo/Turkey: No such file or directory > ls: cannot access /mnt/glusterfs/test/zoneinfo/ROC: No such file or directory > ls: cannot access /mnt/glusterfs/test/zoneinfo/Israel: No such file or directory > ls: cannot access /mnt/glusterfs/test/zoneinfo/Eire: No such file or directory > ls: cannot access /mnt/glusterfs/test/zoneinfo/Egypt: No such file or directory > ls: cannot access /mnt/glusterfs/test/zoneinfo/Japan: No such file or directory > ls: cannot access /mnt/glusterfs/test/zoneinfo/Portugal: No such file or directory > ls: cannot access /mnt/glusterfs/test/zoneinfo/Navajo: No such file or directory > ls: cannot access /mnt/glusterfs/test/zoneinfo/W-SU: No such file or directory > ls: cannot access /mnt/glusterfs/test/zoneinfo/ROK: No such file or directory > ls: cannot access /mnt/glusterfs/test/zoneinfo/Iran: No such file or directory > ls: cannot access /mnt/glusterfs/test/zoneinfo/NZ-CHAT: No such file or directory > ls: cannot access /mnt/glusterfs/test/zoneinfo/PRC: No such file or directory > ls: cannot access /mnt/glusterfs/test/zoneinfo/posixrules: No such file or directory > total 228K > drwxr-xr-x 2 root root 4.0K Jun 8 17:04 Africa > drwxr-xr-x 6 root root 4.0K Jun 8 17:04 America > drwxr-xr-x 2 root root 4.0K Sep 6 2006 Antarctica > drwxr-xr-x 2 root root 4.0K Sep 6 2006 Arctic > drwxr-xr-x 2 root root 4.0K Sep 6 2006 Asia > drwxr-xr-x 2 root root 4.0K Jun 8 17:04 Atlantic > drwxr-xr-x 2 root root 4.0K Jun 8 17:04 Australia > drwxr-xr-x 2 root root 4.0K Sep 6 2006 Brazil > -rw-r--r-- 1 root root 2.1K Jun 8 17:04 CET > -rw-r--r-- 1 root root 2.3K Jun 8 17:04 CST6CDT > drwxr-xr-x 2 root root 4.0K Sep 6 2006 Canada > drwxr-xr-x 2 root root 4.0K Sep 6 2006 Chile > -rw-r--r-- 2 root root 2.4K Jun 8 17:04 Cuba > -rw-r--r-- 1 root root 1.9K Jun 8 17:04 EET > -rw-r--r-- 1 root root 118 Jun 8 17:04 EST > -rw-r--r-- 1 root root 2.3K Jun 8 17:04 EST5EDT > -????????? ? ? ? ? ? Egypt > -????????? ? ? ? ? ? Eire > drwxr-xr-x 2 root root 4.0K Sep 6 2006 Etc > drwxr-xr-x 2 root root 4.0K Jun 8 17:04 Europe > -rw-r--r-- 2 root root 255 Jun 8 17:04 Factory > -rw-r--r-- 7 root root 3.6K Jun 8 17:04 GB > -rw-r--r-- 7 root root 3.6K Jun 8 17:04 GB-Eire > -rw-r--r-- 10 root root 118 Jun 8 17:04 GMT > -rw-r--r-- 10 root root 118 Jun 8 17:04 GMT+0 > -rw-r--r-- 10 root root 118 Jun 8 17:04 GMT-0 > -rw-r--r-- 10 root root 118 Jun 8 17:04 GMT0 > -rw-r--r-- 10 root root 118 Jun 8 17:04 Greenwich > -rw-r--r-- 1 root root 119 Jun 8 17:04 HST > -????????? ? ? ? ? ? Hongkong > -rw-r--r-- 2 root root 1.2K Jun 8 17:04 Iceland > drwxr-xr-x 2 root root 4.0K Sep 6 2006 Indian > -????????? ? ? ? ? ? Iran > -????????? ? ? ? ? ? Israel > -rw-r--r-- 2 root root 481 Jun 8 17:04 Jamaica > -????????? ? ? ? ? ? Japan > -rw-r--r-- 2 root root 211 Jun 8 17:04 Kwajalein > -rw-r--r-- 2 root root 599 Jun 8 17:04 Libya > -rw-r--r-- 1 root root 2.1K Jun 8 17:04 MET > -rw-r--r-- 1 root root 118 Jun 8 17:04 MST > -rw-r--r-- 1 root root 2.3K Jun 8 17:04 MST7MDT > drwxr-xr-x 2 root root 4.0K Sep 6 2006 Mexico > drwxr-xr-x 2 root root 4.0K Sep 6 2006 Mideast > -rw-r--r-- 2 root root 2.4K Jun 8 17:04 NZ > -????????? ? ? ? ? ? NZ-CHAT > -????????? ? ? ? ? ? Navajo > -????????? ? ? ? ? ? PRC > -rw-r--r-- 1 root root 2.3K Jun 8 17:04 PST8PDT > drwxr-xr-x 2 root root 4.0K Sep 6 2006 Pacific > -rw-r--r-- 2 root root 2.7K Jun 8 17:04 Poland > -????????? ? ? ? ? ? Portugal > -????????? ? ? ? ? ? ROC > -????????? ? ? ? ? ? ROK > -rw-r--r-- 2 root root 402 Jun 8 17:04 Singapore > -????????? ? ? ? ? ? Turkey > -rw-r--r-- 2 root root 118 Jun 8 17:04 UCT > drwxr-xr-x 2 root root 4.0K Sep 6 2006 US > -rw-r--r-- 6 root root 118 Jun 8 17:04 UTC > -rw-r--r-- 6 root root 118 Jun 8 17:04 Universal > -????????? ? ? ? ? ? W-SU > -rw-r--r-- 1 root root 1.9K Jun 8 17:04 WET > -rw-r--r-- 6 root root 118 Jun 8 17:04 Zulu > -rw-r--r-- 1 root root 4.0K Jun 8 17:04 iso3166.tab > -rw-r--r-- 2 root root 255 Jun 8 17:04 localtime > drwxr-xr-x 19 root root 4.0K Sep 6 2006 posix > -????????? ? ? ? ? ? posixrules > drwxr-xr-x 19 root root 4.0K Sep 6 2006 right > -rw-r--r-- 1 root root 19K Jun 8 17:04 zone.tab > > > After restarting the client: > > ls -lh /mnt/glusterfs/test/zoneinfo/ > total 296K > drwxr-xr-x 2 root root 4.0K Jun 8 17:04 Africa > drwxr-xr-x 6 root root 4.0K Jun 8 17:04 America > drwxr-xr-x 2 root root 4.0K Sep 6 2006 Antarctica > drwxr-xr-x 2 root root 4.0K Sep 6 2006 Arctic > drwxr-xr-x 2 root root 4.0K Sep 6 2006 Asia > drwxr-xr-x 2 root root 4.0K Jun 8 17:04 Atlantic > drwxr-xr-x 2 root root 4.0K Jun 8 17:04 Australia > drwxr-xr-x 2 root root 4.0K Sep 6 2006 Brazil > -rw-r--r-- 1 root root 2.1K Jun 8 17:04 CET > -rw-r--r-- 1 root root 2.3K Jun 8 17:04 CST6CDT > drwxr-xr-x 2 root root 4.0K Sep 6 2006 Canada > drwxr-xr-x 2 root root 4.0K Sep 6 2006 Chile > -rw-r--r-- 2 root root 2.4K Jun 8 17:04 Cuba > -rw-r--r-- 1 root root 1.9K Jun 8 17:04 EET > -rw-r--r-- 1 root root 118 Jun 8 17:04 EST > -rw-r--r-- 1 root root 2.3K Jun 8 17:04 EST5EDT > -rw-r--r-- 2 root root 9.1K Jun 8 17:04 Egypt > -rw-r--r-- 2 root root 3.5K Jun 8 17:04 Eire > drwxr-xr-x 2 root root 4.0K Sep 6 2006 Etc > drwxr-xr-x 2 root root 4.0K Jun 8 17:04 Europe > -rw-r--r-- 2 root root 255 Jun 8 17:04 Factory > -rw-r--r-- 7 root root 3.6K Jun 8 17:04 GB > -rw-r--r-- 7 root root 3.6K Jun 8 17:04 GB-Eire > -rw-r--r-- 10 root root 118 Jun 8 17:04 GMT > -rw-r--r-- 10 root root 118 Jun 8 17:04 GMT+0 > -rw-r--r-- 10 root root 118 Jun 8 17:04 GMT-0 > -rw-r--r-- 10 root root 118 Jun 8 17:04 GMT0 > -rw-r--r-- 10 root root 118 Jun 8 17:04 Greenwich > -rw-r--r-- 1 root root 119 Jun 8 17:04 HST > -rw-r--r-- 2 root root 1.2K Jun 8 17:04 Hongkong > -rw-r--r-- 2 root root 1.2K Jun 8 17:04 Iceland > drwxr-xr-x 2 root root 4.0K Sep 6 2006 Indian > -rw-r--r-- 2 root root 791 Jun 8 17:04 Iran > -rw-r--r-- 3 root root 2.2K Jun 8 17:04 Israel > -rw-r--r-- 2 root root 481 Jun 8 17:04 Jamaica > -rw-r--r-- 2 root root 331 Jun 8 17:04 Japan > -rw-r--r-- 2 root root 211 Jun 8 17:04 Kwajalein > -rw-r--r-- 2 root root 599 Jun 8 17:04 Libya > -rw-r--r-- 1 root root 2.1K Jun 8 17:04 MET > -rw-r--r-- 1 root root 118 Jun 8 17:04 MST > -rw-r--r-- 1 root root 2.3K Jun 8 17:04 MST7MDT > drwxr-xr-x 2 root root 4.0K Sep 6 2006 Mexico > drwxr-xr-x 2 root root 4.0K Sep 6 2006 Mideast > -rw-r--r-- 2 root root 2.4K Jun 8 17:04 NZ > -rw-r--r-- 2 root root 2.0K Jun 8 17:04 NZ-CHAT > -rw-r--r-- 3 root root 2.4K Jun 8 17:04 Navajo > -rw-r--r-- 2 root root 405 Jun 8 17:04 PRC > -rw-r--r-- 1 root root 2.3K Jun 8 17:04 PST8PDT > drwxr-xr-x 2 root root 4.0K Sep 6 2006 Pacific > -rw-r--r-- 2 root root 2.7K Jun 8 17:04 Poland > -rw-r--r-- 2 root root 3.4K Jun 8 17:04 Portugal > -rw-r--r-- 2 root root 724 Jun 8 17:04 ROC > -rw-r--r-- 2 root root 380 Jun 8 17:04 ROK > -rw-r--r-- 2 root root 402 Jun 8 17:04 Singapore > -rw-r--r-- 3 root root 2.7K Jun 8 17:04 Turkey > -rw-r--r-- 2 root root 118 Jun 8 17:04 UCT > drwxr-xr-x 2 root root 4.0K Sep 6 2006 US > -rw-r--r-- 6 root root 118 Jun 8 17:04 UTC > -rw-r--r-- 6 root root 118 Jun 8 17:04 Universal > -rw-r--r-- 2 root root 2.2K Jun 8 17:04 W-SU > -rw-r--r-- 1 root root 1.9K Jun 8 17:04 WET > -rw-r--r-- 6 root root 118 Jun 8 17:04 Zulu > -rw-r--r-- 1 root root 4.0K Jun 8 17:04 iso3166.tab > -rw-r--r-- 2 root root 255 Jun 8 17:04 localtime > drwxr-xr-x 19 root root 4.0K Sep 6 2006 posix > -rw-r--r-- 2 root root 3.5K Jun 8 17:04 posixrules > drwxr-xr-x 19 root root 4.0K Sep 6 2006 right > -rw-r--r-- 1 root root 19K Jun 8 17:04 zone.tab > > Best, > > Harris > > ----- Original Message ----- > From: "Brent A Nelson" <brent@xxxxxxxxxxxx> > To: "Anand Avati" <avati@xxxxxxxxxxxxx> > Cc: gluster-devel@xxxxxxxxxx > Sent: Thursday, July 26, 2007 7:09:16 PM (GMT-0500) America/New_York > Subject: Re: copy glitch, latest TLA > > Strace attached. > > Thanks, > > Brent > > On Fri, 27 Jul 2007, Anand Avati wrote: > >> Brent, August, >> I just committed some fixes related to hardlinks into patch-371. Is it >> possible to get an strace of the ls -l, so that I can confirm if patch-371 >> will fix your issue? >> >> thanks, >> avati >> >> 2007/7/26, August R. Wohlt <glusterfs@xxxxxxxxxxx>: >>> I noticed something very similar this morning with a similar setup. For me >>> it only shows up on hard-linked files that I do not have permissions to >>> view: >>> >>> [goose@test]$ ls -ail /backups/20070726/root/ | head -10 >>> total 0 >>> ??--------- ? ? ? ? ? . >>> ??--------- ? ? ? ? ? .. >>> ??--------- ? ? ? ? ? anaconda-ks.cfg >>> ??--------- ? ? ? ? ? .bash_history >>> ??--------- ? ? ? ? ? .bash_logout >>> ??--------- ? ? ? ? ? .bash_profile >>> ??--------- ? ? ? ? ? .bashrc >>> ??--------- ? ? ? ? ? .config >>> [goose@test]$ sudo ls -ail /backups/20070726/root/ | head -10 >>> total 404 >>> 4213728 drwxr-xr-- 18 root root 4096 Jul 20 09:44 . >>> 4210689 drwxr-xr-x 18 root root 4096 Jul 26 07:20 .. >>> 4213743 -rw-r--r-- 1 root root 1294 Mar 23 2006 anaconda-ks.cfg >>> 4213731 -rw------- 1 root root 2054 Jul 17 20:57 .bash_history >>> 4213732 -rw-r--r-- 1 root root 24 Sep 22 2004 .bash_logout >>> 4213733 -rw-r--r-- 1 root root 191 Sep 22 2004 .bash_profile >>> 4213734 -rw-r--r-- 1 root root 176 Sep 22 2004 .bashrc >>> 7375158 drwxr-xr-x 3 root root 4096 Mar 23 2006 .config >>> >>> :goose >>> >>> On 7/26/07, Brent A Nelson <brent@xxxxxxxxxxxx> wrote: >>>> In copying (cp -a) a local /usr to a GlusterFS (unify, protocol/client, >>>> protocol/server, features/posix-locks, storage/posix), I notice this >>>> glitch: >>>> >>>> ls -lai /beast/usr/share/zoneinfo/posix/America/ >>>> total 484 >>>> 115452 drwxr-xr-x 6 root root 0 2007-06-18 13:33 . >>>> 115278 drwxr-xr-x 20 root root 4096 2007-06-18 13:33 .. >>>> 115443 -rw-r--r-- 3 root root 858 2007-04-23 06:07 Adak >>>> 115435 -rw-r--r-- 3 root root 861 2007-04-23 06:07 Anchorage >>>> 115528 -rw-r--r-- 1 root root 73 2007-04-23 06:07 Anguilla >>>> 115454 -rw-r--r-- 1 root root 90 2007-04-23 06:07 Antigua >>>> 115477 -rw-r--r-- 1 root root 326 2007-04-23 06:07 Araguaina >>>> 115533 drwxr-xr-x 2 root root 4096 2007-06-18 13:33 Argentina >>>> 115470 -rw-r--r-- 1 root root 90 2007-04-23 06:07 Aruba >>>> 115517 -rw-r--r-- 1 root root 729 2007-04-23 06:07 Asuncion >>>> 115472 -rw-r--r-- 2 root root 134 2007-04-23 06:07 Atikokan >>>> 115443 -rw-r--r-- 3 root root 858 2007-04-23 06:07 Atka >>>> 115465 -rw-r--r-- 1 root root 376 2007-04-23 06:07 Bahia >>>> 115526 -rw-r--r-- 1 root root 142 2007-04-23 06:07 Barbados >>>> ? ?--------- ? ? ? ? ? >>>> /beast/usr/share/zoneinfo/posix/America/Edmonton >>>> ? ?--------- ? ? ? ? ? >>>> /beast/usr/share/zoneinfo/posix/America/Halifax >>>> ? ?--------- ? ? ? ? ? >>>> /beast/usr/share/zoneinfo/posix/America/Regina >>>> ? ?--------- ? ? ? ? ? >>>> /beast/usr/share/zoneinfo/posix/America/Rosario >>>> ? ?--------- ? ? ? ? ? >>>> /beast/usr/share/zoneinfo/posix/America/Santiago >>>> ? ?--------- ? ? ? ? ? >>>> /beast/usr/share/zoneinfo/posix/America/St_Johns >>>> ? ?--------- ? ? ? ? ? >>>> /beast/usr/share/zoneinfo/posix/America/Toronto >>>> ? ?--------- ? ? ? ? ? >>>> /beast/usr/share/zoneinfo/posix/America/Vancouver >>>> ? ?--------- ? ? ? ? ? >>>> /beast/usr/share/zoneinfo/posix/America/Whitehorse >>>> ? ?--------- ? ? ? ? ? >>>> /beast/usr/share/zoneinfo/posix/America/Winnipeg >>>> 115482 -rw-r--r-- 1 root root 226 2007-04-23 06:07 Belem >>>> 115521 -rw-r--r-- 1 root root 368 2007-04-23 06:07 Belize >>>> ... (everything normal after that). >>>> >>>> Plenty of other areas in zoneinfo were also affected. Is this a glitch >>> in >>>> hardlinks? >>>> >>>> Thanks, >>>> >>>> Brent >>>> >>>> >>>> _______________________________________________ >>>> Gluster-devel mailing list >>>> Gluster-devel@xxxxxxxxxx >>>> http://lists.nongnu.org/mailman/listinfo/gluster-devel >>>> >>> _______________________________________________ >>> Gluster-devel mailing list >>> Gluster-devel@xxxxxxxxxx >>> http://lists.nongnu.org/mailman/listinfo/gluster-devel >>> >> >> >> -- >> Anand V. Avati >> > > > _______________________________________________ > Gluster-devel mailing list > Gluster-devel@xxxxxxxxxx > http://lists.nongnu.org/mailman/listinfo/gluster-devel
