Harris, do you have io-cache in your setup? avati 2007/7/27, Harris Landgarten <harrisl@xxxxxxxxxxxxx>: > > The cp -av behavior I am seeing worked in patch-368. I am also seeing some > other issues. > > 1. my tar test slowed down after 368. 366 is still fast. > 2. running tar -cf immediately after restarting the client results is a > failure: bad descriptor. tar -cvf runs. rerunning tar -cf runs as well. It > is difficult to test this further because slowing it down makes the error go > away. It also does not happen every time. > > Harris > > ----- Original Message ----- > From: "Anand Babu Periasamy" <ab@xxxxxxxxxx> > To: "Harris Landgarten" <harrisl@xxxxxxxxxxxxx> > Cc: "Brent A Nelson" <brent@xxxxxxxxxxxx>, gluster-devel@xxxxxxxxxx > Sent: Thursday, July 26, 2007 7:48:12 PM (GMT-0500) America/New_York > Subject: Re: copy glitch, latest TLA > > You are correct, Brent's strace confirms it. ls gets the file listing > from name space, but stat on it is performed on actual file. It looks > like only name space entries are made, but files were not copied. We are > looking into it. > > -- > Anand Babu > GPG Key ID: 0x62E15A31 > Blog [http://ab.freeshell.org] > The GNU Operating System [http://www.gnu.org] > Z RESEARCH Inc [http://www.zresearch.com] > > > > Harris Landgarten wrote: > > I can verify that something is wrong. > > > > cp -av /usr/share/zoneinfo /mnt/glusterfs/test/ > > > > completed without error. > > > > Then: > > > > ls -lh /mnt/glusterfs/test/zoneinfo/ > > ls: cannot access /mnt/glusterfs/test/zoneinfo/Hongkong: No such file or > directory > > ls: cannot access /mnt/glusterfs/test/zoneinfo/Turkey: No such file or > directory > > ls: cannot access /mnt/glusterfs/test/zoneinfo/ROC: No such file or > directory > > ls: cannot access /mnt/glusterfs/test/zoneinfo/Israel: No such file or > directory > > ls: cannot access /mnt/glusterfs/test/zoneinfo/Eire: No such file or > directory > > ls: cannot access /mnt/glusterfs/test/zoneinfo/Egypt: No such file or > directory > > ls: cannot access /mnt/glusterfs/test/zoneinfo/Japan: No such file or > directory > > ls: cannot access /mnt/glusterfs/test/zoneinfo/Portugal: No such file or > directory > > ls: cannot access /mnt/glusterfs/test/zoneinfo/Navajo: No such file or > directory > > ls: cannot access /mnt/glusterfs/test/zoneinfo/W-SU: No such file or > directory > > ls: cannot access /mnt/glusterfs/test/zoneinfo/ROK: No such file or > directory > > ls: cannot access /mnt/glusterfs/test/zoneinfo/Iran: No such file or > directory > > ls: cannot access /mnt/glusterfs/test/zoneinfo/NZ-CHAT: No such file or > directory > > ls: cannot access /mnt/glusterfs/test/zoneinfo/PRC: No such file or > directory > > ls: cannot access /mnt/glusterfs/test/zoneinfo/posixrules: No such file > or directory > > total 228K > > drwxr-xr-x 2 root root 4.0K Jun 8 17:04 Africa > > drwxr-xr-x 6 root root 4.0K Jun 8 17:04 America > > drwxr-xr-x 2 root root 4.0K Sep 6 2006 Antarctica > > drwxr-xr-x 2 root root 4.0K Sep 6 2006 Arctic > > drwxr-xr-x 2 root root 4.0K Sep 6 2006 Asia > > drwxr-xr-x 2 root root 4.0K Jun 8 17:04 Atlantic > > drwxr-xr-x 2 root root 4.0K Jun 8 17:04 Australia > > drwxr-xr-x 2 root root 4.0K Sep 6 2006 Brazil > > -rw-r--r-- 1 root root 2.1K Jun 8 17:04 CET > > -rw-r--r-- 1 root root 2.3K Jun 8 17:04 CST6CDT > > drwxr-xr-x 2 root root 4.0K Sep 6 2006 Canada > > drwxr-xr-x 2 root root 4.0K Sep 6 2006 Chile > > -rw-r--r-- 2 root root 2.4K Jun 8 17:04 Cuba > > -rw-r--r-- 1 root root 1.9K Jun 8 17:04 EET > > -rw-r--r-- 1 root root 118 Jun 8 17:04 EST > > -rw-r--r-- 1 root root 2.3K Jun 8 17:04 EST5EDT > > -????????? ? ? ? ? ? Egypt > > -????????? ? ? ? ? ? Eire > > drwxr-xr-x 2 root root 4.0K Sep 6 2006 Etc > > drwxr-xr-x 2 root root 4.0K Jun 8 17:04 Europe > > -rw-r--r-- 2 root root 255 Jun 8 17:04 Factory > > -rw-r--r-- 7 root root 3.6K Jun 8 17:04 GB > > -rw-r--r-- 7 root root 3.6K Jun 8 17:04 GB-Eire > > -rw-r--r-- 10 root root 118 Jun 8 17:04 GMT > > -rw-r--r-- 10 root root 118 Jun 8 17:04 GMT+0 > > -rw-r--r-- 10 root root 118 Jun 8 17:04 GMT-0 > > -rw-r--r-- 10 root root 118 Jun 8 17:04 GMT0 > > -rw-r--r-- 10 root root 118 Jun 8 17:04 Greenwich > > -rw-r--r-- 1 root root 119 Jun 8 17:04 HST > > -????????? ? ? ? ? ? Hongkong > > -rw-r--r-- 2 root root 1.2K Jun 8 17:04 Iceland > > drwxr-xr-x 2 root root 4.0K Sep 6 2006 Indian > > -????????? ? ? ? ? ? Iran > > -????????? ? ? ? ? ? Israel > > -rw-r--r-- 2 root root 481 Jun 8 17:04 Jamaica > > -????????? ? ? ? ? ? Japan > > -rw-r--r-- 2 root root 211 Jun 8 17:04 Kwajalein > > -rw-r--r-- 2 root root 599 Jun 8 17:04 Libya > > -rw-r--r-- 1 root root 2.1K Jun 8 17:04 MET > > -rw-r--r-- 1 root root 118 Jun 8 17:04 MST > > -rw-r--r-- 1 root root 2.3K Jun 8 17:04 MST7MDT > > drwxr-xr-x 2 root root 4.0K Sep 6 2006 Mexico > > drwxr-xr-x 2 root root 4.0K Sep 6 2006 Mideast > > -rw-r--r-- 2 root root 2.4K Jun 8 17:04 NZ > > -????????? ? ? ? ? ? NZ-CHAT > > -????????? ? ? ? ? ? Navajo > > -????????? ? ? ? ? ? PRC > > -rw-r--r-- 1 root root 2.3K Jun 8 17:04 PST8PDT > > drwxr-xr-x 2 root root 4.0K Sep 6 2006 Pacific > > -rw-r--r-- 2 root root 2.7K Jun 8 17:04 Poland > > -????????? ? ? ? ? ? Portugal > > -????????? ? ? ? ? ? ROC > > -????????? ? ? ? ? ? ROK > > -rw-r--r-- 2 root root 402 Jun 8 17:04 Singapore > > -????????? ? ? ? ? ? Turkey > > -rw-r--r-- 2 root root 118 Jun 8 17:04 UCT > > drwxr-xr-x 2 root root 4.0K Sep 6 2006 US > > -rw-r--r-- 6 root root 118 Jun 8 17:04 UTC > > -rw-r--r-- 6 root root 118 Jun 8 17:04 Universal > > -????????? ? ? ? ? ? W-SU > > -rw-r--r-- 1 root root 1.9K Jun 8 17:04 WET > > -rw-r--r-- 6 root root 118 Jun 8 17:04 Zulu > > -rw-r--r-- 1 root root 4.0K Jun 8 17:04 iso3166.tab > > -rw-r--r-- 2 root root 255 Jun 8 17:04 localtime > > drwxr-xr-x 19 root root 4.0K Sep 6 2006 posix > > -????????? ? ? ? ? ? posixrules > > drwxr-xr-x 19 root root 4.0K Sep 6 2006 right > > -rw-r--r-- 1 root root 19K Jun 8 17:04 zone.tab > > > > > > After restarting the client: > > > > ls -lh /mnt/glusterfs/test/zoneinfo/ > > total 296K > > drwxr-xr-x 2 root root 4.0K Jun 8 17:04 Africa > > drwxr-xr-x 6 root root 4.0K Jun 8 17:04 America > > drwxr-xr-x 2 root root 4.0K Sep 6 2006 Antarctica > > drwxr-xr-x 2 root root 4.0K Sep 6 2006 Arctic > > drwxr-xr-x 2 root root 4.0K Sep 6 2006 Asia > > drwxr-xr-x 2 root root 4.0K Jun 8 17:04 Atlantic > > drwxr-xr-x 2 root root 4.0K Jun 8 17:04 Australia > > drwxr-xr-x 2 root root 4.0K Sep 6 2006 Brazil > > -rw-r--r-- 1 root root 2.1K Jun 8 17:04 CET > > -rw-r--r-- 1 root root 2.3K Jun 8 17:04 CST6CDT > > drwxr-xr-x 2 root root 4.0K Sep 6 2006 Canada > > drwxr-xr-x 2 root root 4.0K Sep 6 2006 Chile > > -rw-r--r-- 2 root root 2.4K Jun 8 17:04 Cuba > > -rw-r--r-- 1 root root 1.9K Jun 8 17:04 EET > > -rw-r--r-- 1 root root 118 Jun 8 17:04 EST > > -rw-r--r-- 1 root root 2.3K Jun 8 17:04 EST5EDT > > -rw-r--r-- 2 root root 9.1K Jun 8 17:04 Egypt > > -rw-r--r-- 2 root root 3.5K Jun 8 17:04 Eire > > drwxr-xr-x 2 root root 4.0K Sep 6 2006 Etc > > drwxr-xr-x 2 root root 4.0K Jun 8 17:04 Europe > > -rw-r--r-- 2 root root 255 Jun 8 17:04 Factory > > -rw-r--r-- 7 root root 3.6K Jun 8 17:04 GB > > -rw-r--r-- 7 root root 3.6K Jun 8 17:04 GB-Eire > > -rw-r--r-- 10 root root 118 Jun 8 17:04 GMT > > -rw-r--r-- 10 root root 118 Jun 8 17:04 GMT+0 > > -rw-r--r-- 10 root root 118 Jun 8 17:04 GMT-0 > > -rw-r--r-- 10 root root 118 Jun 8 17:04 GMT0 > > -rw-r--r-- 10 root root 118 Jun 8 17:04 Greenwich > > -rw-r--r-- 1 root root 119 Jun 8 17:04 HST > > -rw-r--r-- 2 root root 1.2K Jun 8 17:04 Hongkong > > -rw-r--r-- 2 root root 1.2K Jun 8 17:04 Iceland > > drwxr-xr-x 2 root root 4.0K Sep 6 2006 Indian > > -rw-r--r-- 2 root root 791 Jun 8 17:04 Iran > > -rw-r--r-- 3 root root 2.2K Jun 8 17:04 Israel > > -rw-r--r-- 2 root root 481 Jun 8 17:04 Jamaica > > -rw-r--r-- 2 root root 331 Jun 8 17:04 Japan > > -rw-r--r-- 2 root root 211 Jun 8 17:04 Kwajalein > > -rw-r--r-- 2 root root 599 Jun 8 17:04 Libya > > -rw-r--r-- 1 root root 2.1K Jun 8 17:04 MET > > -rw-r--r-- 1 root root 118 Jun 8 17:04 MST > > -rw-r--r-- 1 root root 2.3K Jun 8 17:04 MST7MDT > > drwxr-xr-x 2 root root 4.0K Sep 6 2006 Mexico > > drwxr-xr-x 2 root root 4.0K Sep 6 2006 Mideast > > -rw-r--r-- 2 root root 2.4K Jun 8 17:04 NZ > > -rw-r--r-- 2 root root 2.0K Jun 8 17:04 NZ-CHAT > > -rw-r--r-- 3 root root 2.4K Jun 8 17:04 Navajo > > -rw-r--r-- 2 root root 405 Jun 8 17:04 PRC > > -rw-r--r-- 1 root root 2.3K Jun 8 17:04 PST8PDT > > drwxr-xr-x 2 root root 4.0K Sep 6 2006 Pacific > > -rw-r--r-- 2 root root 2.7K Jun 8 17:04 Poland > > -rw-r--r-- 2 root root 3.4K Jun 8 17:04 Portugal > > -rw-r--r-- 2 root root 724 Jun 8 17:04 ROC > > -rw-r--r-- 2 root root 380 Jun 8 17:04 ROK > > -rw-r--r-- 2 root root 402 Jun 8 17:04 Singapore > > -rw-r--r-- 3 root root 2.7K Jun 8 17:04 Turkey > > -rw-r--r-- 2 root root 118 Jun 8 17:04 UCT > > drwxr-xr-x 2 root root 4.0K Sep 6 2006 US > > -rw-r--r-- 6 root root 118 Jun 8 17:04 UTC > > -rw-r--r-- 6 root root 118 Jun 8 17:04 Universal > > -rw-r--r-- 2 root root 2.2K Jun 8 17:04 W-SU > > -rw-r--r-- 1 root root 1.9K Jun 8 17:04 WET > > -rw-r--r-- 6 root root 118 Jun 8 17:04 Zulu > > -rw-r--r-- 1 root root 4.0K Jun 8 17:04 iso3166.tab > > -rw-r--r-- 2 root root 255 Jun 8 17:04 localtime > > drwxr-xr-x 19 root root 4.0K Sep 6 2006 posix > > -rw-r--r-- 2 root root 3.5K Jun 8 17:04 posixrules > > drwxr-xr-x 19 root root 4.0K Sep 6 2006 right > > -rw-r--r-- 1 root root 19K Jun 8 17:04 zone.tab > > > > Best, > > > > Harris > > > > ----- Original Message ----- > > From: "Brent A Nelson" <brent@xxxxxxxxxxxx> > > To: "Anand Avati" <avati@xxxxxxxxxxxxx> > > Cc: gluster-devel@xxxxxxxxxx > > Sent: Thursday, July 26, 2007 7:09:16 PM (GMT-0500) America/New_York > > Subject: Re: copy glitch, latest TLA > > > > Strace attached. > > > > Thanks, > > > > Brent > > > > On Fri, 27 Jul 2007, Anand Avati wrote: > > > >> Brent, August, > >> I just committed some fixes related to hardlinks into patch-371. Is it > >> possible to get an strace of the ls -l, so that I can confirm if > patch-371 > >> will fix your issue? > >> > >> thanks, > >> avati > >> > >> 2007/7/26, August R. Wohlt <glusterfs@xxxxxxxxxxx>: > >>> I noticed something very similar this morning with a similar setup. > For me > >>> it only shows up on hard-linked files that I do not have permissions > to > >>> view: > >>> > >>> [goose@test]$ ls -ail /backups/20070726/root/ | head -10 > >>> total 0 > >>> ??--------- ? ? ? ? ? . > >>> ??--------- ? ? ? ? ? .. > >>> ??--------- ? ? ? ? ? anaconda-ks.cfg > >>> ??--------- ? ? ? ? ? .bash_history > >>> ??--------- ? ? ? ? ? .bash_logout > >>> ??--------- ? ? ? ? ? .bash_profile > >>> ??--------- ? ? ? ? ? .bashrc > >>> ??--------- ? ? ? ? ? .config > >>> [goose@test]$ sudo ls -ail /backups/20070726/root/ | head -10 > >>> total 404 > >>> 4213728 drwxr-xr-- 18 root root 4096 Jul 20 09:44 . > >>> 4210689 drwxr-xr-x 18 root root 4096 Jul 26 07:20 .. > >>> 4213743 -rw-r--r-- 1 root root 1294 Mar 23 2006 anaconda-ks.cfg > >>> 4213731 -rw------- 1 root root 2054 Jul 17 20:57 .bash_history > >>> 4213732 -rw-r--r-- 1 root root 24 Sep 22 2004 .bash_logout > >>> 4213733 -rw-r--r-- 1 root root 191 Sep 22 2004 .bash_profile > >>> 4213734 -rw-r--r-- 1 root root 176 Sep 22 2004 .bashrc > >>> 7375158 drwxr-xr-x 3 root root 4096 Mar 23 2006 .config > >>> > >>> :goose > >>> > >>> On 7/26/07, Brent A Nelson <brent@xxxxxxxxxxxx> wrote: > >>>> In copying (cp -a) a local /usr to a GlusterFS (unify, > protocol/client, > >>>> protocol/server, features/posix-locks, storage/posix), I notice this > >>>> glitch: > >>>> > >>>> ls -lai /beast/usr/share/zoneinfo/posix/America/ > >>>> total 484 > >>>> 115452 drwxr-xr-x 6 root root 0 2007-06-18 13:33 . > >>>> 115278 drwxr-xr-x 20 root root 4096 2007-06-18 13:33 .. > >>>> 115443 -rw-r--r-- 3 root root 858 2007-04-23 06:07 Adak > >>>> 115435 -rw-r--r-- 3 root root 861 2007-04-23 06:07 Anchorage > >>>> 115528 -rw-r--r-- 1 root root 73 2007-04-23 06:07 Anguilla > >>>> 115454 -rw-r--r-- 1 root root 90 2007-04-23 06:07 Antigua > >>>> 115477 -rw-r--r-- 1 root root 326 2007-04-23 06:07 Araguaina > >>>> 115533 drwxr-xr-x 2 root root 4096 2007-06-18 13:33 Argentina > >>>> 115470 -rw-r--r-- 1 root root 90 2007-04-23 06:07 Aruba > >>>> 115517 -rw-r--r-- 1 root root 729 2007-04-23 06:07 Asuncion > >>>> 115472 -rw-r--r-- 2 root root 134 2007-04-23 06:07 Atikokan > >>>> 115443 -rw-r--r-- 3 root root 858 2007-04-23 06:07 Atka > >>>> 115465 -rw-r--r-- 1 root root 376 2007-04-23 06:07 Bahia > >>>> 115526 -rw-r--r-- 1 root root 142 2007-04-23 06:07 Barbados > >>>> ? ?--------- ? ? ? ? ? > >>>> /beast/usr/share/zoneinfo/posix/America/Edmonton > >>>> ? ?--------- ? ? ? ? ? > >>>> /beast/usr/share/zoneinfo/posix/America/Halifax > >>>> ? ?--------- ? ? ? ? ? > >>>> /beast/usr/share/zoneinfo/posix/America/Regina > >>>> ? ?--------- ? ? ? ? ? > >>>> /beast/usr/share/zoneinfo/posix/America/Rosario > >>>> ? ?--------- ? ? ? ? ? > >>>> /beast/usr/share/zoneinfo/posix/America/Santiago > >>>> ? ?--------- ? ? ? ? ? > >>>> /beast/usr/share/zoneinfo/posix/America/St_Johns > >>>> ? ?--------- ? ? ? ? ? > >>>> /beast/usr/share/zoneinfo/posix/America/Toronto > >>>> ? ?--------- ? ? ? ? ? > >>>> /beast/usr/share/zoneinfo/posix/America/Vancouver > >>>> ? ?--------- ? ? ? ? ? > >>>> /beast/usr/share/zoneinfo/posix/America/Whitehorse > >>>> ? ?--------- ? ? ? ? ? > >>>> /beast/usr/share/zoneinfo/posix/America/Winnipeg > >>>> 115482 -rw-r--r-- 1 root root 226 2007-04-23 06:07 Belem > >>>> 115521 -rw-r--r-- 1 root root 368 2007-04-23 06:07 Belize > >>>> ... (everything normal after that). > >>>> > >>>> Plenty of other areas in zoneinfo were also affected. Is this a > glitch > >>> in > >>>> hardlinks? > >>>> > >>>> Thanks, > >>>> > >>>> Brent > >>>> > >>>> > >>>> _______________________________________________ > >>>> Gluster-devel mailing list > >>>> Gluster-devel@xxxxxxxxxx > >>>> http://lists.nongnu.org/mailman/listinfo/gluster-devel > >>>> > >>> _______________________________________________ > >>> Gluster-devel mailing list > >>> Gluster-devel@xxxxxxxxxx > >>> http://lists.nongnu.org/mailman/listinfo/gluster-devel > >>> > >> > >> > >> -- > >> Anand V. Avati > >> > > > > > > _______________________________________________ > > Gluster-devel mailing list > > Gluster-devel@xxxxxxxxxx > > http://lists.nongnu.org/mailman/listinfo/gluster-devel > > > > _______________________________________________ > Gluster-devel mailing list > Gluster-devel@xxxxxxxxxx > http://lists.nongnu.org/mailman/listinfo/gluster-devel > -- Anand V. Avati
