Hi! These empty files with sticky bit are so called link-files. Their extended attributes contains location of the server, where the real file resides. These link-files are used by distribute translator, when the actual location of a file differs from the location computed using name hash ( see lookup-unhashed option ). This could happen if GlusterFS installed over existing data or when number of servers changed. WBR, Andrey 2009/8/31 Simon Liang <simonl at bigair.net.au>: > Hi, > > > > I have 4 server nodes set up, distributed over 2-replicated-nodes. > > > > volume client1a > > type protocol/client > > option transport-type tcp/client > > option remote-host gs1 > > option remote-port 7001 > > option remote-subvolume brick > > end-volume > > > > volume client2a > > type protocol/client > > option transport-type tcp/client > > option remote-host gs2 > > option remote-port 7001 > > option remote-subvolume brick > > end-volume > > > > volume client1b > > type protocol/client > > option transport-type tcp/client > > option remote-host gs1 > > option remote-port 7002 > > option remote-subvolume brick > > end-volume > > > > volume client2b > > type protocol/client > > option transport-type tcp/client > > option remote-host gs2 > > option remote-port 7002 > > option remote-subvolume brick > > end-volume > > > > volume afr1 > > type cluster/replicate > > subvolumes client1a client2a > > end-volume > > > > volume afr2 > > type cluster/replicate > > subvolumes client1b client2b > > end-volume > > > > volume distribute > > type cluster/distribute > > subvolumes afr1 afr2 > > end-volume > > > > I recently just noticed that there are some files missing, and when I > check the nodes client1a and client1b, or client2a and client2b. > > > > I notice that on one node, the file appears as: > > ---------T 1 root root 0 2009-08-25 16:25 DSC01927.JPG > > ---------T 1 root root 0 2009-08-25 16:26 DSC01929.JPG > > ---------T 1 root root 0 2009-08-25 16:26 DSC01931.JPG > > ---------T 1 root root 0 2009-08-25 16:25 DSC01942.JPG > > ---------T 1 root root 0 2009-08-25 16:25 DSC01944.JPG > > ---------T 1 root root 0 2009-08-25 16:25 DSC01946.JPG > > ---------T 1 root root 0 2009-08-25 16:26 DSC01915.JPG > > ---------T 1 root root 0 2009-08-25 16:26 DSC01905.JPG > > ---------T 1 root root 0 2009-08-25 16:26 DSC01907.JPG > > > > But on the other node is fine. > > > > That is one problem, the other is that since files are distributed > between client(1,2)a and client(1,2)b, why are the files appearing on > both servers? Distribute should only copy files to one node or the > other, not both. > > > > Regards, > > Simon