Thank you Ravi for your answer. I have now set the afr xattr as you suggested and I am running the "find . | xargs -d '\n' stat" on my gluster fuse mount for this volume. This volume has around 3 million of files and directories so it will take a long time to finish I suppose. Do I really need to run this find over the whole volume starting from its root? Note that I added the "-d '\n'" option in xargs in order to deal with filenames which have spaces inside. ‐‐‐‐‐‐‐ Original Message ‐‐‐‐‐‐‐ On Saturday, November 17, 2018 6:04 AM, Ravishankar N <ravishankar@xxxxxxxxxx> wrote: > Okay so for all files and dirs, node 2 seems to be the bad copy. Try the > following: > > 1. On both node 1 and node3, set theafr xattr for dir10: > setfattr -n trusted.afr.myvol-pro-client-1 -v 0x000000000000000100000001 > /data/myvol-private/brick/data/dir1/dir2/dir3/dir4/dir5/dir6/dir7/dir8/dir9/dir10 > > 2. Fuse mount the volume temporarily in some location and from that > mount point, do a `find .|xargs stat >/dev/null` > > > 3. Run`gluster volume heal $volname` > > HTH, > Ravi > > On 11/16/2018 09:07 PM, mabi wrote: > > > And finally here is the output of a getfattr from both files from the 3 nodes: > > FILE 1: /data/dir1/dir2/dir3/dir4/dir5/dir6/dir7/dir8/dir9/dir10/dir11/oc_dir/fileKey > > NODE 1: > > trusted.afr.dirty=0x000000000000000000000000 > > trusted.afr.myvol-pro-client-1=0x000000020000000100000000 > > trusted.gfid=0xaae4098a1a7141559cc9e564b89957cf > > trusted.gfid2path.9a863b050c1975ed=0x32356532363136622d346662362d346232612d383934352d3161666339353666666631392f66696c654b6579 > > NODE 2: > > trusted.afr.dirty=0x000000000000000000000000 > > trusted.gfid=0x48ccb52b788f4361b33fad43157b8ea8 > > trusted.gfid2path.32a8dc56983f7b8f=0x64396163313932632d653835652d343430322d616631302d3535353166353837656439612f66696c654b6579 > > NODE 3: > > trusted.afr.dirty=0x000000000000000000000000 > > trusted.afr.myvol-pro-client-1=0x000000020000000100000000 > > trusted.gfid=0xaae4098a1a7141559cc9e564b89957cf > > trusted.gfid2path.9a863b050c1975ed=0x32356532363136622d346662362d346232612d383934352d3161666339353666666631392f66696c654b6579 > > FILE 2: /data/dir1/dir2/dir3/dir4/dir5/dir6/dir7/dir8/dir9/dir10/dir11/oc_dir/username.shareKey > > NODE 1: > > trusted.afr.dirty=0x000000000000000000000000 > > trusted.afr.myvol-pro-client-1=0x000000020000000100000000 > > trusted.gfid=0x3c92459b8fa146699a3db38b8d41c360 > > trusted.gfid2path.510dd4750ef350f9=0x32356532363136622d346662362d346232612d383934352d3161666339353666666631392f6a6d406d616765726c2e63682e73686172654b6579 > > NODE 2: > > trusted.afr.dirty=0x000000000000000000000000 > > trusted.gfid=0xae880a4f19824bc6a3baabe2e3c62ace > > trusted.gfid2path.0c0f97b97351b4af=0x64396163313932632d653835652d343430322d616631302d3535353166353837656439612f6a6d406d616765726c2e63682e73686172654b6579 > > NODE 3: > > trusted.afr.dirty=0x000000000000000000000000 > > trusted.afr.myvol-pro-client-1=0x000000020000000100000000 > > trusted.gfid=0x3c92459b8fa146699a3db38b8d41c360 > > trusted.gfid2path.510dd4750ef350f9=0x32356532363136622d346662362d346232612d383934352d3161666339353666666631392f6a6d406d616765726c2e63682e73686172654b6579 _______________________________________________ Gluster-users mailing list Gluster-users@xxxxxxxxxxx https://lists.gluster.org/mailman/listinfo/gluster-users