the attributes seem to match: 0 root at pserver5:~ # getfattr -R -d -e hex -m "trusted.afr." /mnt/gluster/brick1/storage/images/2078/ebb83b05-3a83-9d18-ad8f-8542864da= 6ef /hdd-images/ # file: mnt/gluster/brick1/storage/images/2078/ebb83b05-3a83-9d18-ad8f-8542864da6= ef/ hdd-images//20964 trusted.afr.storage0-client-2=3D0x000000000000000000000000 trusted.afr.storage0-client-3=3D0x000000000000000000000000 0 root at pserver5:~ # find /mnt/gluster/ -name 20964 | xargs -i ls -al {} -rwxrwx--- 1 libvirt-qemu vcb 21474836480 May 13 11:21 /mnt/gluster/brick1/storage/images/2078/ebb83b05-3a83-9d18-ad8f-8542864da= 6ef /hdd-images/20964 But the client view shows 2!! files with 0 byte size!! And these aren't = any link files created by Gluster=85 ( with the T on the end) 0 root at pserver5:~ # find /opt/profitbricks/storage/ -name 20964 | xargs -i ls -al {} -rwxrwx--- 1 libvirt-qemu kvm 0 May 13 11:24 /opt/profitbricks/storage/images/2078/ebb83b05-3a83-9d18-ad8f-8542864da6e= f/h dd-images/20964 -rwxrwx--- 1 libvirt-qemu kvm 0 May 13 11:24 /opt/profitbricks/storage/images/2078/ebb83b05-3a83-9d18-ad8f-8542864da6e= f/h dd-images/20964 I'm a bit stumped that we seem to have so many weird errors cropping up. = Any ideas? I've checked the ext4 filesystem on all boxes, no real problems. = We run a distributed cluster with 4 servers offering 2 bricks each. Best, Martin > -----Original Message----- > From: Mohit Anchlia [mailto:mohitanchlia at gmail.com]=20 > Sent: Monday, May 16, 2011 2:24 AM > To: Martin Schenker > Cc: gluster-users at gluster.org > Subject: Re: Brick pair file mismatch,=20 > self-heal problems? >=20 >=20 > Try this to trigger self heal: >=20 > find <gluster-mount> -noleaf -print0 -name <file name>| xargs=20 > --null stat >/dev/null >=20 >=20 >=20 > On Sun, May 15, 2011 at 11:20 AM, Martin Schenker=20 > <martin.schenker at profitbricks.com> wrote: > > Can someone enlighten me what's going on here? We have a two peers,=20 > > the file 21313 is shown through the client mountpoint as=20 > "1Jan1970",=20 > > attribs on server pserver3 don't match but NO self-heal or=20 > repair can=20 > > be triggered through "ls -alR"?!? > > > > Checking the files through the server mounts show that two versions=20 > > are on the system. But the wrong one (as with the=20 > "1Jan1970") seems to=20 > > be the preferred one by the client?!? > > > > Do I need to use setattr or what in order to get the client=20 > to see the=20 > > RIGHT version?!? This is not the ONLY file displaying this=20 > problematic=20 > > behaviour! > > > > Thanks for any feedback. > > > > Martin > > > > pserver5: > > > > 0 root at pserver5:~ # ls -al=20 > >=20 > /mnt/gluster/brick1/storage/images/2078/ebb83b05-3a83-9d18-ad8f-854286 > > 4da6ef > > /hdd-images > > > > -rwxrwx--- 1 libvirt-qemu vcb 483183820800 May 13 13:41 21313 > > > > 0 root at pserver5:~ # getfattr -R -d -e hex -m "trusted.afr."=20 > >=20 > /mnt/gluster/brick1/storage/images/2078/ebb83b05-3a83-9d18-ad8f-854286 > > 4da6ef > > /hdd-images/21313 > > getfattr: Removing leading '/' from absolute path names > > # file: > >=20 > mnt/gluster/brick1/storage/images/2078/ebb83b05-3a83-9d18-ad8f > -8542864da6ef/ > > hdd-images/21313 > > trusted.afr.storage0-client-2=3D0x000000000000000000000000 > > trusted.afr.storage0-client-3=3D0x000000000000000000000000 > > > > 0 root at pserver5:~ # ls -alR=20 > >=20 > /opt/profitbricks/storage/images/2078/ebb83b05-3a83-9d18-ad8f-8542864d > > a6ef/h > > dd-images/21313 > > -rwxrwx--- 1 libvirt-qemu kvm 483183820800 Jan 1 1970 > >=20 > /opt/profitbricks/storage/images/2078/ebb83b05-3a83-9d18-ad8f- > 8542864da6ef/h > > dd-images/21313 > > > > pserver3: > > > > 0 root at pserver3:~ # ls -al=20 > >=20 > /mnt/gluster/brick1/storage/images/2078/ebb83b05-3a83-9d18-ad8f-854286 > > 4da6ef > > /hdd-images > > > > -rwxrwx--- 1 libvirt-qemu kvm 483183820800 Jan 1 1970 21313 > > > > 0 root at pserver3:~ # ls -alR=20 > >=20 > /opt/profitbricks/storage/images/2078/ebb83b05-3a83-9d18-ad8f-8542864d > > a6ef/h > > dd-images/21313 > > -rwxrwx--- 1 libvirt-qemu kvm 483183820800 Jan 1 1970 > >=20 > /opt/profitbricks/storage/images/2078/ebb83b05-3a83-9d18-ad8f- > 8542864da6ef/h > > dd-images/21313 > > > > 0 root at pserver3:~ # getfattr -R -d -e hex -m "trusted.afr." > > /mnt/gluster/brick1/storage/images/2078/ebb83b05-3a83-9d18- > > ad8f-8542864da6ef/hdd-images/21313 > > getfattr: Removing leading '/' from absolute path names > > # file:=20 > >=20 > mnt/gluster/brick1/storage/images/2078/ebb83b05-3a83-9d18-ad8f-8542864 > > da6ef/ > > hdd-images/21313 > > trusted.afr.storage0-client-2=3D0x000000000000000000000000 > > trusted.afr.storage0-client-3=3D0x0b0000090900000000000000 =20 > <- mismatch, > > should be targeted for self-heal/repair? Why is there a=20 > difference in the > > views? > > > > > > From the volfile: > > > > volume storage0-client-2 > > type protocol/client > > option remote-host de-dc1-c1-pserver3 > > option remote-subvolume /mnt/gluster/brick1/storage > > option transport-type rdma > > option ping-timeout 5 > > end-volume > > > > volume storage0-client-3 > > type protocol/client > > option remote-host de-dc1-c1-pserver5 > > option remote-subvolume /mnt/gluster/brick1/storage > > option transport-type rdma > > option ping-timeout 5 > > end-volume > > > > > > > > _______________________________________________ > > Gluster-users mailing list > > Gluster-users at gluster.org=20 > > http://gluster.org/cgi-bin/mailman/listinfo/gluster-users > > >=20 ------=_NextPart_000_0221_01CC13BB.20FB3D50 Content-Type: text/html; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable <!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 3.2//EN"> <HTML> <HEAD> <META HTTP-EQUIV=3D"Content-Type" CONTENT=3D"text/html; = charset=3Diso-8859-1"> <META NAME=3D"Generator" CONTENT=3D"MS Exchange Server version = 6.0.4630.0"> <TITLE>Client and server file "view", different results?! = Client can't see the right file.</TITLE> </HEAD> <BODY> <!-- Converted from text/rtf format --> <P><SPAN LANG=3D"en-gb"><FONT SIZE=3D2 FACE=3D"Arial">Hi = all!</FONT></SPAN> </P> <P><SPAN LANG=3D"en-gb"><FONT SIZE=3D2 FACE=3D"Arial">Here we have = another mismatch between the client "view" and the server = mounts:</FONT></SPAN> </P> <P><SPAN LANG=3D"en-gb"><FONT SIZE=3D2 FACE=3D"Arial">From the server = site everything seems well, the 20G file is visible and the attributes = seem to match:</FONT></SPAN> </P> <P><SPAN LANG=3D"en-gb"> <FONT = SIZE=3D2 FACE=3D"Arial">0 root at pserver5:~ # getfattr -R -d -e hex -m = "trusted.afr." = /mnt/gluster/brick1/storage/images/2078/ebb83b05-3a83-9d18-ad8f-8542864da= 6ef/hdd-images/</FONT></SPAN></P> <P><SPAN LANG=3D"en-gb"> <FONT = SIZE=3D2 FACE=3D"Arial"># file: = mnt/gluster/brick1/storage/images/2078/ebb83b05-3a83-9d18-ad8f-8542864da6= ef/hdd-images//20964</FONT></SPAN> <BR><SPAN LANG=3D"en-gb"> = <FONT SIZE=3D2 = FACE=3D"Arial">trusted.afr.storage0-client-2=3D0x000000000000000000000000= </FONT></SPAN> <BR><SPAN LANG=3D"en-gb"> = <FONT SIZE=3D2 = FACE=3D"Arial">trusted.afr.storage0-client-3=3D0x000000000000000000000000= </FONT></SPAN> </P> <P><SPAN LANG=3D"en-gb"> <FONT = SIZE=3D2 FACE=3D"Arial">0 root at pserver5:~ # find /mnt/gluster/ -name = 20964 | xargs -i ls -al {}</FONT></SPAN> <BR><SPAN LANG=3D"en-gb"> = <FONT SIZE=3D2 FACE=3D"Arial">-rwxrwx--- 1 libvirt-qemu vcb 21474836480 = May 13 11:21 = /mnt/gluster/brick1/storage/images/2078/ebb83b05-3a83-9d18-ad8f-8542864da= 6ef/hdd-images/20964</FONT></SPAN></P> <P><SPAN LANG=3D"en-gb"><FONT SIZE=3D2 FACE=3D"Arial">But the client = view shows 2!! files with 0 byte size!! And these aren't any link files = created by Gluster… ( with the T on the end)</FONT></SPAN></P> <P><SPAN LANG=3D"en-gb"> <FONT = SIZE=3D2 FACE=3D"Arial">0 root at pserver5:~ # find = /opt/profitbricks/storage/ -name 20964 | xargs -i ls -al = {}</FONT></SPAN> <BR><SPAN LANG=3D"en-gb"> = <FONT SIZE=3D2 FACE=3D"Arial">-rwxrwx--- 1 libvirt-qemu kvm 0 May 13 = 11:24 = /opt/profitbricks/storage/images/2078/ebb83b05-3a83-9d18-ad8f-8542864da6e= f/hdd-images/20964</FONT></SPAN></P> <P><SPAN LANG=3D"en-gb"> <FONT = SIZE=3D2 FACE=3D"Arial">-rwxrwx--- 1 libvirt-qemu kvm 0 May 13 11:24 = /opt/profitbricks/storage/images/2078/ebb83b05-3a83-9d18-ad8f-8542864da6e= f/hdd-images/20964</FONT></SPAN></P> <P><SPAN LANG=3D"en-gb"><FONT SIZE=3D2 FACE=3D"Arial">I'm a bit stumped = that we seem to have so many weird errors cropping up. Any ideas? I've = checked the ext4 filesystem on all boxes, no real problems. We run a = distributed cluster with 4 servers offering 2 bricks = each.</FONT></SPAN></P> <P><SPAN LANG=3D"en-gb"><FONT SIZE=3D2 FACE=3D"Arial">Best, = Martin</FONT></SPAN> </P> <BR> <BR> <BR> <P><SPAN LANG=3D"en-gb"><FONT SIZE=3D2 FACE=3D"Arial">> -----Original = Message-----</FONT></SPAN> <BR><SPAN LANG=3D"en-gb"><FONT SIZE=3D2 FACE=3D"Arial">> From: Mohit = Anchlia [</FONT></SPAN><A HREF=3D"mailto:mohitanchlia at gmail.com"><SPAN = LANG=3D"en-gb"><U><FONT COLOR=3D"#0000FF" SIZE=3D2 = FACE=3D"Arial">mailto:mohitanchlia at gmail.com</FONT></U></SPAN></A><SPAN = LANG=3D"en-gb"><FONT SIZE=3D2 FACE=3D"Arial">] </FONT></SPAN> <BR><SPAN LANG=3D"en-gb"><FONT SIZE=3D2 FACE=3D"Arial">> Sent: = Monday, May 16, 2011 2:24 AM</FONT></SPAN> <BR><SPAN LANG=3D"en-gb"><FONT SIZE=3D2 FACE=3D"Arial">> To: Martin = Schenker</FONT></SPAN> <BR><SPAN LANG=3D"en-gb"><FONT SIZE=3D2 FACE=3D"Arial">> Cc: = gluster-users at gluster.org</FONT></SPAN> <BR><SPAN LANG=3D"en-gb"><FONT SIZE=3D2 FACE=3D"Arial">> Subject: Re: = Brick pair file mismatch, </FONT></SPAN> <BR><SPAN LANG=3D"en-gb"><FONT SIZE=3D2 FACE=3D"Arial">> self-heal = problems?</FONT></SPAN> <BR><SPAN LANG=3D"en-gb"><FONT SIZE=3D2 FACE=3D"Arial">> = </FONT></SPAN> <BR><SPAN LANG=3D"en-gb"><FONT SIZE=3D2 FACE=3D"Arial">> = </FONT></SPAN> <BR><SPAN LANG=3D"en-gb"><FONT SIZE=3D2 FACE=3D"Arial">> Try this to = trigger self heal:</FONT></SPAN> <BR><SPAN LANG=3D"en-gb"><FONT SIZE=3D2 FACE=3D"Arial">> = </FONT></SPAN> <BR><SPAN LANG=3D"en-gb"><FONT SIZE=3D2 FACE=3D"Arial">> find = <gluster-mount> -noleaf -print0 -name <file name>| xargs = </FONT></SPAN> <BR><SPAN LANG=3D"en-gb"><FONT SIZE=3D2 FACE=3D"Arial">> --null stat = >/dev/null</FONT></SPAN> <BR><SPAN LANG=3D"en-gb"><FONT SIZE=3D2 FACE=3D"Arial">> = </FONT></SPAN> <BR><SPAN LANG=3D"en-gb"><FONT SIZE=3D2 FACE=3D"Arial">> = </FONT></SPAN> <BR><SPAN LANG=3D"en-gb"><FONT SIZE=3D2 FACE=3D"Arial">> = </FONT></SPAN> <BR><SPAN LANG=3D"en-gb"><FONT SIZE=3D2 FACE=3D"Arial">> On Sun, May = 15, 2011 at 11:20 AM, Martin Schenker </FONT></SPAN> <BR><SPAN LANG=3D"en-gb"><FONT SIZE=3D2 FACE=3D"Arial">> = <martin.schenker at profitbricks.com> wrote:</FONT></SPAN> <BR><SPAN LANG=3D"en-gb"><FONT SIZE=3D2 FACE=3D"Arial">> > Can = someone enlighten me what's going on here? We have a two peers, = </FONT></SPAN> <BR><SPAN LANG=3D"en-gb"><FONT SIZE=3D2 FACE=3D"Arial">> > the = file 21313 is shown through the client mountpoint as </FONT></SPAN> <BR><SPAN LANG=3D"en-gb"><FONT SIZE=3D2 FACE=3D"Arial">> = "1Jan1970", </FONT></SPAN> <BR><SPAN LANG=3D"en-gb"><FONT SIZE=3D2 FACE=3D"Arial">> > attribs = on server pserver3 don't match but NO self-heal or </FONT></SPAN> <BR><SPAN LANG=3D"en-gb"><FONT SIZE=3D2 FACE=3D"Arial">> repair can = </FONT></SPAN> <BR><SPAN LANG=3D"en-gb"><FONT SIZE=3D2 FACE=3D"Arial">> > be = triggered through "ls -alR"?!?</FONT></SPAN> <BR><SPAN LANG=3D"en-gb"><FONT SIZE=3D2 FACE=3D"Arial">> = ></FONT></SPAN> <BR><SPAN LANG=3D"en-gb"><FONT SIZE=3D2 FACE=3D"Arial">> > = Checking the files through the server mounts show that two versions = </FONT></SPAN> <BR><SPAN LANG=3D"en-gb"><FONT SIZE=3D2 FACE=3D"Arial">> > are on = the system. But the wrong one (as with the </FONT></SPAN> <BR><SPAN LANG=3D"en-gb"><FONT SIZE=3D2 FACE=3D"Arial">> = "1Jan1970") seems to </FONT></SPAN> <BR><SPAN LANG=3D"en-gb"><FONT SIZE=3D2 FACE=3D"Arial">> > be the = preferred one by the client?!?</FONT></SPAN> <BR><SPAN LANG=3D"en-gb"><FONT SIZE=3D2 FACE=3D"Arial">> = ></FONT></SPAN> <BR><SPAN LANG=3D"en-gb"><FONT SIZE=3D2 FACE=3D"Arial">> > Do I = need to use setattr or what in order to get the client </FONT></SPAN> <BR><SPAN LANG=3D"en-gb"><FONT SIZE=3D2 FACE=3D"Arial">> to see the = </FONT></SPAN> <BR><SPAN LANG=3D"en-gb"><FONT SIZE=3D2 FACE=3D"Arial">> > RIGHT = version?!? This is not the ONLY file displaying this </FONT></SPAN> <BR><SPAN LANG=3D"en-gb"><FONT SIZE=3D2 FACE=3D"Arial">> problematic = </FONT></SPAN> <BR><SPAN LANG=3D"en-gb"><FONT SIZE=3D2 FACE=3D"Arial">> > = behaviour!</FONT></SPAN> <BR><SPAN LANG=3D"en-gb"><FONT SIZE=3D2 FACE=3D"Arial">> = ></FONT></SPAN> <BR><SPAN LANG=3D"en-gb"><FONT SIZE=3D2 FACE=3D"Arial">> > Thanks = for any feedback.</FONT></SPAN> <BR><SPAN LANG=3D"en-gb"><FONT SIZE=3D2 FACE=3D"Arial">> = ></FONT></SPAN> <BR><SPAN LANG=3D"en-gb"><FONT SIZE=3D2 FACE=3D"Arial">> > = Martin</FONT></SPAN> <BR><SPAN LANG=3D"en-gb"><FONT SIZE=3D2 FACE=3D"Arial">> = ></FONT></SPAN> <BR><SPAN LANG=3D"en-gb"><FONT SIZE=3D2 FACE=3D"Arial">> > = pserver5:</FONT></SPAN> <BR><SPAN LANG=3D"en-gb"><FONT SIZE=3D2 FACE=3D"Arial">> = ></FONT></SPAN> <BR><SPAN LANG=3D"en-gb"><FONT SIZE=3D2 FACE=3D"Arial">> > 0 = root at pserver5:~ # ls -al </FONT></SPAN> <BR><SPAN LANG=3D"en-gb"><FONT SIZE=3D2 FACE=3D"Arial">> > = </FONT></SPAN> <BR><SPAN LANG=3D"en-gb"><FONT SIZE=3D2 FACE=3D"Arial">> = /mnt/gluster/brick1/storage/images/2078/ebb83b05-3a83-9d18-ad8f-854286</F= ONT></SPAN> <BR><SPAN LANG=3D"en-gb"><FONT SIZE=3D2 FACE=3D"Arial">> > = 4da6ef</FONT></SPAN> <BR><SPAN LANG=3D"en-gb"><FONT SIZE=3D2 FACE=3D"Arial">> > = /hdd-images</FONT></SPAN> <BR><SPAN LANG=3D"en-gb"><FONT SIZE=3D2 FACE=3D"Arial">> = ></FONT></SPAN> <BR><SPAN LANG=3D"en-gb"><FONT SIZE=3D2 FACE=3D"Arial">> > = -rwxrwx--- 1 libvirt-qemu vcb =A0483183820800 May 13 13:41 = 21313</FONT></SPAN> <BR><SPAN LANG=3D"en-gb"><FONT SIZE=3D2 FACE=3D"Arial">> = ></FONT></SPAN> <BR><SPAN LANG=3D"en-gb"><FONT SIZE=3D2 FACE=3D"Arial">> > 0 = root at pserver5:~ # getfattr -R -d -e hex -m "trusted.afr." = </FONT></SPAN> <BR><SPAN LANG=3D"en-gb"><FONT SIZE=3D2 FACE=3D"Arial">> > = </FONT></SPAN> <BR><SPAN LANG=3D"en-gb"><FONT SIZE=3D2 FACE=3D"Arial">> = /mnt/gluster/brick1/storage/images/2078/ebb83b05-3a83-9d18-ad8f-854286</F= ONT></SPAN> <BR><SPAN LANG=3D"en-gb"><FONT SIZE=3D2 FACE=3D"Arial">> > = 4da6ef</FONT></SPAN> <BR><SPAN LANG=3D"en-gb"><FONT SIZE=3D2 FACE=3D"Arial">> > = /hdd-images/21313</FONT></SPAN> <BR><SPAN LANG=3D"en-gb"><FONT SIZE=3D2 FACE=3D"Arial">> > = getfattr: Removing leading '/' from absolute path names</FONT></SPAN> <BR><SPAN LANG=3D"en-gb"><FONT SIZE=3D2 FACE=3D"Arial">> > # = file:</FONT></SPAN> <BR><SPAN LANG=3D"en-gb"><FONT SIZE=3D2 FACE=3D"Arial">> > = </FONT></SPAN> <BR><SPAN LANG=3D"en-gb"><FONT SIZE=3D2 FACE=3D"Arial">> = mnt/gluster/brick1/storage/images/2078/ebb83b05-3a83-9d18-ad8f</FONT></SP= AN> <BR><SPAN LANG=3D"en-gb"><FONT SIZE=3D2 FACE=3D"Arial">> = -8542864da6ef/</FONT></SPAN> <BR><SPAN LANG=3D"en-gb"><FONT SIZE=3D2 FACE=3D"Arial">> > = hdd-images/21313</FONT></SPAN> <BR><SPAN LANG=3D"en-gb"><FONT SIZE=3D2 FACE=3D"Arial">> > = trusted.afr.storage0-client-2=3D0x000000000000000000000000</FONT></SPAN> <BR><SPAN LANG=3D"en-gb"><FONT SIZE=3D2 FACE=3D"Arial">> > = trusted.afr.storage0-client-3=3D0x000000000000000000000000</FONT></SPAN> <BR><SPAN LANG=3D"en-gb"><FONT SIZE=3D2 FACE=3D"Arial">> = ></FONT></SPAN> <BR><SPAN LANG=3D"en-gb"><FONT SIZE=3D2 FACE=3D"Arial">> > 0 = root at pserver5:~ # ls -alR </FONT></SPAN> <BR><SPAN LANG=3D"en-gb"><FONT SIZE=3D2 FACE=3D"Arial">> > = </FONT></SPAN> <BR><SPAN LANG=3D"en-gb"><FONT SIZE=3D2 FACE=3D"Arial">> = /opt/profitbricks/storage/images/2078/ebb83b05-3a83-9d18-ad8f-8542864d</F= ONT></SPAN> <BR><SPAN LANG=3D"en-gb"><FONT SIZE=3D2 FACE=3D"Arial">> > = a6ef/h</FONT></SPAN> <BR><SPAN LANG=3D"en-gb"><FONT SIZE=3D2 FACE=3D"Arial">> > = dd-images/21313</FONT></SPAN> <BR><SPAN LANG=3D"en-gb"><FONT SIZE=3D2 FACE=3D"Arial">> > = -rwxrwx--- 1 libvirt-qemu kvm 483183820800 Jan =A01 = =A01970</FONT></SPAN> <BR><SPAN LANG=3D"en-gb"><FONT SIZE=3D2 FACE=3D"Arial">> > = </FONT></SPAN> <BR><SPAN LANG=3D"en-gb"><FONT SIZE=3D2 FACE=3D"Arial">> = /opt/profitbricks/storage/images/2078/ebb83b05-3a83-9d18-ad8f-</FONT></SP= AN> <BR><SPAN LANG=3D"en-gb"><FONT SIZE=3D2 FACE=3D"Arial">> = 8542864da6ef/h</FONT></SPAN> <BR><SPAN LANG=3D"en-gb"><FONT SIZE=3D2 FACE=3D"Arial">> > = dd-images/21313</FONT></SPAN> <BR><SPAN LANG=3D"en-gb"><FONT SIZE=3D2 FACE=3D"Arial">> = ></FONT></SPAN> <BR><SPAN LANG=3D"en-gb"><FONT SIZE=3D2 FACE=3D"Arial">> > = pserver3:</FONT></SPAN> <BR><SPAN LANG=3D"en-gb"><FONT SIZE=3D2 FACE=3D"Arial">> = ></FONT></SPAN> <BR><SPAN LANG=3D"en-gb"><FONT SIZE=3D2 FACE=3D"Arial">> > 0 = root at pserver3:~ # ls -al </FONT></SPAN> <BR><SPAN LANG=3D"en-gb"><FONT SIZE=3D2 FACE=3D"Arial">> > = </FONT></SPAN> <BR><SPAN LANG=3D"en-gb"><FONT SIZE=3D2 FACE=3D"Arial">> = /mnt/gluster/brick1/storage/images/2078/ebb83b05-3a83-9d18-ad8f-854286</F= ONT></SPAN> <BR><SPAN LANG=3D"en-gb"><FONT SIZE=3D2 FACE=3D"Arial">> > = 4da6ef</FONT></SPAN> <BR><SPAN LANG=3D"en-gb"><FONT SIZE=3D2 FACE=3D"Arial">> > = /hdd-images</FONT></SPAN> <BR><SPAN LANG=3D"en-gb"><FONT SIZE=3D2 FACE=3D"Arial">> = ></FONT></SPAN> <BR><SPAN LANG=3D"en-gb"><FONT SIZE=3D2 FACE=3D"Arial">> > = -rwxrwx--- 1 libvirt-qemu kvm =A0483183820800 Jan =A01 =A01970 = 21313</FONT></SPAN> <BR><SPAN LANG=3D"en-gb"><FONT SIZE=3D2 FACE=3D"Arial">> = ></FONT></SPAN> <BR><SPAN LANG=3D"en-gb"><FONT SIZE=3D2 FACE=3D"Arial">> > 0 = root at pserver3:~ # ls -alR </FONT></SPAN> <BR><SPAN LANG=3D"en-gb"><FONT SIZE=3D2 FACE=3D"Arial">> > = </FONT></SPAN> <BR><SPAN LANG=3D"en-gb"><FONT SIZE=3D2 FACE=3D"Arial">> = /opt/profitbricks/storage/images/2078/ebb83b05-3a83-9d18-ad8f-8542864d</F= ONT></SPAN> <BR><SPAN LANG=3D"en-gb"><FONT SIZE=3D2 FACE=3D"Arial">> > = a6ef/h</FONT></SPAN> <BR><SPAN LANG=3D"en-gb"><FONT SIZE=3D2 FACE=3D"Arial">> > = dd-images/21313</FONT></SPAN> <BR><SPAN LANG=3D"en-gb"><FONT SIZE=3D2 FACE=3D"Arial">> > = -rwxrwx--- 1 libvirt-qemu kvm 483183820800 Jan =A01 = =A01970</FONT></SPAN> <BR><SPAN LANG=3D"en-gb"><FONT SIZE=3D2 FACE=3D"Arial">> > = </FONT></SPAN> <BR><SPAN LANG=3D"en-gb"><FONT SIZE=3D2 FACE=3D"Arial">> = /opt/profitbricks/storage/images/2078/ebb83b05-3a83-9d18-ad8f-</FONT></SP= AN> <BR><SPAN LANG=3D"en-gb"><FONT SIZE=3D2 FACE=3D"Arial">> = 8542864da6ef/h</FONT></SPAN> <BR><SPAN LANG=3D"en-gb"><FONT SIZE=3D2 FACE=3D"Arial">> > = dd-images/21313</FONT></SPAN> <BR><SPAN LANG=3D"en-gb"><FONT SIZE=3D2 FACE=3D"Arial">> = ></FONT></SPAN> <BR><SPAN LANG=3D"en-gb"><FONT SIZE=3D2 FACE=3D"Arial">> > 0 = root at pserver3:~ # getfattr -R -d -e hex -m = "trusted.afr."</FONT></SPAN> <BR><SPAN LANG=3D"en-gb"><FONT SIZE=3D2 FACE=3D"Arial">> > = /mnt/gluster/brick1/storage/images/2078/ebb83b05-3a83-9d18-</FONT></SPAN>= <BR><SPAN LANG=3D"en-gb"><FONT SIZE=3D2 FACE=3D"Arial">> > = ad8f-8542864da6ef/hdd-images/21313</FONT></SPAN> <BR><SPAN LANG=3D"en-gb"><FONT SIZE=3D2 FACE=3D"Arial">> > = getfattr: Removing leading '/' from absolute path names</FONT></SPAN> <BR><SPAN LANG=3D"en-gb"><FONT SIZE=3D2 FACE=3D"Arial">> > # file: = </FONT></SPAN> <BR><SPAN LANG=3D"en-gb"><FONT SIZE=3D2 FACE=3D"Arial">> > = </FONT></SPAN> <BR><SPAN LANG=3D"en-gb"><FONT SIZE=3D2 FACE=3D"Arial">> = mnt/gluster/brick1/storage/images/2078/ebb83b05-3a83-9d18-ad8f-8542864</F= ONT></SPAN> <BR><SPAN LANG=3D"en-gb"><FONT SIZE=3D2 FACE=3D"Arial">> > = da6ef/</FONT></SPAN> <BR><SPAN LANG=3D"en-gb"><FONT SIZE=3D2 FACE=3D"Arial">> > = hdd-images/21313</FONT></SPAN> <BR><SPAN LANG=3D"en-gb"><FONT SIZE=3D2 FACE=3D"Arial">> > = trusted.afr.storage0-client-2=3D0x000000000000000000000000</FONT></SPAN> <BR><SPAN LANG=3D"en-gb"><FONT SIZE=3D2 FACE=3D"Arial">> > = trusted.afr.storage0-client-3=3D0x0b0000090900000000000000 = =A0</FONT></SPAN> <BR><SPAN LANG=3D"en-gb"><FONT SIZE=3D2 FACE=3D"Arial">> <- = mismatch,</FONT></SPAN> <BR><SPAN LANG=3D"en-gb"><FONT SIZE=3D2 FACE=3D"Arial">> > should = be targeted for self-heal/repair? Why is there a </FONT></SPAN> <BR><SPAN LANG=3D"en-gb"><FONT SIZE=3D2 FACE=3D"Arial">> difference = in the</FONT></SPAN> <BR><SPAN LANG=3D"en-gb"><FONT SIZE=3D2 FACE=3D"Arial">> > = views?</FONT></SPAN> <BR><SPAN LANG=3D"en-gb"><FONT SIZE=3D2 FACE=3D"Arial">> = ></FONT></SPAN> <BR><SPAN LANG=3D"en-gb"><FONT SIZE=3D2 FACE=3D"Arial">> = ></FONT></SPAN> <BR><SPAN LANG=3D"en-gb"><FONT SIZE=3D2 FACE=3D"Arial">> > From = the volfile:</FONT></SPAN> <BR><SPAN LANG=3D"en-gb"><FONT SIZE=3D2 FACE=3D"Arial">> = ></FONT></SPAN> <BR><SPAN LANG=3D"en-gb"><FONT SIZE=3D2 FACE=3D"Arial">> > volume = storage0-client-2</FONT></SPAN> <BR><SPAN LANG=3D"en-gb"><FONT SIZE=3D2 FACE=3D"Arial">> > =A0 = =A0type protocol/client</FONT></SPAN> <BR><SPAN LANG=3D"en-gb"><FONT SIZE=3D2 FACE=3D"Arial">> > =A0 = =A0option remote-host de-dc1-c1-pserver3</FONT></SPAN> <BR><SPAN LANG=3D"en-gb"><FONT SIZE=3D2 FACE=3D"Arial">> > =A0 = =A0option remote-subvolume /mnt/gluster/brick1/storage</FONT></SPAN> <BR><SPAN LANG=3D"en-gb"><FONT SIZE=3D2 FACE=3D"Arial">> > =A0 = =A0option transport-type rdma</FONT></SPAN> <BR><SPAN LANG=3D"en-gb"><FONT SIZE=3D2 FACE=3D"Arial">> > =A0 = =A0option ping-timeout 5</FONT></SPAN> <BR><SPAN LANG=3D"en-gb"><FONT SIZE=3D2 FACE=3D"Arial">> > = end-volume</FONT></SPAN> <BR><SPAN LANG=3D"en-gb"><FONT SIZE=3D2 FACE=3D"Arial">> = ></FONT></SPAN> <BR><SPAN LANG=3D"en-gb"><FONT SIZE=3D2 FACE=3D"Arial">> > volume = storage0-client-3</FONT></SPAN> <BR><SPAN LANG=3D"en-gb"><FONT SIZE=3D2 FACE=3D"Arial">> > =A0 = =A0type protocol/client</FONT></SPAN> <BR><SPAN LANG=3D"en-gb"><FONT SIZE=3D2 FACE=3D"Arial">> > =A0 = =A0option remote-host de-dc1-c1-pserver5</FONT></SPAN> <BR><SPAN LANG=3D"en-gb"><FONT SIZE=3D2 FACE=3D"Arial">> > =A0 = =A0option remote-subvolume /mnt/gluster/brick1/storage</FONT></SPAN> <BR><SPAN LANG=3D"en-gb"><FONT SIZE=3D2 FACE=3D"Arial">> > =A0 = =A0option transport-type rdma</FONT></SPAN> <BR><SPAN LANG=3D"en-gb"><FONT SIZE=3D2 FACE=3D"Arial">> > =A0 = =A0option ping-timeout 5</FONT></SPAN> <BR><SPAN LANG=3D"en-gb"><FONT SIZE=3D2 FACE=3D"Arial">> > = end-volume</FONT></SPAN> <BR><SPAN LANG=3D"en-gb"><FONT SIZE=3D2 FACE=3D"Arial">> = ></FONT></SPAN> <BR><SPAN LANG=3D"en-gb"><FONT SIZE=3D2 FACE=3D"Arial">> = ></FONT></SPAN> <BR><SPAN LANG=3D"en-gb"><FONT SIZE=3D2 FACE=3D"Arial">> = ></FONT></SPAN> <BR><SPAN LANG=3D"en-gb"><FONT SIZE=3D2 FACE=3D"Arial">> > = _______________________________________________</FONT></SPAN> <BR><SPAN LANG=3D"en-gb"><FONT SIZE=3D2 FACE=3D"Arial">> > = Gluster-users mailing list</FONT></SPAN> <BR><SPAN LANG=3D"en-gb"><FONT SIZE=3D2 FACE=3D"Arial">> > = Gluster-users at gluster.org </FONT></SPAN> <BR><SPAN LANG=3D"en-gb"><FONT SIZE=3D2 FACE=3D"Arial">> > = </FONT></SPAN><A = HREF=3D"http://gluster.org/cgi-bin/mailman/listinfo/gluster-users"><SPAN = LANG=3D"en-gb"><U><FONT COLOR=3D"#0000FF" SIZE=3D2 = FACE=3D"Arial">http://gluster.org/cgi-bin/mailman/listinfo/gluster-users<= /FONT></U></SPAN></A><SPAN LANG=3D"en-gb"></SPAN> <BR><SPAN LANG=3D"en-gb"><FONT SIZE=3D2 FACE=3D"Arial">> = ></FONT></SPAN> <BR><SPAN LANG=3D"en-gb"><FONT SIZE=3D2 FACE=3D"Arial">> = </FONT></SPAN> </P> </BODY> </HTML> ------=_NextPart_000_0221_01CC13BB.20FB3D50--