Re: split brain: how should it be cured?

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



hi,
   Replicate only keeps track of the fact that an operation is performed successfully on one brick while on the other brick it was not successful. It does not know the actual change. So you can endup where both the files are same but there is xattr-split-brain.
Example:

touch f
bring brick-0 down
echo 'a' > f
brick brick-0 up, bring brick-1 down (assume self-heal on this file was not trggered on this file)
echo 'a' > f
Bring brick-1 up. Now the file 'f' is in xattr split-brain, even though both of the files contain same data.

Pranith.
----- Original Message -----
From: "Emmanuel Dreyfus" <manu@xxxxxxxxxx>
To: "Pranith Kumar Karampuri" <pkarampu@xxxxxxxxxx>
Cc: gluster-devel@xxxxxxxxxx
Sent: Wednesday, June 20, 2012 5:03:36 PM
Subject: Re: split brain: how should it be cured?

On Wed, Jun 20, 2012 at 05:35:36AM -0400, Pranith Kumar Karampuri wrote:
> Procedure to reset split-brain is to remove one of the files. 
> 3.3 release onwards we need to also delete the file from gfid-backend.
> if the file is a.txt with gfid 5c71a049-a424-480e-9e69-2cdfd7a0a7a0
> remove the file a.txt
> remove the file <brick-path>/.glusterfs/5c/71/5c71a049-a424-480e-9e69-2cdfd7a0a7a0
> the gfid path is a hardlink to a.txt

glusterfs 3.3 behavior is really odd. It was possible to read the
offending file, and after a while, it started  returning EIO again.
Removing the file and its gfid hardlink seems to workaround the
problem, though.

But I still do not understand how they are considered in metadata split brain: 
all metadata were the same:

On brick1:
  File: "/export/wd3a/manu/netbsd/usr/src/tools/mktemp/Makefile"
  Size: 165          FileType: Regular File
  Mode: (0644/-rw-r--r--)         Uid: (  500/    manu)  Gid: (  500/    manu)
Device: 0,16   Inode: 55748693    Links: 2
Access: Wed Jun 20 13:24:31 2012
Modify: Sun Dec  8 21:20:03 2002
Change: Wed Jun 20 11:31:28 2012

trusted.afr.pfs-client-0 00 00 00 00 00 00 00 00 00 00 00 00
trusted.afr.pfs-client-1 00 00 00 00 00 00 00 01 00 00 00 00

On brick2:
  File: "/export/wd3a/manu/netbsd/usr/src/tools/mktemp/Makefile"
  Size: 165          FileType: Regular File
  Mode: (0644/-rw-r--r--)         Uid: (  500/    manu)  Gid: (  500/    manu)
Device: 0,24   Inode: 25441937    Links: 2
Access: Wed Jun 20 13:24:31 2012
Modify: Sun Dec  8 21:20:03 2002
Change: Wed Jun 20 11:31:28 2012

trusted.afr.pfs-client-0 00 00 00 00 00 00 00 03 00 00 00 00
trusted.afr.pfs-client-1 00 00 00 00 00 00 00 00 00 00 00 00
-- 
Emmanuel Dreyfus
manu@xxxxxxxxxx

_______________________________________________
Gluster-devel mailing list
Gluster-devel@xxxxxxxxxx
https://lists.nongnu.org/mailman/listinfo/gluster-devel



[Index of Archives]     [Gluster Users]     [Ceph Users]     [Linux ARM Kernel]     [Linux ARM]     [Linux Omap]     [Fedora ARM]     [IETF Annouce]     [Security]     [Bugtraq]     [Linux]     [Linux OMAP]     [Linux MIPS]     [eCos]     [Asterisk Internet PBX]     [Linux API]

  Powered by Linux