Split brain or what

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



Hi,

 

I have a wired situation. Is this as it should be? or what is going on

 

# gluster --version

glusterfs 3.6.2 built on Jan 22 2015 12:58:11

 

There are 8 files reported in split-brain (1024 times), but they seem to be identical.

# gluster volume heal glu_rhevtst_dr2_data_01 info split-brain| awk '$3 ~ /^\// {print $3}'|sort|uniq -d|wc -l

8

 

Also when I run heal info without split-brain it all looks fine.

# gluster volume heal glu_rhevtst_dr2_data_01 info

-- snip --

Brick glustertst03.net.dr.dk:/bricks/brick1/glu_rhevtst_dr2_data_01/

Number of entries: 0

 

Brick glustertst04.net.dr.dk:/bricks/brick1/glu_rhevtst_dr2_data_01/

Number of entries: 0

 

Brick glustertst03.net.dr.dk:/bricks/brick2/glu_rhevtst_dr2_data_01/

Number of entries: 0

 

Brick glustertst04.net.dr.dk:/bricks/brick2/glu_rhevtst_dr2_data_01/

Number of entries: 0

 

The fattr and md5sum on the files are identical on both nodes (except for the contri=). Here is one sample

[root@glustertst03 ~]# getfattr -d -m . -e hex /bricks/brick1/glu_rhevtst_dr2_data_01/6bdc67d1-4ae5-47e3-86c3-ef0916996862/images/8e488152-be3c-42fb-909f-fd123a033a8e/7718978e-cd30-4916-966e-c9cd65e6f14c

getfattr: Removing leading '/' from absolute path names

# file: bricks/brick1/glu_rhevtst_dr2_data_01/6bdc67d1-4ae5-47e3-86c3-ef0916996862/images/8e488152-be3c-42fb-909f-fd123a033a8e/7718978e-cd30-4916-966e-c9cd65e6f14c

security.selinux=0x756e636f6e66696e65645f753a6f626a6563745f723a66696c655f743a733000

trusted.afr.dirty=0x000000000000000000000000

trusted.afr.glu_rhevtst_dr2_data_01-client-0=0x000000000000000000000000

trusted.afr.glu_rhevtst_dr2_data_01-client-1=0x000000000000000000000000

trusted.gfid=0x4c717a67aed64ad4b78b9881af44be61

trusted.glusterfs.quota.9fc26a27-988b-4926-817e-d184d87f16bf.contri=0x000000077275f000

trusted.pgfid.9fc26a27-988b-4926-817e-d184d87f16bf=0x00000001

 

[root@glustertst03 ~]# md5sum /bricks/brick1/glu_rhevtst_dr2_data_01/6bdc67d1-4ae5-47e3-86c3-ef0916996862/images/8e488152-be3c-42fb-909f-fd123a033a8e/7718978e-cd30-4916-966e-c9cd65e6f14c

bd9b7b68cc9f80fb9e7782a4569afa2b  /bricks/brick1/glu_rhevtst_dr2_data_01/6bdc67d1-4ae5-47e3-86c3-ef0916996862/images/8e488152-be3c-42fb-909f-fd123a033a8e/7718978e-cd30-4916-966e-c9cd65e6f14c

 

[root@glustertst04 ~]# getfattr -d -m . -e hex /bricks/brick1/glu_rhevtst_dr2_data_01/6bdc67d1-4ae5-47e3-86c3-ef0916996862/images/8e488152-be3c-42fb-909f-fd123a033a8e/7718978e-cd30-4916-966e-c9cd65e6f14c

getfattr: Removing leading '/' from absolute path names

# file: bricks/brick1/glu_rhevtst_dr2_data_01/6bdc67d1-4ae5-47e3-86c3-ef0916996862/images/8e488152-be3c-42fb-909f-fd123a033a8e/7718978e-cd30-4916-966e-c9cd65e6f14c

security.selinux=0x756e636f6e66696e65645f753a6f626a6563745f723a66696c655f743a733000

trusted.afr.dirty=0x000000000000000000000000

trusted.afr.glu_rhevtst_dr2_data_01-client-0=0x000000000000000000000000

trusted.afr.glu_rhevtst_dr2_data_01-client-1=0x000000000000000000000000

trusted.gfid=0x4c717a67aed64ad4b78b9881af44be61

trusted.glusterfs.quota.9fc26a27-988b-4926-817e-d184d87f16bf.contri=0x0000000772958000

trusted.pgfid.9fc26a27-988b-4926-817e-d184d87f16bf=0x00000001

 

[root@glustertst04 ~]# md5sum /bricks/brick1/glu_rhevtst_dr2_data_01/6bdc67d1-4ae5-47e3-86c3-ef0916996862/images/8e488152-be3c-42fb-909f-fd123a033a8e/7718978e-cd30-4916-966e-c9cd65e6f14c

bd9b7b68cc9f80fb9e7782a4569afa2b  /bricks/brick1/glu_rhevtst_dr2_data_01/6bdc67d1-4ae5-47e3-86c3-ef0916996862/images/8e488152-be3c-42fb-909f-fd123a033a8e/7718978e-cd30-4916-966e-c9cd65e6f14c

 

# gluster volume heal glu_rhevtst_dr2_data_01 info split-brain

  -- snip  --

Brick glustoretst04.net.dr.dk:/bricks/brick2/glu_rhevtst_dr2_data_01

Number of entries: 1024

at                    path on brick

-----------------------------------

2015-07-14 03:56:22  /6bdc67d1-4ae5-47e3-86c3-ef0916996862/images/a2a61288-e39e-4765-a7a5-870b5a248e8d/e168cf91-8005-49da-9d11-b07f326898ba

 

Brick glustoretst03.net.dr.dk:/bricks/brick2/glu_rhevtst_dr2_data_01

Number of entries: 1024

at                    path on brick

-----------------------------------

2015-07-14 03:55:02  /6bdc67d1-4ae5-47e3-86c3-ef0916996862/images/a2a61288-e39e-4765-a7a5-870b5a248e8d/e168cf91-8005-49da-9d11-b07f326898ba

 

Brick glustoretst04.net.dr.dk:/bricks/brick1/glu_rhevtst_dr2_data_01

Number of entries: 1024

at                    path on brick

-----------------------------------

2015-07-14 08:01:22 /6bdc67d1-4ae5-47e3-86c3-ef0916996862/images/8e488152-be3c-42fb-909f-fd123a033a8e/7718978e-cd30-4916-966e-c9cd65e6f14c

 

Brick glustoretst03.net.dr.dk:/bricks/brick1/glu_rhevtst_dr2_data_01

Number of entries: 1024

at                    path on brick

-----------------------------------

2015-07-14 07:41:25 /6bdc67d1-4ae5-47e3-86c3-ef0916996862/images/8e488152-be3c-42fb-909f-fd123a033a8e/7718978e-cd30-4916-966e-c9cd65e6f14c

 

# gluster volume info glu_rhevtst_dr2_data_01

 

Volume Name: glu_rhevtst_dr2_data_01

Type: Distributed-Replicate

Volume ID: 5f24fb9e-76cd-4610-85c5-4b4734349958

Status: Started

Number of Bricks: 4 x 2 = 8

Transport-type: tcp

Bricks:

Brick1: glustoretst03.net.dr.dk:/bricks/brick1/glu_rhevtst_dr2_data_01

Brick2: glustoretst04.net.dr.dk:/bricks/brick1/glu_rhevtst_dr2_data_01

Brick3: glustoretst03.net.dr.dk:/bricks/brick2/glu_rhevtst_dr2_data_01

Brick4: glustoretst04.net.dr.dk:/bricks/brick2/glu_rhevtst_dr2_data_01

Brick5: glustoretst01.net.dr.dk:/bricks/brick1/glu_rhevtst_dr2_data_01

Brick6: glustoretst02.net.dr.dk:/bricks/brick1/glu_rhevtst_dr2_data_01

Brick7: glustoretst01.net.dr.dk:/bricks/brick2/glu_rhevtst_dr2_data_01

Brick8: glustoretst02.net.dr.dk:/bricks/brick2/glu_rhevtst_dr2_data_01

Options Reconfigured:

nfs.disable: on

user.cifs: disable

auth.allow: xxxxxxx

performance.quick-read: off

performance.read-ahead: off

performance.io-cache: off

performance.stat-prefetch: off

cluster.eager-lock: enable

network.remote-dio: enable

cluster.quorum-type: none

cluster.server-quorum-type: server

storage.owner-uid: 36

storage.owner-gid: 36

features.quota-deem-statfs: on

features.quota: on

cluster.server-quorum-ratio: 50%

 

Thanks

Jesper

_______________________________________________
Gluster-users mailing list
Gluster-users@xxxxxxxxxxx
http://www.gluster.org/mailman/listinfo/gluster-users

[Index of Archives]     [Gluster Development]     [Linux Filesytems Development]     [Linux ARM Kernel]     [Linux ARM]     [Linux Omap]     [Fedora ARM]     [IETF Annouce]     [Bugtraq]     [Linux OMAP]     [Linux MIPS]     [eCos]     [Asterisk Internet PBX]     [Linux API]

  Powered by Linux