Re: Problems after adding bricks and rebalancing

[Pranith Kumar Karampuri <pkarampu@xxxxxxxxxx>]

CC people who work on rebalance.

Pranith
On 06/13/2014 05:24 PM, Anders Blomdell wrote:
> -----BEGIN PGP SIGNED MESSAGE-----
> Hash: SHA1
>
> After having expanded my test gluster from 2*4 to 4*4, I got very weird results in some
> directories:
>
> On machine 1 (that had the gluster mounted during rebalance)
> # ls -l /mnt/gluster/some/sub/path/
> total 2902
> - -rw-r--r-- 1 user    group    151 10 nov  2010 1C04C61346A1FA3139A37D860ED92632AA13DECF.heu
> - -rw-r--r-- 1 user    group 565987 10 nov  2010 1C04C61346A1FA3139A37D860ED92632AA13DECF.swz
> - -rw-r--r-- 1 user    group      0 10 nov  2010 1C04C61346A1FA3139A37D860ED92632AA13DECF.swz
> - -rw-r--r-- 1 user    group 565987 10 nov  2010 1C04C61346A1FA3139A37D860ED92632AA13DECF.swz
> - -rw-r--r-- 1 user    group    151  7 mar 09.42 33D9983BC427DD69DF151E816FB0AB02C0B8D5CF.heu
> - ---------T 1 user    group      0 13 jun 10.08 33D9983BC427DD69DF151E816FB0AB02C0B8D5CF.heu
> - -rw-r--r-- 1 user    group 317992  7 mar 09.42 33D9983BC427DD69DF151E816FB0AB02C0B8D5CF.swz
> - -rw-r--r-- 1 user    group      0  7 mar 09.42 33D9983BC427DD69DF151E816FB0AB02C0B8D5CF.swz
> - -rw-r--r-- 1 user    group 317992  7 mar 09.42 33D9983BC427DD69DF151E816FB0AB02C0B8D5CF.swz
> - -rw-r--r-- 1 user    group    151  7 mar 09.42 67BA9F962EEC4D8B413432AFAD5C88BB810426B9.heu
> - -rw-r--r-- 1 user    group      0  7 mar 09.42 67BA9F962EEC4D8B413432AFAD5C88BB810426B9.heu
> - -rw-r--r-- 1 user    group    151  7 mar 09.42 67BA9F962EEC4D8B413432AFAD5C88BB810426B9.heu
> - -rw-r--r-- 1 user    group  54494  7 mar 09.42 67BA9F962EEC4D8B413432AFAD5C88BB810426B9.swz
> - -rw-r--r-- 1 user    group    151  7 mar 09.42 7421C71F94DB4F028E7528B2D278F3FE4DC21273.heu
> - -rw-r--r-- 1 user    group 156308  7 mar 09.42 7421C71F94DB4F028E7528B2D278F3FE4DC21273.swz
> - -rw-r--r-- 1 user    group    151  7 mar 09.42 C3306B26751D6A80EB1FCB651912469AE18819AB.heu
> - -rw-r--r-- 1 user    group  98047  7 mar 09.42 C3306B26751D6A80EB1FCB651912469AE18819AB.swz
> - -rw-r--r-- 1 user    group      8  7 mar 09.42 cacheSize.txt
> - ---------T 1 user    group      0 13 jun 10.08 cacheSize.txt
> - -rw-r--r-- 1 user    group    148  7 mar 09.42 D796AC95BD6E16151B6D3C0019A52E648CED1FE1.heu
> - -rw-r--r-- 1 user    group      0  7 mar 09.42 D796AC95BD6E16151B6D3C0019A52E648CED1FE1.heu
> - -rw-r--r-- 1 user    group    148  7 mar 09.42 D796AC95BD6E16151B6D3C0019A52E648CED1FE1.heu
> - -rw-r--r-- 1 user    group 131911  7 mar 09.42 D796AC95BD6E16151B6D3C0019A52E648CED1FE1.swz
> - -rw-r--r-- 1 user    group      0  7 mar 09.42 D796AC95BD6E16151B6D3C0019A52E648CED1FE1.swz
> - -rw-r--r-- 1 user    group 131911  7 mar 09.42 D796AC95BD6E16151B6D3C0019A52E648CED1FE1.swz
> - -rw-r--r-- 1 user    group    151  7 mar 09.42 F74FCD943BAC79E6DADBF0307B55B0697C5907E4.heu
> - -rw-r--r-- 1 user    group      0  7 mar 09.42 F74FCD943BAC79E6DADBF0307B55B0697C5907E4.heu
> - -rw-r--r-- 1 user    group    151  7 mar 09.42 F74FCD943BAC79E6DADBF0307B55B0697C5907E4.heu
> - -rw-r--r-- 1 user    group 621999  7 mar 09.42 F74FCD943BAC79E6DADBF0307B55B0697C5907E4.swz
>
> On machine 2 (that had the gluster mounted after rebalance)
>
> # ls -l /mnt/gluster/some/sub/path/
> - -rw-r--r-- 1 user    group    151 10 nov  2010 1C04C61346A1FA3139A37D860ED92632AA13DECF.heu
> - -rw-r--r-- 1 user    group 565987 10 nov  2010 1C04C61346A1FA3139A37D860ED92632AA13DECF.swz
> - -rw-r--r-- 1 user    group 565987 10 nov  2010 1C04C61346A1FA3139A37D860ED92632AA13DECF.swz
> - -rw-r--r-- 1 user    group 565987 10 nov  2010 1C04C61346A1FA3139A37D860ED92632AA13DECF.swz
> - -rw-r--r-- 1 user    group    151  7 mar 09.42 33D9983BC427DD69DF151E816FB0AB02C0B8D5CF.heu
> - ---------T 1 user    group      0 13 jun 10.08 33D9983BC427DD69DF151E816FB0AB02C0B8D5CF.heu
> - -rw-r--r-- 1 user    group 317992  7 mar 09.42 33D9983BC427DD69DF151E816FB0AB02C0B8D5CF.swz
> - -rw-r--r-- 1 user    group      0  7 mar 09.42 33D9983BC427DD69DF151E816FB0AB02C0B8D5CF.swz
> - -rw-r--r-- 1 user    group 317992  7 mar 09.42 33D9983BC427DD69DF151E816FB0AB02C0B8D5CF.swz
> - -rw-r--r-- 1 user    group    151  7 mar 09.42 67BA9F962EEC4D8B413432AFAD5C88BB810426B9.heu
> - -rw-r--r-- 1 user    group      0  7 mar 09.42 67BA9F962EEC4D8B413432AFAD5C88BB810426B9.heu
> - -rw-r--r-- 1 user    group    151  7 mar 09.42 67BA9F962EEC4D8B413432AFAD5C88BB810426B9.heu
> - -rw-r--r-- 1 user    group  54494  7 mar 09.42 67BA9F962EEC4D8B413432AFAD5C88BB810426B9.swz
> - -rw-r--r-- 1 user    group    151  7 mar 09.42 7421C71F94DB4F028E7528B2D278F3FE4DC21273.heu
> - -rw-r--r-- 1 user    group 156308  7 mar 09.42 7421C71F94DB4F028E7528B2D278F3FE4DC21273.swz
> - -rw-r--r-- 1 user    group    151  7 mar 09.42 C3306B26751D6A80EB1FCB651912469AE18819AB.heu
> - -rw-r--r-- 1 user    group  98047  7 mar 09.42 C3306B26751D6A80EB1FCB651912469AE18819AB.swz
> - -rw-r--r-- 1 user    group      8  7 mar 09.42 cacheSize.txt
> - ---------T 1 user    group      0 13 jun 10.08 cacheSize.txt
> - -rw-r--r-- 1 user    group    148  7 mar 09.42 D796AC95BD6E16151B6D3C0019A52E648CED1FE1.heu
> - -rw-r--r-- 1 user    group    148  7 mar 09.42 D796AC95BD6E16151B6D3C0019A52E648CED1FE1.heu
> - -rw-r--r-- 1 user    group    148  7 mar 09.42 D796AC95BD6E16151B6D3C0019A52E648CED1FE1.heu
> - -rw-r--r-- 1 user    group 131911  7 mar 09.42 D796AC95BD6E16151B6D3C0019A52E648CED1FE1.swz
> - -rw-r--r-- 1 user    group 131911  7 mar 09.42 D796AC95BD6E16151B6D3C0019A52E648CED1FE1.swz
> - -rw-r--r-- 1 user    group 131911  7 mar 09.42 D796AC95BD6E16151B6D3C0019A52E648CED1FE1.swz
> - -rw-r--r-- 1 user    group    151  7 mar 09.42 F74FCD943BAC79E6DADBF0307B55B0697C5907E4.heu
> - -rw-r--r-- 1 user    group    151  7 mar 09.42 F74FCD943BAC79E6DADBF0307B55B0697C5907E4.heu
> - -rw-r--r-- 1 user    group    151  7 mar 09.42 F74FCD943BAC79E6DADBF0307B55B0697C5907E4.heu
> - -rw-r--r-- 1 user    group 621999  7 mar 09.42 F74FCD943BAC79E6DADBF0307B55B0697C5907E4.swz
>
> As can be seen there are both files with T bit set, and duplicates (sometimes up to three times
> D796AC95BD6E16151B6D3C0019A52E648CED1FE1.heu).
>
> Anybody that has a hint of what might have gone wrong (and how to fix it)?
>
> /Anders
>
> - -- 
> Anders Blomdell                  Email: anders.blomdell@xxxxxxxxxxxxxx
> Department of Automatic Control
> Lund University                  Phone:    +46 46 222 4625
> P.O. Box 118                     Fax:      +46 46 138118
> SE-221 00 Lund, Sweden
>
> -----BEGIN PGP SIGNATURE-----
> Version: GnuPG v1
> Comment: Using GnuPG with Thunderbird - http://www.enigmail.net/
>
> iQEcBAEBAgAGBQJTmuZbAAoJENZYyvaDG8NcSBUH/0xotErU1u0GMjfTI5puq8te
> WxXSYWu8um9+6e5LBQi0w6lAoJLZ1GaAaL5s0BtvKKDeKHYWt3HcFMj6RLd996wz
> sTp/ltA0eMnLuFZUTqwE/kyL7m8JR6D0bGlTcH4R8VN641WImwAx3th7vuRaTDyt
> 9fwNfLS4OexBXefR7LNZmRl6E4t1G8aaDl2PrLpqPBB8u9AMls0l5D22hmlgAMIt
> K1olC589nskhKxVgEAcafsNixZM2PfLREX+Tifs/y7R3gNBtKvdp+OXZ8TEmm2cy
> 1WXzEWUsSncgTtTQly0E4nBpBmb3Wo9de1ofLp2SimZKee/sJ2pMS4kbn83kAW8=
> =IlR7
> -----END PGP SIGNATURE-----
> _______________________________________________
> Gluster-users mailing list
> Gluster-users@xxxxxxxxxxx
> http://supercolony.gluster.org/mailman/listinfo/gluster-users

_______________________________________________
Gluster-users mailing list
Gluster-users@xxxxxxxxxxx
http://supercolony.gluster.org/mailman/listinfo/gluster-users