Hi Krishna, Reprodusing is a problem. This is production servers, and i can`t play with them. For past week, there was only 2 accident, with about 30-50 files changed daily. I can guarantee, that only on first server and only one process writes to this files. On second server all changes go throw gluster only. I`ll try to setup two process configuration. And send you message in some time with the results. On Monday 09 February 2009 21:31:08 Krishna Srinivas wrote: > Ruslan, > > Indeed it is a strange error. Is it an easy bug to reproduce? By the > way, don't use single process server and client, we found issues > regarding locking. If the bug is easy to reproduce you can also check > if it is seen if server and client are different processes. > > Krishna > > On Thu, Feb 5, 2009 at 4:25 PM, Ruslan Bondar <r.bondar@xxxxxxxxxxx> wrote: > > Hi, > > > > We found something strange with new glusterfs-2.0.0rc1. Previously, we > > worked on 1.3.12, and some time ago upgraded to 2.0.0. > > > > So our configuration is 2 web servers web1 and web2. On gluster we store > > only webscripts, for High Availability, in case one server down. > > Glusterfs configured in simple single process AFR. All changes we made on > > first server (web1). > > > > After some time we found that some script files on _second_ server have > > content of other files. > > Making diff of all files md5sum show some files have different checksum > > on different servers. But this checksums have other files on glusterfs > > tree. For examples > > file > > Web1: /gluster/joinus.php 954fdb7686c1a8836b863fa8a09deeb8 > > Web1: /gluster/lib.php 9cd1fb4db6021d37f3098d361b089f65 > > Web2: /gluster/joinus.php 9cd1fb4db6021d37f3098d361b089f65 > > Web2: /gluster/lib.php 9cd1fb4db6021d37f3098d361b089f65 > > > > If we open joinus.php and lib.php they are the same on web2, but on web1 > > this file is different. > > > > The way that this conflict can be solved is: > > web1# mv joinus.php joinus.php1 > > web2# mv joinus.php1 joinus.php > > > > after this we have: > > Web1: /gluster/joinus.php 954fdb7686c1a8836b863fa8a09deeb8 > > Web2: /gluster/joinus.php 954fdb7686c1a8836b863fa8a09deeb8 > > > > In logs i found nothing. > > > > Our gluster config web1: > > ++++++++++++++++++++++++++++++++++ > > # file: /etc/glusterfs/glusterfs-client.vol > > volume store > > type storage/posix > > option directory /export/storage0/glusterfs-test > > end-volume > > > > volume store-lock > > type features/posix-locks > > subvolumes store > > end-volume > > > > volume brick1 > > type performance/io-threads > > option thread-count 4 > > subvolumes store-lock > > end-volume > > > > volume outserver > > type protocol/server > > option transport-type tcp/server > > option auth.addr.brick1.allow * > > subvolumes brick1 > > end-volume > > > > volume remote2 > > type protocol/client > > option transport-type tcp/client > > option transport-timeout 5 > > option remote-host web2 > > option remote-subvolume brick2 > > end-volume > > > > volume server > > type cluster/afr > > subvolumes remote2 brick1 > > option read-subvolume brick1 > > end-volume > > +++++++++++++++++++++++++++++++++++++ > > > > gluster on web2: > > +++++++++++++++++++++++++++++++++++++ > > # file: /etc/glusterfs/glusterfs-client.vol > > > > volume store > > type storage/posix > > option directory /export/storage0/glusterfs-test > > end-volume > > > > volume store-lock > > type features/posix-locks > > subvolumes store > > end-volume > > > > volume brick2 > > type performance/io-threads > > option thread-count 4 > > subvolumes store-lock > > end-volume > > > > volume outserver > > type protocol/server > > option transport-type tcp/server > > option auth.addr.brick2.allow * > > subvolumes brick2 > > end-volume > > > > volume remote1 > > type protocol/client > > option transport-type tcp/client > > option transport-timeout 5 > > option remote-host web1 > > option remote-subvolume brick1 > > end-volume > > > > volume server > > type cluster/afr > > subvolumes brick2 remote1 > > option read-subvolume brick2 > > end-volume > > +++++++++++++++++++++++++++++++++++++ > > > > > > -- > > Best regards, > > Ruslan Bondar > > Ext: 21111 > > Skype: b0rland > > mailto:rus@xxxxxxxxxxx > > > > > > _______________________________________________ > > Gluster-devel mailing list > > Gluster-devel@xxxxxxxxxx > > http://lists.nongnu.org/mailman/listinfo/gluster-devel -- Best regards, Ruslan Bondar Ext: 21111 Skype: b0rland mailto:rus@xxxxxxxxxxx
