Hi Pierre, Thank you for your constructive suggestion. I'll have a try and let you know. I have one question about what you mentioned the logical version of files. Does it mean all the files in gluster labeled with version? Thank you very much! Cheers, Qiulan > -----Original Messages----- > From: "Pierre Léonard" <pierre-mgp-jouy.inra@xxxxxxxxx> > Sent Time: Wednesday, May 27, 2015 > To: "HUANG Qiulan" <huangql@xxxxxxxxxx>, gluster-users@xxxxxxxxxxx > Cc: pierre-mgp-jouy.inra@xxxxxxxxx > Subject: Re: Cannot remove files > > Hi HUANG, > > I got that problem some time. It came for my different volumes when one > node quit the volume management because of a network problem, or more > often because of a glusterd daemon stop. > > So You have to control that all the glusterd daemon are on on each node > "service glusterd status" if you find one stopped restart it. > Then you have to do a rebalance operation on each volume manage by all > the node of your glusterd file system : > > gluster volume rebalance <volumeName> start > ... > > That take some time in backgroud, depending of the node number and the > size. After that you will get back the logical vision of your file s. > > I do that yesterday on my 14 nodes gluster cluster. The question is now > to monitor the glusterd daemon in order to restart it when it stop. I > will use webmin which can monitor any services. > > Hoping that it help you. > > Pierre Léonard > > Dear all, > > > > I found a strange cases that I remove the directory from server side including the hide files under .gluster/, while I can still list the directory. > > > > > > Server side: > > > > > > ls: /data1/gdata1/home/liyb/boss/TestRelease/TestRelease-00-00-80/run/hc/4420real/log: No such file or directory > > ls: /data2/gdata1/home/liyb/boss/TestRelease/TestRelease-00-00-80/run/hc/4420real/log: No such file or directory > > ls: /data3/gdata1/home/liyb/boss/TestRelease/TestRelease-00-00-80/run/hc/4420real/log: No such file or directory > > ls: /data4/gdata1/home/liyb/boss/TestRelease/TestRelease-00-00-80/run/hc/4420real/log: No such file or directory > > ls: /data5/gdata1/home/liyb/boss/TestRelease/TestRelease-00-00-80/run/hc/4420real/log: No such file or directory > > ls: /data6/gdata1/home/liyb/boss/TestRelease/TestRelease-00-00-80/run/hc/4420real/log: No such file or directory > > ls: /data7/gdata1/home/liyb/boss/TestRelease/TestRelease-00-00-80/run/hc/4420real/log: No such file or directory > > ls: /data8/gdata1/home/liyb/boss/TestRelease/TestRelease-00-00-80/run/hc/4420real/log: No such file or directory > > ls: /data9/gdata1/home/liyb/boss/TestRelease/TestRelease-00-00-80/run/hc/4420real/log: No such file or directory > > ls: /data10/gdata1/home/liyb/boss/TestRelease/TestRelease-00-00-80/run/hc/4420real/log: No such file or directory > > ls: /data11/gdata1/home/liyb/boss/TestRelease/TestRelease-00-00-80/run/hc/4420real/log: No such file or directory > > ls: /data12/gdata1/home/liyb/boss/TestRelease/TestRelease-00-00-80/run/hc/4420real/log: No such file or directory > > ls: /data13/gdata1/home/liyb/boss/TestRelease/TestRelease-00-00-80/run/hc/4420real/log: No such file or directory > > ls: /data14/gdata1/home/liyb/boss/TestRelease/TestRelease-00-00-80/run/hc/4420real/log: No such file or directory > > ls: /data15/gdata1/home/liyb/boss/TestRelease/TestRelease-00-00-80/run/hc/4420real/log: No such file or directory > > ls: /data16/gdata1/home/liyb/boss/TestRelease/TestRelease-00-00-80/run/hc/4420real/log: No such file or directory > > ls: /data17/gdata1/home/liyb/boss/TestRelease/TestRelease-00-00-80/run/hc/4420real/log: No such file or directory > > ls: /data18/gdata1/home/liyb/boss/TestRelease/TestRelease-00-00-80/run/hc/4420real/log: No such file or directory > > > > Client side: > > > > [root@hep ~]# ls /datafs/home/liyb/boss/TestRelease/TestRelease-00-00-80/run/hc/4420real/log/ -l > > total 0 > > ?--------- ? ? ? ? ? ana101.csh > > ?--------- ? ? ? ? ? ana103.csh > > ?--------- ? ? ? ? ? ana39.csh > > ?--------- ? ? ? ? ? ana45.csh > > ?--------- ? ? ? ? ? ana55.csh > > ?--------- ? ? ? ? ? ana5.csh > > ?--------- ? ? ? ? ? ana65.csh > > ?--------- ? ? ? ? ? ana68.csh > > ?--------- ? ? ? ? ? ana69.csh > > ?--------- ? ? ? ? ? ana82.csh > > ?--------- ? ? ? ? ? ana83.csh > > ?--------- ? ? ? ? ? ana87.csh > > ?--------- ? ? ? ? ? ana99.csh > > > > So, it's weird that we can see the deleted directory exist from client. > > > > We deployed glusterfs-3.5.2 and set 2 replicas. > > > > Did someone know this issue? And how can I delete the directory clearly? > > > > Thank you very much in advance. Looking forward to your reply. > > > > Thanks, > > Qiulan > > > > > > > > _______________________________________________ > > Gluster-users mailing list > > Gluster-users@xxxxxxxxxxx > > http://www.gluster.org/mailman/listinfo/gluster-users > _______________________________________________ Gluster-users mailing list Gluster-users@xxxxxxxxxxx http://www.gluster.org/mailman/listinfo/gluster-users
