Did this occur after adding or removing a brick and then running rebalance? On Thu, Jul 21, 2011 at 8:30 AM, Joe Landman <landman at scalableinformatics.com> wrote: > On 07/21/2011 11:21 AM, Joe Landman wrote: >> >> On 07/21/2011 11:17 AM, Burnash, James wrote: >>> >>> Hi Joe. >>> > > Found it: > > ? find $local -type f -perm +01000 -exec rm -v '{}' \; > > for $local > > >>> Before I answer - can you share your volume info dump? >> >> This is >> >> [root at X02 ~]# gluster volume info >> >> Volume Name: brick1 >> Type: Distribute >> Status: Started >> Number of Bricks: 4 >> Transport-type: tcp >> Bricks: >> Brick1: X01:/data/glusterfs/dht >> Brick2: X02:/data/glusterfs/dht >> Brick3: X03:/data/brick-sdc2/glusterfs/dht >> Brick4: X03:/data/brick-sdd2/glusterfs/dht >> >> >>> >>> My understanding is that those "link" files are valid if you have my >>> kind of config - which is distributed-replicate across 2 mirrored >>> pairs of backed servers. If the request for a file come into the pair >>> that do not have that file physically on their storage, the "link" >>> file is created to point to the actual location on the other mirror. >>> At least ... that is what I think it's supposed to do ... >> >> They are a known bug from 2.0.x time frame. I am searching my emails >> from 2 years ago for the magic command that removes them. >> >>> >>> James Burnash Unix Engineer Knight Capital Group >>> >>> >>> -----Original Message----- From: gluster-users-bounces at gluster.org >>> [mailto:gluster-users-bounces at gluster.org] On Behalf Of Joe Landman >>> Sent: Thursday, July 21, 2011 11:11 AM To: gluster-users Subject: >>> Anyone have that find command handy >>> >>> Ran into a situation that I thought had been corrected in the 2.0.x >>> time frame. >>> >>> [root at X03 ~]# ls -alF >>> >>> /data/brick-sdc2/glusterfs/dht/opra/20110502/options_20110502_opra_ch_015_.dat.zip.stats >>> >>> >>> >> >> /data/brick-sdd2/glusterfs/dht/opra/20110502/options_20110502_opra_ch_015_.dat.zip >> >>> ---------T 1 root root 0 Jul 19 18:08 >>> >>> /data/brick-sdc2/glusterfs/dht/opra/20110502/options_20110502_opra_ch_015_.dat.zip.stats >>> >>> >>> >> ---------T 1 root root 0 Jul 21 10:48 >>> >>> >>> /data/brick-sdd2/glusterfs/dht/opra/20110502/options_20110502_opra_ch_015_.dat.zip >>> >>> >>> and the real files >>> >>> [root at X02 ~]# ls -alF >>> /data/glusterfs/dht/opra/20110502/options_20110502_opra_ch_015_* >>> -rw-r--r-- 1 oracle oinstall 984227914 Jul 21 11:05 >>> /data/glusterfs/dht/opra/20110502/options_20110502_opra_ch_015_.dat.zip >>> >>> >> -rw-r--r-- 1 root root 17028780 Jul 20 13:00 >>> >>> >>> /data/glusterfs/dht/opra/20110502/options_20110502_opra_ch_015_.dat.zip.stats >>> >>> >>> Note the permissions on the first as compared to the second. This >>> came from a rebalance operation with 3.1.5. >>> >>> Anyone have that handy >>> >>> find -perm XXXX -exec rm {} >>> >>> command handy so we can scan for and remove the ghost files? I can >>> search for it in my old emails, just figured I'd ask. >>> >>> -- Joseph Landman, Ph.D Founder and CEO Scalable Informatics, Inc. >>> email: landman at scalableinformatics.com web : >>> http://scalableinformatics.com >>> http://scalableinformatics.com/sicluster phone: +1 734 786 8423 x121 >>> fax : +1 866 888 3112 cell : +1 734 612 4615 >>> _______________________________________________ Gluster-users mailing >>> list Gluster-users at gluster.org >>> http://gluster.org/cgi-bin/mailman/listinfo/gluster-users >>> >>> >>> DISCLAIMER: This e-mail, and any attachments thereto, is intended >>> only for use by the addressee(s) named herein and may contain legally >>> privileged and/or confidential information. If you are not the >>> intended recipient of this e-mail, you are hereby notified that any >>> dissemination, distribution or copying of this e-mail, and any >>> attachments thereto, is strictly prohibited. If you have received >>> this in error, please immediately notify me and permanently delete >>> the original and any copy of any e-mail and any printout thereof. >>> E-mail transmission cannot be guaranteed to be secure or error-free. >>> The sender therefore does not accept liability for any errors or >>> omissions in the contents of this message which arise as a result of >>> e-mail transmission. NOTICE REGARDING PRIVACY AND CONFIDENTIALITY >>> Knight Capital Group may, at its discretion, monitor and review the >>> content of all e-mail communications. http://www.knight.com >> >> > > > -- > Joseph Landman, Ph.D > Founder and CEO > Scalable Informatics, Inc. > email: landman at scalableinformatics.com > web ?: http://scalableinformatics.com > ? ? ? http://scalableinformatics.com/sicluster > phone: +1 734 786 8423 x121 > fax ?: +1 866 888 3112 > cell : +1 734 612 4615 > _______________________________________________ > Gluster-users mailing list > Gluster-users at gluster.org > http://gluster.org/cgi-bin/mailman/listinfo/gluster-users >