On 07/21/2011 12:35 PM, Mohit Anchlia wrote: > Did this occur after adding or removing a brick and then running rebalance? Adding and rebalance. > > On Thu, Jul 21, 2011 at 8:30 AM, Joe Landman > <landman at scalableinformatics.com> wrote: >> On 07/21/2011 11:21 AM, Joe Landman wrote: >>> >>> On 07/21/2011 11:17 AM, Burnash, James wrote: >>>> >>>> Hi Joe. >>>> >> >> Found it: >> >> find $local -type f -perm +01000 -exec rm -v '{}' \; >> >> for $local >> >> >>>> Before I answer - can you share your volume info dump? >>> >>> This is >>> >>> [root at X02 ~]# gluster volume info >>> >>> Volume Name: brick1 >>> Type: Distribute >>> Status: Started >>> Number of Bricks: 4 >>> Transport-type: tcp >>> Bricks: >>> Brick1: X01:/data/glusterfs/dht >>> Brick2: X02:/data/glusterfs/dht >>> Brick3: X03:/data/brick-sdc2/glusterfs/dht >>> Brick4: X03:/data/brick-sdd2/glusterfs/dht >>> >>> >>>> >>>> My understanding is that those "link" files are valid if you have my >>>> kind of config - which is distributed-replicate across 2 mirrored >>>> pairs of backed servers. If the request for a file come into the pair >>>> that do not have that file physically on their storage, the "link" >>>> file is created to point to the actual location on the other mirror. >>>> At least ... that is what I think it's supposed to do ... >>> >>> They are a known bug from 2.0.x time frame. I am searching my emails >>> from 2 years ago for the magic command that removes them. >>> >>>> >>>> James Burnash Unix Engineer Knight Capital Group >>>> >>>> >>>> -----Original Message----- From: gluster-users-bounces at gluster.org >>>> [mailto:gluster-users-bounces at gluster.org] On Behalf Of Joe Landman >>>> Sent: Thursday, July 21, 2011 11:11 AM To: gluster-users Subject: >>>> Anyone have that find command handy >>>> >>>> Ran into a situation that I thought had been corrected in the 2.0.x >>>> time frame. >>>> >>>> [root at X03 ~]# ls -alF >>>> >>>> /data/brick-sdc2/glusterfs/dht/opra/20110502/options_20110502_opra_ch_015_.dat.zip.stats >>>> >>>> >>>> >>> >>> /data/brick-sdd2/glusterfs/dht/opra/20110502/options_20110502_opra_ch_015_.dat.zip >>> >>>> ---------T 1 root root 0 Jul 19 18:08 >>>> >>>> /data/brick-sdc2/glusterfs/dht/opra/20110502/options_20110502_opra_ch_015_.dat.zip.stats >>>> >>>> >>>> >>> ---------T 1 root root 0 Jul 21 10:48 >>>> >>>> >>>> /data/brick-sdd2/glusterfs/dht/opra/20110502/options_20110502_opra_ch_015_.dat.zip >>>> >>>> >>>> and the real files >>>> >>>> [root at X02 ~]# ls -alF >>>> /data/glusterfs/dht/opra/20110502/options_20110502_opra_ch_015_* >>>> -rw-r--r-- 1 oracle oinstall 984227914 Jul 21 11:05 >>>> /data/glusterfs/dht/opra/20110502/options_20110502_opra_ch_015_.dat.zip >>>> >>>> >>> -rw-r--r-- 1 root root 17028780 Jul 20 13:00 >>>> >>>> >>>> /data/glusterfs/dht/opra/20110502/options_20110502_opra_ch_015_.dat.zip.stats >>>> >>>> >>>> Note the permissions on the first as compared to the second. This >>>> came from a rebalance operation with 3.1.5. >>>> >>>> Anyone have that handy >>>> >>>> find -perm XXXX -exec rm {} >>>> >>>> command handy so we can scan for and remove the ghost files? I can >>>> search for it in my old emails, just figured I'd ask. >>>> >>>> -- Joseph Landman, Ph.D Founder and CEO Scalable Informatics, Inc. >>>> email: landman at scalableinformatics.com web : >>>> http://scalableinformatics.com >>>> http://scalableinformatics.com/sicluster phone: +1 734 786 8423 x121 >>>> fax : +1 866 888 3112 cell : +1 734 612 4615 >>>> _______________________________________________ Gluster-users mailing >>>> list Gluster-users at gluster.org >>>> http://gluster.org/cgi-bin/mailman/listinfo/gluster-users >>>> >>>> >>>> DISCLAIMER: This e-mail, and any attachments thereto, is intended >>>> only for use by the addressee(s) named herein and may contain legally >>>> privileged and/or confidential information. If you are not the >>>> intended recipient of this e-mail, you are hereby notified that any >>>> dissemination, distribution or copying of this e-mail, and any >>>> attachments thereto, is strictly prohibited. If you have received >>>> this in error, please immediately notify me and permanently delete >>>> the original and any copy of any e-mail and any printout thereof. >>>> E-mail transmission cannot be guaranteed to be secure or error-free. >>>> The sender therefore does not accept liability for any errors or >>>> omissions in the contents of this message which arise as a result of >>>> e-mail transmission. NOTICE REGARDING PRIVACY AND CONFIDENTIALITY >>>> Knight Capital Group may, at its discretion, monitor and review the >>>> content of all e-mail communications. http://www.knight.com >>> >>> >> >> >> -- >> Joseph Landman, Ph.D >> Founder and CEO >> Scalable Informatics, Inc. >> email: landman at scalableinformatics.com >> web : http://scalableinformatics.com >> http://scalableinformatics.com/sicluster >> phone: +1 734 786 8423 x121 >> fax : +1 866 888 3112 >> cell : +1 734 612 4615 >> _______________________________________________ >> Gluster-users mailing list >> Gluster-users at gluster.org >> http://gluster.org/cgi-bin/mailman/listinfo/gluster-users >> -- Joseph Landman, Ph.D Founder and CEO Scalable Informatics, Inc. email: landman at scalableinformatics.com web : http://scalableinformatics.com http://scalableinformatics.com/sicluster phone: +1 734 786 8423 x121 fax : +1 866 888 3112 cell : +1 734 612 4615