There is something more to it. I am guessing. On Mon, Apr 25, 2011 at 9:21 AM, Burnash, James <jburnash at knight.com> wrote: > Self healing will still work - it's just that is a program does a "find" or an "ls -l" on any files they won't be pre-cached at the client, and if there are a LOT of files it could take quite a while for the command to return. > > I think :-) > > James Burnash, Unix Engineering > > -----Original Message----- > From: Mohit Anchlia [mailto:mohitanchlia at gmail.com] > Sent: Monday, April 25, 2011 12:20 PM > To: Burnash, James; landman at scalableinformatics.com > Cc: gluster-users at gluster.org > Subject: Re: Client hang on find of directories > > What's the downside of turning off stat-prefetch? Would self healing still work? > > On Mon, Apr 25, 2011 at 5:08 AM, Burnash, James <jburnash at knight.com> wrote: >> Thanks Joe. >> >> I will go through your recommendations and come back with my findings. >> >> Based on your (and other) comments in previous threads, I have already turned off stat-prefetch while I sort through multiple issues here on this GlusterFS namespace. >> >> James Burnash, Unix Engineering >> >> -----Original Message----- >> From: gluster-users-bounces at gluster.org [mailto:gluster-users-bounces at gluster.org] On Behalf Of Joe Landman >> Sent: Sunday, April 24, 2011 4:11 PM >> To: gluster-users at gluster.org >> Subject: Re: Client hang on find of directories >> >> On 04/24/2011 03:03 PM, Burnash, James wrote: >>> Gluster 3.1.1 >>> >>> CentOS 5.5 (servers), CentOS 5.2 (client). >>> >>> /pfs2 is the mount point for a Duplicated-Replicate volume of 4 servers. >>> >>> Given this command line executed on the client: >>> >>> root at jc1lnxsamm46:/root # time find /pfs2/online_archive/2010 -type d -print >>> >>> and this output: >>> >> >> [...] >> >>> Client was originally deployed as GlusterFS 3.0.4, that was uninstalled, >>> version 3.1.1 was installed, and then later upgraded to 3.1.3. >>> >>> Any ideas on what is going on here? >> >> possibly multiple things. ?Looks like a slow stat issue, compounded by a >> run-time link issue. ?You might need to locate where you installed your >> glusterfs installation, and make sure it is included in a file in >> /etc/ld.so.conf.d/gluster.conf >> >> ? ? ? ?/usr/local/lib >> ? ? ? ?/usr/local/lib64 >> >> then run >> >> ? ? ? ?ldconfig -v >> >> and then restart gluster. >> >> As to the slow aspect, large directories with many stats will take a >> very long time. ?At this point in time, we are turning off stat-prefetch >> and a number of other things by default due to breakage, for >> deployments. ?This will negatively impact stat performance (requiring at >> least one round trip per stat), and show up as huge time delays in large >> directories. >> >> It might help to turn up debugging on the servers, and pastebin the logs. >> >>> >>> Thanks, >>> >>> James Burnash >>> >>> Unix Engineering >>> >>> >>> >>> DISCLAIMER: >>> This e-mail, and any attachments thereto, is intended only for use by >>> the addressee(s)named herein and >>> may contain legally privileged and/or confidential information. If you >>> are not the intended recipient of this >>> e-mail, you are hereby notified that any dissemination, distribution or >>> copying of this e-mail and any attachments >>> thereto, is strictly prohibited. If you have received this in error, >>> please immediately notify me and permanently >>> delete the original and any printout thereof.E-mail transmission cannot >>> be guaranteed to be secure or error-free. >>> The sender therefore does not accept liability for any errors or >>> omissions in the contents of this message which >>> arise as a result of e-mail transmission. >>> NOTICE REGARDING PRIVACY AND CONFIDENTIALITY >>> Knight Capital Group may, at its discretion, monitor and review the >>> content of all e-mail communications. >>> >>> http://www.knight.com <http://www.knight.com/> >>> >>> >>> >>> _______________________________________________ >>> Gluster-users mailing list >>> Gluster-users at gluster.org >>> http://gluster.org/cgi-bin/mailman/listinfo/gluster-users >> >> >> -- >> Joseph Landman, Ph.D >> Founder and CEO >> Scalable Informatics, Inc. >> email: landman at scalableinformatics.com >> web ?: http://scalableinformatics.com >> ? ? ? ?http://scalableinformatics.com/sicluster >> phone: +1 734 786 8423 x121 >> fax ?: +1 866 888 3112 >> cell : +1 734 612 4615 >> _______________________________________________ >> Gluster-users mailing list >> Gluster-users at gluster.org >> http://gluster.org/cgi-bin/mailman/listinfo/gluster-users >> _______________________________________________ >> Gluster-users mailing list >> Gluster-users at gluster.org >> http://gluster.org/cgi-bin/mailman/listinfo/gluster-users >> >
