Some more infos: http://gluster.readthedocs.org/en/latest/Feature%20Planning/GlusterFS%203.7/Small%20File%20Performance/index.html?highlight=small%20file%20performance Am 24.07.2015 um 20:15 schrieb Mathieu Chateau: > Hello, > > gluster performance are not good with large number of small files. > Recent version do a better job with them, but not yet what I would enjoy. > > As you are starting at gluster having an existing architecture, you > should first setup a lab to learn about it Else you will learn the hard way. > Don't play with turning off nodes, as you may create more issues than solve. > > just my 2cents > > Cordialement, > Mathieu CHATEAU > http://www.lotp.fr > > 2015-07-24 19:34 GMT+02:00 John Kennedy <skebi69@xxxxxxxxx > <mailto:skebi69@xxxxxxxxx>>: > > I am new to Gluster and have not found anything useful from my > friend Google. I have not dealt with physical hardware in a few > years (my last few jobs have been VM's and AWS based) > > I inherited a 4 node gluster configuration. There are 2 bricks, one > is 9TB the other 11TB. > > The 11TB brick has a HUGE number of small files taking up only 1.3TB > of the brick. For some reason, even a simple ls command can take > hours to even start listing files. I removed a node by shutting down > gluster on that node. The change in performance is dramatic. If I > try and do ls on the 11TB brick on the downed node, I am still > getting the slow response. I have narrowed the issue down to this > one node as a result. > > When I start gluster on the bad node, glusterfsd hits over 1000%CPU > use (The server has dual 8 core CPU's) and the load will jump to > 25-30 within 5 minutes. As such, I think this is a gluster issue and > not a hardware issue. I am trying to not reinstall gluster yet. > > Is there something I am missing in my checks or will I need to > reinstall gluster on that node? > > Thanks, > John > > John Kennedy (_8(|) > Sometimes it happens, sometimes it doesn't - Pedro Catacora > > Just because nobody disagrees with you doesn't mean you are correct. > > Anatidaephobia is the fear that somehow, somewhere a duck is > watching you - urbandictionary.com <http://urbandictionary.com> > > The Dunning-Kruger effect occurs when incompetent people not only > fail to realize their incompetence, but consider themselves much > more competent than everyone else. Basically - they're too stupid to > know that they're stupid. > > _______________________________________________ > Gluster-users mailing list > Gluster-users@xxxxxxxxxxx <mailto:Gluster-users@xxxxxxxxxxx> > http://www.gluster.org/mailman/listinfo/gluster-users > > > > > _______________________________________________ > Gluster-users mailing list > Gluster-users@xxxxxxxxxxx > http://www.gluster.org/mailman/listinfo/gluster-users > -- Mit freundlichen Grüßen André Bauer MAGIX Software GmbH André Bauer Administrator August-Bebel-Straße 48 01219 Dresden GERMANY tel.: 0351 41884875 e-mail: abauer@xxxxxxxxx abauer@xxxxxxxxx <mailto:Email> www.magix.com <http://www.magix.com/> Geschäftsführer | Managing Directors: Dr. Arnd Schröder, Michael Keith Amtsgericht | Commercial Register: Berlin Charlottenburg, HRB 127205 Find us on: <http://www.facebook.com/MAGIX> <http://www.twitter.com/magix_de> <http://www.youtube.com/wwwmagixcom> <http://www.magixmagazin.de> ---------------------------------------------------------------------- The information in this email is intended only for the addressee named above. Access to this email by anyone else is unauthorized. If you are not the intended recipient of this message any disclosure, copying, distribution or any action taken in reliance on it is prohibited and may be unlawful. MAGIX does not warrant that any attachments are free from viruses or other defects and accepts no liability for any losses resulting from infected email transmissions. Please note that any views expressed in this email may be those of the originator and do not necessarily represent the agenda of the company. ---------------------------------------------------------------------- _______________________________________________ Gluster-users mailing list Gluster-users@xxxxxxxxxxx http://www.gluster.org/mailman/listinfo/gluster-users
