Rsync

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



Hi Hiren,
What glusterfs version are you using? Can you send us the volfiles and the log files.

Pavan

On 22/09/09 16:01 +0100, Hiren Joshi wrote:
> I forgot to mention, the mount is mounted with direct-io, would this
> make a difference? 
> 
> > -----Original Message-----
> > From: gluster-users-bounces at gluster.org 
> > [mailto:gluster-users-bounces at gluster.org] On Behalf Of Hiren Joshi
> > Sent: 22 September 2009 11:40
> > To: gluster-users at gluster.org
> > Subject: Rsync
> > 
> > Hello all,
> >  
> > I'm getting what I think is bizarre behaviour.... I have about 400G to
> > rsync (rsync -av) onto a gluster share, the data is in a directory
> > structure which has about 1000 directories per parent and about 1000
> > directories in each of them.
> >  
> > When I try to rsync an end leaf directory (this has about 4 
> > dirs and 100
> > files in each) the operation takes about 10 seconds. When I 
> > go one level
> > above (1000 dirs with about 4 dirs in each with about 100 
> > files in each)
> > the operation takes about 10 minutes.
> >  
> > Now, if I then go one level above that (that's 1000 dirs with 
> > 1000 dirs
> > in each with about 4 dirs in each with about 100 files in each) the
> > operation takes days! Top shows glusterfsd takes 300-600% cpu usage
> > (2X4core), I have about 48G of memory (usage is 0% as expected).
> >  
> > Has anyone seen anything like this? How can I speed it up?
> >  
> > Thanks,
> >  
> > Josh.
> > 
> _______________________________________________
> Gluster-users mailing list
> Gluster-users at gluster.org
> http://gluster.org/cgi-bin/mailman/listinfo/gluster-users


[Index of Archives]     [Gluster Development]     [Linux Filesytems Development]     [Linux ARM Kernel]     [Linux ARM]     [Linux Omap]     [Fedora ARM]     [IETF Annouce]     [Bugtraq]     [Linux OMAP]     [Linux MIPS]     [eCos]     [Asterisk Internet PBX]     [Linux API]

  Powered by Linux