Re: How to speed up Rsync transfers

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]



--- Dan Carl <danc@xxxxxxxxxxxxxxxxx> wrote:

> 
> ----- Original Message ----- 
> From: "William L. Maltby" <CentOS4Bill@xxxxxxxxxxxx>
> To: "CentOS General List" <centos@xxxxxxxxxx>
> Sent: Saturday, February 23, 2008 12:32 PM
> Subject: Re:  How to speed up Rsync
> transfers
> 
> 
> > On Sat, 2008-02-23 at 10:38 -0600, Dan Carl wrote:
> >> ----- Original Message ----- 
> >> From: "nate" <centos@xxxxxxxxxxxxxxxx>
> >> To: <centos@xxxxxxxxxx>
> >> Sent: Friday, February 22, 2008 10:33 PM
> >> Subject: RE:  How to speed up Rsync
> transfers
> >>
> >>
> >> > Dan Carl wrote:
> >> ><snip>
> >
> >> > - Do you know what sort of bandwidth your
> "supposed" to have from your
> >> >  ISP?
> >> source server business DSL 1.5m down / 878k up
> >> distination server T1 colo at a large ISP.
> >> >
> >> > nate
> >> Sounds like I'll be stuck with the tranfer rate
> I'm getting.
> >
> > In that case, it sounds like you need a local
> staging that can be
> > quickly done before starting upload sync. Then the
> upload can run 24/7.
> > How you might want to deal with new updates that
> happen before the
> > previous upload finishes is going to be an
> interesting problem.
> >
> This is exactly the situation I'm trying to avoid.
> Right now its less than 2GB new/edited images a day
> so the rsync backup 
> finishes before the script runs again.
> But I can't take it for granted that this will
> always be the case.
> Any ideas would be appreciated. What do you mean by
> local staging?
> I'd like the backup to run from 7pm to 7am and then
> if it didn't finish to 
> resume again the next night.
> That way when nothing was added/edited on the
> weekends the backup can catch 
> up.
> Dan 
> 
> _______________________________________________
> CentOS mailing list
> CentOS@xxxxxxxxxx
> http://lists.centos.org/mailman/listinfo/centos
> 
maybe an idea but could you not do a cron job at 0700
to check to see if there is an rsync running if there
is then kill it and what was not finished will be
picked up the next time. 

my .000000000002 cents
_______________________________________________
CentOS mailing list
CentOS@xxxxxxxxxx
http://lists.centos.org/mailman/listinfo/centos

[Index of Archives]     [CentOS]     [CentOS Announce]     [CentOS Development]     [CentOS ARM Devel]     [CentOS Docs]     [CentOS Virtualization]     [Carrier Grade Linux]     [Linux Media]     [Asterisk]     [DCCP]     [Netdev]     [Xorg]     [Linux USB]
  Powered by Linux