Re: rsync optimization

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]




 
We are now doing on the work to reduce the amount of images that would be compared before rsync many of which maybe aready exist on the receiving end.
After we do a successful rsync, we log the images transfered, and we use another script to delete them on the send end. And that turns out to be helpful in this case.
 
 
 
2010-01-12

xufengnju

发件人: Kwan Lowe
发送时间: 2010-01-11  21:14:58
收件人: CentOS mailing list
抄送:
主题: Re: [CentOS] rsync optimization
On Mon, Jan 11, 2010 at 4:36 AM, xufengnju <xufengnju@xxxxxxxx> wrote:
> Hi,
>
> We currently have upload servers in one data center(A), and users upload the
> images there. We have storage server in another data center(B). When users
> upload many images at the same time, we face sync difficulties.
>
> On B, we use rsync in server mode, with authentication.
> On A, we use  `rsync -azpogtRv --safe-links 1/
> rsync://user@serverB/img/ --password-file=/var/www/r.passwd `
>
> Both ends run centos 5.3 X86_64.
>
> Any suggestions to optimize rsync in this case?
You can add the following options:
--ignore-times
--delay-updates
The first will speed up the comparison. The second can prevent some
errors related to synchronization on the receiving side.
BTW, have you considered using a DRBD volume with GFS?  This might
work better than rsync, depending on your configuration.
_______________________________________________
CentOS mailing list
CentOS@xxxxxxxxxx
http://lists.centos.org/mailman/listinfo/centos
_______________________________________________
CentOS mailing list
CentOS@xxxxxxxxxx
http://lists.centos.org/mailman/listinfo/centos

[Index of Archives]     [CentOS]     [CentOS Announce]     [CentOS Development]     [CentOS ARM Devel]     [CentOS Docs]     [CentOS Virtualization]     [Carrier Grade Linux]     [Linux Media]     [Asterisk]     [DCCP]     [Netdev]     [Xorg]     [Linux USB]
  Powered by Linux