On Sun, 22 Jun 2008, Raja Subramanian wrote:
On Sun, Jun 22, 2008 at 3:36 AM, Rainer Duffner <rainer@xxxxxxxxxxxxxxx> wrote:
Now that I know the details - I don' think this is going to work. Not with
100 TB of data. It kind-of-works with 1 TB.
Can anybody comment on the feasibility of rsync on 1 million files?
rsync always broke on my filesystems with 200-300k files
due to out of memory errors (my box had 2GB RAM).
I have done 700k and 800k files transfers (including hardlinks), but
indeed it could take a while to compute the transferlist. Newer rsync
versions bring down the amount of memory needed drastically. That is one
of the reasons I offer a recent rsync in RPMforge. There is almost never a
good reason to use a dated rsync.
--
-- dag wieers, dag@xxxxxxxxxx, http://dag.wieers.com/ --
[Any errors in spelling, tact or fact are transmission errors]
_______________________________________________
CentOS mailing list
CentOS@xxxxxxxxxx
http://lists.centos.org/mailman/listinfo/centos
