On Mon, 2003-07-28 at 16:17, Robert G. Brown wrote: ... > wget is pretty simple as well, but you have to tell it to decend > recursively to an appropriate depth or use the --mirror option. > Something like: > > wget --mirror http://whatever.repository.youlike.org -o > /tmp/mirror_log Yeah, that doesn't work quite right. Without parameter fiddling, I get non-repository files (.html, etc) as well as it may go UP the url and continue to suck down. I didn't realize this until I pulled down 3+ gig from Duke... had stuff like 7.x updates to (useless to me, as we have no <8 machines)... luckily we get like a megabyte a second from you guys. Also, I don't think wget has the guts to actually remove files that are no longer on the repository. > > should do it. You have to look to see if rsync works for each > repository you might want to mirror. Where it works it is "better". It > is also reasonable to ask permission before mirroring regularly from a > public repository that doesn't already grant it openly. Some sites have > spare bandwidth and a public-spiritedness, others don't. I've never used rsync, but I don't think I can use it here. Our heavily DMZ'ed public http server can really only do HTTP requests, and even those I back tunnel over ssh to a proxy. I think I'm restricted to HTTP-pure mirroring techniques. -- // Aleksander.Demko@xxxxxxxxxxxxxx ademko@xxxxxx scopira.org //
