Orion Poplawski wrote, at 03/12/2008 04:58 AM +9:00:
Michael Schwendt wrote:Examine the contents of the robots.txt file.And wget -e robots=off to ignore...
This actually works. Thank you, Michael and Orion! Regards, Mamoru -- fedora-devel-list mailing list fedora-devel-list@xxxxxxxxxx https://www.redhat.com/mailman/listinfo/fedora-devel-list