Re: disable wget-like user-agents

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



----- "Mark Montague" <mark@xxxxxxxxxxx> wrote:

> On January 4, 2011 22:32 , Carlos S <neubyr@xxxxxxxxx> wrote:
> > Recently I was trying to download a package using wget, but the
> > website prevented access to it. I tried --user-agent  option but it
> > didn't work either. So I was curious to know what strategy this web
> > admin must have implemented.
> 
> Without an example URL, I can only speculate, but the ideas that come
> to 
> mind first are denying the download unless a cookie is set (you could

i.galic@panic ~ % wget --help | grep cook
       --no-cookies            donât use cookies.
       --load-cookies=FILE     load cookies from FILE before session.
       --save-cookies=FILE     save cookies to FILE after session.
       --keep-session-cookies  load and save session (non-permanent) cookies.
i.galic@panic ~ %                             
 
> get quite complex with this, such as setting the cookie via
> JavaScript, 

Yup.. that (JS) would kill off wget.. but also many other (sensible) clients

> which wget won't execute), checking the referrer header, or other 

i.galic@panic ~ % wget --help | grep -i referer
       --referer=URL           include âReferer: URLâ header in HTTP request.
i.galic@panic ~ %

> JavaScript based checks.

i

> --
>    Mark Montague
>    mark@xxxxxxxxxxx

i

-- 
Igor GaliÄ

Tel: +43 (0) 664 886 22 883
Mail: i.galic@xxxxxxxxxxxxxx
URL: http://brainsware.org/

---------------------------------------------------------------------
The official User-To-User support forum of the Apache HTTP Server Project.
See <URL:http://httpd.apache.org/userslist.html> for more info.
To unsubscribe, e-mail: users-unsubscribe@xxxxxxxxxxxxxxxx
   "   from the digest: users-digest-unsubscribe@xxxxxxxxxxxxxxxx
For additional commands, e-mail: users-help@xxxxxxxxxxxxxxxx




[Index of Archives]     [Open SSH Users]     [Linux ACPI]     [Linux Kernel]     [Linux Laptop]     [Kernel Newbies]     [Security]     [Netfilter]     [Bugtraq]     [Squid]     [Yosemite News]     [MIPS Linux]     [ARM Linux]     [Linux Security]     [Linux RAID]     [Samba]     [Video 4 Linux]     [Device Mapper]

  Powered by Linux