Search squid archive

Re: Squid proxy: big initial delay with certain pages

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



On 29/10/10 22:02, Gianni Costanzi wrote:
Hi,
I've noticed a very bad problem with my squid installation... it seems
to work without errors (nothing wrong in the log files), but when I
load some sites as www.repubblica.it my browser shows a blank page and
it says "waiting for oas.repubblica.it".. after several seconds (more
than 20 secs, which means eternity in this case), the site shows up
immediately (almost everything is loaded, something still loads after
a while but the most important parts of the page are loaded).. I've
looked at the access.log file and the first line I can see after the
initial long delay is:

1288281355.044  63243 10.1.0.1 TCP_MISS/503 4996 GET
http://oas.repubblica.it/RealMedia/ads/adstream_mjx.ads/repubblica.it/nz/home/1004754881@Position3,Position2,Top3,Top2,Top1,Middle1,TopLeft,Right1,Middle2,Left,Left1,Left2,Top,x61,x62,x63,x41,x42,x43,x44,x45,x46,Position1
- DIRECT/194.244.107.100 text/html

So there are problems with the oas.repubblica.it links... how can I
avoid squid getting stuck on some links?

Depends on what the 503 is coming from. It is unclear at this stage.

Can I tell him to load more
than a link in parallel?

Squid regularly loads several hundred in parallel. Any problems with parallel requests are in your browser or in the website server.

Can I set a timeout? Can you do a test with

http://www.squid-cache.org/Doc/config/connect_timeout

the same site and tell me which is the result of your test? If I load
the same page without going through squid, it is loaded quickly
without any delay..

These are the options I've set in /etc/squid/squid.conf (I've
experienced the same with both squid and squid3 proxies):

acl manager proto cache_object
acl localhost src 127.0.0.1/32 ::1
acl to_localhost dst 127.0.0.0/8 0.0.0.0/32 ::1
acl localnet src 10.0.0.0/8     # RFC1918 possible internal network
acl SSL_ports port 443
acl Safe_ports port 80          # http
acl Safe_ports port 21          # ftp
acl Safe_ports port 443         # https
acl Safe_ports port 70          # gopher
acl Safe_ports port 210         # wais
acl Safe_ports port 1025-65535  # unregistered ports
acl Safe_ports port 280         # http-mgmt
acl Safe_ports port 488         # gss-http
acl Safe_ports port 591         # filemaker
acl Safe_ports port 777         # multiling http
acl CONNECT method CONNECT
http_access allow manager localhost localnet
http_access deny manager
http_access deny !Safe_ports
http_access deny CONNECT !SSL_ports
http_access allow localnet
http_access allow localhost
http_access deny all
http_port 3128
hierarchy_stoplist cgi-bin ?
cache_mem 32 MB  # -->  (I can not give squid a bigger amount of
memory, but I don't think it is a problem)
maximum_object_size_in_memory 10 MB
cache_dir aufs /var/spool/squid3 100 16 256
coredump_dir /var/spool/squid3
refresh_pattern ^ftp:           1440    20%     10080
refresh_pattern ^gopher:        1440    0%      1440
refresh_pattern -i (/cgi-bin/|\?) 0     0%      0
refresh_pattern .               0       20%     4320
dns_nameservers 127.0.0.1
forwarded_for transparent  # (I've also tried with "on" instead of
"transparent")

A workaround is to add two lines like the following ones before
"http_access allow localnet":
acl REP_REAL url_regex -i oas\.repubblica\.it/RealMedia
http_access deny REP_REAL

but I don't like it very much.... I'd like to understand why squid
isn't able to load that link..

You could try loading it through squidclient and see what happens...
squidclient -h oas.repubblica.it -j oas.repubblica.it -p 80 -v /RealMedia ...

If that is not clear try redbot.org and/or a tcpdump of the traffic between squid and the web server.


BTW, I have "Squid Cache version 2.7.STABLE9" on Ubuntu 10.10

Thank you very much!


Amos
--
Please be using
  Current Stable Squid 2.7.STABLE9 or 3.1.8
  Beta testers wanted for 3.2.0.2


[Index of Archives]     [Linux Audio Users]     [Samba]     [Big List of Linux Books]     [Linux USB]     [Yosemite News]

  Powered by Linux