Hi joe, Eliezer, Amos.. today I saw something different regarding high
bandwidth and caching of windows updates ranged requests..
A client begins a windows update, it does a:
HEAD to check size or something, which is ok..
then a ranged GET, which outputs a TCP_MISS/206,
then the next GET gives a TCP_SWAPFAIL_MISS/206.
Lots of other TCP_MISS/206, then in the end, TCP_MISS_ABORTED/000
A big amount of parallel connections are being made because of each
GET.. ok, I know squid can't do much about it.. but then, why the
content does not get cached in the end?
I mean, the way it is, it will happen every day.. are these
"TCP_MISS_ABORTED" really the client aborting the download? I doubt it...
Take a look and see if you can understand:
[Tue Mar 15 12:36:12 2016].159 95 10.88.100.100 TCP_MISS/200 508
HEAD
http://fg.v4.download.windowsupdate.com/msdownload/update/software/crup/2012/11/windows8-rt-kb2769165-x64_e97d07dda97d56be1561ece773aaff90fb61f7e6.psf
- HIER_DIRECT/13.107.4.50 application/octet-stream
[Tue Mar 15 12:36:36 2016].321 23798 10.88.100.100 TCP_MISS/206 5441
GET
http://fg.v4.download.windowsupdate.com/msdownload/update/software/crup/2012/11/windows8-rt-kb2769165-x64_e97d07dda97d56be1561ece773aaff90fb61f7e6.psf
- HIER_DIRECT/13.107.4.50 application/octet-stream
[Tue Mar 15 12:37:00 2016].353 24026 10.88.100.100
TCP_SWAPFAIL_MISS/206 14155 GET
http://fg.v4.download.windowsupdate.com/msdownload/update/software/crup/2012/11/windows8-rt-kb2769165-x64_e97d07dda97d56be1561ece773aaff90fb61f7e6.psf
- HIER_DIRECT/13.107.4.50 application/octet-stream
[Tue Mar 15 12:37:39 2016].293 38939 10.88.100.100 TCP_MISS/206 22954
GET
http://fg.v4.download.windowsupdate.com/msdownload/update/software/crup/2012/11/windows8-rt-kb2769165-x64_e97d07dda97d56be1561ece773aaff90fb61f7e6.psf
- HIER_DIRECT/13.107.4.50 application/octet-stream
[Tue Mar 15 12:38:04 2016].711 25415 10.88.100.100 TCP_MISS/206 31488
GET
http://fg.v4.download.windowsupdate.com/msdownload/update/software/crup/2012/11/windows8-rt-kb2769165-x64_e97d07dda97d56be1561ece773aaff90fb61f7e6.psf
- HIER_DIRECT/13.107.4.50 application/octet-stream
[Tue Mar 15 12:38:40 2016].959 36243 10.88.100.100 TCP_MISS/206 33880
GET
http://fg.v4.download.windowsupdate.com/msdownload/update/software/crup/2012/11/windows8-rt-kb2769165-x64_e97d07dda97d56be1561ece773aaff90fb61f7e6.psf
- HIER_DIRECT/13.107.4.50 application/octet-stream
[Tue Mar 15 12:39:19 2016].051 38089 10.88.100.100 TCP_MISS/206 38228
GET
http://fg.v4.download.windowsupdate.com/msdownload/update/software/crup/2012/11/windows8-rt-kb2769165-x64_e97d07dda97d56be1561ece773aaff90fb61f7e6.psf
- HIER_DIRECT/13.107.4.50 application/octet-stream
[Tue Mar 15 12:39:27 2016].767 8714 10.88.100.100 TCP_MISS/206 38826
GET
http://fg.v4.download.windowsupdate.com/msdownload/update/software/crup/2012/11/windows8-rt-kb2769165-x64_e97d07dda97d56be1561ece773aaff90fb61f7e6.psf
- HIER_DIRECT/13.107.4.50 application/octet-stream
[Tue Mar 15 12:40:36 2016].177 68404 10.88.100.100 TCP_MISS/206 42085
GET
http://fg.v4.download.windowsupdate.com/msdownload/update/software/crup/2012/11/windows8-rt-kb2769165-x64_e97d07dda97d56be1561ece773aaff90fb61f7e6.psf
- HIER_DIRECT/13.107.4.50 application/octet-stream
[Tue Mar 15 12:43:01 2016].193 145011 10.88.100.100 TCP_MISS/206 47404
GET
http://fg.v4.download.windowsupdate.com/msdownload/update/software/crup/2012/11/windows8-rt-kb2769165-x64_e97d07dda97d56be1561ece773aaff90fb61f7e6.psf
- HIER_DIRECT/13.107.4.50 application/octet-stream
[Tue Mar 15 12:44:06 2016].563 65368 10.88.100.100 TCP_MISS/206 52196
GET
http://fg.v4.download.windowsupdate.com/msdownload/update/software/crup/2012/11/windows8-rt-kb2769165-x64_e97d07dda97d56be1561ece773aaff90fb61f7e6.psf
- HIER_DIRECT/13.107.4.50 application/octet-stream
[Tue Mar 15 12:45:58 2016].017 111451 10.88.100.100 TCP_MISS/206 52577
GET
http://fg.v4.download.windowsupdate.com/msdownload/update/software/crup/2012/11/windows8-rt-kb2769165-x64_e97d07dda97d56be1561ece773aaff90fb61f7e6.psf
- HIER_DIRECT/13.107.4.50 application/octet-stream
[Tue Mar 15 12:47:18 2016].578 80558 10.88.100.100 TCP_MISS/206 51278
GET
http://fg.v4.download.windowsupdate.com/msdownload/update/software/crup/2012/11/windows8-rt-kb2769165-x64_e97d07dda97d56be1561ece773aaff90fb61f7e6.psf
- HIER_DIRECT/13.107.4.50 application/octet-stream
[Tue Mar 15 12:49:44 2016].069 145484 10.88.100.100 TCP_MISS/206 52524
GET
http://fg.v4.download.windowsupdate.com/msdownload/update/software/crup/2012/11/windows8-rt-kb2769165-x64_e97d07dda97d56be1561ece773aaff90fb61f7e6.psf
- HIER_DIRECT/13.107.4.50 application/octet-stream
[Tue Mar 15 12:50:41 2016].665 57594 10.88.100.100 TCP_MISS/206 53211
GET
http://fg.v4.download.windowsupdate.com/msdownload/update/software/crup/2012/11/windows8-rt-kb2769165-x64_e97d07dda97d56be1561ece773aaff90fb61f7e6.psf
- HIER_DIRECT/13.107.4.50 application/octet-stream
[Tue Mar 15 12:51:50 2016].167 68500 10.88.100.100 TCP_MISS/206 58537
GET
http://fg.v4.download.windowsupdate.com/msdownload/update/software/crup/2012/11/windows8-rt-kb2769165-x64_e97d07dda97d56be1561ece773aaff90fb61f7e6.psf
- HIER_DIRECT/13.107.4.50 application/octet-stream
[Tue Mar 15 12:52:53 2016].939 63769 10.88.100.100 TCP_MISS/206 56951
GET
http://fg.v4.download.windowsupdate.com/msdownload/update/software/crup/2012/11/windows8-rt-kb2769165-x64_e97d07dda97d56be1561ece773aaff90fb61f7e6.psf
- HIER_DIRECT/13.107.4.50 application/octet-stream
[Tue Mar 15 12:57:57 2016].547 303606 10.88.100.100 TCP_MISS_ABORTED/206
497 GET
http://fg.v4.download.windowsupdate.com/msdownload/update/software/crup/2012/11/windows8-rt-kb2769165-x64_e97d07dda97d56be1561ece773aaff90fb61f7e6.psf
- HIER_DIRECT/192.221.249.30 application/octet-stream
[Tue Mar 15 13:02:57 2016].710 300097 10.88.100.100 TCP_MISS_ABORTED/206
418 GET
http://fg.v4.download.windowsupdate.com/msdownload/update/software/crup/2012/11/windows8-rt-kb2769165-x64_e97d07dda97d56be1561ece773aaff90fb61f7e6.psf
- HIER_DIRECT/8.253.0.46 application/octet-stream
[Tue Mar 15 13:03:27 2016].687 29942 10.88.100.100 TCP_MISS/206 62378
GET
http://fg.v4.download.windowsupdate.com/msdownload/update/software/crup/2012/11/windows8-rt-kb2769165-x64_e97d07dda97d56be1561ece773aaff90fb61f7e6.psf
- HIER_DIRECT/192.221.249.30 application/octet-stream
[Tue Mar 15 13:04:01 2016].689 34000 10.88.100.100 TCP_MISS/206 57075
GET
http://fg.v4.download.windowsupdate.com/msdownload/update/software/crup/2012/11/windows8-rt-kb2769165-x64_e97d07dda97d56be1561ece773aaff90fb61f7e6.psf
- HIER_DIRECT/192.221.249.30 application/octet-stream
[Tue Mar 15 13:09:01 2016].738 300046 10.88.100.100 TCP_MISS_ABORTED/206
497 GET
http://fg.v4.download.windowsupdate.com/msdownload/update/software/crup/2012/11/windows8-rt-kb2769165-x64_e97d07dda97d56be1561ece773aaff90fb61f7e6.psf
- HIER_DIRECT/192.221.249.30 application/octet-stream
[Tue Mar 15 13:11:49 2016].704 167900 10.88.100.100 TCP_MISS/206 57270
GET
http://fg.v4.download.windowsupdate.com/msdownload/update/software/crup/2012/11/windows8-rt-kb2769165-x64_e97d07dda97d56be1561ece773aaff90fb61f7e6.psf
- HIER_DIRECT/13.107.4.50 application/octet-stream
[Tue Mar 15 13:15:06 2016].538 196832 10.88.100.100 TCP_MISS/206 57365
GET
http://fg.v4.download.windowsupdate.com/msdownload/update/software/crup/2012/11/windows8-rt-kb2769165-x64_e97d07dda97d56be1561ece773aaff90fb61f7e6.psf
- HIER_DIRECT/13.107.4.50 application/octet-stream
[Tue Mar 15 13:19:22 2016].963 256422 10.88.100.100 TCP_MISS/206 57458
GET
http://fg.v4.download.windowsupdate.com/msdownload/update/software/crup/2012/11/windows8-rt-kb2769165-x64_e97d07dda97d56be1561ece773aaff90fb61f7e6.psf
- HIER_DIRECT/13.107.4.50 application/octet-stream
[Tue Mar 15 13:20:06 2016].187 43222 10.88.100.100 TCP_MISS/206 57483
GET
http://fg.v4.download.windowsupdate.com/msdownload/update/software/crup/2012/11/windows8-rt-kb2769165-x64_e97d07dda97d56be1561ece773aaff90fb61f7e6.psf
- HIER_DIRECT/192.221.249.30 application/octet-stream
[Tue Mar 15 13:25:06 2016].054 299865 10.88.100.100 TCP_MISS_ABORTED/206
497 GET
http://fg.v4.download.windowsupdate.com/msdownload/update/software/crup/2012/11/windows8-rt-kb2769165-x64_e97d07dda97d56be1561ece773aaff90fb61f7e6.psf
- HIER_DIRECT/192.221.249.30 application/octet-stream
[Tue Mar 15 13:25:15 2016].625 9490 10.88.100.100 TCP_MISS/206 57707
GET
http://fg.v4.download.windowsupdate.com/msdownload/update/software/crup/2012/11/windows8-rt-kb2769165-x64_e97d07dda97d56be1561ece773aaff90fb61f7e6.psf
- HIER_DIRECT/13.107.4.50 application/octet-stream
[Tue Mar 15 13:25:32 2016].250 16624 10.88.100.100 TCP_MISS/206 58530
GET
http://fg.v4.download.windowsupdate.com/msdownload/update/software/crup/2012/11/windows8-rt-kb2769165-x64_e97d07dda97d56be1561ece773aaff90fb61f7e6.psf
- HIER_DIRECT/13.107.4.50 application/octet-stream
[Tue Mar 15 13:30:33 2016].158 300906 10.88.100.100 TCP_MISS_ABORTED/206
571 GET
http://fg.v4.download.windowsupdate.com/msdownload/update/software/crup/2012/11/windows8-rt-kb2769165-x64_e97d07dda97d56be1561ece773aaff90fb61f7e6.psf
- HIER_DIRECT/13.107.4.50 application/octet-stream
[Tue Mar 15 13:41:26 2016].875 42 10.88.100.100 TCP_MISS_ABORTED/000
0 GET
http://fg.v4.download.windowsupdate.com/msdownload/update/software/crup/2012/11/windows8-rt-kb2769165-x64_e97d07dda97d56be1561ece773aaff90fb61f7e6.psf
- HIER_DIRECT/8.253.0.46 -
Best Regards,
--
Heiler Bemerguy - (91) 98151-4894
Assessor Técnico - CINBESA (91) 3184-1751
Em 14/03/2016 11:32, Heiler Bemerguy escreveu:
Hi Eliezer and Joe!!!
Thank you very much for your support.
I have done a test here too. I've replaced 3.5.15 with 3.5.14 and the
high bandwidth (associated with SWAPFAIL) is GONE.
I've checked twice the sources diffs between 14 and 15 and can't tell
what break this.. but I'm running 3.5.14 for 3 days without any
download-loop sucking all our bandwidth.
I'm still having a SWAPFAIL here and there, and a lot of MISSES for
files that should have been cached... but no high bandwidth !!
access.log:
1457958469.926 152 10.101.1.163 TCP_MISS/206 6674 GET
http://au.download.windowsupdate.com/c/msdownload/update/software/uprl/2016/03/windows-kb890830-v5.34_1a3d7e16cc62bb4fc4322eabde9cd8c9605f33ce.exe
- HIER_DIRECT/13.107.4.50 application/octet-stream
1457958474.598 356 10.101.1.163 TCP_SWAPFAIL_MISS/206 9142 GET
http://au.download.windowsupdate.com/c/msdownload/update/software/uprl/2016/03/windows-kb890830-v5.34_1a3d7e16cc62bb4fc4322eabde9cd8c9605f33ce.exe
- HIER_DIRECT/13.107.4.50 application/octet-stream
1457958478.292 676 10.101.1.163 TCP_MISS/206 10509 GET
http://au.download.windowsupdate.com/c/msdownload/update/software/uprl/2016/03/windows-kb890830-v5.34_1a3d7e16cc62bb4fc4322eabde9cd8c9605f33ce.exe
- HIER_DIRECT/13.107.4.50 application/octet-stream
1457958481.165 220 10.101.1.163 TCP_MISS/206 11681 GET
http://au.download.windowsupdate.com/c/msdownload/update/software/uprl/2016/03/windows-kb890830-v5.34_1a3d7e16cc62bb4fc4322eabde9cd8c9605f33ce.exe
- HIER_DIRECT/13.107.4.50 application/octet-stream
1457958483.012 958 10.101.1.163 TCP_MISS/206 14003 GET
http://au.download.windowsupdate.com/c/msdownload/update/software/uprl/2016/03/windows-kb890830-v5.34_1a3d7e16cc62bb4fc4322eabde9cd8c9605f33ce.exe
- HIER_DIRECT/13.107.4.50 application/octet-stream
1457958484.334 1155 10.101.1.163 TCP_MISS/206 19973 GET
http://au.download.windowsupdate.com/c/msdownload/update/software/uprl/2016/03/windows-kb890830-v5.34_1a3d7e16cc62bb4fc4322eabde9cd8c9605f33ce.exe
- HIER_DIRECT/13.107.4.50 application/octet-stream
1457958485.967 1630 10.101.1.163 TCP_MISS/206 33511 GET
http://au.download.windowsupdate.com/c/msdownload/update/software/uprl/2016/03/windows-kb890830-v5.34_1a3d7e16cc62bb4fc4322eabde9cd8c9605f33ce.exe
- HIER_DIRECT/13.107.4.50 application/octet-stream
1457958488.804 2835 10.101.1.163 TCP_MISS/206 37266 GET
http://au.download.windowsupdate.com/c/msdownload/update/software/uprl/2016/03/windows-kb890830-v5.34_1a3d7e16cc62bb4fc4322eabde9cd8c9605f33ce.exe
- HIER_DIRECT/13.107.4.50 application/octet-stream
1457958492.630 3824 10.101.1.163 TCP_MISS/206 43918 GET
http://au.download.windowsupdate.com/c/msdownload/update/software/uprl/2016/03/windows-kb890830-v5.34_1a3d7e16cc62bb4fc4322eabde9cd8c9605f33ce.exe
- HIER_DIRECT/13.107.4.50 application/octet-stream
1457958498.908 6274 10.101.1.163 TCP_MISS/206 93504 GET
http://au.download.windowsupdate.com/c/msdownload/update/software/uprl/2016/03/windows-kb890830-v5.34_1a3d7e16cc62bb4fc4322eabde9cd8c9605f33ce.exe
- HIER_DIRECT/13.107.4.50 application/octet-stream
1457958505.432 6523 10.101.1.163 TCP_MISS/206 72478 GET
http://au.download.windowsupdate.com/c/msdownload/update/software/uprl/2016/03/windows-kb890830-v5.34_1a3d7e16cc62bb4fc4322eabde9cd8c9605f33ce.exe
- HIER_DIRECT/13.107.4.50 application/octet-stream
conf:
cache_mem 4 GB
maximum_object_size_in_memory 512 KB
memory_replacement_policy heap GDSF
cache_replacement_policy heap LFUDA
maximum_object_size 10 GB
cache_dir rock /cache2/rock1 90000 min-size=0 max-size=32768
cache_dir rock /cache/rock1 150000 min-size=32769 max-size=5368725504
cache_dir rock /cache/rock2 150000 min-size=5368725505
max-size=10737418240
acl wupdatecachable url_regex -i
(microsoft|windowsupdate)\.com.*\.(cab|exe|ms[i|u|f]|dat|zip|psf|appx|appxbundle|esd)
range_offset_limit -1 wupdatecachable
quick_abort_pct 90
refresh_pattern -i
(microsoft|windowsupdate)\.com.*\.(cab|exe|ms[i|u|f]|dat|zip|psf|appx|appxbundle|esd)
483840 80% 483840 override-expire ignore-private ignore-no-store
Best Regards,
_______________________________________________
squid-users mailing list
squid-users@xxxxxxxxxxxxxxxxxxxxx
http://lists.squid-cache.org/listinfo/squid-users
