-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 On Fri, 1 Jun 2007 14:37:35 +0200 (CEST) "Thomas Falkeborg" <thomas@xxxxxxxxxxxx> wrote: > Hi folks, > i'm running squid for about 30 users with a very close to standard setup. > The proxy is transparrent to the users. I increased the cache size to 14 G > and have allocated about 512 mb ram. Apart from that the conf is standard. > > Below I enclose a "calamaris statistic report", which is where my trouble > begins. I often have a negative average speed increase, and my byte hit > ratio is bad - approxematly 3-5 % allthough I get a good request hit > ratio. > > My hope is that anyone by looking at the report can help me improve the > overall proxy performance. If needed I'll enclose the squid.conf file. > > # Summary > Calamaris statistics > --------------------------------------------------------- -------------- > ------ > lines parsed: lines > 126047 > invalid lines: lines > 0 > parse time: sec > 41 > parse speed: lines/sec > 3074 > --------------------------------------------------------- -------------- > ------ > Proxy statistics > --------------------------------------------------------- -------------- > ------ > Total amount: requests > 126047 > unique hosts/users: hosts > 34 > Total Bandwidth: Byte > 3360M > Proxy efficiency (HIT [kB/sec] / DIRECT [kB/sec]): factor > 0.66 > Average speed increase: % > -2.28 > TCP response time of 100% requests: msec > 755 > --------------------------------------------------------- -------------- > ------ > Cache statistics > --------------------------------------------------------- -------------- > ------ > Total amount cached: requests > 47735 > Request hit rate: % > 37.87 > Bandwidth savings: Byte > 150M > Bandwidth savings in Percent (Byte hit rate): % > 4.47 > Average cached object size: Byte > 3299 > Average direct object size: Byte > 42980 > Average object size: Byte > 27952 > --------------------------------------------------------- -------------- > ------ > > > # Incoming requests by method > method request % sec/req Byte % > kB/sec > ------------------------------ --------- ------ ------- -------- ------ > ------- > GET 123481 97.96 0.75 3433347K 99.79 > 36.99 > POST 2294 1.82 0.99 7395777 0.21 > 3.19 > HEAD 235 0.19 0.20 99037 0.00 > 2.05 > NONE 20 0.02 0.00 29096 0.00 > 1092.85 > PROPFIND 13 0.01 0.11 17371 0.00 > 12.06 > OPTIONS 4 0.00 0.06 3280 0.00 > 14.43 > ------------------------------ --------- ------ ------- -------- ------ > ------- > Sum 126047 100.00 0.75 3440715K 100.00 > 36.17 > > > # Incoming UDP-requests by status > no matching requests > > > # Incoming TCP-requests by status > status request % sec/req Byte % > kB/sec > ------------------------------ --------- ------ ------- -------- ------ > ------- > HIT 47735 37.87 0.13 153786K 4.47 > 24.33 > TCP_IMS_HIT 26661 21.15 0.02 9833998 0.28 > 18.76 > TCP_REFRESH_HIT 9925 7.87 0.55 78555994 2.23 > 14.15 > TCP_HIT 5286 4.19 0.06 58741309 1.67 > 188.53 > TCP_NEGATIVE_HIT 2960 2.35 0.01 3513393 0.10 > 102.69 > TCP_MEM_HIT 2903 2.30 0.02 6832080 0.19 > 134.31 > MISS 78288 62.11 1.13 3286878K 95.53 > 37.01 > TCP_MISS 74323 58.96 1.15 3254574K 94.59 > 38.24 > TCP_REFRESH_MISS 3668 2.91 0.64 31017023 0.88 > 12.91 > TCP_CLIENT_REFRESH_MISS 297 0.24 4.57 2063016 0.06 > 1.48 > ERROR 24 0.02 0.00 51692 0.00 > 1147.28 > TCP_DENIED 24 0.02 0.00 51692 0.00 > 1147.28 > ------------------------------ --------- ------ ------- -------- ------ > ------- > Sum 126047 100.00 0.75 3440715K 100.00 > 36.17 > > > # Outgoing requests by status > status request % sec/req Byte % > kB/sec > ------------------------------ --------- ------ ------- -------- ------ > ------- > DIRECT Fetch from Source 88219 100.00 1.07 3364765K 100.00 > 35.70 > DIRECT 88219 100.00 1.07 3364765K 100.00 > 35.70 > SIBLING 0 0.00 0.00 0 0.00 > 0.00 > PARENT 0 0.00 0.00 0 0.00 > 0.00 > ------------------------------ --------- ------ ------- -------- ------ > ------- > Sum 88219 100.00 1.07 3364765K 100.00 > 35.70 > > > # Outgoing requests by destination > neighbor type request % sec/req Byte % > kB/sec > ------------------------------ --------- ------ ------- -------- ------ > ------- > DIRECT 88219 100.00 1.07 3364765K 100.00 > 35.70 > ------------------------------ --------- ------ ------- -------- ------ > ------- > Sum 88219 100.00 1.07 3364765K 100.00 > 35.70 > > > # Request-destinations by 2nd-level-domain > destination request % hit-% Byte % > hit-% > -------------------------------- --------- ------ ------ -------- ------ > ------ > *.cafeen.org 5937 4.71 93.72 6801134 0.19 > 54.69 > <error> 5305 4.21 55.44 6872343 0.20 > 51.06 > *.dr.dk 4842 3.84 73.38 730135K 21.22 > 1.07 > *.travian.dk 3279 2.60 32.08 8640691 0.25 > 18.21 > *.dba.dk 3228 2.56 66.51 14169266 0.40 > 10.43 > *.msn.com 2851 2.26 18.10 11143648 0.32 > 5.57 > statistik-gallup.net 2466 1.96 0.00 1414712 0.04 > 0.00 > *.myspace.com 2180 1.73 17.29 28930777 0.82 > 4.89 > *.google.com 2129 1.69 5.78 30745388 0.87 > 0.90 > *.mymusic.dk 2110 1.67 35.21 228983K 6.66 > 0.12 > *.berlingske-mail.dk 1897 1.50 96.26 1067141 0.03 > 80.67 > ekstrabladet.dk 1785 1.42 12.89 4375244 0.12 > 14.28 > *.myspacecdn.com 1730 1.37 21.56 454945K 13.22 > 0.48 > dkbn.dk 1452 1.15 55.10 11947861 0.34 > 3.03 > *.lego.com 1379 1.09 23.93 5892238 0.17 > 1.86 > *.momondo.com 1365 1.08 32.01 4259281 0.12 > 5.62 > *.adtech.de 1318 1.05 1.29 1424658 0.04 > 0.25 > *.youtube.com 1223 0.97 22.16 122194K 3.55 > 0.30 > *.klassik.dk 1198 0.95 32.05 3904904 0.11 > 3.43 > *.flickr.com 1161 0.92 2.67 21110460 0.60 > 1.85 > other: 2110 2nd-level-domains 77212 61.26 33.70 1745571K 50.73 > 7.34 > -------------------------------- --------- ------ ------ -------- ------ > ------ > Sum 126047 100.00 37.87 3440715K 100.00 > 4.47 > > > # Request-destinations by toplevel-domain > destination request % hit-% Byte % > hit-% > -------------------------------- --------- ------ ------ -------- ------ > ------ > *.dk 48026 38.10 48.94 1249551K 36.32 > 3.62 > *.com 45732 36.28 25.12 1748592K 50.82 > 3.53 > *.net 8299 6.58 20.29 245920K 7.15 > 3.75 > *.org 7309 5.80 81.71 39343871 1.12 > 20.55 > <error> 5305 4.21 55.44 6872343 0.20 > 51.06 > <unresolved> 3638 2.89 12.20 70001247 1.99 > 6.84 > *.de 1680 1.33 12.14 7873640 0.22 > 12.74 > *.cn 960 0.76 54.27 2766639 0.08 > 6.28 > *.info 836 0.66 23.56 13495337 0.38 > 9.91 > *.pl 751 0.60 0.13 309584 0.01 > 1.81 > *.se 539 0.43 3.71 1199302 0.03 > 2.50 > *.fr 428 0.34 31.07 9620581 0.27 > 21.82 > *.es 428 0.34 0.23 1564132 0.04 > 1.63 > *.uk 360 0.29 30.83 2717396 0.08 > 9.77 > *.biz 329 0.26 50.76 2293951 0.07 > 29.66 > *.edu 325 0.26 1.85 7511238 0.21 > 54.58 > *.us 202 0.16 69.80 13502787 0.38 > 71.94 > *.eu 172 0.14 18.60 1147106 0.03 > 7.36 > *.no 143 0.11 1.40 2345350 0.07 > 11.87 > *.au 122 0.10 2.46 161752 0.00 > 4.51 > other: 28 top-level-domains 463 0.37 35.21 18646026 0.53 > 13.01 > -------------------------------- --------- ------ ------ -------- ------ > ------ > Sum 126047 100.00 37.87 3440715K 100.00 > 4.47 > > > # TCP-Request-protocol > protocol request % hit-% Byte % > hit-% > -------------------------------- --------- ------ ------ -------- ------ > ------ > http: 120742 95.79 37.10 3434004K 99.80 > 4.38 > <error> 5305 4.21 55.44 6872343 0.20 > 51.06 > -------------------------------- --------- ------ ------ -------- ------ > ------ > Sum 126047 100.00 37.87 3440715K 100.00 > 4.47 > > > # Requested content-type > content-type request % hit-% Byte % > hit-% > -------------------------------- --------- ------ ------ -------- ------ > ------ > image/gif 38897 30.86 61.94 102731K 2.99 > 44.54 > image/jpeg 26678 21.17 30.94 321255K 9.34 > 19.50 > text/html 23512 18.65 3.57 194778K 5.66 > 1.27 > <unknown> 8032 6.37 36.77 2953716 0.08 > 30.40 > application/x-javascript 7345 5.83 45.38 27856728 0.79 > 27.45 > <error> 5305 4.21 55.44 6872343 0.20 > 51.06 > text/css 3033 2.41 59.48 11928551 0.34 > 36.07 > image/png 2769 2.20 67.39 15192812 0.43 > 40.76 > text/xml 2282 1.81 4.95 5610341 0.16 > 1.64 > text/plain 2018 1.60 4.56 488498K 14.20 > 1.55 > application/x-shockwave-flash 1892 1.50 20.51 73785996 2.09 > 5.71 > text/javascript 1319 1.05 46.55 3214408 0.09 > 15.34 > application/octet-stream 1000 0.79 18.80 243926K 7.09 > 0.08 > audio/mpeg 505 0.40 0.79 670022K 19.47 > 0.01 > application/zip 238 0.19 1.26 3253937 0.09 > 18.50 > image/x-icon 222 0.18 52.25 638332 0.02 > 56.70 > application/xml 167 0.13 37.13 659342 0.02 > 12.07 > image/pjpeg 127 0.10 0.00 553810 0.02 > 0.00 > application/x-mms-framed 78 0.06 0.00 705775K 20.51 > 0.00 > video/x-ms-asf 73 0.06 4.11 57413 0.00 > 3.39 > other: 56 content-types 555 0.44 12.61 564728K 16.41 > 1.30 > -------------------------------- --------- ------ ------ -------- ------ > ------ > Sum 126047 100.00 37.87 3440715K 100.00 > 4.47 > > > # Requested extensions > extensions request % hit-% Byte % > hit-% > -------------------------------- --------- ------ ------ -------- ------ > ------ > <dynamic> 36478 28.94 0.38 1689769K 49.11 > 0.03 > gif 35311 28.01 72.83 99698830 2.83 > 47.40 > jpg 26492 21.02 34.29 277642K 8.07 > 22.21 > js 5600 4.44 73.71 18959700 0.54 > 45.14 > <error> 5305 4.21 55.44 6872343 0.20 > 51.06 > <none> 4575 3.63 7.83 34990326 0.99 > 3.99 > css 2856 2.27 66.98 9386898 0.27 > 45.70 > png 2616 2.08 74.24 11648394 0.33 > 53.32 > php 1163 0.92 5.85 7605359 0.22 > 0.33 > xml 1015 0.81 17.93 2426912 0.07 > 6.19 > html 816 0.65 14.83 8604816 0.24 > 5.51 > swf 613 0.49 66.23 44421312 1.26 > 9.68 > htm 512 0.41 27.73 6174349 0.18 > 3.68 > asp 414 0.33 5.80 2856910 0.08 > 1.34 > ico 365 0.29 36.99 955532 0.03 > 41.36 > aspx 320 0.25 0.00 5041846 0.14 > 0.00 > JPG 317 0.25 31.86 5909269 0.17 > 12.49 > jpeg 228 0.18 57.46 1438056 0.04 > 28.08 > flv 71 0.06 21.13 416471K 12.10 > 2.22 > wmv 48 0.04 0.00 468082K 13.60 > 0.00 > other: 107 extensions 932 0.74 20.49 328017K 9.53 > 1.89 > -------------------------------- --------- ------ ------ -------- ------ > ------ > Sum 126047 100.00 37.87 3440715K 100.00 > 4.47 > > > # Incoming UDP-requests by host > no matching requests > > > # Incoming TCP-requests by host > host request hit-% sec/req Byte hit-% > kB/sec > ------------------------------ --------- ------ ------- -------- ------ > ------- > 192.168.0.251 23794 51.23 0.43 680523K 7.72 > 67.25 > 192.168.0.231 13864 31.61 0.36 121489K 16.62 > 24.60 > 192.168.0.241 11883 45.57 0.46 222074K 5.12 > 40.50 > 192.168.0.79 8474 26.54 0.18 42479278 9.27 > 27.33 > 192.168.0.244 8173 29.17 1.09 260161K 1.03 > 29.34 > 192.168.0.118 6506 30.03 0.33 167104K 1.76 > 76.75 > 192.168.0.242 5407 26.91 5.38 501600K 1.09 > 17.26 > 192.168.0.139 4371 64.42 0.16 8762011 34.39 > 12.08 > 192.168.0.126 4096 22.46 0.58 84831104 10.94 > 34.71 > 192.168.0.227 4079 42.73 1.05 290881K 2.63 > 67.79 > 192.168.0.58 4010 39.40 0.16 53297233 8.82 > 83.35 > 192.168.0.32 3821 23.45 0.14 24276371 2.93 > 44.05 > 192.168.0.221 3580 30.11 0.33 180426K 3.70 > 152.66 > 192.168.0.56 2977 29.73 0.24 22034040 4.47 > 30.70 > 192.168.0.170 2940 55.17 1.58 427911K 0.89 > 91.89 > 192.168.0.236 2323 36.20 0.88 54787387 8.07 > 26.30 > 192.168.0.235 1927 45.98 1.92 6839339 12.38 > 1.80 > 192.168.0.68 1697 52.33 1.22 182109K 0.68 > 87.75 > 192.168.0.81 1596 45.80 0.56 20251574 22.19 > 22.28 > 192.168.0.228 1528 24.67 0.62 30664557 4.75 > 31.62 > other: 14 requesting hosts 9001 27.13 0.07 67969233 9.33 > 0.70 > ------------------------------ --------- ------ ------- -------- ------ > ------- > Sum 126047 37.87 0.75 3440715K 4.47 > 36.17 > > > # Size Distribution Diagram > object-size (bytes) request hit-% sec/req Byte hit-% > kB/sec > ------------------------------ --------- ------ ------- -------- ------ > ------- > 0-0 785 6.24 1.08 0 0.00 > 0.00 > 100-999 67281 54.48 0.18 31354112 45.28 > 2.52 > 1000-9999 40912 21.05 0.61 143237K 19.71 > 5.78 > 10000-99999 15613 14.26 0.99 402277K 13.74 > 26.03 > 100000-999999 976 19.16 2.94 219705K 19.46 > 76.69 > 1000000-9999999 434 2.07 69.47 1181480K 1.16 > 39.19 > 10000000-99999999 45 0.00 194.29 1314789K 0.00 > 150.38 > 100000000-999999999 1 0.00 141.81 148608K 0.00 > 1047.96 > ------------------------------ --------- ------ ------- -------- ------ > ------- > Sum 126047 37.87 0.75 3440715K 4.47 > 36.17 > > > # Performance in 1 hour steps > incomin hit miss direct sibling > fetch > date request Byte kB/sec kB/sec kB/sec kB/sec kB/sec > kB/sec > --------------- --------- ----- ------- ------- ------- ------- ------- > ------- > 30.May 07 06:00 979 12M 64.36 20.33 73.51 66.92 - - > 30.May 07 07:00 1832 21M 27.45 15.64 31.88 25.49 - - > 30.May 07 08:00 1579 11M 39.75 105.22 32.54 33.66 - - > 30.May 07 09:00 2094 12M 33.29 34.54 33.22 32.90 - - > 30.May 07 10:00 2550 69M 59.44 8.62 66.21 60.04 - - > 30.May 07 11:00 2564 10M 23.40 62.73 18.94 21.28 - - > 30.May 07 12:00 7590 257M 57.14 105.53 56.04 55.86 - - > 30.May 07 13:00 11080 346M 34.74 60.53 34.11 34.26 - - > 30.May 07 14:00 3610 44M 9.01 11.58 8.93 8.90 - - > 30.May 07 15:00 5150 162M 27.04 39.54 26.77 26.77 - - > 30.May 07 16:00 10327 306M 38.23 28.93 38.55 37.81 - - > 30.May 07 17:00 18339 290M 17.40 39.68 16.72 17.01 - - > 30.May 07 18:00 13404 209M 28.56 46.13 27.62 27.60 - - > 30.May 07 19:00 7679 92M 17.05 50.22 15.64 16.71 - - > 30.May 07 20:00 8380 220M 28.76 38.72 28.55 28.47 - - > 30.May 07 21:00 11279 343M 73.69 84.77 72.81 72.59 - - > 30.May 07 22:00 7412 125M 27.25 23.98 27.37 27.15 - - > 30.May 07 23:00 3694 58M 59.56 27.93 62.90 60.96 - - > 31.May 07 00:00 3792 689M 91.52 1.94 148.86 91.45 - - > 31.May 07 01:00 2583 81M 54.76 86.85 53.56 54.82 - - > 31.May 07 02:00 40 218K 25.03 6.08 25.50 24.94 - - > 31.May 07 03:00 43 229K 20.23 1.36 20.56 20.23 - - > 31.May 07 04:00 19 129K 15.90 - 15.90 15.90 - - > 31.May 07 05:00 14 127K 21.65 - 21.65 21.65 - - > 31.May 07 06:00 14 43455 12.89 - 12.89 12.89 - - > --------------- --------- ----- ------- ------- ------- ------- ------- > ------- > overall 126047 3360M 36.17 24.33 37.01 35.70 - - > > > # UDP-Request duration distribution in msec > no matching requests > > > > # TCP-Request duration distribution in msec > time request % hit-% sec/req Byte % hit-% > kB/sec > ---------------- --------- ------ ------ ------- -------- ------ ------ > ------- > <= 0.1 6481 5.14 98.86 0.00 4554606 0.13 100.00 > 6862.92 > <= 0.2 6481 5.14 98.86 0.00 4554606 0.13 100.00 > 6862.92 > <= 0.5 6481 5.14 98.86 0.00 4554606 0.13 100.00 > 6862.92 > <= 1 13822 10.97 99.00 0.00 9464128 0.27 99.56 > 1156.87 > <= 2 17600 13.96 99.08 0.00 12514848 0.36 99.54 > 786.20 > <= 5 22413 17.78 99.05 0.00 17677478 0.50 99.60 > 509.43 > <= 10 26148 20.74 99.06 0.00 22395790 0.64 99.67 > 347.62 > <= 20 30106 23.88 99.05 0.00 29293130 0.83 99.73 > 234.72 > <= 50 42705 33.88 82.49 0.01 58353902 1.66 73.61 > 95.95 > <= 100 68510 54.35 59.74 0.04 143179K 4.16 44.78 > 58.25 > <= 200 89370 70.90 49.63 0.06 272172K 7.91 31.18 > 49.93 > <= 500 112600 89.33 41.76 0.11 448183K 13.03 24.95 > 34.62 > <= 1000 121005 96.00 39.30 0.16 590707K 17.17 21.39 > 31.46 > <= 2000 123703 98.14 38.53 0.18 713232K 20.73 20.20 > 31.90 > <= 5000 124946 99.13 38.19 0.21 857564K 24.92 17.74 > 32.80 > <= 10000 125331 99.43 38.08 0.23 1118622K 32.51 13.74 > 38.75 > <= 20000 125545 99.60 38.01 0.25 1394361K 40.53 11.02 > 43.74 > <= 50000 125705 99.73 37.97 0.29 1861301K 54.10 8.26 > 50.69 > <= 100000 125819 99.82 37.94 0.37 2206349K 64.12 6.97 > 47.28 > <= 200000 126017 99.98 37.88 0.59 2804263K 81.50 5.48 > 37.84 > <= 500000 126033 99.99 37.87 0.62 3185421K 92.58 4.83 > 40.55 > <= 1000000 126040 99.99 37.87 0.67 3392516K 98.60 4.53 > 40.44 > <= 1e10 126047 100.00 37.87 0.75 3440715K 100.00 4.47 > 36.17 > ---------------- --------- ------ ------ ------- -------- ------ ------ > ------- > Sum 126047 100.00 37.87 0.75 3440715K 100.00 4.47 > 36.17 > > > # UDP Response code distribution > no matching requests > > > # TCP Response code distribution > status-code request % Byte > % > ---------------------------------------------- --------- ------ -------- > ------ > 000 (Used mostly with UDP traffic) 733 0.58 0 > 0.00 > 200 (OK) 79473 63.05 3408848K > 99.07 > 204 (No Content) 308 0.24 106962 > 0.00 > 206 (Partial Content) 76 0.06 9424810 > 0.27 > 207 (Multi Status) 6 0.00 7074 > 0.00 > 301 (Moved Permanently) 1025 0.81 695657 > 0.02 > 302 (Moved Temporarily) 5395 4.28 4111776 > 0.12 > 303 (See Other) 239 0.19 120335 > 0.00 > 304 (Not Modified) 33486 26.57 11277324 > 0.32 > 400 (Bad Request) 27 0.02 53199 > 0.00 > 403 (Forbidden) 132 0.10 246752 > 0.01 > 404 (Not Found) 4953 3.93 6333840 > 0.18 > 410 (Gone) 1 0.00 715 > 0.00 > 500 (Internal Server Error) 59 0.05 43854 > 0.00 > 502 (Bad Gateway) 10 0.01 14655 > 0.00 > 503 (Service Unavailable) 84 0.07 117156 > 0.00 > 504 (Gateway Timeout) 39 0.03 62172 > 0.00 > 600 (Squid header parsing error) 1 0.00 15021 > 0.00 > ---------------------------------------------- --------- ------ -------- > ------ > Sum 126047 100.00 3440715K > 100.00 > Hi Thomas, Which OS are you using and which squid version? Are you using 512 MB Ram for cache_mem? Posting your squid.conf would help to troubleshoot your problems. Can you also post the statistics of your squidclient info? squidclient mgr:info > > > Calamaris 2.99.4.0 > Copyright (C) 1997, 1998, 1999, 2000, 2001, 2002, 2003, 2004, 2005, 2006 > Cord Beermann. Authors: Cord Beermann and Michael Pophal. > Calamaris comes with ABSOLUTELY NO WARRANTY. It is free software, and you are > welcome to redistribute it under certain conditions. See source for details. > http://Calamaris.Cord.de/ > > > > - -- With best regards and good wishes, Yours sincerely, Tek Bahadur Limbu (TAG/TDG Group) Jwl Systems Department Worldlink Communications Pvt. Ltd. Jawalakhel, Nepal http://www.wlink.com.np -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.2.2 (FreeBSD) iD8DBQFGYnbYVrOl+eVhOvYRAggOAKCc5WDJqp61pdFjPnZdoh/kAHHN9gCfeatL Kay0NcagbAuuKmZLuD5TbWw= =fS1i -----END PGP SIGNATURE-----
