no I do not. I simply manage some 30 squid servers and I included in this mail some statistics from one of these proxies because I think I should increase the cache_mem value for some of them but I am not really sure about my suggestions ... so if some of you have deep experience in it I would be happy they help me. do not hesitate to read the 5 questions in my mail. many thks Vincent _______________________________ From: Gerard Leonardo [mailto:gerard.leonardo@xxxxxxxxx] Sent: Tuesday, August 25, 2009 3:06 PM To: Blondel, V. (Vincent) Cc: squid-users@xxxxxxxxxxxxxxx Subject: Re: TCP response time | Proxy efficiency | Paging .. pending questions Hi, Do you mind sending how to tune or tweak squid+dansguardian with 300 concurrent users. Thanks in advancE! Gerard On Tue, Aug 25, 2009 at 6:45 PM, <vincent.blondel@xxxxxx> wrote: Hello all, when looking on the good working of one of my squid proxies, I see some values I think somewhat relevant for increasing the cache_mem. next to my investigations I can see this machine receives some 130req/s, sends some 80 req/s, caches some 1.2 million objects on disk. this is the very basic part of it. $ squidclient mgr:info Internal Data Structures: 1182755 StoreEntries 70431 StoreEntries with MemObjects 70365 Hot Object Cache Items 1174685 on-disk objects $ squidclient mgr:5min |egrep 'http|fault' client_http.requests = 127.388482/sec client_http.hits = 45.899453/sec client_http.errors = 0.000000/sec client_http.kbytes_in = 95.962190/sec client_http.kbytes_out = 1820.344974/sec client_http.all_median_svc_time = 0.021898 seconds client_http.miss_median_svc_time = 0.042766 seconds client_http.nm_median_svc_time = 0.001789 seconds client_http.nh_median_svc_time = 0.020695 seconds client_http.hit_median_svc_time = 0.004626 seconds server.http.requests = 78.912393/sec server.http.errors = 0.000000/sec server.http.kbytes_in = 1285.901343/sec server.http.kbytes_out = 66.245877/sec page_faults = 0.043333/sec we can also see a correct hit (36%) and byte (20%) rate on this server but ... * what does it mean "Proxy efficiency 46.01" ?? * and what does it mean "Average speed increase 24.27% " ?? * what does it mean "TCP response time of 100%% requests" .. ? the maximum time taken to make the SYN SYN/ACK ACK when asking for a socket on the parent cahe ? the maximum time taken for getting an object from the parent cache ??? Summary Calamaris statistics lines parsed: lines 15855657 invalid lines: lines 0 parse time: sec 4145 parse speed: lines/sec 3825 Proxy statistics Total amount: requests 15855657 Total Bandwidth: Byte 165G Proxy efficiency (HIT [kB/sec] / DIRECT [kB/sec]): factor 46.01 Average speed increase: % 24.27 TCP response time of 100%% requests: msec 1900 Cache statistics Total amount cached: requests 5627335 Request hit rate: % 35.49 Bandwidth savings: Byte 33781M Bandwidth savings in Percent (Byte hit rate): % 19.96 Average cached object size: Byte 6294 Average direct object size: Byte 13885 Average object size: Byte 11191 the machine squid is running on is a Sun Solaris 8 V210 with 2Gb memory. $ prtconf System Configuration: Sun Microsystems sun4u Memory size: 2048 Megabytes System Peripherals (Software Nodes): SUNW,Sun-Fire-V210 concerning the memory usage this becomes much more unclear for me ... if I good understand I see the process size is some 700mb and get some 600mb allocated. when going deeper in the vmstat stats pi and po column respectively give 825 and 236 at some time ... * is this not some too big value ?? * cache_mem is currently defined at 400mb, don't you think increasing this value to a bigger value (let's say some 500-600 mb) would not be better ?? $ squidclient mgr:info Squid Object Cache: Version 2.7.STABLE4 Start Time: Mon, 17 Aug 2009 02:00:38 GMT Current Time: Thu, 20 Aug 2009 10:48:06 GMT Connection information for squid: Number of clients accessing cache: 2264 Number of HTTP requests received: 11355087 Number of ICP messages received: 11553839 Number of ICP messages sent: 11564676 Number of queued ICP replies: 0 Number of HTCP messages received: 0 Number of HTCP messages sent: 0 Request failure ratio: 0.00 Average HTTP requests per minute since start: 2342.5 Average ICP messages per minute since start: 4769.2 Select loop called: 94346313 times, 3.083 ms avg Cache information for squid: Request Hit Ratios: 5min: 38.8%, 60min: 30.9% Byte Hit Ratios: 5min: 21.8%, 60min: 29.7% Request Memory Hit Ratios: 5min: 27.4%, 60min: 27.1% Request Disk Hit Ratios: 5min: 23.4%, 60min: 18.0% Storage Swap size: 29196377 KB Storage Mem size: 409632 KB Mean Object Size: 24.85 KB Requests given to unlinkd: 114 Median Service Times (seconds) 5 min 60 min: HTTP Requests (All): 0.02190 0.01035 Cache Misses: 0.04047 0.03622 Cache Hits: 0.00463 0.00379 Near Hits: 0.01955 0.02317 Not-Modified Replies: 0.00179 0.00179 DNS Lookups: 0.00190 0.00190 ICP Queries: 0.00221 0.00221 Resource usage for squid: UP Time: 290848.297 seconds CPU Time: 26579.690 seconds CPU Usage: 9.14% CPU Usage, 5 minute avg: 30.92% CPU Usage, 60 minute avg: 32.65% Process Data Segment Size via sbrk(): 693792 KB Maximum Resident Size: 0 KB Page faults with physical i/o: 19875 Memory accounted for: Total accounted: 603121 KB memPoolAlloc calls: 1390282241 memPoolFree calls: 1384735607 File descriptor usage for squid: Maximum number of file descriptors: 8192 Largest file desc currently in use: 801 Number of file desc currently in use: 697 Files queued for open: 0 Available number of file descriptors: 7495 Reserved number of file descriptors: 100 Store Disk files open: 0 IO loop method: poll $ vmstat 5 5 procs memory page disk faults cpu r b w swap free re mf pi po fr de sr m0 m1 m3 m4 in sy cs us sy id 0 0 0 2614824 634360 62 277 76 29 29 0 0 3 0 3 5 4294967261 276 176 10 9 81 0 0 0 2442720 414768 145 128 568 236 236 0 0 0 0 0 60 3418 15771 2959 31 30 39 2 1 0 2442304 418104 296 851 739 75 75 0 0 27 0 1 20 2862 58159 2199 41 45 14 0 0 0 2442720 423744 229 0 825 180 180 0 0 0 0 0 8 2749 36179 2911 36 28 36 0 0 0 2442720 428832 146 0 452 96 96 0 0 0 0 1 4 3825 13153 2585 26 30 45 $ vmstat -i interrupt total rate -------------------------------- clock 1582676343 100 -------------------------------- Total 1582676343 100 $ vmstat -s 0 swap ins 0 swap outs 0 pages swapped in 0 pages swapped out 119188729 total address trans. faults taken 63414018 page ins 33261045 page outs 150679474 pages paged in 57581487 pages paged out 985466858 total reclaims 985358256 reclaims from free list 0 micro (hat) faults 119188729 minor (as) faults 34878720 major faults 1518806042 copy-on-write faults 655083663 zero fill page faults 187523 pages examined by the clock daemon 0 revolutions of the clock hand 57477049 pages freed by the clock daemon 47526220 forks 149015 vforks 49086268 execs 3171912755 cpu context switches 1401743919 device interrupts 3042943801 traps 2429831033 system calls 1065243178 total name lookups (cache hits 87%) 151392974 user cpu 148588621 system cpu 1165931599 idle cpu 116763714 wait cpu many thks to help me and do not hesitate to give me any comment about the files give above. Vincent. ----------------------------------------------------------------- ATTENTION: The information in this electronic mail message is private and confidential, and only intended for the addressee. Should you receive this message by mistake, you are hereby notified that any disclosure, reproduction, distribution or use of this message is strictly prohibited. Please inform the sender by reply transmission and delete the message without copying or opening it. Messages and attachments are scanned for all viruses known. If this message contains password-protected attachments, the files have NOT been scanned for viruses by the ING mail domain. Always scan attachments before opening them. -----------------------------------------------------------------
