Search squid archive

Re: leaking memory in squid 3.4.8 and 3.4.7.

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



On 29.09.14 13:39, Eliezer Croitoru wrote:
Hey Steve,

Can you share the basic cache manager requests statistics and the up
time for the service?
(mgr:info)

This is with 8 workers and was restarted this morning, about 6 hours ago. As you can see, it's using about 5GB at the moment - as mentioned, there is no caching enabled for this configuration so there doesn't seem much reason for it to grow so large.

Squid Object Cache: Version 3.4.6
Build Info:
Start Time:	Tue, 30 Sep 2014 08:33:01 GMT
Current Time:	Tue, 30 Sep 2014 14:14:28 GMT
Connection information for squid:
	Number of clients accessing cache:	2545
	Number of HTTP requests received:	926815
	Number of ICP messages received:	0
	Number of ICP messages sent:	0
	Number of queued ICP replies:	0
	Number of HTCP messages received:	0
	Number of HTCP messages sent:	0
	Request failure ratio:	 0.00
	Average HTTP requests per minute since start:	2714.3
	Average ICP messages per minute since start:	0.0
	Select loop called: 33693001 times, 5.219 ms avg
Cache information for squid:
	Hits as % of all requests:	5min: 0.0%, 60min: 0.0%
	Hits as % of bytes sent:	5min: 3.5%, 60min: 4.4%
	Memory hits as % of hit requests:	5min: 0.0%, 60min: 0.0%
	Disk hits as % of hit requests:	5min: 0.0%, 60min: 0.0%
	Storage Swap size:	0 KB
	Storage Swap capacity:	 0.0% used,  0.0% free
	Storage Mem size:	2168 KB
	Storage Mem capacity:	 0.0% used,  0.0% free
	Mean Object Size:	0.00 KB
	Requests given to unlinkd:	0
Median Service Times (seconds)  5 min    60 min:
	HTTP Requests (All):   0.06557  0.06988
	Cache Misses:          0.06629  0.07171
	Cache Hits:            0.00000  0.00000
	Near Hits:             0.00000  0.00000
	Not-Modified Replies:  0.00000  0.00000
	DNS Lookups:           0.00012  0.00000
	ICP Queries:           0.00000  0.00000
Resource usage for squid:
	UP Time:	20487.255 seconds
	CPU Time:	3177.711 seconds
	CPU Usage:	15.51%
	CPU Usage, 5 minute avg:	11.44%
	CPU Usage, 60 minute avg:	12.40%
	Maximum Resident Size: 19930960 KB
	Page faults with physical i/o: 6
Memory usage for squid via mallinfo():
	Total space in arena:  5014812 KB
	Ordinary blocks:       5004965 KB   2620 blks
	Small blocks:               0 KB      0 blks
	Holding blocks:         82080 KB     48 blks
	Free Small blocks:          0 KB
	Free Ordinary blocks:    9847 KB
	Total in use:            9847 KB 0%
	Total free:              9847 KB 0%
	Total size:            5096892 KB
Memory accounted for:
	Total accounted:       447132 KB   9%
	memPool accounted:     447132 KB   9%
	memPool unaccounted:   4649760 KB  91%
	memPoolAlloc calls: 528851610
	memPoolFree calls:  531832922
File descriptor usage for squid:
	Maximum number of file descriptors:   131072
	Largest file desc currently in use:    209
	Number of file desc currently in use:  754
	Files queued for open:                   0
	Available number of file descriptors: 130318
	Reserved number of file descriptors:   800
	Store Disk files open:                   0
Internal Data Structures:
	   510 StoreEntries
	   510 StoreEntries with MemObjects
	   408 Hot Object Cache Items
	     0 on-disk objects


For comparison, almost all of the http (but none of the https) requests that go through the proxy above are then sent through a second proxy which does do some caching, but no fancy stuff like ICAP or ssl bumping - the caching proxy has been running for 18 days and has a far smaller process size (again, 8 workers):

Squid Object Cache: Version 3.4.6
Build Info:
Start Time:	Fri, 12 Sep 2014 08:48:50 GMT
Current Time:	Tue, 30 Sep 2014 14:18:35 GMT
Connection information for squid:
	Number of clients accessing cache:	1
	Number of HTTP requests received:	19496669
	Number of ICP messages received:	0
	Number of ICP messages sent:	0
	Number of queued ICP replies:	0
	Number of HTCP messages received:	0
	Number of HTCP messages sent:	0
	Request failure ratio:	 0.00
	Average HTTP requests per minute since start:	742.7
	Average ICP messages per minute since start:	0.0
	Select loop called: 763795228 times, 2.062 ms avg
Cache information for squid:
	Hits as % of all requests:	5min: 13.1%, 60min: 12.8%
	Hits as % of bytes sent:	5min: 7.0%, 60min: 4.7%
	Memory hits as % of hit requests:	5min: 0.0%, 60min: 0.0%
	Disk hits as % of hit requests:	5min: 16.4%, 60min: 11.9%
	Storage Swap size:	3773012 KB
	Storage Swap capacity:	90.0% used, 10.0% free
	Storage Mem size:	262144 KB
	Storage Mem capacity:	100.0% used,  0.0% free
	Mean Object Size:	28.55 KB
	Requests given to unlinkd:	3198063
Median Service Times (seconds)  5 min    60 min:
	HTTP Requests (All):   0.02899  0.03241
	Cache Misses:          0.03066  0.03241
	Cache Hits:            0.00405  0.00091
	Near Hits:             0.03066  0.03427
	Not-Modified Replies:  0.00000  0.00000
	DNS Lookups:           0.00000  0.00000
	ICP Queries:           0.00000  0.00000
Resource usage for squid:
	UP Time:	1574985.354 seconds
	CPU Time:	32733.608 seconds
	CPU Usage:	2.08%
	CPU Usage, 5 minute avg:	3.80%
	CPU Usage, 60 minute avg:	3.54%
	Maximum Resident Size: 1025200 KB
	Page faults with physical i/o: 289968
Memory usage for squid via mallinfo():
	Total space in arena:   49616 KB
	Ordinary blocks:        38418 KB  15268 blks
	Small blocks:               0 KB      0 blks
	Holding blocks:         10520 KB      7 blks
	Free Small blocks:          0 KB
	Free Ordinary blocks:   11198 KB
	Total in use:           11198 KB 19%
	Total free:             11198 KB 19%
	Total size:             60136 KB
Memory accounted for:
	Total accounted:        27128 KB  45%
	memPool accounted:      27128 KB  45%
	memPool unaccounted:    33008 KB  55%
	memPoolAlloc calls: 5279809700
	memPoolFree calls:  5314670336
File descriptor usage for squid:
	Maximum number of file descriptors:   16384
	Largest file desc currently in use:     67
	Number of file desc currently in use:   50
	Files queued for open:                   0
	Available number of file descriptors: 16334
	Reserved number of file descriptors:   100
	Store Disk files open:                   0
Internal Data Structures:
	132586 StoreEntries
	   444 StoreEntries with MemObjects
	  8192 Hot Object Cache Items
	132142 on-disk objects



As a separate note: I'm not sure why the memory footprint of the caching squid is so low - with cache_mem set to 256MB (100% used, apparently) and 8 workers I would expect it to be much more. Something else for me to investigate when I've got time. :)

--
 - Steve Hill
   Technical Director
   Opendium Limited     http://www.opendium.com

Direct contacts:
   Instant messager: xmpp:steve@xxxxxxxxxxxx
   Email:            steve@xxxxxxxxxxxx
   Phone:            sip:steve@xxxxxxxxxxxx

Sales / enquiries contacts:
   Email:            sales@xxxxxxxxxxxx
   Phone:            +44-844-9791439 / sip:sales@xxxxxxxxxxxx

Support contacts:
   Email:            support@xxxxxxxxxxxx
   Phone:            +44-844-4844916 / sip:support@xxxxxxxxxxxx
_______________________________________________
squid-users mailing list
squid-users@xxxxxxxxxxxxxxxxxxxxx
http://lists.squid-cache.org/listinfo/squid-users





[Index of Archives]     [Linux Audio Users]     [Samba]     [Big List of Linux Books]     [Linux USB]     [Yosemite News]

  Powered by Linux