Search squid archive

Re: leaking memory in squid 3.4.8 and 3.4.7.

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



Amos Jeffries wrote:
> > 
> > I have tried looking at the cachemgr.cgi memory counters but they
> > are too numerous and cryptic for me.
> 
> Would you mind posting a copy of that mgr report? perhapse we can see
> something unusual.
> 

I am attaching two reports. The first one was taken right after the
squid restart. The second it several hours later when squid is already
843M in size (610M RES).

-- 
Victor Sudakov,  VAS4-RIPE, VAS47-RIPN
sip:sudakov@xxxxxxxxxxxxxxxx
Title: CacheMgr@localhost: mem

Cache Manager menu



Current memory usage:
PoolObj SizeChunksAllocatedIn UseIdleAllocations SavedRate
(bytes)KB/chobj/ch(#)usedfreepart%Frag(#)(KB)high (KB)high (hrs)%Tot(#)(KB)high (KB)high (hrs)%alloc(#)(KB)high (KB)(#)%cnt%vol(#)/sec
mem_node4120638125674256740.0069.106638125674256740.00100.00000000.0000.000257.766
cbdata IdentStateData (18)4148941381238120.0010.260941381238120.00100.00000000.0000.0006.833
2K Buffer2048946189219040.005.093946189219040.00100.000004200.0000.008262.596
4K Buffer4096399159616040.004.296399159616040.00100.00000000.0000.00019.199
Short Strings36244738618970.002.316244738618970.00100.00000000.0000.0004962.669
cbdata clientReplyContext (22)42241054345330.001.1661054345330.00100.00000000.0000.00036.430
cbdata ClientSocketContext (21)41881054305280.001.1561054305280.00100.00000000.0000.00036.430
cbdata IdleConnList (38)4136963884210.011.044963884210.01100.00000000.0000.0007.149
Comm::Connection15620653153200.000.84720653153200.00100.00000000.0000.000118.353
HttpHeaderEntry28101202772840.000.745101202772840.00100.00000000.0000.0001398.524
16K Buffer16384152407840.020.646152407840.02100.00000000.0000.00025.838
Medium Strings12818112273450.000.60918112273450.00100.00000000.0000.0001216.673
HttpReply17210541781780.000.47710541781780.00100.00000000.0000.000104.863
HttpRequest14001051441770.000.3861051441770.00100.00000000.0000.00036.430
MemObject13610481401400.000.37510481401400.00100.00000000.0000.00035.165
StoreEntry6022271311310.000.35122271311310.00100.00000000.0000.00035.148
cbdata ConnStateData (17)22037982820.000.21937982820.00100.00000000.0000.0006.850
HttpHdrCc6071242440.000.11271242440.00100.00000000.0000.00064.867
cbdata MemBuf (13)36106938390.000.101106938390.00100.00000000.0000.000174.192
NotePairs::Entry24158938570.000.100158938570.00100.00000000.0000.000756.647
LRU policy node12313137370.000.099313137370.00100.00000000.0000.00026.997
MD5 digest16222735350.000.094222735350.00100.00000000.0000.00048.936
Long Strings5124925380.020.0664925380.02100.00000000.0000.00067.783
cbdata ClientHttpRequest (20)17210518220.000.04710518220.00100.00000000.0000.00036.430
ClientInfo3405218180.010.0465218180.01100.00000000.0000.0000.123
ipcache_entry6427418180.000.04627418180.00100.00000000.0000.0004.602
cbdata clientStreamNode (23)7221015190.000.04021015190.00100.00000000.0000.00072.860
Auth::Ntlm::UserRequest4429113130.000.03429113130.00100.00000000.0000.0004.549
cbdata TunnelStateData (35)1168510110.000.0268510110.00100.00000000.0000.0001.458
MimeEntry48177990.030.022177990.03100.00000000.0000.0000.000
Auth::Ntlm::User9236450.020.00936450.02100.00000000.0000.0004.549
cbdata helper_stateful_server (31)15620440.020.00820440.02100.00000000.0000.0000.000
cbdata HttpStateData (36)14415370.020.00615370.02100.00000000.0000.00025.065
cbdata AuthUserIP (32)6036330.000.00636330.00100.00000000.0000.0000.070
1KB Strings102422240.000.00522240.00100.00000000.0000.00020.305
cbdata store_client (29)9620250.020.00520250.02100.00000000.0000.00035.376
Acl::AndNode10418220.030.00518220.03100.00000000.0000.0000.000
cbdata FwdState (33)8819250.020.00419250.02100.00000000.0000.00025.171
acl_ip_data8813220.030.00313220.03100.00000160.0000.0000.000
cbdata Logfile (11)10801220.030.0031220.03100.00000000.0000.0000.000
acl_proxy_auth_match_cache2036110.000.00236110.00100.00000000.0000.0000.070
cbdata Tree (3)1365110.030.0025110.03100.00000000.0000.0000.000
ACLStrategised1045110.030.0015110.03100.00000000.0000.0000.000
cbdata CbDataList (1)2818110.030.00118110.03100.00000000.0000.0000.000
cbdata CbDataList (37)529130.020.0019130.02100.00000000.0000.00044374.950
AuthUserHashPointer1236110.000.00136110.00100.00000000.0000.0000.070
ACLStrategised1044110.030.0014110.03100.00000000.0000.0000.000
ev_entry3212110.030.00112110.03100.00000000.0000.0002.723
ACLSourceIP964110.030.0014110.03100.00000000.0000.0000.000
fqdncache_entry804110.030.0014110.03100.00000000.0000.0000.000
Acl::NotNode1043110.030.0013110.03100.00000000.0000.0000.000
cbdata ConnOpener (19)764130.020.0014130.02100.00000000.0000.00016.511
cbdata ACLFilledChecklist (26)2961170.020.0011170.02100.00000000.0000.00036.430
RegexList289110.030.0019110.03100.00000000.0000.0000.000
ACLProxyAuth1002110.030.0012110.03100.00000000.0000.0000.000
cbdata PortCfg (4)1002110.030.0012110.03100.00000000.0000.0000.000
ACLDestinationIP962110.030.0012110.03100.00000000.0000.0000.000
cbdata BodyPipe (24)922110.020.0002110.02100.00000000.0000.0000.773
ACLRegexData819110.030.00019110.03100.00000000.0000.0000.000
cbdata statefulhelper (9)1361110.030.0001110.03100.00000000.0000.0000.000
cbdata TcpAcceptor (15)562110.030.0002110.03100.00000000.0000.0000.000
cbdata RemovalPolicy (6)562110.030.0002110.03100.00000000.0000.0000.000
ACLStrategised1041110.030.0001110.03100.00000000.0000.0000.000
ACLTimeData205110.030.0005110.03100.00000000.0000.0000.000
ACLIdent1001110.030.0001110.03100.00000000.0000.0000.000
cbdata StoreSearchHashIndex (16)601110.030.0001110.03100.00000000.0000.0000.000
cbdata AclAddress (5)521110.030.0001110.03100.00000000.0000.0000.000
HttpHdrContRange242110.010.0002110.01100.00000000.0000.0000.141
ACLUserData124110.030.0004110.03100.00000000.0000.0000.000
ACLHTTPHeaderData242110.030.0002110.03100.00000000.0000.0000.000
ACLDomainData85110.030.0005110.03100.00000000.0000.0000.000
cbdata CbDataList (2)361110.030.0001110.03100.00000000.0000.0000.000
ACLStringData84110.030.0004110.03100.00000000.0000.0000.000
ACLHierCodeData281110.030.0001110.03100.00000000.0000.0000.000
CacheDigest241110.030.0001110.03100.00000000.0000.0000.000
wordlist83120.030.0003120.03100.000002210.0000.0000.000
ACLNoteData201110.030.0001110.03100.00000000.0000.0000.000
ACLASN82110.030.0002110.03100.00000000.0000.0000.000
ACLMethodData82110.030.0002110.03100.00000000.0000.0000.000
ACLProtocolData81110.030.0001110.03100.00000000.0000.0000.000
8K Buffer819200960.030.00000960.03-1.00000000.0000.00014.790
cbdata ps_state (34)1760010.030.0000010.03-1.00000000.0000.00026.629
cbdata RemovalPurgeWalker (39)440010.030.0000010.03-1.00000000.0000.0001.001
StoreMetaMD5160010.030.0000010.03-1.00000000.0000.00013.507
StoreMetaSTDLFS160010.030.0000010.03-1.00000000.0000.00013.507
StoreMetaURL160010.030.0000010.03-1.00000000.0000.00013.507
StoreMetaObjSize160010.030.0000010.03-1.00000000.0000.00013.507
cbdata UFSStoreState (40)1040020.000.0000020.00-1.00000000.0000.00013.507
cbdata BlockingFile (41)520010.000.0000010.00-1.00000000.0000.00013.507
UFSStoreState::_queued_write200010.030.0000010.03-1.00000000.0000.00095.957
cbdata WriteRequest (42)480010.030.0000010.03-1.00000000.0000.00095.957
StoreMetaVary160010.030.0000010.03-1.00000000.0000.0000.474
HttpHdrRange200010.010.0000010.01-1.00000000.0000.0000.123
HttpHdrRangeSpec160010.010.0000010.01-1.00000000.0000.0000.123
StoreSwapLogData680010.030.0000010.03-1.00000000.0000.00017.143
cbdata ReadRequest (43)440010.010.0000010.01-1.00000000.0000.0000.018
FwdServer120010.030.0000010.03-1.00000000.0000.00026.629
cbdata RebuildState (12)6360010.030.0000010.03-1.00000000.0000.0000.000
cbdata idns_query (8)8604001520.030.000001520.03-1.00000000.0000.0004.602
4KB Strings409600360.020.00000360.02-1.00000000.0000.0002.020
cbdata ClientRequestContext (25)640020.020.0000020.02-1.00000000.0000.00036.430
dwrite_q280010.030.0000010.03-1.00000000.0000.000113.101
cbdata generic_cbdata (27)200010.030.0000010.03-1.00000000.0000.00018.092
cbdata ErrorState (28)1400010.030.0000010.03-1.00000000.0000.0009.503
dread_ctrl320010.010.0000010.01-1.00000000.0000.0000.018
dlink_node120010.030.0000010.03-1.00000000.0000.0000.000
link_list80010.030.0000010.03-1.00000000.0000.00095.957
cbdata StateData (30)280010.020.0000010.02-1.00000000.0000.0008.730
helper_stateful_request160010.020.0000010.02-1.00000000.0000.0008.730
Total16264137152371520.00100.0006264137152371520.00100.000002470.0010.00897744.644
Cumulative allocated volume: 542.05 MB
Current overhead: 20521 bytes (0.054%)
Idle pool limit: 0.00 MB
Total Pools created: 121
Pools ever used:     109 (shown above)
Currently in use:    80
String PoolImpact
(%strings)(%volume)
Short Strings9377
Medium Strings720
Long Strings02
1KB Strings00
4KB Strings00
16KB Strings00
Other Strings00
Large buffers: 0 (0 KB)

Generated Mon, 29 Sep 2014 04:46:28 GMT, by cachemgr.cgi/3.4.7@xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx
Title: CacheMgr@localhost: mem

Cache Manager menu



Current memory usage:
PoolObj SizeChunksAllocatedIn UseIdleAllocations SavedRate
(bytes)KB/chobj/ch(#)usedfreepart%Frag(#)(KB)high (KB)high (hrs)%Tot(#)(KB)high (KB)high (hrs)%alloc(#)(KB)high (KB)(#)%cnt%vol(#)/sec
cbdata IdentStateData (18)4148492141993561993560.0042.263492141993561993560.00100.00000000.0000.0002.527
mem_node4120324611306051323840.3427.688324611306051323840.34100.00000000.0000.00084.917
2K Buffer20484922498448984500.0020.8714922498448984500.00100.000004200.0000.000109.443
Medium Strings12810133812668154630.132.68510133812668154630.13100.00000000.0000.0003277.125
Short Strings362694849475104450.132.0082694849475104450.13100.00000000.0000.0004368.967
Comm::Connection15650342767076700.001.62650342767076700.00100.00000000.0000.00037.898
NotePairs::Entry2499222232628370.130.49399222232628370.13100.00000000.0000.0003137.487
HttpHeaderEntry2877220211224640.810.44877220211224640.81100.00000000.0000.000410.103
StoreEntry6024288142414660.540.30224288142414660.54100.00000000.0000.00011.154
4K Buffer4096355142021120.140.301355142021120.14100.00000000.0000.00010.168
HttpReply1728452142016400.810.3018452142016400.81100.00000000.0000.00033.030
MemObject1368435112112940.810.2378435112112940.81100.00000000.0000.00011.277
cbdata clientReplyContext (22)42241335499820.140.1161335499820.14100.00000000.0000.00012.633
cbdata ClientSocketContext (21)41881335449740.140.1151335449740.14100.00000000.0000.00012.633
16K Buffer163842438410720.190.0812438410720.19100.00000000.0000.0007.148
LRU policy node12325603824030.540.081325603824030.54100.00000000.0000.0003.574
MD5 digest16242883803910.540.080242883803910.54100.00000000.0000.00013.311
HttpHdrCc6055793274220.810.06955793274220.81100.00000000.0000.00017.316
cbdata MemBuf (13)3684762983440.690.06384762983440.69100.00000000.0000.00054.475
cbdata IdleConnList (38)41365321510221.980.0455321510221.98100.00000000.0000.0003.759
HttpRequest14001492043440.140.0431492043440.14100.00000000.0000.00012.633
cbdata ConnStateData (17)220324701030.100.015324701030.10100.00000000.0000.0002.588
ipcache_entry6495460651.980.01395460651.98100.00000000.0000.0002.095
ClientInfo34015251510.030.01115251510.03100.00000000.0000.0000.000
Long Strings51279401080.170.00879401080.17100.00000000.0000.00020.274
cbdata ClientHttpRequest (20)17213323400.140.00513323400.14100.00000000.0000.00012.633
cbdata clientStreamNode (23)7226619340.140.00426619340.14100.00000000.0000.00025.266
8K Buffer81922165120.180.0032165120.18100.00000000.0000.0002.218
1KB Strings10241414460.400.0031414460.40100.00000000.0000.0003.451
cbdata TunnelStateData (35)11610112180.140.00210112180.14100.00000000.0000.0001.356
cbdata helper_stateful_server (31)1566410100.180.0026410100.18100.00000000.0000.0000.000
Auth::Ntlm::User9210110140.180.00210110140.18100.00000000.0000.0001.417
MimeEntry48177992.500.002177992.50100.00000000.0000.0000.000
Auth::Ntlm::UserRequest441939160.330.0021939160.33100.00000000.0000.0001.417
cbdata AuthUserIP (32)60101660.010.001101660.01100.00000000.0000.0000.000
cbdata ACLFilledChecklist (26)296196221.110.001196221.11100.00000000.0000.00012.633
4KB Strings409614761.800.00114761.80100.00000000.0000.0000.801
cbdata HttpStateData (36)144244100.190.001244100.19100.00000000.0000.0007.087
acl_proxy_auth_match_cache20168440.010.001168440.01100.00000000.0000.0000.000
cbdata store_client (29)96303110.170.001303110.17100.00000000.0000.00011.708
cbdata FwdState (33)8827370.170.00027370.17100.00000000.0000.0007.272
fqdncache_entry8025230.070.00025230.07100.00000000.0000.0000.000
Acl::AndNode10418222.500.00018222.50100.00000000.0000.0000.000
cbdata ClientRequestContext (25)6419260.140.00019260.14100.00000000.0000.00012.633
AuthUserHashPointer12100220.010.000100220.01100.00000000.0000.0000.000
acl_ip_data8813222.500.00013222.50100.00000160.0000.0000.000
cbdata Logfile (11)10801222.500.0001222.50100.00000000.0000.0000.000
cbdata Tree (3)1365112.500.0005112.50100.00000000.0000.0000.000
ACLStrategised1045112.500.0005112.50100.00000000.0000.0000.000
cbdata CbDataList (1)2818112.500.00018112.50100.00000000.0000.0000.000
cbdata BodyPipe (24)925120.280.0005120.28100.00000000.0000.0000.801
ACLStrategised1044112.500.0004112.50100.00000000.0000.0000.000
ACLSourceIP964112.500.0004112.50100.00000000.0000.0000.000
cbdata ConnOpener (19)765191.110.0005191.11100.00000000.0000.0008.073
ev_entry3211110.170.00011110.17100.00000000.0000.0002.218
Acl::NotNode1043112.500.0003112.50100.00000000.0000.0000.000
RegexList289112.500.0009112.50100.00000000.0000.0000.000
cbdata PortCfg (4)1002112.500.0002112.50100.00000000.0000.0000.000
ACLProxyAuth1002112.500.0002112.50100.00000000.0000.0000.000
ACLDestinationIP962112.500.0002112.50100.00000000.0000.0000.000
ACLRegexData819112.500.00019112.50100.00000000.0000.0000.000
cbdata statefulhelper (9)1361112.500.0001112.50100.00000000.0000.0000.000
cbdata RemovalPolicy (6)562112.500.0002112.50100.00000000.0000.0000.000
cbdata TcpAcceptor (15)562112.500.0002112.50100.00000000.0000.0000.000
ACLStrategised1041112.500.0001112.50100.00000000.0000.0000.000
cbdata CbDataList (37)522130.190.0002130.19100.00000000.0000.00056.447
cbdata UFSStoreState (40)1041130.520.0001130.52100.00000000.0000.0002.095
ACLTimeData205112.500.0005112.50100.00000000.0000.0000.000
ACLIdent1001112.500.0001112.50100.00000000.0000.0000.000
cbdata StoreSearchHashIndex (16)601112.500.0001112.50100.00000000.0000.0000.000
cbdata AclAddress (5)521112.500.0001112.50100.00000000.0000.0000.000
cbdata BlockingFile (41)521120.520.0001120.52100.00000000.0000.0002.095
ACLUserData124112.500.0004112.50100.00000000.0000.0000.000
ACLHTTPHeaderData242112.500.0002112.50100.00000000.0000.0000.000
ACLDomainData85112.500.0005112.50100.00000000.0000.0000.000
cbdata CbDataList (2)361112.500.0001112.50100.00000000.0000.0000.000
ACLStringData84112.500.0004112.50100.00000000.0000.0000.000
ACLHierCodeData281112.500.0001112.50100.00000000.0000.0000.000
CacheDigest241112.500.0001112.50100.00000000.0000.0000.000
wordlist83122.500.0003122.50100.000002210.0000.0000.000
cbdata generic_cbdata (27)201110.140.0001110.14100.00000000.0000.0004.006
ACLNoteData201112.500.0001112.50100.00000000.0000.0000.000
ACLMethodData82112.500.0002112.50100.00000000.0000.0000.000
ACLASN82112.500.0002112.50100.00000000.0000.0000.000
ACLProtocolData81112.500.0001112.50100.00000000.0000.0000.000
cbdata BodySink (44)440011.170.0000011.17-1.00000000.0000.0000.000
16KB Strings1638400321.070.00000321.07-1.00000000.0000.0000.000
cbdata idns_query (8)8604003530.140.000003530.14-1.00000000.0000.0002.095
cbdata RebuildState (12)6360012.500.0000012.50-1.00000000.0000.0000.000
HttpHdrContRange240011.840.0000011.84-1.00000000.0000.0000.000
dwrite_q280012.500.0000012.50-1.00000000.0000.00012.263
dread_ctrl320012.220.0000012.22-1.00000000.0000.0000.431
dlink_node120012.500.0000012.50-1.00000000.0000.0000.000
link_list80012.500.0000012.50-1.00000000.0000.0009.059
64K Buffer65536001920.110.000001920.11-1.00000000.0000.0000.000
32K Buffer3276800640.120.00000640.12-1.00000000.0000.0000.000
FwdServer120011.120.0000011.12-1.00000000.0000.0008.627
StoreSwapLogData680012.500.0000012.50-1.00000000.0000.0003.204
cbdata ErrorState (28)1400010.180.0000010.18-1.00000000.0000.0003.451
cbdata StateData (30)280020.180.0000020.18-1.00000000.0000.0002.650
helper_stateful_request160010.180.0000010.18-1.00000000.0000.0002.650
cbdata ps_state (34)1760011.120.0000011.12-1.00000000.0000.0008.627
cbdata RemovalPurgeWalker (39)440012.500.0000012.50-1.00000000.0000.0001.232
StoreMetaMD5160012.500.0000012.50-1.00000000.0000.0002.034
StoreMetaSTDLFS160012.500.0000012.50-1.00000000.0000.0002.034
StoreMetaURL160012.500.0000012.50-1.00000000.0000.0002.034
StoreMetaObjSize160012.500.0000012.50-1.00000000.0000.0002.034
UFSStoreState::_queued_write200012.500.0000012.50-1.00000000.0000.0009.059
cbdata WriteRequest (42)480012.500.0000012.50-1.00000000.0000.0009.059
StoreMetaVary160012.500.0000012.50-1.00000000.0000.0000.246
HttpHdrRange200011.840.0000011.84-1.00000000.0000.0000.000
HttpHdrRangeSpec160011.840.0000011.84-1.00000000.0000.0000.000
cbdata ReadRequest (43)440012.220.0000012.22-1.00000000.0000.0000.431
Total18446764716984724160.01100.0008446764716984724160.01100.000002470.0000.00010549831.901
Cumulative allocated volume: 20.550 GB
Current overhead: 20694 bytes (0.004%)
Idle pool limit: 0.00 MB
Total Pools created: 122
Pools ever used:     113 (shown above)
Currently in use:    85
String PoolImpact
(%strings)(%volume)
Short Strings7343
Medium Strings2757
Long Strings00
1KB Strings00
4KB Strings00
16KB Strings00
Other Strings00
Large buffers: 0 (0 KB)

Generated Mon, 29 Sep 2014 07:14:45 GMT, by cachemgr.cgi/3.4.7@xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx
_______________________________________________
squid-users mailing list
squid-users@xxxxxxxxxxxxxxxxxxxxx
http://lists.squid-cache.org/listinfo/squid-users

[Index of Archives]     [Linux Audio Users]     [Samba]     [Big List of Linux Books]     [Linux USB]     [Yosemite News]

  Powered by Linux