Search squid archive

Re: squid cpu usage

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



Thanks for all the tips.

I should've done this before, but I just took a second look at cache.log and found the following message repeated a few times before the 100% CPU issue:

"Your cache is running out of filedescriptors"

I have no more info because the debug level was low.

If this is the cause then I'm even more worried now because:

# ulimit -a
core file size          (blocks, -c) 0
data seg size           (kbytes, -d) unlimited
scheduling priority             (-e) 0
file size               (blocks, -f) unlimited
pending signals                 (-i) 127521
max locked memory       (kbytes, -l) 64
max memory size         (kbytes, -m) unlimited
open files                      (-n) 16384
pipe size            (512 bytes, -p) 8
POSIX message queues     (bytes, -q) 819200
real-time priority              (-r) 0
stack size              (kbytes, -s) 8192
cpu time               (seconds, -t) unlimited
max user processes              (-u) 127521
virtual memory          (kbytes, -v) unlimited
file locks                      (-x) unlimited

# cat /etc/security/limits.d/01_squid.conf 
* hard nofile 65535
* soft nofile 16384

It just so happens I ran mgr:filedescriptors while the CPU was at 100%.

Here's the output (stripped of domains and IP addresses):

HTTP/1.1 200 OK
Server: squid
Mime-Version: 1.0
Date: Thu, 26 Oct 2017 08:35:16 GMT
Content-Type: text/plain;charset=utf-8
Expires: Thu, 26 Oct 2017 08:35:16 GMT
Last-Modified: Thu, 26 Oct 2017 08:35:16 GMT
X-Cache: MISS from inf-fw2
X-Cache-Lookup: MISS from inf-fw2:3128
Connection: close

Active file descriptors:
File Type   Tout Nread  * Nwrite * Remote Address        Description
---- ------ ---- -------- -------- --------------------- ------------------------------
5 Log       0       0        0                        /var/log/squid/cache.log
6 Pipe      0       0        0                        IPC UNIX STREAM Parent
9 Socket 28796       0        0  x.x.x.x:3199    client https start
11 Socket    8    1829*  174558  x.x.x.x:62569  Idle client: Waiting for next request
12 Socket    0   77571   243300  x.x.x.x:1344        x.x.x.x
13 Socket 28798       0        0  x.x.x.x:1428   client https start
14 Socket  113     201*    3316  x.x.x.x:49847  Idle client: Waiting for next request
15 Socket 7614       0*       0  x.x.x.x:56204   client https start
16 Socket    0   70492    72860  x.x.x.x:1344        x.x.x.x
17 Socket    0  184736   412668  x.x.x.x:1344        x.x.x.x
18 Socket    0  269207   467337  x.x.x.x:1344        x.x.x.x
19 Socket    0   70386    70846  x.x.x.x:1344        x.x.x.x
20 Socket   56     319*     452  x.x.x.x:59366   Idle client: Waiting for next request
21 Socket    0   74155   160454  x.x.x.x:1344        x.x.x.x
22 Socket    0   70373   184389  x.x.x.x:1344        x.x.x.x
23 Socket    0  321566   418429  x.x.x.x:1344        x.x.x.x
24 Socket 28783    1633*       0  x.x.x.x:60033  Reading next request
25 Socket  895    1809*   37539  x.x.x.x:1344        x.x.x.x
26 Socket    0  171606   765947  x.x.x.x:1344        x.x.x.x
27 Socket    0  505651   936639  x.x.x.x:1344        x.x.x.x
28 Socket    0   77690   579865  x.x.x.x:1344        x.x.x.x
29 Socket  893 1120129* 1356723  x.x.x.x:1344        x.x.x.x
30 Socket   99    1409*    1067  x.x.x.x:51458  Idle client: Waiting for next request
31 Socket    0  697084   991951  x.x.x.x:1344        x.x.x.x
32 Socket    0   72740   380302  x.x.x.x:1344        x.x.x.x
33 Socket    0  133319  4018875  x.x.x.x:1344        x.x.x.x
34 Socket  885  365084*  418439  x.x.x.x:1344        x.x.x.x
35 Socket    0  230550   976940  x.x.x.x:1344        x.x.x.x
36 Socket    0   72085   159051  x.x.x.x:1344        x.x.x.x
37 Socket    0  142361   344294  x.x.x.x:1344        x.x.x.x
38 Socket    0 1008147  1644576  x.x.x.x:1344        x.x.x.x
39 Socket    0  861819  1334921  x.x.x.x:1344        x.x.x.x
40 Socket 28800    2851*     344  x.x.x.x:60799  Reading next request
41 Socket    0       0        0  [::]:39163            DNS Socket IPv6
42 Socket    0  152497   327514  x.x.x.x:1344        x.x.x.x
43 Socket    0 1139088  1516707  x.x.x.x:1344        x.x.x.x
44 Socket    0  237721   398977  x.x.x.x:1344        x.x.x.x
45 Socket    0   91801   114000  x.x.x.x:1344        x.x.x.x
46 Socket    0       0        0  x.x.x.x:3233    HTTP Request
47 Socket    0  131675   695360  x.x.x.x:1344        x.x.x.x
48 Socket    0  159372   179649  x.x.x.x:1344        x.x.x.x
49 Socket    0       0*       0  x.x.x.x:443    x.x.x.x pinned connection for x.x.x.x (187)
50 Socket    0     161*    1378  x.x.x.x:443      https://domain.org
52 Socket   69     286*    1430  x.x.x.x:55771   Idle client: Waiting for next request
53 Socket    8     397*   48788  x.x.x.x:62572  Idle client: Waiting for next request
54 Socket    0  341879   480589  x.x.x.x:1344        x.x.x.x
55 Socket   91     201*    3315  x.x.x.x:56787   Idle client: Waiting for next request
56 Socket    0  726999  1336667  x.x.x.x:1344        x.x.x.x
57 Socket  113     201*    3316  x.x.x.x:51036  Idle client: Waiting for next request
58 Socket  119     556*    3723  x.x.x.x:51851   Idle client: Waiting for next request
59 Socket   99    1322*     766  x.x.x.x:1968    Idle client: Waiting for next request
60 Socket    0   78554   216848  x.x.x.x:1344        x.x.x.x
61 Socket    0   70211   717853  x.x.x.x:1344        x.x.x.x
62 Socket    0   78361   182762  x.x.x.x:1344        x.x.x.x
63 Socket    0 1945692  4239277  x.x.x.x:1344        x.x.x.x
64 Socket   66    1092*    1117  x.x.x.x:50080   Idle client: Waiting for next request
65 Socket   62     202*     286  x.x.x.x:55769   Idle client: Waiting for next request
66 Socket    0   17396*     904  x.x.x.x:443    https://domain.org
67 Socket    0    3536*    1166  x.x.x.x:443     https://domain.org
68 Socket 28798    3038*     797  x.x.x.x:65116  Reading next request
69 Socket 28798       0*       0  x.x.x.x:1426   client https start
70 Socket 28780       0*       0  x.x.x.x:60791  client https start
71 Socket    0   70387    70867  x.x.x.x:1344        x.x.x.x
72 Socket    0  254449   502590  x.x.x.x:1344        x.x.x.x
73 Socket    9   11524*    1152  x.x.x.x:54067  Idle client: Waiting for next request
74 Socket    0   96195   103010  x.x.x.x:1344        x.x.x.x
75 Socket   28    1516*    1291  x.x.x.x:3023    Idle client: Waiting for next request
76 Socket    0  205806   602151  x.x.x.x:1344        x.x.x.x
77 Socket  115    2195*    1248  x.x.x.x:59024  Idle client: Waiting for next request
78 Socket    0  352877   444820  x.x.x.x:1344        x.x.x.x
79 Socket    6     384*     612  x.x.x.x:80      Idle server: x.x.x.x:80/some_path
80 Socket    0   71272   230010  x.x.x.x:1344        x.x.x.x
81 Socket    5    1490*  168706  x.x.x.x:54376  Idle client: Waiting for next request
82 Socket    0 4403371   651548  x.x.x.x:47443         DNS Socket IPv4
83 Socket    0  782173   984402  x.x.x.x:1344        x.x.x.x
84 Pipe      0       0        0                        unlinkd -> squid
85 Socket 28798     433*       0  x.x.x.x:1423   Reading next request
86 Socket    5    2211*    1249  x.x.x.x:49400  Idle client: Waiting for next request
87 Pipe      0       0        0                        squid -> unlinkd
88 Pipe      0       0        0                        squid -> diskd
89 Socket 28792    4914*    2557  x.x.x.x:3381   Reading next request
90 Socket   66     598*     712  x.x.x.x:2262   Idle client: Waiting for next request
91 Socket    0  486500  1052648  x.x.x.x:1344        x.x.x.x
92 Socket    0   84149   459690  x.x.x.x:1344        x.x.x.x
93 Socket    0  446707   703970  x.x.x.x:1344        x.x.x.x
94 Socket 28797    1744*       0  x.x.x.x:49666  Reading next request
95 Socket    0  196505  1356207  x.x.x.x:1344        x.x.x.x
96 Socket    0   71430   747104  x.x.x.x:1344        x.x.x.x
97 Pipe      0 55385864* 83254354                        ssl_crtd #1
98 Socket   99    4720*   74394  x.x.x.x:51833   Idle client: Waiting for next request
99 Socket    0   80191   352164  x.x.x.x:1344        x.x.x.x
100 Socket    0  831352  1205057  x.x.x.x:1344        x.x.x.x
101 Socket    0   67263    68047  x.x.x.x:1344        x.x.x.x
102 Socket 28734       0*       0  x.x.x.x:56784   client https start
103 Socket    0   90037   239742  x.x.x.x:1344        x.x.x.x
104 Socket    0   86557   182854  x.x.x.x:1344        x.x.x.x
105 Socket    0   74680   272842  x.x.x.x:1344        x.x.x.x
106 Socket    0   82432   182773  x.x.x.x:1344        x.x.x.x
107 Socket    0   91159   110508  x.x.x.x:1344        x.x.x.x
108 Socket    0   74341   182862  x.x.x.x:1344        x.x.x.x
109 Socket   58  354520*  417712  x.x.x.x:1344        x.x.x.x
110 Socket  896  110923*  238345  x.x.x.x:1344        x.x.x.x
111 Socket    0  367211   830710  x.x.x.x:1344        x.x.x.x
112 Socket    0  799681  2454675  x.x.x.x:1344        x.x.x.x
113 Socket    0  174639   526254  x.x.x.x:1344        x.x.x.x
114 Socket    0  224143   626713  x.x.x.x:1344        x.x.x.x
115 Socket    0     825*    4338  x.x.x.x:443    https://domain.org
116 Socket   50       0        0* x.x.x.x:80       domain.org
117 Socket 28799       0        0  x.x.x.x:3208    client https start
118 Socket    0   29387*    3248  x.x.x.x:443   https://domain.org
119 Socket   69   13796*    1117  x.x.x.x:64434  Idle client: Waiting for next request
120 Socket    0  401186   536770  x.x.x.x:1344        x.x.x.x
121 Socket    0   70420    72431  x.x.x.x:1344        x.x.x.x
122 Socket    0 1248701  2243251  x.x.x.x:1344        x.x.x.x
123 Pipe      0 12387700* 18425650                        ssl_crtd #2
124 Socket    0   74579   186204  x.x.x.x:1344        x.x.x.x
125 Socket    0  147688   317832  x.x.x.x:1344        x.x.x.x
126 Socket    0  157570  1000064  x.x.x.x:1344        x.x.x.x
127 Socket    0  484039   932396  x.x.x.x:1344        x.x.x.x
128 Socket    0   72709   204331  x.x.x.x:1344        x.x.x.x
129 Socket    0  121209   121541  x.x.x.x:1344        x.x.x.x
130 Socket    0   89678   203510  x.x.x.x:1344        x.x.x.x
131 Socket    0 1096513  1775872  x.x.x.x:1344        x.x.x.x
132 Socket 28774    1636*       0  x.x.x.x:65117  Reading next request
133 Socket   53     378*    1542  x.x.x.x:80        Idle server: x.x.x.x:80/some_path
134 Socket  108     482*     654  x.x.x.x:59022  Idle client: Waiting for next request
135 Socket    0   67261    67977  x.x.x.x:1344        x.x.x.x
136 Socket    0  353852  1257798  x.x.x.x:1344        x.x.x.x
137 Socket  120    3820*    3424  x.x.x.x:64559  Idle client: Waiting for next request
138 Socket    8     829*    1280  x.x.x.x:3040    Idle client: Waiting for next request
139 Socket 6069       0*       0  x.x.x.x:56177   client https start
140 Socket    0   75215   314184  x.x.x.x:1344        x.x.x.x
141 Socket    0   72428   421624  x.x.x.x:1344        x.x.x.x
142 Socket    0  205459   279606  x.x.x.x:1344        x.x.x.x
143 Socket    0  983140  1528993  x.x.x.x:1344        x.x.x.x
144 Socket    0   72254   128634  x.x.x.x:1344        x.x.x.x
145 Socket  108     470*     654  x.x.x.x:2259   Idle client: Waiting for next request
146 Socket 28798       0        0  x.x.x.x:1839   client https start
147 Socket 28754    6505*    2748  x.x.x.x:2121   Reading next request
148 Socket    0   94387   437023  x.x.x.x:1344        x.x.x.x
149 Socket  112     526*     636  x.x.x.x:54464  Idle client: Waiting for next request
150 Socket    0  291712   418901  x.x.x.x:1344        x.x.x.x
151 Socket    0  260125   466643  x.x.x.x:1344        x.x.x.x
152 Socket    0   75500   192364  x.x.x.x:1344        x.x.x.x
153 Socket   91    6720*   31850  x.x.x.x:51199   Idle client: Waiting for next request
154 Socket    0  340510  3310843  x.x.x.x:1344        x.x.x.x
155 Socket 28799       0        0  x.x.x.x:3206    client https start
156 Socket    0   74500   184502  x.x.x.x:1344        x.x.x.x
157 Socket  888  208562*  377059  x.x.x.x:1344        x.x.x.x
158 Pipe      0 5872190* 8607084                        ssl_crtd #3
159 Socket    0  103064   525215  x.x.x.x:1344        x.x.x.x
160 Socket   98     482*     654  x.x.x.x:60031  Idle client: Waiting for next request
161 Socket   62     516*     675  x.x.x.x:51195   Idle client: Waiting for next request
162 Socket 28799       0        0  x.x.x.x:3209    client https start
163 Socket   66    2211*    2150  x.x.x.x:54426  Idle client: Waiting for next request
164 Socket 28798    3348*     798  x.x.x.x:2255   Reading next request
165 Socket    0  222093   321752  x.x.x.x:1344        x.x.x.x
166 Socket    0  126144   442862  x.x.x.x:1344        x.x.x.x
167 Socket   62   16353*   41096  x.x.x.x:3235    Idle client: Waiting for next request
168 Socket    0   67365    68179  x.x.x.x:1344        x.x.x.x
169 Socket    0    9195*    2294  x.x.x.x:443   https://domain.org
170 Socket  113     201*    3316  x.x.x.x:51037  Idle client: Waiting for next request
171 Socket 28800       0        0  x.x.x.x:55497  client https connect
172 Socket    0  126735   522798  x.x.x.x:1344        x.x.x.x
173 Socket    0   27366*    6978  x.x.x.x:443    https://domain.org
174 Socket 28779    3231*     870  x.x.x.x:2142   Reading next request
175 Socket    0 1214190  1308440  x.x.x.x:1344        x.x.x.x
176 Socket 28745    3983*       0  x.x.x.x:1365   Reading next request
177 Socket 27422       0*       0  x.x.x.x:56749   client https start
178 Socket    0   71305   194143  x.x.x.x:1344        x.x.x.x
179 Socket   66     306*     452  x.x.x.x:1353   Idle client: Waiting for next request
180 Socket 28774    1758*       0  x.x.x.x:59375   Reading next request
181 Socket 28798    3618*     609* x.x.x.x:55780   Reading next request
182 Socket    0  463907  4817276  x.x.x.x:1344        x.x.x.x
183 Socket    0  366549   818689  x.x.x.x:1344        x.x.x.x
184 Pipe      0 3597805* 5272955                        ssl_crtd #4
185 Socket    0  330910   964399  x.x.x.x:1344        x.x.x.x
186 Socket  113     645*    1205  x.x.x.x:4116    Idle client: Waiting for next request
187 Socket 28800     876*       0* x.x.x.x:62588  Reading next request
188 Socket    0 1484456  1616112  x.x.x.x:1344        x.x.x.x
189 Socket    0  902153  1747543  x.x.x.x:1344        x.x.x.x
190 Socket   99   13466*    1117  x.x.x.x:64687   Idle client: Waiting for next request
191 Socket    0       0*       0  x.x.x.x:443    x.x.x.x pinned connection for x.x.x.x (505)
192 Socket   58  277899*  415305  x.x.x.x:1344        x.x.x.x
193 Socket   19     838*     739  x.x.x.x:62578  Idle client: Waiting for next request
194 Socket   58   32594*   53867  x.x.x.x:1344        x.x.x.x
195 Socket    0   74412   748176  x.x.x.x:1344        x.x.x.x
196 Socket    0  294684   832445  x.x.x.x:1344        x.x.x.x
197 Socket  876  431920*  668818  x.x.x.x:1344        x.x.x.x
198 Socket 28744    2487*       0  x.x.x.x:3267    Reading next request
199 Socket  113     201*    3316  x.x.x.x:51238  Idle client: Waiting for next request
200 Socket    0    1043*     886  x.x.x.x:443    https://domain.org
201 Socket 28779    3150*     870  x.x.x.x:2134   Reading next request
202 Socket  104     361*    3527  x.x.x.x:3173    Idle client: Waiting for next request
203 Socket    0       0        0  x.x.x.x:3234    HTTP Request
204 Socket    8    1450*    1308  x.x.x.x:65097  Reading next request
205 Socket   19     566*     784  x.x.x.x:54405  Idle client: Waiting for next request
206 Socket    0 1018301  1251632  x.x.x.x:1344        x.x.x.x
207 Socket    0  243460   725933  x.x.x.x:1344        x.x.x.x
208 Pipe      0 2674774* 3914935                        ssl_crtd #5
209 Socket  115     610*     712  x.x.x.x:64689   Idle client: Waiting for next request
210 Socket    0     764*    7298  x.x.x.x:443    https://domain.org
211 Socket  105    1277*     344  x.x.x.x:2283   Idle client: Waiting for next request
212 Socket    0  131679  1220103  x.x.x.x:1344        x.x.x.x
213 Socket  876   30969*  222063  x.x.x.x:1344        x.x.x.x
214 Socket    0  191177   438150  x.x.x.x:1344        x.x.x.x
215 Socket    0   78829   290995  x.x.x.x:1344        x.x.x.x
216 Socket  112    1002*    1328  x.x.x.x:51197   Idle client: Waiting for next request
217 Socket    0  174193*    3658  x.x.x.x:443    https://domain.org
218 Socket 28781       0*       0  x.x.x.x:60795  client https start
219 Pipe      0 1969670* 2885654                        ssl_crtd #6
220 Socket   67    5709*   13745  x.x.x.x:1366   Idle client: Waiting for next request
221 Socket    0  570053   628689  x.x.x.x:1344        x.x.x.x
222 Socket 28790     308*       0  x.x.x.x:2899   Reading next request
223 Socket 28798     704*  267112  x.x.x.x:1827    Reading next request
224 Pipe      0 1464643* 2151275                        ssl_crtd #7
225 Socket  107    3463*   26520  x.x.x.x:51202   Idle client: Waiting for next request
226 Socket 28799     433*       0  x.x.x.x:1425   Reading next request
227 Socket  118    1424*     344  x.x.x.x:1826    Idle client: Waiting for next request
228 Socket    0  321598   669611  x.x.x.x:1344        x.x.x.x
229 Socket    0       0*       0  x.x.x.x:443    x.x.x.x pinned connection for x.x.x.x (686)
230 Socket   87     909*     718  x.x.x.x:1389   Idle client: Waiting for next request
231 Socket    0   70445    89872  x.x.x.x:1344        x.x.x.x
232 Socket 28797       0*       0  x.x.x.x:3389   client https start
233 Socket    0  145988   147306  x.x.x.x:1344        x.x.x.x
234 Socket    0  586261  1258275  x.x.x.x:1344        x.x.x.x
235 Socket    0  285602   466348  x.x.x.x:1344        x.x.x.x
236 Socket    0  131679  3752672  x.x.x.x:1344        x.x.x.x
237 Socket    0  447059  1790353  x.x.x.x:1344        x.x.x.x
238 Socket    0   87910  2010315  x.x.x.x:1344        x.x.x.x
239 Socket 5812       0*       0  x.x.x.x:56171   client https start
240 Socket   28   48115*    1178  x.x.x.x:80        Idle server: x.x.x.x:80/some_path
241 Socket   66    4466*   18377  x.x.x.x:3268    Idle client: Waiting for next request
242 Socket    0  596879  1296258  x.x.x.x:1344        x.x.x.x
243 Socket    0  568370   987503  x.x.x.x:1344        x.x.x.x
244 Pipe      0 1150405* 1697637                        ssl_crtd #8
245 Socket   56     485*  682630  x.x.x.x:62580  Idle client: Waiting for next request
246 Socket    0  175607  1683506  x.x.x.x:1344        x.x.x.x
247 Socket   16    1424*   17194  x.x.x.x:54395  Idle client: Waiting for next request
248 Socket 28798     829*   12831* x.x.x.x:2308   Reading next request
249 Socket   56     318*     452  x.x.x.x:62585  Idle client: Waiting for next request
250 Socket  875    1734*    5924  x.x.x.x:443    https://domain.org
251 Socket    5     518*   70059  x.x.x.x:54373  Idle client: Waiting for next request
252 Socket    0  149322   313136  x.x.x.x:1344        x.x.x.x
253 Socket    0  589520   836807  x.x.x.x:1344        x.x.x.x
254 Socket 28797       0        0* x.x.x.x:54932   client https start
255 Socket 28771    1660*       0  x.x.x.x:51201   Reading next request
256 Pipe      0  916891* 1351785                        ssl_crtd #9
257 Socket   60   22466*  111364  x.x.x.x:1344        x.x.x.x
258 Socket 28796    3294*    1180  x.x.x.x:59020  Reading next request
259 Socket    0    1055*     872  x.x.x.x:443    https://domain.org
260 Socket    0   14835*     624  x.x.x.x:443    https://domain.org
261 Socket  875  289287*  581694  x.x.x.x:1344        x.x.x.x
262 Socket    7    2437*   10773  x.x.x.x:65303  Idle client: Waiting for next request
263 Socket 28796       0        0  x.x.x.x:3197    client https start
264 Pipe      0  729453* 1059077                        ssl_crtd #10
265 Socket   66    4370*    5763  x.x.x.x:3269    Idle client: Waiting for next request
266 Socket  107    3233*    4119  x.x.x.x:64586  Idle client: Waiting for next request
267 Socket    0  212472   431063  x.x.x.x:1344        x.x.x.x
268 Pipe      0  578076*  850440                        ssl_crtd #11
269 Socket  113     407*     613  x.x.x.x:51460  Idle client: Waiting for next request
270 Socket    0    1101*    4474  x.x.x.x:443    https://domain.org
271 Socket    0 2563693  3830336  x.x.x.x:1344        x.x.x.x
272 Socket    0  828859  1380776  x.x.x.x:1344        x.x.x.x
273 Socket    0   71319   259076  x.x.x.x:1344        x.x.x.x
274 Socket  105     609*     435  x.x.x.x:3171    Idle client: Waiting for next request
275 Socket 28799     433*       0  x.x.x.x:1427   Reading next request
276 Socket    0   74500   185574  x.x.x.x:1344        x.x.x.x
277 Socket    0  189973   564948  x.x.x.x:1344        x.x.x.x
278 Socket   60  129925*  458165  x.x.x.x:1344        x.x.x.x
279 Socket 28783       0*       0  x.x.x.x:60797  client https start
280 Socket 28797     731*       0  x.x.x.x:54488  Reading next request
281 Socket    0   70962    98876  x.x.x.x:1344        x.x.x.x
282 Socket    0   77789   334559  x.x.x.x:1344        x.x.x.x
283 Socket  115     649*     623  x.x.x.x:54482  Idle client: Waiting for next request
284 Socket    0  131737   182857  x.x.x.x:1344        x.x.x.x
285 Socket 28799       0        0  x.x.x.x:3216    client https start
286 Socket   74     469*     555  x.x.x.x:60744  Idle client: Waiting for next request
287 Pipe      0   85247*  124165                        ssl_crtd #1
288 Socket    0  996913  1509983  x.x.x.x:1344        x.x.x.x
289 Pipe      0  466480*  700518                        ssl_crtd #12
290 Socket    0   70702    74868  x.x.x.x:1344        x.x.x.x
291 Socket   88     518*   43112  x.x.x.x:60756  Idle client: Waiting for next request
292 Socket    9   10213*    1158  x.x.x.x:54068  Idle client: Waiting for next request
293 Socket  900  269761*  431423* x.x.x.x:1344        x.x.x.x
294 Socket    0   88023   296477  x.x.x.x:1344        x.x.x.x
295 Socket  113     201*    3316  x.x.x.x:51038  Idle client: Waiting for next request
296 Socket 28800       0        0  x.x.x.x:2385   client https start
297 Socket    0 1409562  1861582  x.x.x.x:1344        x.x.x.x
298 Socket    0   74282   713086  x.x.x.x:1344        x.x.x.x
299 Socket    0   74290   182774  x.x.x.x:1344        x.x.x.x
300 Socket   97    2215*    1301  x.x.x.x:51848   Idle client: Waiting for next request
301 Socket    0   85396   343984  x.x.x.x:1344        x.x.x.x
302 Socket    0   78177   143882  x.x.x.x:1344        x.x.x.x
303 Socket   66    5881*    6604  x.x.x.x:1367   Idle client: Waiting for next request
304 Socket    0 2942297  3069551  x.x.x.x:1344        x.x.x.x
305 Pipe      0  364706*  534055                        ssl_crtd #13
306 Socket 28758       0        0  x.x.x.x:55095  client https start
307 Socket  118     410*    1231  x.x.x.x:2311   Idle client: Waiting for next request
308 Socket    0  503380  1071795  x.x.x.x:1344        x.x.x.x
309 Socket    0   96839   350661  x.x.x.x:1344        x.x.x.x
310 Socket    0  556795  5837880  x.x.x.x:1344        x.x.x.x
311 Socket  112     254*     787  x.x.x.x:50711  Idle client: Waiting for next request
312 Socket 28800       0        0  x.x.x.x:3220    client https start
313 Socket    0   72449   172781  x.x.x.x:1344        x.x.x.x
314 Socket    0  185849  1747378  x.x.x.x:1344        x.x.x.x
315 Socket    0       0        0  x.x.x.x:3232    HTTP Request
316 Socket   87     201*    3316  x.x.x.x:56871  Idle client: Waiting for next request
317 Socket    9     888*    1066  x.x.x.x:2976    Idle client: Waiting for next request
318 Socket    0       0*       0  x.x.x.x:443       x.x.x.x pinned connection for x.x.x.x (269)
319 Socket    0   73737    86419  x.x.x.x:1344        x.x.x.x
320 Socket    0  648346   962465  x.x.x.x:1344        x.x.x.x
321 Socket    0  151927   449211  x.x.x.x:1344        x.x.x.x
322 Socket    0     275*    2398  x.x.x.x:443      https://domain.org
323 Socket    2     354*     466  x.x.x.x:80     Idle server: x.x.x.x:80/some_path
324 Socket  108     470*     654  x.x.x.x:2257   Idle client: Waiting for next request
325 Pipe      0   68850*  103401                        ssl_crtd #2
326 Socket    0       0        0  x.x.x.x:3230    client https connect
327 Socket 28773       0*       0  x.x.x.x:56789   client https start
328 Socket    0  242751   910187  x.x.x.x:1344        x.x.x.x
329 Socket 28730    1146*       0  x.x.x.x:2150   Reading next request
330 Pipe      0  309147*  463388                        ssl_crtd #14
331 Socket 28783    1366*       0  x.x.x.x:64173  Reading next request
332 Socket    0     531*    1360  x.x.x.x:443    https://domain.org
333 Socket    0  467739   655208  x.x.x.x:1344        x.x.x.x
334 Socket    0       0        0  x.x.x.x:55499  client https connect
335 Socket   10    2143*     880  x.x.x.x:54391  Idle client: Waiting for next request
336 Socket  113   10176*    1157  x.x.x.x:31352   Idle client: Waiting for next request
337 Socket    0  520857  1758549  x.x.x.x:1344        x.x.x.x
338 Socket    0  232302   359424  x.x.x.x:1344        x.x.x.x
339 Socket   59  164364*  422776  x.x.x.x:1344        x.x.x.x
340 Socket    0 1459622  1885753  x.x.x.x:1344        x.x.x.x
341 Socket 28800       0        0  x.x.x.x:60102  client https start
342 Socket   16     201*    3316  x.x.x.x:54400  Idle client: Waiting for next request
343 Socket 28799     433*       0  x.x.x.x:1429   Reading next request
344 Socket    0  170597   572080  x.x.x.x:1344        x.x.x.x
345 Pipe      0  256576*  380163                        ssl_crtd #15
346 Socket   16     399*     286  x.x.x.x:61194   Idle client: Waiting for next request
347 Pipe      0   59571*   89389                        ssl_crtd #3
348 Socket   19     563*     784  x.x.x.x:54402  Idle client: Waiting for next request
349 Socket 28800       0        0  x.x.x.x:3219    client https start
350 Socket    0  381663  1005072  x.x.x.x:1344        x.x.x.x
351 Socket 28799    2283*       0  x.x.x.x:49667  Reading next request
352 Socket  112     964*    1306  x.x.x.x:51189   Idle client: Waiting for next request
353 Pipe      0  218850*  321361                        ssl_crtd #16
354 Socket  106     526*     276  x.x.x.x:51461  Idle client: Waiting for next request
355 Socket   19     573*     784  x.x.x.x:54403  Idle client: Waiting for next request
356 Socket   66     490*    8229  x.x.x.x:3144    Idle client: Waiting for next request
357 Pipe      0  179339*  269018                        ssl_crtd #17
358 Socket 28800       0        0  x.x.x.x:3217    client https start
359 Socket 28798       0        0  x.x.x.x:1840   client https start
360 Socket    0 1080220  1947420  x.x.x.x:1344        x.x.x.x
361 Socket    0       0        0  x.x.x.x:443     x.x.x.x pinned connection for x.x.x.x (46)
362 Socket    0  217293   913828  x.x.x.x:1344        x.x.x.x
363 Socket   44     630*    2746  x.x.x.x:80     Idle server: x.x.x.x:80/some_path
364 Socket    0   12335*   15764  x.x.x.x:443      https://domain.org
365 Socket 28800       0        0  x.x.x.x:3221    client https start
366 Socket    0       0*       0  x.x.x.x:443    x.x.x.x pinned connection for x.x.x.x (479)
367 Socket    0  343536   972237  x.x.x.x:1344        x.x.x.x
368 Socket    0 1138072  1520823  x.x.x.x:1344        x.x.x.x
369 Socket    0       0*       0  x.x.x.x:443       x.x.x.x pinned connection for x.x.x.x (254)
370 Socket   19     563*     784  x.x.x.x:54404  Idle client: Waiting for next request
371 Socket   98     537*    1246  x.x.x.x:54444  Idle client: Waiting for next request
372 Socket    0  860350  1104913  x.x.x.x:1344        x.x.x.x
373 Socket    0    1060*   23048  x.x.x.x:443    https://domain.org
374 Socket    0    1066*   20478  x.x.x.x:443    https://domain.org
375 Socket 28799       0        0  x.x.x.x:3210    client https start
376 Socket  900       0*    4618  x.x.x.x:443    https://domain.org
377 Pipe      0   55913*   81124                        ssl_crtd #4
378 Socket  113     201*    3316  x.x.x.x:51039  Idle client: Waiting for next request
379 Socket    0       0*       0  x.x.x.x:443      x.x.x.x pinned connection for x.x.x.x (263)
380 Socket  113     201*    3316  x.x.x.x:51040  Idle client: Waiting for next request
381 Socket   46    3906*   24391  x.x.x.x:1344        x.x.x.x
382 Socket 28798       0        0  x.x.x.x:2320   client https start
383 Socket    0   72481   157154  x.x.x.x:1344        x.x.x.x
384 Pipe      0  133145*  199159                        ssl_crtd #18
385 Socket 28776    7538*    1630  x.x.x.x:54399  Reading next request
386 Pipe      0    7025*   10746                        ssl_crtd #1
387 Socket   86     482*     654  x.x.x.x:49662  Idle client: Waiting for next request
388 Socket   91    1173*     343  x.x.x.x:60760  Idle client: Waiting for next request
389 Socket    0 1560783  3101138  x.x.x.x:1344        x.x.x.x
390 Socket 28796       0        0  x.x.x.x:3198    client https start
391 Socket    0  580399   792546  x.x.x.x:1344        x.x.x.x
392 Socket    0   78307   198904  x.x.x.x:1344        x.x.x.x
393 Socket 28737       0*       0  x.x.x.x:51806  client https start
394 Socket   18     470*    3778  x.x.x.x:3088    Idle client: Waiting for next request
395 Socket 28800       0        0  x.x.x.x:3223    client https start
396 Socket    0       0        0  x.x.x.x:3235    HTTP Request
397 Socket    7    1934*     615  x.x.x.x:54066  Idle client: Waiting for next request
398 Pipe      0  113172*  166273                        ssl_crtd #19
399 Socket  893  195206*  214787  x.x.x.x:1344        x.x.x.x
400 Socket 28754   10860*   10436  x.x.x.x:4100    Reading next request
401 Socket   17     201*    1324  x.x.x.x:80       Idle server: x.x.x.x:80/some_path
402 Socket    0 2234270  2503172  x.x.x.x:1344        x.x.x.x
403 Socket 28800    5134*    2537  x.x.x.x:1834   Reading next request
404 Socket 28772    1637*       0  x.x.x.x:51847   Reading next request
405 Socket   54     306*     452  x.x.x.x:31306   Idle client: Waiting for next request
406 Socket   63     819*    1961  x.x.x.x:52887  Idle client: Waiting for next request
407 Socket   28     253*    2550  x.x.x.x:3093    Idle client: Waiting for next request
408 Socket 28793     536*    8935* x.x.x.x:60800  Reading next request
409 Socket    0   67261    67880  x.x.x.x:1344        x.x.x.x
410 Pipe      0    7959*   12590                        ssl_crtd #2
411 Pipe      0   37269*   56216                        ssl_crtd #5
412 Socket    0   76888   138606  x.x.x.x:1344        x.x.x.x
413 Socket 28800       0        0  x.x.x.x:3225    client https start
414 Socket   98     549*    1141  x.x.x.x:54445  Idle client: Waiting for next request
415 Socket    0  873728  1316366  x.x.x.x:1344        x.x.x.x
416 Socket    0       0*       0  x.x.x.x:443      x.x.x.x pinned connection for x.x.x.x (390)
417 Socket   97     482*     654  x.x.x.x:49408  Idle client: Waiting for next request
418 Socket    0 4690935  6430992  x.x.x.x:1344        x.x.x.x
419 Pipe      0    7549*   11042                        ssl_crtd #3
420 Socket    0 1058661  1673219  x.x.x.x:1344        x.x.x.x
421 Socket 28796   10874*  125020* x.x.x.x:54421  Reading next request
422 Socket    0  619900  1893341  x.x.x.x:1344        x.x.x.x
423 Socket    0  484497   639048  x.x.x.x:1344        x.x.x.x
424 Socket    0       0*       0  x.x.x.x:443      x.x.x.x pinned connection for x.x.x.x (497)
425 Socket 28798       0        0  x.x.x.x:3200    client https start
426 Socket    0  217686   282356  x.x.x.x:1344        x.x.x.x
427 Socket    0  171843  2226884  x.x.x.x:1344        x.x.x.x
428 Socket    0  742382  1291857  x.x.x.x:1344        x.x.x.x
429 Socket  104     249*     776  x.x.x.x:61437   Idle client: Waiting for next request
430 Socket  876  338749*  449700  x.x.x.x:1344        x.x.x.x
431 Socket    0  638966   976750  x.x.x.x:1344        x.x.x.x
432 Socket    0   67626   109037  x.x.x.x:1344        x.x.x.x
433 Socket 28799       0        0  x.x.x.x:3207    client https start
434 Socket    0  539438   762345  x.x.x.x:1344        x.x.x.x
435 Socket    0  529527   740350  x.x.x.x:1344        x.x.x.x
436 Socket    0  133828   244486  x.x.x.x:1344        x.x.x.x
437 Socket   91     273*    3437  x.x.x.x:55776   Idle client: Waiting for next request
438 Socket 28799       0        0  x.x.x.x:3212    client https start
439 Socket    0  175285   360548  x.x.x.x:1344        x.x.x.x
440 Socket 28800       0        0  x.x.x.x:55498  client https connect
441 Socket  900  866564* 1274512* x.x.x.x:1344        x.x.x.x
442 Socket    0  104615   259266  x.x.x.x:1344        x.x.x.x
443 Socket    0  767495  1513964  x.x.x.x:1344        x.x.x.x
444 Socket  113     557*    3604  x.x.x.x:3187    Idle client: Waiting for next request
445 Socket    0  589528   777412  x.x.x.x:1344        x.x.x.x
446 Pipe      0   99772*  143323                        ssl_crtd #20
447 Socket    0   51392*    5692  x.x.x.x:443    https://domain.org
448 Socket    0     622*    3326  x.x.x.x:443    https://domain.org
449 Socket    0  178130   479705  x.x.x.x:1344        x.x.x.x
450 Socket    0   75335   249026  x.x.x.x:1344        x.x.x.x
451 Socket    0  584110  1041464  x.x.x.x:1344        x.x.x.x
452 Socket    0 5989855  7840009  x.x.x.x:1344        x.x.x.x
453 Socket    0   70378   183780  x.x.x.x:1344        x.x.x.x
454 Socket    9     397*     817  x.x.x.x:60714  Idle client: Waiting for next request
455 Socket    0       0*       0  x.x.x.x:443    x.x.x.x pinned connection for x.x.x.x (615)
456 Socket    0   67473    70236  x.x.x.x:1344        x.x.x.x
457 Socket  113     647*     811  x.x.x.x:54477  Idle client: Waiting for next request
458 Socket  106     277*    3421  x.x.x.x:55778   Idle client: Waiting for next request
459 Socket    0   80521   283037  x.x.x.x:1344        x.x.x.x
460 Socket   98     598*     712  x.x.x.x:50085   Idle client: Waiting for next request
461 Socket    0  167275   298854  x.x.x.x:1344        x.x.x.x
462 Socket 28781       0*       0  x.x.x.x:60792  client https start
463 Socket  115     281*    3428  x.x.x.x:55779   Idle client: Waiting for next request
464 Socket    0   10405*    4874  x.x.x.x:443    https://domain.org
465 Socket    0    1025*   27592  x.x.x.x:443    https://domain.org
466 Socket    0       0*       0  x.x.x.x:443     x.x.x.x pinned connection for x.x.x.x (9)
467 Socket   98     555*    2252  x.x.x.x:60770  Idle client: Waiting for next request
468 Socket    0    9354*    2314  x.x.x.x:443   https://domain.org
469 Socket    0   91540   325953  x.x.x.x:1344        x.x.x.x
470 Socket    0  762551  1389788  x.x.x.x:1344        x.x.x.x
471 Socket   74    7830*   12535  x.x.x.x:4097    Idle client: Waiting for next request
472 Socket    0  380016   476604  x.x.x.x:1344        x.x.x.x
473 Socket  885   15670*   85733  x.x.x.x:1344        x.x.x.x
474 Socket    0  406074   456587  x.x.x.x:1344        x.x.x.x
475 Socket 28800    1335*     253  x.x.x.x:3180    Reading next request
476 Socket   46     315*    4617  x.x.x.x:1344        x.x.x.x
477 Socket   58   32530*   49384  x.x.x.x:1344        x.x.x.x
478 Socket    0  172630   242324  x.x.x.x:1344        x.x.x.x
479 Socket  118     387*    3558  x.x.x.x:2316   Idle client: Waiting for next request
480 Socket    0   74290   182781  x.x.x.x:1344        x.x.x.x
481 Socket    0   80770   197294  x.x.x.x:1344        x.x.x.x
482 Socket    0   75048   281261  x.x.x.x:1344        x.x.x.x
483 Socket    0   74554   185351  x.x.x.x:1344        x.x.x.x
484 Socket   97     482*     654  x.x.x.x:49409  Idle client: Waiting for next request
485 Socket   60    1302*   11029  x.x.x.x:1344        x.x.x.x
486 Socket   86    4856*    5810  x.x.x.x:4112    Idle client: Waiting for next request
487 Socket  105     250*     779  x.x.x.x:56421  Idle client: Waiting for next request
488 Socket    0    2063*    4526  x.x.x.x:443    https://domain.org
489 Pipe      0   30386*   47145                        ssl_crtd #6
490 Socket 28756       0        0  x.x.x.x:55093  client https start
491 Socket 28800    5190*    1214  x.x.x.x:1835   Reading next request
492 Socket  878     105*    4307  x.x.x.x:1344        x.x.x.x
493 Socket    0       0*       0  x.x.x.x:443      x.x.x.x pinned connection for x.x.x.x (232)
494 Socket  900     429      866  x.x.x.x:443   https://domain.org
495 Socket  900  160740*  529879* x.x.x.x:1344        x.x.x.x
496 Socket    0  474171   673500  x.x.x.x:1344        x.x.x.x
497 Socket  113     331*    3485  x.x.x.x:54480  Idle client: Waiting for next request
498 Socket   74    1595*     730  x.x.x.x:49696  Idle client: Waiting for next request
499 Socket    0  559618   865116  x.x.x.x:1344        x.x.x.x
500 Socket  898     595*    3540  x.x.x.x:443    https://domain.org
501 Socket    0   75127   273504  x.x.x.x:1344        x.x.x.x
502 Socket    0  171003   603908  x.x.x.x:1344        x.x.x.x
503 Socket    0  377031   835100  x.x.x.x:1344        x.x.x.x
504 Socket    0   67366    69093  x.x.x.x:1344        x.x.x.x
505 Socket   88     520*     675  x.x.x.x:51841   Idle client: Waiting for next request
506 Socket    0   70420    71693  x.x.x.x:1344        x.x.x.x
507 Socket    0   71047   275124  x.x.x.x:1344        x.x.x.x
508 Socket    0  196158*   23334  x.x.x.x:443    https://domain.org
509 Socket    0       0*       0  ::1:48239             ext_wbinfo_group_acl #1
510 Socket    0  136980   194711  x.x.x.x:1344        x.x.x.x
511 Socket  898    9550*   41835  x.x.x.x:1344        x.x.x.x
512 Socket    0  921556  1321574  x.x.x.x:1344        x.x.x.x
513 Socket   98     537*    1068  x.x.x.x:54446  Idle client: Waiting for next request
514 Socket    0   70273   182857  x.x.x.x:1344        x.x.x.x
515 Socket    0       0        0  x.x.x.x:443     x.x.x.x pinned connection for x.x.x.x (315)
516 Socket   74     507*    1559  x.x.x.x:60741  Idle client: Waiting for next request
517 Socket   87    1531*   29663  x.x.x.x:54429  Idle client: Waiting for next request
518 Socket   87    1085*    9379  x.x.x.x:54430  Idle client: Waiting for next request
519 Socket    0   36043*     842  x.x.x.x:443      https://domain.org
520 Socket    0  156225   280780  x.x.x.x:1344        x.x.x.x
521 Socket   87    1095*    9538  x.x.x.x:54431  Idle client: Waiting for next request
522 Socket    0 1090575  1456044  x.x.x.x:1344        x.x.x.x
523 Socket    0   67263    67988  x.x.x.x:1344        x.x.x.x
524 Socket    0  133693   347078  x.x.x.x:1344        x.x.x.x
525 Socket    0       0*       0  x.x.x.x:443   x.x.x.x pinned connection for x.x.x.x (69)
526 Socket  898  311676*  510052  x.x.x.x:1344        x.x.x.x
527 Socket  900     425      866  x.x.x.x:443   https://domain.org
528 Socket    0       0*       0  ::1:59459             ext_wbinfo_group_acl #2
529 Socket    0   78353   989595  x.x.x.x:1344        x.x.x.x
530 Socket    0    1096*    1782  x.x.x.x:443    https://domain.org
531 Socket 28800       0        0  x.x.x.x:3222    client https start
532 Socket    0       0*       0  x.x.x.x:443    x.x.x.x pinned connection for x.x.x.x (764)
533 Socket    0   71390   110141  x.x.x.x:1344        x.x.x.x
534 Socket    0 1203421  1809900  x.x.x.x:1344        x.x.x.x
535 Socket    0   70832    76525  x.x.x.x:1344        x.x.x.x
536 Socket  118     417*    1219  x.x.x.x:2310   Idle client: Waiting for next request
537 Socket   77     662*     275  x.x.x.x:1392   Idle client: Waiting for next request
538 Socket    0   76434   486358  x.x.x.x:1344        x.x.x.x
539 Socket  898  445876*  531378  x.x.x.x:1344        x.x.x.x
540 Socket    0       0        0  x.x.x.x:443     x.x.x.x pinned connection for x.x.x.x (203)
541 Socket    0   69878*    1098  x.x.x.x:443    https://domain.org
542 Socket   46     384*     612  x.x.x.x:80      Idle server: x.x.x.x:80/some_path
543 Socket    0     636*     794  x.x.x.x:443    https://domain.org
544 Socket    0 2182761  2218810  x.x.x.x:1344        x.x.x.x
545 Socket   46  150988*  321272  x.x.x.x:1344        x.x.x.x
546 Socket    0   68503    78530  x.x.x.x:1344        x.x.x.x
547 Socket  896    1598*    6692  x.x.x.x:443    https://domain.org
548 Socket    0       0*       0  x.x.x.x:443   x.x.x.x pinned connection for x.x.x.x (13)
549 Socket  900       0*     866  x.x.x.x:443   https://domain.org
550 Socket 28799       0        0  x.x.x.x:3203    client https start
551 Socket   59  302774*  595817  x.x.x.x:1344        x.x.x.x
552 Socket    0     515*    1112  x.x.x.x:443     https://domain.org
553 Socket    7     395*     286  x.x.x.x:61191   Idle client: Waiting for next request
554 Socket    0  438847   475815  x.x.x.x:1344        x.x.x.x
555 Socket    0 1666817  2225879  x.x.x.x:1344        x.x.x.x
556 Socket    0       0*       0  x.x.x.x:443    x.x.x.x pinned connection for x.x.x.x (625)
557 Socket    0   87652   250185  x.x.x.x:1344        x.x.x.x
558 Socket    0  888616  1629204  x.x.x.x:1344        x.x.x.x
559 Socket  878    2012*   15232  x.x.x.x:443    https://domain.org
560 Socket   85     201*    3316  x.x.x.x:49698  Idle client: Waiting for next request
561 Socket 28774    2910*    1058  x.x.x.x:64166  Reading next request
562 Socket  898    1211*    6180  x.x.x.x:443    https://domain.org
563 Socket   97     940*    1308  x.x.x.x:3376   Idle client: Waiting for next request
564 Socket    0     275*    4748  x.x.x.x:443      https://domain.org
565 Socket   15    1446*    1306  x.x.x.x:51817   Reading next request
566 Socket    0       0*       0  x.x.x.x:443    x.x.x.x pinned connection for x.x.x.x (324)
567 Socket    0  594802   827936  x.x.x.x:1344        x.x.x.x
568 Socket    0  303279   409733  x.x.x.x:1344        x.x.x.x
569 Socket  117    1849*     615  x.x.x.x:2304   Idle client: Waiting for next request
570 Socket    0    3110*    7764  x.x.x.x:443      https://domain.org
571 Socket    0   75913*    9544  x.x.x.x:443    https://domain.org
572 Socket   57     198*     286  x.x.x.x:55768   Idle client: Waiting for next request
573 Socket   27    2763*   51668  x.x.x.x:62577  Idle client: Waiting for next request
574 Socket    0    1025*    2184  x.x.x.x:443    https://domain.org
575 Socket   99   11511*  192197  x.x.x.x:50483   Idle client: Waiting for next request
576 Socket    0       0*       0  ::1:37181             ext_wbinfo_group_acl #3
577 Socket  113    1181*     629  x.x.x.x:51203   Idle client: Waiting for next request
578 Socket    0  125227   327390  x.x.x.x:1344        x.x.x.x
579 Socket    0   80821   222391  x.x.x.x:1344        x.x.x.x
580 Socket 28798       0        0  x.x.x.x:1841   client https start
581 Socket 28798       0        0  x.x.x.x:2321   client https start
582 Socket    0       0        0  x.x.x.x:443     x.x.x.x pinned connection for x.x.x.x (396)
583 Socket    0       0*       0  ::1:39025             ext_wbinfo_group_acl #4
584 Socket 28798       0        0  x.x.x.x:2322   client https start
585 Socket    0   67261    67974  x.x.x.x:1344        x.x.x.x
586 Socket  900  192830*    7818  x.x.x.x:443     https://domain.org
587 Socket    0  464123  1899880  x.x.x.x:1344        x.x.x.x
588 Socket    0   74290   182755  x.x.x.x:1344        x.x.x.x
589 Socket    0     647*    1728  x.x.x.x:443    https://domain.org
590 Socket    0       0*       0  x.x.x.x:443    x.x.x.x pinned connection for x.x.x.x (145)
591 Socket 28799       0        0  x.x.x.x:2323   client https start
592 Socket 28799       0        0  x.x.x.x:3201    client https start
593 Pipe      0   18335*   25554                        ssl_crtd #7
594 Socket   91     292*     452  x.x.x.x:52893  Idle client: Waiting for next request
595 Socket    0  302843  1136496  x.x.x.x:1344        x.x.x.x
596 Socket 28800       0        0  x.x.x.x:2386   client https start
597 Socket    0   86639   207373  x.x.x.x:1344        x.x.x.x
598 Socket    0       0*       0  x.x.x.x:443      x.x.x.x pinned connection for x.x.x.x (279)
599 Socket    0       0*       0  ::1:51769             ext_wbinfo_group_acl #5
600 Socket    0   71364   312248  x.x.x.x:1344        x.x.x.x
601 Socket    0  919397  1075737  x.x.x.x:1344        x.x.x.x
602 Socket    0  180943  1358113  x.x.x.x:1344        x.x.x.x
603 Socket 28799       0        0  x.x.x.x:3214    client https start
604 Socket    0     692*    1178  x.x.x.x:443    https://domain.org
605 Socket   62    7966*   12814  x.x.x.x:1230   Idle client: Waiting for next request
606 Socket    0     638*    7316  x.x.x.x:443    https://domain.org
607 Socket   23     306*     452  x.x.x.x:1767    Idle client: Waiting for next request
608 Socket 28799       0        0  x.x.x.x:3205    client https start
609 Socket    0   85591   164291  x.x.x.x:1344        x.x.x.x
610 Socket    0     692*    1198  x.x.x.x:443    https://domain.org
611 Socket 28785       0*       0  x.x.x.x:3183    client https start
612 Socket    0     692*    1178  x.x.x.x:443    https://domain.org
613 Socket    0       0*       0  x.x.x.x:443    x.x.x.x pinned connection for x.x.x.x (134)
614 Socket  900   28870*  195741* x.x.x.x:1344        x.x.x.x
615 Socket 28754       0        0  x.x.x.x:55092  client https start
616 Socket  118     390*   36111  x.x.x.x:2319   Idle client: Waiting for next request
617 Socket   98     555*    2252  x.x.x.x:60769  Idle client: Waiting for next request
618 Socket  299       0*       0  x.x.x.x:1828    client http connect
619 Socket    0  473529   793634  x.x.x.x:1344        x.x.x.x
620 Socket  900  450715*  716503  x.x.x.x:1344        x.x.x.x
621 Socket 28799       0        0  x.x.x.x:3202    client https start
622 Socket    0     692*    1184  x.x.x.x:443    https://domain.org
623 Socket  874   16754*   21876  x.x.x.x:443      https://domain.org
624 Socket 28788    4986*    1596  x.x.x.x:49406  Reading next request
625 Socket   98     482*     654  x.x.x.x:64171  Idle client: Waiting for next request
626 Pipe      0   14687*   22194                        ssl_crtd #8
627 Socket   59     210*    2635  x.x.x.x:1344        x.x.x.x
628 Socket    0  134507  1462114  x.x.x.x:1344        x.x.x.x
629 Socket    0  108885* 2533583* ::1:34453             squid_url_lookup.pl #1
630 Socket    0   72439   150972  x.x.x.x:1344        x.x.x.x
631 Socket 28799       0        0  x.x.x.x:3204    client https start
632 Socket  879     734*    6486  x.x.x.x:443    https://domain.org
633 Socket    0 1051410  1201280  x.x.x.x:1344        x.x.x.x
634 Socket 28799       0        0  x.x.x.x:3211    client https start
635 Socket  879     734*    6648  x.x.x.x:443    https://domain.org
636 Socket    0       0*       0  x.x.x.x:443     x.x.x.x pinned connection for x.x.x.x (611)
637 Socket    0  163962   604624  x.x.x.x:1344        x.x.x.x
638 Socket    0   48696*     856  x.x.x.x:443     https://domain.org
639 Socket    0  729827  1196381  x.x.x.x:1344        x.x.x.x
640 Socket    0  232516   347567  x.x.x.x:1344        x.x.x.x
641 Socket 28798    3754*  128113  x.x.x.x:2303   Reading next request
642 Socket    0  325777   602015  x.x.x.x:1344        x.x.x.x
643 Socket 28799       0        0  x.x.x.x:3213    client https start
644 Socket   18     397*     265  x.x.x.x:1258   Idle client: Waiting for next request
645 Socket   99    3596*     822  x.x.x.x:54417  Idle client: Waiting for next request
646 Pipe      0   14180*   21549                        ssl_crtd #9
647 Socket    0  571668  1758812  x.x.x.x:1344        x.x.x.x
648 Socket    0     252*    3372  x.x.x.x:443    https://domain.org
649 Socket    0   68228   116478  x.x.x.x:1344        x.x.x.x
650 Socket    0     582*    1818  x.x.x.x:443   https://domain.org
651 Pipe      0    7520*   11022                        ssl_crtd #10
652 Socket   90     435*     285  x.x.x.x:3386   Idle client: Waiting for next request
653 Socket 28799       0        0  x.x.x.x:3215    client https start
654 Socket   99    1110*    2214  x.x.x.x:60771  Idle client: Waiting for next request
655 Socket 28800       0        0  x.x.x.x:3218    client https connect
656 Socket    0     882*    1880  x.x.x.x:443    https://domain.org
657 Socket   59       0        0* x.x.x.x:80        domain.org
658 Socket    0    1283*    4442  x.x.x.x:443    https://domain.org
659 Socket    0       0        0  x.x.x.x:443    x.x.x.x pinned connection for x.x.x.x (807)
660 Socket   90     435*     285  x.x.x.x:3384   Idle client: Waiting for next request
661 Socket 28800       0        0  x.x.x.x:3224    client https start
662 Socket    0  365673   608482  x.x.x.x:1344        x.x.x.x
663 Socket    0   81625   110628  x.x.x.x:1344        x.x.x.x
664 Socket 28800     156*       0* ::1:35046             Reading next request
665 Socket   97    2215*    1279  x.x.x.x:51849   Idle client: Waiting for next request
666 Socket   90     435*     285  x.x.x.x:3385   Idle client: Waiting for next request
667 Socket    0     620*    1220  x.x.x.x:443    https://domain.org
668 Socket 28800     201*       0* x.x.x.x:50010  Reading next request
669 Socket    0  136145   440062  x.x.x.x:1344        x.x.x.x
670 Socket    0   17564*  323089* ::1:33603             squid_url_lookup.pl #2
671 Socket   91    2348*     343  x.x.x.x:60757  Idle client: Waiting for next request
672 Socket  118     421*   17488  x.x.x.x:51046  Idle client: Waiting for next request
673 Socket 28800       0        0  x.x.x.x:3228    client https start
674 Socket    0  168525*    3042  x.x.x.x:443    https://domain.org
675 Socket    0  449451  1179110  x.x.x.x:1344        x.x.x.x
676 Socket    0   81705   176401  x.x.x.x:1344        x.x.x.x
677 Socket 28800       0        0  x.x.x.x:3229    client https connect
678 Socket    0  607338   804760  x.x.x.x:1344        x.x.x.x
679 Socket    0       0*       0  x.x.x.x:443    x.x.x.x pinned connection for x.x.x.x (417)
680 Socket    0    7879*  141662  ::1:59195             squid_url_lookup.pl #3
681 Socket    0       0*       0  x.x.x.x:443    x.x.x.x pinned connection for x.x.x.x (387)
682 Socket    0       0*       0  x.x.x.x:443    x.x.x.x pinned connection for x.x.x.x (393)
683 Socket    0       0*       0  x.x.x.x:443    x.x.x.x pinned connection for x.x.x.x (70)
684 Socket 28800    5112*    2235  x.x.x.x:1838   Reading next request
685 Socket    0     586*     990  x.x.x.x:443    https://domain.org
686 Socket   99     482*     654  x.x.x.x:60032  Idle client: Waiting for next request
687 Socket    0    1065*   20404  x.x.x.x:443    https://domain.org
688 Socket    0    4874*   61424  ::1:48333             squid_url_lookup.pl #4
689 Socket    0  225785   342266  x.x.x.x:1344        x.x.x.x
690 Socket    0       0*       0  x.x.x.x:443    x.x.x.x pinned connection for x.x.x.x (484)
691 Socket    0  247595   638177  x.x.x.x:1344        x.x.x.x
692 Socket    0     544*    1104  x.x.x.x:443    https://domain.org
693 Socket    0   70387    70862  x.x.x.x:1344        x.x.x.x
694 Socket 27680       0*       0  x.x.x.x:56755   client https start
695 Socket  300       0*       0  x.x.x.x:60802  client http connect
696 Socket    0       0        0  x.x.x.x:3231    HTTP Request
697 Socket    0   67261    67986  x.x.x.x:1344        x.x.x.x
698 Socket    0    1129*    2870  x.x.x.x:443    https://domain.org
700 Socket    0       0*       0  x.x.x.x:443    x.x.x.x pinned connection for x.x.x.x (462)
702 Socket   18     402*     266  x.x.x.x:1262   Idle client: Waiting for next request
703 Socket    9    1338*     634  x.x.x.x:80     Idle server: x.x.x.x:80/some_path
704 Socket   58     491*  682630  x.x.x.x:62581  Idle client: Waiting for next request
705 Socket    0   67626    91631  x.x.x.x:1344        x.x.x.x
706 Socket    0   67780   149096  x.x.x.x:1344        x.x.x.x
707 Socket    0   93177   639083  x.x.x.x:1344        x.x.x.x
708 Socket    0  875386  1172221  x.x.x.x:1344        x.x.x.x
709 Socket  876     588*    3324  x.x.x.x:443    https://domain.org
710 Socket   19     444*     384  x.x.x.x:1265   Idle client: Waiting for next request
711 Socket   19     425*     384  x.x.x.x:1266   Idle client: Waiting for next request
712 Socket    0       0*       0  x.x.x.x:443    x.x.x.x pinned connection for x.x.x.x (218)
716 Socket   57     420*     158  x.x.x.x:62586  Idle client: Waiting for next request
717 Socket    0    1491*    1066  x.x.x.x:443      https://domain.org
719 Socket    0  169746*   21748  x.x.x.x:443    https://domain.org
720 Socket    0   17102*    2910  x.x.x.x:443    https://domain.org
721 Socket    0    3279*   43331  ::1:42983             squid_url_lookup.pl #5
722 Socket    0  256289   269402  x.x.x.x:1344        x.x.x.x
723 Socket    0    7714*    2384  x.x.x.x:443    https://domain.org
724 Socket    0    1830*   24920  ::1:47149             squid_url_lookup.pl #6
725 Socket    0       0*       0  x.x.x.x:443      x.x.x.x pinned connection for x.x.x.x (327)
726 Socket    0 1063154  1790141  x.x.x.x:1344        x.x.x.x
727 Socket    0     616*   13608  ::1:48873             squid_url_lookup.pl #7
729 Socket   18     329*    3506  x.x.x.x:1267   Idle client: Waiting for next request
730 Socket    0   67260    67952  x.x.x.x:1344        x.x.x.x
731 Socket    0   32251*   13544  x.x.x.x:443    https://domain.org
732 Socket    0   12614*   16036  x.x.x.x:443      https://domain.org
733 Socket    0     298*    5090  ::1:59995             squid_url_lookup.pl #8
734 Socket    0     638*    3252  x.x.x.x:443     https://domain.org
735 Socket    0     252*    2900  x.x.x.x:443    https://domain.org
736 Socket  900    2405*   10516  x.x.x.x:443    https://domain.org
737 Socket    0     241*    2542  ::1:44247             squid_url_lookup.pl #9
738 Socket    0  256065  1016479  x.x.x.x:1344        x.x.x.x
740 Socket    0   69188   114543  x.x.x.x:1344        x.x.x.x
741 Socket   97     940*    1308  x.x.x.x:3379   Idle client: Waiting for next request
742 Socket  900   41281*    1514  x.x.x.x:443    https://domain.org
743 Socket    0  681278  1185273  x.x.x.x:1344        x.x.x.x
744 Socket    0       0*       0  x.x.x.x:443    x.x.x.x pinned connection for x.x.x.x (306)
745 Socket  900    1082*   10628  x.x.x.x:443    https://domain.org
746 Socket    0    5718*    9764  x.x.x.x:443      https://domain.org
747 Socket    0     620*    1196  x.x.x.x:443    https://domain.org
748 Socket    0     207*    2293  ::1:33591             squid_url_lookup.pl #10
749 Socket    0       0        0  [::]:3128             HTTP Socket
750 Socket  876     592*    3568  x.x.x.x:443    https://domain.org
751 Socket    0       0        0  [::]:3129             HTTP Socket
752 Socket    0   71255   145856  x.x.x.x:1344        x.x.x.x
753 Socket    0       0*       0  x.x.x.x:443    x.x.x.x pinned connection for x.x.x.x (569)
754 Socket    0       0        0  [::]:3130             HTTPS Socket
755 Socket    0       0*       0  x.x.x.x:443    x.x.x.x pinned connection for x.x.x.x (490)
756 Socket    0   70375   184071  x.x.x.x:1344        x.x.x.x
758 Socket    0   68918   187587  x.x.x.x:1344        x.x.x.x
760 Socket    0  132072   189220  x.x.x.x:1344        x.x.x.x
762 Socket    0     367*    1280  x.x.x.x:443       https://domain.org
763 Socket    0   74474   206574  x.x.x.x:1344        x.x.x.x
764 Socket   87     482*     654  x.x.x.x:49665  Idle client: Waiting for next request
765 Socket    0       0        0  ::1:50813             pinger
766 File      0       0   993744                        /var/cache/squid/swap.state
767 Socket  893    2800*    9984  x.x.x.x:443    https://domain.org
769 Socket    0     537*    2414  x.x.x.x:443    https://domain.org
770 Socket    0     628*    3372  x.x.x.x:443    https://domain.org
771 Socket    0  306851   815547  x.x.x.x:1344        x.x.x.x
772 Socket   56     516*     676  x.x.x.x:54415  Idle client: Waiting for next request
773 Socket    0     620*    1196  x.x.x.x:443    https://domain.org
774 Socket    0   43044*    1098  x.x.x.x:443       https://domain.org
775 Socket    0    2458*     568  x.x.x.x:443     https://domain.org
776 Socket    0     173*     794  x.x.x.x:443    https://domain.org
777 Socket    0  131967   194732  x.x.x.x:1344        x.x.x.x
778 Socket    0   30285*    1720  x.x.x.x:443     https://domain.org
780 Socket  898    1213*    6800  x.x.x.x:443    https://domain.org
781 Socket  900    2103*   10472  x.x.x.x:443    https://domain.org
782 Socket    0    3627*   14436  x.x.x.x:443    https://domain.org
783 Socket    0     174*     804  x.x.x.x:443    https://domain.org
784 Socket    0  199486   463497  x.x.x.x:1344        x.x.x.x
785 Socket    0    1099*    4762  x.x.x.x:443    https://domain.org
787 Socket    0     316*     888  x.x.x.x:443   https://domain.org
790 Socket    0    2078*    2324  x.x.x.x:443      https://domain.org
791 Socket    0     316*     850  x.x.x.x:443   https://domain.org
792 Socket    0    2184*    1162  x.x.x.x:443      https://domain.org
793 Socket    0    2184*    1162  x.x.x.x:443      https://domain.org
794 Socket    0       0*       0  x.x.x.x:443    x.x.x.x pinned connection for x.x.x.x (202)
796 Socket    0 1290186  1774914  x.x.x.x:1344        x.x.x.x
797 Socket    0   67263    67949  x.x.x.x:1344        x.x.x.x
798 Socket    0       0*       0  x.x.x.x:443    x.x.x.x pinned connection for x.x.x.x (160)
799 Socket   99    7140*    3811  x.x.x.x:54406  Idle client: Waiting for next request
800 Socket    0   70622    74503  x.x.x.x:1344        x.x.x.x
801 Socket   27    2355*    1251  x.x.x.x:54407  Idle client: Waiting for next request
802 Socket    0    1154*    1136  x.x.x.x:443   https://domain.org
803 Socket    0   69578    75080  x.x.x.x:1344        x.x.x.x
804 Socket    0    1049*    1160  x.x.x.x:443   https://domain.org
805 Socket    0     976*    1136  x.x.x.x:443   https://domain.org
806 Socket    0    1261*    4482  x.x.x.x:443    https://domain.org
808 Socket  885     589*    3318  x.x.x.x:443    https://domain.org
809 Socket    0    1317*    4482  x.x.x.x:443    https://domain.org
810 Socket  900   82342*     866  x.x.x.x:443   https://domain.org
811 Socket    0     719*    1346  x.x.x.x:443    https://domain.org
812 Socket    0    1113*    1342  x.x.x.x:443     https://domain.org
814 Socket  855    2387*   13320  x.x.x.x:443    https://domain.org
815 Socket   27     500*     286  x.x.x.x:55764   Idle client: Waiting for next request
816 Socket    0 1080317  1867520  x.x.x.x:1344        x.x.x.x
820 Socket   66    1192*    7898  x.x.x.x:4110    Idle client: Waiting for next request
821 Socket    0    1025*   26932  x.x.x.x:443    https://domain.org
822 Socket    0   86033    89065  x.x.x.x:1344        x.x.x.x
823 Socket   59  326800*  558361  x.x.x.x:1344        x.x.x.x
824 Socket  893    5922*    5026  x.x.x.x:443      https://domain.org
826 Socket    0 1317411  1355916  x.x.x.x:1344        x.x.x.x
827 Pipe      0    7431*    9205                        ssl_crtd #4
828 Socket  895    6112*    8018  x.x.x.x:443      https://domain.org
829 Socket    0   67263    68003  x.x.x.x:1344        x.x.x.x
830 Socket    0   13653*   11470  x.x.x.x:443      https://domain.org
831 Pipe      0    4461*    5937                        ssl_crtd #5
832 Socket    0   98682   230913  x.x.x.x:1344        x.x.x.x
833 Socket    0   18285*    8984  x.x.x.x:443      https://domain.org
834 Socket    0 2769082  3379609  x.x.x.x:1344        x.x.x.x
835 Socket    0    5671*    8792  x.x.x.x:443      https://domain.org
837 Socket    0    6512*   11814  x.x.x.x:443      https://domain.org
838 Pipe      0    4461*    5937                        ssl_crtd #6
839 Socket    0     252*    2606  x.x.x.x:443    https://domain.org
840 Socket    0   67366    74962  x.x.x.x:1344        x.x.x.x
842 Socket    0   71312   221653  x.x.x.x:1344        x.x.x.x
846 Pipe      0    4461*    5937                        ssl_crtd #7
847 Socket    0  225360   346218  x.x.x.x:1344        x.x.x.x
849 Pipe      0    4461*    5937                        ssl_crtd #8
850 Socket    0    8137*    1042  x.x.x.x:443     https://domain.org
851 Socket  885     591*    2784  x.x.x.x:443    https://domain.org
852 Pipe      0       0*       0                        ssl_crtd #9
854 Socket    0    3983*    6570  x.x.x.x:443    https://domain.org
857 Pipe      0       0*       0                        ssl_crtd #10
869 Socket    0   40620*   32966  x.x.x.x:443      https://domain.org
870 Socket    0 4328494  4704878  x.x.x.x:1344        x.x.x.x
878 Socket    0   70812  1451399  x.x.x.x:1344        x.x.x.x
885 Socket    0  646465  1098283  x.x.x.x:1344        x.x.x.x
891 Socket    0  949722  1844840  x.x.x.x:1344        x.x.x.x
904 Socket  888    1837*   10128  x.x.x.x:443    https://domain.org
909 Socket    0   85268   151920  x.x.x.x:1344        x.x.x.x
911 Socket  831       0*    2354  x.x.x.x:443    https://domain.org
913 Socket    0   70315    70855  x.x.x.x:1344        x.x.x.x


I don't get it. There aren't that many active file descriptors (less than 1000).
Also, on low traffic (late evening) with no CPU or mem issues at all, mgr:filedescriptors shows that there are about 2500 active file descriptors.

The only two things I can think of that could mess with Squid are:

- squid_url_lookup.pl which is an external_acl_type perl script that does a MySQL lookup (ttl=86400 negative_ttl=86400 children-max=80 children-startup=10 children-idle=3 concurrency=8)

- c-icap content scanning with clamav and libarchive

If push comes to shove I might consider temporarily disabling one or both just to see what happens, but I'm not sure if that can really be the cause of a Squid process coming down to a crawl.

Thanks,

Vieri
_______________________________________________
squid-users mailing list
squid-users@xxxxxxxxxxxxxxxxxxxxx
http://lists.squid-cache.org/listinfo/squid-users





[Index of Archives]     [Linux Audio Users]     [Samba]     [Big List of Linux Books]     [Linux USB]     [Yosemite News]

  Powered by Linux