Re: squid stops replying

Amos Jeffries <squid3@xxxxxxxxxxxxx> · Fri, 25 Aug 2017 21:51:19 +1200

On 25/08/17 20:34, Vieri wrote:
________________________________
From: Amos Jeffries

At ALL,9 that is a sign of major trouble. The log data is not going

where it should be. Please check your squid.conf that it is not sending
cache_log directive to /dev/null, a pipe or something.
I do not define cache_log, so it should take the default value of "/var/log/squid/cache.log".

# ps -ae | grep squid
4439 ?        05:29:57 squid
9059 ?        00:00:00 squid
9160 ?        00:00:00 squid
9162 ?        00:11:42 squid
9206 ?        00:00:00 squid
9208 ?        00:02:04 squid
9254 ?        00:00:00 squid
9257 ?        00:00:28 squid
9313 ?        00:00:00 squid
9315 ?        00:00:55 squid

That seems a lot. What exactly are those processes each doing?
   "ps aux | grep squid" should show the process roles.

There are 4 reverse proxies, each one with their own squid conf file, and a caching HTTP/S proxy (tproxy).
The one failing is the latter.

cache_log is one of the Squid directives which require a unique file 
path+name per instance when running multiple instances.

As the wiki page <https://wiki.squid-cache.org/MultipleInstances> says, 
it *might* work but the result is *probably* a garbled mess. And in your 
case I'm relatively sure that some critical information is being 
delivered into nul-space.

Also there will be issues with shared memory and such things on current 
Squid if you run multiple instances on one machine without proper 
instance naming - this will happen for some things even if you are not 
using SMP workers.
 Add the -n (lower case) command line option to your startup script(s), 
with a unique instance name for each.

First thing to do is fix the above issues. Then whatever the pause is 
about will be much easier to track down.

Here's the process list (also includes external processes):

# ps aux | grep squid
squid     7139  7.9  0.6 276064 200472 ?       S    10:10   1:11 (squid-1) -YC -f /etc/squid/squid.conf
squid     7156  0.0  0.0   4012   640 ?        S    10:10   0:00 (unlinkd)
squid     7157  0.0  0.0  13904  3292 ?        S    10:10   0:00 diskd 7310340 7310341 7310342
squid    17857  0.0  0.0   4156   736 ?        S    10:20   0:00 (logfile-daemon) /var/log/squid/access.log
squid    17858  5.2  0.0  41780  7804 ?        S    10:20   0:15 (ssl_crtd) -s /var/lib/squid/ssl_db -M 16MB
squid    17859  0.6  0.0  41792  8000 ?        S    10:20   0:01 (ssl_crtd) -s /var/lib/squid/ssl_db -M 16MB
squid    17860  0.0  0.0  41780  7800 ?        S    10:20   0:00 (ssl_crtd) -s /var/lib/squid/ssl_db -M 16MB
squid    17861  0.0  0.0  41776  7608 ?        S    10:20   0:00 (ssl_crtd) -s /var/lib/squid/ssl_db -M 16MB
squid    17862  0.0  0.0  41776  7612 ?        S    10:20   0:00 (ssl_crtd) -s /var/lib/squid/ssl_db -M 16MB
squid    17863  0.0  0.0  27204  9120 ?        S    10:20   0:00 /usr/bin/perl -w /usr/libexec/squid/ext_wbinfo_group_acl -K
squid    17864  0.0  0.0  27140  8872 ?        S    10:20   0:00 /usr/bin/perl -w /usr/libexec/squid/ext_wbinfo_group_acl -K
squid    17865  0.0  0.0  27140  8872 ?        S    10:20   0:00 /usr/bin/perl -w /usr/libexec/squid/ext_wbinfo_group_acl -K
squid    17866  0.0  0.0  27140  8912 ?        S    10:20   0:00 /usr/bin/perl -w /usr/libexec/squid/ext_wbinfo_group_acl -K
squid    17867  0.0  0.0  27140  8912 ?        S    10:20   0:00 /usr/bin/perl -w /usr/libexec/squid/ext_wbinfo_group_acl -K
squid    17868  0.8  0.0  68920 15488 ?        S    10:20   0:02 /usr/bin/perl -w -s /opt/custom/scripts/run/scripts/firewall/squid_url_lookup.pl -tbl_name=shallalist_bl adv,aggressive,alcohol,anonvpn,automobile_bikes,automobile_boats,automobile_cars,automobile_planes,chat,costtraps,dating,drugs,dynamic,finance_insurance,finance_moneylending,finance_other,finance_realestate,finance_trading,fortunetelling,forum,gamble,hacking,hobby_cooking,hobby_games-misc,hobby_games-online,hobby_gardening,hobby_pets,homestyle,imagehosting,isp,jobsearch,military,models,movies,music,podcasts,politics,porn,radiotv,recreation_humor,recreation_martialarts,recreation_restaurants,recreation_sports,recreation_travel,recreation_wellness,redirector,religion,remotecontrol,ringtones,science_astronomy,science_chemistry,sex_education,sex_lingerie,shopping,socialnet,spyware,tracker,updatesites,urlshortener,violence,warez,weapons,webphone,webradio,webtv
squid    17869  0.1  0.0  68916 15380 ?        S    10:20   0:00 /usr/bin/perl -w -s /opt/custom/scripts/run/scripts/firewall/squid_url_lookup.pl -tbl_name=shallalist_bl adv,aggressive,alcohol,anonvpn,automobile_bikes,automobile_boats,automobile_cars,automobile_planes,chat,costtraps,dating,drugs,dynamic,finance_insurance,finance_moneylending,finance_other,finance_realestate,finance_trading,fortunetelling,forum,gamble,hacking,hobby_cooking,hobby_games-misc,hobby_games-online,hobby_gardening,hobby_pets,homestyle,imagehosting,isp,jobsearch,military,models,movies,music,podcasts,politics,porn,radiotv,recreation_humor,recreation_martialarts,recreation_restaurants,recreation_sports,recreation_travel,recreation_wellness,redirector,religion,remotecontrol,ringtones,science_astronomy,science_chemistry,sex_education,sex_lingerie,shopping,socialnet,spyware,tracker,updatesites,urlshortener,violence,warez,weapons,webphone,webradio,webtv
squid    17870  0.0  0.0  68904 15400 ?        S    10:20   0:00 /usr/bin/perl -w -s /opt/custom/scripts/run/scripts/firewall/squid_url_lookup.pl -tbl_name=shallalist_bl adv,aggressive,alcohol,anonvpn,automobile_bikes,automobile_boats,automobile_cars,automobile_planes,chat,costtraps,dating,drugs,dynamic,finance_insurance,finance_moneylending,finance_other,finance_realestate,finance_trading,fortunetelling,forum,gamble,hacking,hobby_cooking,hobby_games-misc,hobby_games-online,hobby_gardening,hobby_pets,homestyle,imagehosting,isp,jobsearch,military,models,movies,music,podcasts,politics,porn,radiotv,recreation_humor,recreation_martialarts,recreation_restaurants,recreation_sports,recreation_travel,recreation_wellness,redirector,religion,remotecontrol,ringtones,science_astronomy,science_chemistry,sex_education,sex_lingerie,shopping,socialnet,spyware,tracker,updatesites,urlshortener,violence,warez,weapons,webphone,webradio,webtv
squid    17871  0.0  0.0  68904 15484 ?        S    10:20   0:00 /usr/bin/perl -w -s /opt/custom/scripts/run/scripts/firewall/squid_url_lookup.pl -tbl_name=shallalist_bl adv,aggressive,alcohol,anonvpn,automobile_bikes,automobile_boats,automobile_cars,automobile_planes,chat,costtraps,dating,drugs,dynamic,finance_insurance,finance_moneylending,finance_other,finance_realestate,finance_trading,fortunetelling,forum,gamble,hacking,hobby_cooking,hobby_games-misc,hobby_games-online,hobby_gardening,hobby_pets,homestyle,imagehosting,isp,jobsearch,military,models,movies,music,podcasts,politics,porn,radiotv,recreation_humor,recreation_martialarts,recreation_restaurants,recreation_sports,recreation_travel,recreation_wellness,redirector,religion,remotecontrol,ringtones,science_astronomy,science_chemistry,sex_education,sex_lingerie,shopping,socialnet,spyware,tracker,updatesites,urlshortener,violence,warez,weapons,webphone,webradio,webtv
squid    17872  0.0  0.0  68792 15292 ?        S    10:20   0:00 /usr/bin/perl -w -s /opt/custom/scripts/run/scripts/firewall/squid_url_lookup.pl -tbl_name=shallalist_bl adv,aggressive,alcohol,anonvpn,automobile_bikes,automobile_boats,automobile_cars,automobile_planes,chat,costtraps,dating,drugs,dynamic,finance_insurance,finance_moneylending,finance_other,finance_realestate,finance_trading,fortunetelling,forum,gamble,hacking,hobby_cooking,hobby_games-misc,hobby_games-online,hobby_gardening,hobby_pets,homestyle,imagehosting,isp,jobsearch,military,models,movies,music,podcasts,politics,porn,radiotv,recreation_humor,recreation_martialarts,recreation_restaurants,recreation_sports,recreation_travel,recreation_wellness,redirector,religion,remotecontrol,ringtones,science_astronomy,science_chemistry,sex_education,sex_lingerie,shopping,socialnet,spyware,tracker,updatesites,urlshortener,violence,warez,weapons,webphone,webradio,webtv
squid    17873  0.0  0.0  19852  1812 ?        S    10:20   0:00 (pinger)
squid    18274  0.0  0.0  68792 15288 ?        S    10:20   0:00 /usr/bin/perl -w -s /opt/custom/scripts/run/scripts/firewall/squid_url_lookup.pl -tbl_name=shallalist_bl adv,aggressive,alcohol,anonvpn,automobile_bikes,automobile_boats,automobile_cars,automobile_planes,chat,costtraps,dating,drugs,dynamic,finance_insurance,finance_moneylending,finance_other,finance_realestate,finance_trading,fortunetelling,forum,gamble,hacking,hobby_cooking,hobby_games-misc,hobby_games-online,hobby_gardening,hobby_pets,homestyle,imagehosting,isp,jobsearch,military,models,movies,music,podcasts,politics,porn,radiotv,recreation_humor,recreation_martialarts,recreation_restaurants,recreation_sports,recreation_travel,recreation_wellness,redirector,religion,remotecontrol,ringtones,science_astronomy,science_chemistry,sex_education,sex_lingerie,shopping,socialnet,spyware,tracker,updatesites,urlshortener,violence,warez,weapons,webphone,webradio,webtv
squid    18405  0.0  0.0  68792 15288 ?        S    10:20   0:00 /usr/bin/perl -w -s /opt/custom/scripts/run/scripts/firewall/squid_url_lookup.pl -tbl_name=shallalist_bl adv,aggressive,alcohol,anonvpn,automobile_bikes,automobile_boats,automobile_cars,automobile_planes,chat,costtraps,dating,drugs,dynamic,finance_insurance,finance_moneylending,finance_other,finance_realestate,finance_trading,fortunetelling,forum,gamble,hacking,hobby_cooking,hobby_games-misc,hobby_games-online,hobby_gardening,hobby_pets,homestyle,imagehosting,isp,jobsearch,military,models,movies,music,podcasts,politics,porn,radiotv,recreation_humor,recreation_martialarts,recreation_restaurants,recreation_sports,recreation_travel,recreation_wellness,redirector,religion,remotecontrol,ringtones,science_astronomy,science_chemistry,sex_education,sex_lingerie,shopping,socialnet,spyware,tracker,updatesites,urlshortener,violence,warez,weapons,webphone,webradio,webtv
root     19737  0.0  0.0  87440  5856 ?        Ss   Aug23   0:00 /usr/sbin/squid -YC -f /etc/squid/squid.conf
squid    21262  0.0  0.0  68792 15400 ?        S    10:22   0:00 /usr/bin/perl -w -s /opt/custom/scripts/run/scripts/firewall/squid_url_lookup.pl -tbl_name=shallalist_bl adv,aggressive,alcohol,anonvpn,automobile_bikes,automobile_boats,automobile_cars,automobile_planes,chat,costtraps,dating,drugs,dynamic,finance_insurance,finance_moneylending,finance_other,finance_realestate,finance_trading,fortunetelling,forum,gamble,hacking,hobby_cooking,hobby_games-misc,hobby_games-online,hobby_gardening,hobby_pets,homestyle,imagehosting,isp,jobsearch,military,models,movies,music,podcasts,politics,porn,radiotv,recreation_humor,recreation_martialarts,recreation_restaurants,recreation_sports,recreation_travel,recreation_wellness,redirector,religion,remotecontrol,ringtones,science_astronomy,science_chemistry,sex_education,sex_lingerie,shopping,socialnet,spyware,tracker,updatesites,urlshortener,violence,warez,weapons,webphone,webradio,webtv
squid    21263  0.0  0.0  68792 15400 ?        S    10:22   0:00 /usr/bin/perl -w -s /opt/custom/scripts/run/scripts/firewall/squid_url_lookup.pl -tbl_name=shallalist_bl adv,aggressive,alcohol,anonvpn,automobile_bikes,automobile_boats,automobile_cars,automobile_planes,chat,costtraps,dating,drugs,dynamic,finance_insurance,finance_moneylending,finance_other,finance_realestate,finance_trading,fortunetelling,forum,gamble,hacking,hobby_cooking,hobby_games-misc,hobby_games-online,hobby_gardening,hobby_pets,homestyle,imagehosting,isp,jobsearch,military,models,movies,music,podcasts,politics,porn,radiotv,recreation_humor,recreation_martialarts,recreation_restaurants,recreation_sports,recreation_travel,recreation_wellness,redirector,religion,remotecontrol,ringtones,science_astronomy,science_chemistry,sex_education,sex_lingerie,shopping,socialnet,spyware,tracker,updatesites,urlshortener,violence,warez,weapons,webphone,webradio,webtv
squid    21264  0.0  0.0  68792 15400 ?        S    10:22   0:00 /usr/bin/perl -w -s /opt/custom/scripts/run/scripts/firewall/squid_url_lookup.pl -tbl_name=shallalist_bl adv,aggressive,alcohol,anonvpn,automobile_bikes,automobile_boats,automobile_cars,automobile_planes,chat,costtraps,dating,drugs,dynamic,finance_insurance,finance_moneylending,finance_other,finance_realestate,finance_trading,fortunetelling,forum,gamble,hacking,hobby_cooking,hobby_games-misc,hobby_games-online,hobby_gardening,hobby_pets,homestyle,imagehosting,isp,jobsearch,military,models,movies,music,podcasts,politics,porn,radiotv,recreation_humor,recreation_martialarts,recreation_restaurants,recreation_sports,recreation_travel,recreation_wellness,redirector,religion,remotecontrol,ringtones,science_astronomy,science_chemistry,sex_education,sex_lingerie,shopping,socialnet,spyware,tracker,updatesites,urlshortener,violence,warez,weapons,webphone,webradio,webtv
squid    21265  0.0  0.0  68792 15292 ?        S    10:22   0:00 /usr/bin/perl -w -s /opt/custom/scripts/run/scripts/firewall/squid_url_lookup.pl -tbl_name=shallalist_bl adv,aggressive,alcohol,anonvpn,automobile_bikes,automobile_boats,automobile_cars,automobile_planes,chat,costtraps,dating,drugs,dynamic,finance_insurance,finance_moneylending,finance_other,finance_realestate,finance_trading,fortunetelling,forum,gamble,hacking,hobby_cooking,hobby_games-misc,hobby_games-online,hobby_gardening,hobby_pets,homestyle,imagehosting,isp,jobsearch,military,models,movies,music,podcasts,politics,porn,radiotv,recreation_humor,recreation_martialarts,recreation_restaurants,recreation_sports,recreation_travel,recreation_wellness,redirector,religion,remotecontrol,ringtones,science_astronomy,science_chemistry,sex_education,sex_lingerie,shopping,socialnet,spyware,tracker,updatesites,urlshortener,violence,warez,weapons,webphone,webradio,webtv
squid    21266  0.0  0.0  68792 15292 ?        S    10:22   0:00 /usr/bin/perl -w -s /opt/custom/scripts/run/scripts/firewall/squid_url_lookup.pl -tbl_name=shallalist_bl adv,aggressive,alcohol,anonvpn,automobile_bikes,automobile_boats,automobile_cars,automobile_planes,chat,costtraps,dating,drugs,dynamic,finance_insurance,finance_moneylending,finance_other,finance_realestate,finance_trading,fortunetelling,forum,gamble,hacking,hobby_cooking,hobby_games-misc,hobby_games-online,hobby_gardening,hobby_pets,homestyle,imagehosting,isp,jobsearch,military,models,movies,music,podcasts,politics,porn,radiotv,recreation_humor,recreation_martialarts,recreation_restaurants,recreation_sports,recreation_travel,recreation_wellness,redirector,religion,remotecontrol,ringtones,science_astronomy,science_chemistry,sex_education,sex_lingerie,shopping,socialnet,spyware,tracker,updatesites,urlshortener,violence,warez,weapons,webphone,webradio,webtv
squid    21267  0.0  0.0  68792 15384 ?        S    10:22   0:00 /usr/bin/perl -w -s /opt/custom/scripts/run/scripts/firewall/squid_url_lookup.pl -tbl_name=shallalist_bl adv,aggressive,alcohol,anonvpn,automobile_bikes,automobile_boats,automobile_cars,automobile_planes,chat,costtraps,dating,drugs,dynamic,finance_insurance,finance_moneylending,finance_other,finance_realestate,finance_trading,fortunetelling,forum,gamble,hacking,hobby_cooking,hobby_games-misc,hobby_games-online,hobby_gardening,hobby_pets,homestyle,imagehosting,isp,jobsearch,military,models,movies,music,podcasts,politics,porn,radiotv,recreation_humor,recreation_martialarts,recreation_restaurants,recreation_sports,recreation_travel,recreation_wellness,redirector,religion,remotecontrol,ringtones,science_astronomy,science_chemistry,sex_education,sex_lingerie,shopping,socialnet,spyware,tracker,updatesites,urlshortener,violence,warez,weapons,webphone,webradio,webtv
squid    21268  0.0  0.0  68792 15396 ?        S    10:22   0:00 /usr/bin/perl -w -s /opt/custom/scripts/run/scripts/firewall/squid_url_lookup.pl -tbl_name=shallalist_bl adv,aggressive,alcohol,anonvpn,automobile_bikes,automobile_boats,automobile_cars,automobile_planes,chat,costtraps,dating,drugs,dynamic,finance_insurance,finance_moneylending,finance_other,finance_realestate,finance_trading,fortunetelling,forum,gamble,hacking,hobby_cooking,hobby_games-misc,hobby_games-online,hobby_gardening,hobby_pets,homestyle,imagehosting,isp,jobsearch,military,models,movies,music,podcasts,politics,porn,radiotv,recreation_humor,recreation_martialarts,recreation_restaurants,recreation_sports,recreation_travel,recreation_wellness,redirector,religion,remotecontrol,ringtones,science_astronomy,science_chemistry,sex_education,sex_lingerie,shopping,socialnet,spyware,tracker,updatesites,urlshortener,violence,warez,weapons,webphone,webradio,webtv
squid    21269  0.0  0.0  68792 15400 ?        S    10:22   0:00 /usr/bin/perl -w -s /opt/custom/scripts/run/scripts/firewall/squid_url_lookup.pl -tbl_name=shallalist_bl adv,aggressive,alcohol,anonvpn,automobile_bikes,automobile_boats,automobile_cars,automobile_planes,chat,costtraps,dating,drugs,dynamic,finance_insurance,finance_moneylending,finance_other,finance_realestate,finance_trading,fortunetelling,forum,gamble,hacking,hobby_cooking,hobby_games-misc,hobby_games-online,hobby_gardening,hobby_pets,homestyle,imagehosting,isp,jobsearch,military,models,movies,music,podcasts,politics,porn,radiotv,recreation_humor,recreation_martialarts,recreation_restaurants,recreation_sports,recreation_travel,recreation_wellness,redirector,religion,remotecontrol,ringtones,science_astronomy,science_chemistry,sex_education,sex_lingerie,shopping,socialnet,spyware,tracker,updatesites,urlshortener,violence,warez,weapons,webphone,webradio,webtv
squid    21270  0.0  0.0  68792 15400 ?        S    10:22   0:00 /usr/bin/perl -w -s /opt/custom/scripts/run/scripts/firewall/squid_url_lookup.pl -tbl_name=shallalist_bl adv,aggressive,alcohol,anonvpn,automobile_bikes,automobile_boats,automobile_cars,automobile_planes,chat,costtraps,dating,drugs,dynamic,finance_insurance,finance_moneylending,finance_other,finance_realestate,finance_trading,fortunetelling,forum,gamble,hacking,hobby_cooking,hobby_games-misc,hobby_games-online,hobby_gardening,hobby_pets,homestyle,imagehosting,isp,jobsearch,military,models,movies,music,podcasts,politics,porn,radiotv,recreation_humor,recreation_martialarts,recreation_restaurants,recreation_sports,recreation_travel,recreation_wellness,redirector,religion,remotecontrol,ringtones,science_astronomy,science_chemistry,sex_education,sex_lingerie,shopping,socialnet,spyware,tracker,updatesites,urlshortener,violence,warez,weapons,webphone,webradio,webtv
squid    21276  0.0  0.0  68792 15400 ?        S    10:22   0:00 /usr/bin/perl -w -s /opt/custom/scripts/run/scripts/firewall/squid_url_lookup.pl -tbl_name=shallalist_bl adv,aggressive,alcohol,anonvpn,automobile_bikes,automobile_boats,automobile_cars,automobile_planes,chat,costtraps,dating,drugs,dynamic,finance_insurance,finance_moneylending,finance_other,finance_realestate,finance_trading,fortunetelling,forum,gamble,hacking,hobby_cooking,hobby_games-misc,hobby_games-online,hobby_gardening,hobby_pets,homestyle,imagehosting,isp,jobsearch,military,models,movies,music,podcasts,politics,porn,radiotv,recreation_humor,recreation_martialarts,recreation_restaurants,recreation_sports,recreation_travel,recreation_wellness,redirector,religion,remotecontrol,ringtones,science_astronomy,science_chemistry,sex_education,sex_lingerie,shopping,socialnet,spyware,tracker,updatesites,urlshortener,violence,warez,weapons,webphone,webradio,webtv
squid    22971  0.0  0.0  41772  7604 ?        S    10:24   0:00 (ssl_crtd) -s /var/lib/squid/ssl_db -M 16MB
root     23964  0.0  0.0   8968   944 pts/0    S+   10:24   0:00 grep --colour=auto squid
root     27129  0.0  0.0  84856  5140 ?        Ss   Aug24   0:00 /usr/sbin/squid -YC -f /etc/squid/squid.http.conf
squid    27132  0.0  0.0 100980 26652 ?        S    Aug24   0:04 (squid-1) -YC -f /etc/squid/squid.http.conf
squid    27134  0.0  0.0  19852  1716 ?        S    Aug24   0:03 (pinger)
root     27281  0.0  0.0  86912  5192 ?        Ss   Aug24   0:00 /usr/sbin/squid -YC -f /etc/squid/squid.https.conf
squid    27284  0.0  0.0 106484 31408 ?        S    Aug24   0:13 (squid-1) -YC -f /etc/squid/squid.https.conf
squid    27290  0.0  0.0  19852  1816 ?        S    Aug24   0:03 (pinger)
root     27956  0.0  0.0  86908  5172 ?        Ss   Aug24   0:00 /usr/sbin/squid -YC -f /etc/squid/squid.owa.conf
squid    27958  0.0  0.0  99560 25016 ?        S    Aug24   1:24 (squid-1) -YC -f /etc/squid/squid.owa.conf
squid    27961  0.0  0.0  19852  1812 ?        S    Aug24   0:04 (pinger)
root     28106  0.0  0.0  86908  5188 ?        Ss   Aug24   0:00 /usr/sbin/squid -YC -f /etc/squid/squid.owa2.conf
squid    28109  0.0  0.2 141024 66372 ?        S    Aug24   0:34 (squid-1) -YC -f /etc/squid/squid.owa2.conf
squid    28113  0.0  0.0  19852  1716 ?        S    Aug24   0:04 (pinger)

If you run "squid -k shutdown ; squid -k shutdown" do they all fully stop?> (exactly that command, shutdown twice in a row)

Once Squid is fully stopped, start it again. Is the problem resolved
when it comes back up?

I'd have to wait for Squid to stop replying. That usually takes several days, maybe more than a week.

Okay. The above test was to see if the squid processes were all 
correctly operating.
 Since it is now clear that you have multiple instances stepping over 
each others feet in the background please fix the issues with -n and the 
multi-instance critical directives. *Then* do the above to ensure that 
all instances are fully using the fixed setup.

If/when the problem occurs again you should be better placed to see what 
is going on.

 * crash recovery can be very slow on caching Squid as the cache_dir 
require a full disk scan to load all the objects back in.

 * a suddenly overloaded Squid that is using a lot of memory (ie huge 
disk cache index) can take a lot of time to startup new dynamic helpers.

Both of the above can result in user-visible service pauses. There is 
not much that can be done about it except workaround the cause of the 
delay (better peak configuration, or patching the crash not to happen).

The failing squid process is currently set up with:
debug_options rotate=1 ALL,1

Should I set a different level BEFORE it "stops working", ie. "now"?
I'm asking because it's going to take a long while to reproduce this issue, and I just want to make sure I'll have enough info when it happens.

Probably not then. ALL,1 is sufficient to show crash issues if they 
occur, and if nothing at all appears in the log later you can strace the 
paused process to see what it is doing and maybe send it a "squid -n 
_instance_name -d 9 " debug level change from the command line (if what 
it is doing allows signals to get through before it is finished).

PS; are you using CentOS 6 or an older RHEL with kernel 2.6.x ?
 It has recently just come up that they are still actively using those 
old kernels containing broken TPROXY implementations. I vaguely recall 
the symptoms are not always immediately visible, but triggered by 
certain ICMP or TCP conditions.

Amos
_______________________________________________
squid-users mailing list
squid-users@xxxxxxxxxxxxxxxxxxxxx
http://lists.squid-cache.org/listinfo/squid-users