Some ideas here.
http://www.freeproxies.org/blog/2007/10/03/squid-cache-disk-io-performance-enhancements/
http://www.gcsdstaff.org/roodhouse/?p=2784
You might try dropping your disk cache to 50Gb and see what happens.
I am not sure that caching 7 Million pages gives you much of an
advantage over 1 million.
The 1,000,001th most popular page probably does not come up that often
and by the time you get down to a page that is 7,000,000 in the list of
most accessed pages, you are not seeing much demand for that page.
Probably most of the cache is just accessed once.
Your cache_mem looks low but is not related to your problem but would
improve performance a lot.
Getting a few thousand of the most active pages in memory is worth a lot
more than 6 million of the least active pages sitting on a disk.
I am not a big squid expert but have run squid for a long time.
Ron
On 30/05/2013 10:55 AM, Mike Mitchell wrote:
What garbage collection parameters can I change?
I'm not using authentication, so the default
auth_param digest nonce_garbage_interval 5 minutes
doesn't really apply.
I also run with
client_db off
so the default
authenticate_cache_garbage_interval 1 hour
doesn't apply either.
The lock-up happens randomly across the four servers. I can go several
days without a lock-up. I've only seen one lock-up in a night. Over the
last two nights I had lock-ups both nights, but on different servers.
# squid -v
Squid Cache: Version 3.2.11-20130524-r11822
configure options: '--prefix=/opt/squid' '--with-maxfd=16384' '--with-pthreads' '--enable-storeio=aufs' '--enable-removal-policies=heap' '--disable-external-acl-helpers' '--disable-ipv6' --enable-ltdl-convenience
Here are the relevant parts of the configuration:
acl CIDR_A src 10.0.0.0/8
ident_lookup_access allow CIDR_A
http_port 3128
cache_mem 1024 MB
memory_replacement_policy heap GDSF
cache_replacement_policy heap LFUDA
cache_dir aufs /cache/squid 323368 64 253 max-size=5120000000
maximum_object_size 5000000 KB
cache_swap_low 95
cache_swap_high 97
cache_store_log none
client_idle_pconn_timeout 5 seconds
check_hostnames on
allow_underscore on
dns_defnames on
dns_v4_first on
ipcache_size 4096
fqdncache_size 8192
client_db off
I have about 7,000,000 objects in the cache. During the four
hours the CPU rises from 10% to 100%, the number of objects
does not change by very much. The cache utilization sits at
95% during the four hours.
--
Ron Wheeler
President
Artifact Software Inc
email: rwheeler@xxxxxxxxxxxxxxxxxxxxx
skype: ronaldmwheeler
phone: 866-970-2435, ext 102
