On 27/04/2012 08:37, Mark Engels wrote:
Hello everyone,
Ive been working on a squid cache appliance for a few weeks now (on and off) and things appear to be working. However I seem to have an issue where the cache size simply refuses to grow in size. My first attempt had the cache stall at 2.03gb and with this latest build im stalling at 803mb.
I haven’t a clue on where to go or what to look at for determining what could be wrong and im hopeing you could be of assistance ☺ also any tips for better performance or improved caching would be greatly appreciated. (Yes I have googled and I think ive applied what I could but it’s a little over my head a few weeks in and no deep linux experience)
Some facts:
Ive been determining the cache size with the following command, du –hs /var/spool/squid
Squid is running on a centOS6.2 machine
Squid is version 3.1.10
CentOS is running in a hyperV virtual machine with integration services installed
VM has 4gb ram and a 60gb HDD allocated
Squid is acting as a cache/error page handler box only. There is the main proxy sitting one step downstream with squid setup in a
“T” network (the main cache can skip squid and go direct to the net if squid falls over on me, hyperV issue)
Config file:
Acl downstream src 192.168.1.2/32
http_access allow downstream
cache_mgr protectedemail@xxxxxxxxxxxxx
< all the standard acl rules here>
http_access allow localnet
http_access allow localhost
http_access deny all
# Squid normally listens to port 3128
http_port 8080
# We recommend you to use at least the following line.
hierarchy_stoplist cgi—bin ?
# Uncomment and adjust the following to add a disk cache directory.
cache_dir ufs /var/spool/squid 30000 16 256
# Leave coredumps in the first cache dir
coredump_dir /var/spool/squid
# Change maxinum object size
maxinum_object_size 4 GB
# Define max cache_mem
cache_mem 512 MB
#Lousy attempt at youtube caching
quick_abort_min -1 KB
acl youtube dstdomain .youtube.com
cache allow youtube
from the next refresh patterns it seems you might not quite understand
the meaning of the patterns syntax and options.
the first thing i suggest is to look at:
http://www.squid-cache.org/Doc/config/refresh_pattern/
a more "readable" place is :
http://etutorials.org/Server+Administration/Squid.+The+definitive+guide/Chapter+7.+Disk+Cache+Basics/7.7+refresh_pattern/
and try to read it once or twice so you will know how to benefit from it.
also try to read some info about caching here:
http://www.mnot.net/cache_docs/
and a tool that will help you to analyze pages for cachebility is redbot:
http://redbot.org/
there is a maximum time that a object can stay in the cache server as
it's a cache server and not hosting service.
it's max of 365 days (total of 525600 minutes) if i remember right so
it's useless to use "999999" as a max time for object freshness.
if you want to cache youtube videos you lack a little bit of knowledge
about it so just start with basic caching tweaking.
also you should check your users browsing habits in order to gain
maximum cache efficiency.
until then you will get a solid caching goals you wont need to shoot so
hard.
one very good tool to analyze your users habits is "sarg".
if you need some help i can assist you with it.
just as an example this site: http://djmaza.com/ is heaven of cache
proxy server but until you wont analyze it you wont know what to do with it.
you can see in this link:
http://redbot.org/?descend=True&uri=http://djmaza.com/
how the page is built.
Regards,
Eliezer
# Add any of your own refresh_pattern entries above these.
refresh_pattern -i \.flv$ 10080 90% 999999 ignore-no-cache override-expire ignore-private
refresh_pattern -i \.(gif|png|jpg|jpeg|ico|bmp)$ 40320 90% 40330
refresh_pattern -i \.(iso|avi|wav|mp3|mp4|mpeg|swf|x-flv|mpg|wma|ogg|wmv|asx|asf|dmg|zip|exe|rar)$ 40320 90% 40330
refresh_pattern ^ftp: 1440 20% 10080
refresh_pattern ^gopher: 1440 0% 1440
refresh_pattern -i (/cgi-bin/|\?) 0 0% 0
refresh_pattern . 0 20% 4320
________________________________
Mark Engels l ICT Manager - Network l Mark Oliphant College (B-12) l info@xxxxxxxxxxxxx<mailto:info@> www.moc.sa.edu.au<http://www.moc.sa.edu.au> l Ph: (08) 8209 1600 l Fax: (08) 8209 1650
--
Eliezer Croitoru
https://www1.ngtech.co.il
IT consulting for Nonprofit organizations
eliezer <at> ngtech.co.il
