Steel can not make this setup to work properly.
Is cache_dir max/min-size somehow broken on 3.2.6 and this makes
distribute objects by size impossible?
Or I'm trying to do something that can't be achieved?
On 01/25/2013 01:06 PM, Luciano Ruete wrote:
On 01/24/2013 08:44 PM, Amos Jeffries wrote:
On 25/01/2013 3:48 a.m., Luciano Ruete wrote:
Hi,
I'm trying to unload I/O on a bussy server (about 100M/bit Internet
link and 3000 ISP customers), by splitting cache_dir on two
different storages(and media) as an starting point (later I would
like also to use SMP features, but for now I'm getting too many errors)
For starters please upgrade to 3.2.6. There is a recent log rotation
regression present in 3.2 up to 3.2.5.
Done, thanks for the hint.
What I'have done is
workers 1
cache_dir rock /var/spool/squid/rock 10000 max-size=31000
max-swap-rate=250 swap-timeout=350
cache_dir aufs /var/spool/squid/aufs 300000 16 256 min-size=310001
There is a bug still in 3.2.6 whereby if any cache_dir line has
max-size set they all need one.
As a workaround you can take the value from maximum_object_size
(which is the global disk maximum) and set it as max-size=N on your
AUFS directory.
I've updated cache_dir lines to have both max-size and min-size set.
But the odd behavior still persists. Only the rock cache_dir grows and
even if it gets full the AUFS directory never starts to save objects.
I've tried both store_dir_select_algorithm (round-robin and the
defualt) but it doesn't help.
Updated conf file:
acl localnet src all
acl SSL_ports port 443
acl Safe_ports port 80 # http
acl Safe_ports port 21 # ftp
acl Safe_ports port 443 # https
acl Safe_ports port 70 # gopher
acl Safe_ports port 210 # wais
acl Safe_ports port 1025-65535 # unregistered ports
acl Safe_ports port 280 # http-mgmt
acl Safe_ports port 488 # gss-http
acl Safe_ports port 591 # filemaker
acl Safe_ports port 777 # multiling http
acl CONNECT method CONNECT
http_access allow localhost manager
http_access deny manager
http_access deny !Safe_ports
http_access deny CONNECT !SSL_ports
http_access allow localhost
http_access allow localnet
http_access deny all
http_port 3128
http_port 3129 tproxy
coredump_dir /var/spool/squid
refresh_pattern ^ftp: 1440 20% 10080
refresh_pattern ^gopher: 1440 0% 1440
refresh_pattern -i (/cgi-bin/|\?) 0 0% 0
refresh_pattern . 0 20% 4320
shutdown_lifetime 0 seconds
max_filedescriptors 65536
cache_store_log daemon:/var/log/squid3/store.log
workers 1
cache_mem 256 MB
maximum_object_size_in_memory 8 KB
max_open_disk_fds 0
maximum_object_size 700 MB
minimum_object_size 0 KB
store_dir_select_algorithm round-robin
cache_dir rock /var/spool/squid/rock 1000 min-size=1024 max-size=31000
max-swap-rate=250 swap-timeout=350
cache_dir aufs /var/spool/squid/aufs 30000 16 256 min-size=31001
max-size=734003200
Squid Cache: Version 3.2.6
configure options: '--build=x86_64-linux-gnu' '--prefix=/usr'
'--includedir=${prefix}/include' '--mandir=${prefix}/share/man'
'--infodir=${prefix}/share/info' '--sysconfdir=/etc'
'--localstatedir=/var' '--libexecdir=${prefix}/lib/squid3-ssl'
'--srcdir=.' '--disable-maintainer-mode'
'--disable-dependency-tracking' '--disable-silent-rules'
'--datadir=/usr/share/squid3' '--sysconfdir=/etc/squid3'
'--libdir=/usr/lib/squid3' '--libexecdir=/usr/lib/squid3'
'--mandir=/usr/share/man' '--with-cppunit-basedir=/usr' '--enable-ssl'
'--enable-ssl-crtd' '--enable-inline' '--enable-async-io=8'
'--enable-storeio=ufs,aufs,diskd,rock'
'--enable-removal-policies=lru,heap' '--enable-delay-pools'
'--enable-cache-digests' '--enable-underscores' '--enable-icap-client'
'--enable-follow-x-forwarded-for' '--enable-auth-basic'
'--enable-auth-digest' '--enable-auth-ntlm' '--enable-auth-negotiate'
'--enable-basic-auth-helpers=LDAP,MSNT,NCSA,PAM,SASL,SMB,YP,DB,POP3,getpwnam,squid_radius_auth,multi-domain-NTLM'
'--enable-ntlm-auth-helpers=smb_lm,'
'--enable-digest-auth-helpers=ldap,password'
'--enable-negotiate-auth-helpers=squid_kerb_auth'
'--enable-external-acl-helpers=ip_user,ldap_group,session,unix_group,wbinfo_group'
'--enable-arp-acl' '--enable-esi' '--disable-ipv6'
'--disable-translation' '--with-logdir=/var/log/squid3'
'--with-pidfile=/var/run/squid3.pid' '--with-filedescriptors=65536'
'--with-large-files' '--with-default-user=proxy'
'--enable-linux-netfilter' 'build_alias=x86_64-linux-gnu' 'CFLAGS=-g
-O2 -fstack-protector --param=ssp-buffer-size=4 -Wformat
-Wformat-security -g -O2 -fstack-protector --param=ssp-buffer-size=4
-Wformat -Wformat-security -Werror=format-security -Wall'
'LDFLAGS=-Wl,-Bsymbolic-functions -Wl,-z,relro'
'CPPFLAGS=-D_FORTIFY_SOURCE=2' 'CXXFLAGS=-g -O2 -fstack-protector
--param=ssp-buffer-size=4 -Wformat -Wformat-security -g -O2
-fstack-protector --param=ssp-buffer-size=4 -Wformat -Wformat-security
-Werror=format-security -Wall'
