Search squid archive

Re: Squid and OS tuning

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

On Wed, 04 Apr 2007 13:27:05 +0700
zen <zen@xxxxxxxxxxxxxxx> wrote:

> Dear Users.
> i'm planning to build  a proxy server and it will be serving 10k of 
> users/clients,
> it's a AMD X2 3800 AM2 and currently installed RAM are 4Gigs,  and  2 
> SATA HDD 300GB
> and running FreeBSD 6.2STABLE am64 build.
> i would like to ask for guidance how to build and optimized this proxy 
> server ( OS base or Squid base )
> kindly one of you share the tips/tricks regarding this problems.
> 

Hi Zen,

Do you want to run Squid in transparent mode? If so, which firewall (ipfw/pf/ipf) will you be using?

Try to do download the source package and compile it manually rather than using FreeBSD's ports.

You can using the following compilation options:

- --bindir=/usr/local/sbin \
- --sysconfdir=/usr/local/etc/squid \
- --datadir=/usr/local/etc/squid \
- --libexecdir=/usr/local/libexec/squid \
- --localstatedir=/usr/local/squid \
- --enable-removal-policies=heap,lru \
- --enable-async-io  \
- --enable-storeio=diskd,aufs,coss,ufs,null \
- --enable-time-hack \
- --enable-snmp \
- --enable-kqueue \
- --with-large-files \
- --prefix=/usr/local \
- --disable-ident-lookups 

For full compilation options, see:

#~ ./configure  --help | less

Also, try to use the Squid-2.6 version. It's quite stable and extremely CPU friendly. 

In your Kernel, you can use the following options:

options         SMP

options         SHMSEG=128
options         SHMMNI=256
options         SHMMAX=33554432 # max shared memory segment size (bytes)
options         SHMALL=16384    # max amount of shared memory (pages)
options         MSGMNB=16384    # max # of bytes in a queue
options         MSGMNI=48       # number of message queue identifiers
options         MSGSEG=768      # number of message segments
options         MSGSSZ=64       # size of a message segment
options         MSGTQL=4096     # max messages in system


options         IPFIREWALL            #Only for IPFW firewall
options         IPFIREWALL_VERBOSE    #Only for IPFW enable logging to syslogd(8)
options         IPFIREWALL_FORWARD    #Only for IPFW enable transparent proxy support


For some optimization and also since your users/clients base is about 10000, you might want to try the following values.

/boot/loader.conf:

kern.maxusers=0
kern.ipc.nmbclusters=65536
kern.maxfiles=16384
kern.maxproc=8192
kern.ipc.somaxconn: 8192
kern.ipc.maxsockets=16384


/etc/sysctl.conf:

# TCP/IP optimization
net.inet.tcp.recvspace=65535
net.inet.tcp.sendspace=65535
kern.maxfilesperproc=8192


For squid.conf:  
cache_effective_user nobody
cache_effective_group nobody

cache_mem 128 MB
cache_swap_low  90
cache_swap_high 98

http_port 3128 transparent  # Only if you want Squid to run transparently 

maximum_object_size 131072 KB
maximum_object_size_in_memory 16 KB

tcp_recv_bufsize 65535 bytes
ipcache_size 4096
fqdncache_size 4096

emulate_httpd_log on

client_persistent_connections off
half_closed_clients off

cache_dir diskd /cache1 100000 64 512 Q1=72 Q2=64
cache_dir diskd /cache2 100000 64 512 Q1=72 Q2=64

hierarchy_stoplist cgi-bin ?

acl QUERY urlpath_regex cgi-bin \?
no_cache deny QUERY

negative_dns_ttl 2 minutes

#Default pattern is good enough
refresh_pattern         ^ftp:           1440    20%     10080
refresh_pattern         ^gopher:        1440    0%      1440
refresh_pattern         .               0       20%     4320


Also regarding DISKD storage system, see the great FAQ below:

http://wiki.squid-cache.org/SquidFaq/CyclicObjectStorageSystem

Even though, it is quite outdated, it offers enough insight about DiskD and FreeBSD in general. 


Note: This values should normally work but what works for me does not necessarily mean that it will work for all. 

Also I welcome any suggestions and feedback for the above mentioned values of mine. I may have miss something myself.

Thanking you...

> 
> TIA
> 
> Zen
> 


- -- 


With best regards and good wishes,

Yours sincerely,

Tek Bahadur Limbu

(TAG/TDG Group)
Jwl Systems Department

Worldlink Communications Pvt. Ltd.

Jawalakhel, Nepal

http://www.wlink.com.np
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.2.2 (FreeBSD)

iD8DBQFGE5cLVrOl+eVhOvYRAtwKAJ4ptACbnnkxKlhoYj/h/V6O92sYiQCgmd8Z
TlzhH69L16FH+0iyz0Nh9NI=
=G/3Y
-----END PGP SIGNATURE-----

[Index of Archives]     [Linux Audio Users]     [Samba]     [Big List of Linux Books]     [Linux USB]     [Yosemite News]

  Powered by Linux