Search squid archive

Re: Squid eating too much memory

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



try decreasing the cache_mem !!

256mb maybe a good starting value !!

On 10/21/07, rihad <rihad@xxxxxxx> wrote:
> Tek Bahadur Limbu wrote:
> > Hi Rihad,
> >
> > rihad wrote:
> >> CacheMgr output:
> >> Memory accounted for:
> >>     Total accounted:       1323944 KB
> >>
> >> Memory usage using top(1):
> >>   PID USERNAME     THR PRI NICE   SIZE    RES STATE    TIME   WCPU
> >> COMMAND
> >> 29601 squid         29  20    0  2533M  2465M kserel  92:12  0.00% squid
> >>
> >>
> >> Almost twice as much memory! Any hints?
> >
> > What is your settings for the following parameters?
> >
> > cache_mem
> > maximum_object_size
> > maximum_object_size_in_memory
> > cache_replacement_policy
> > memory_replacement_policy
> > ipcache_size
> > fqdncache_size
> >
> cache_mem 1000 MB
> maximum_object_size 100 MB
> # maximum_object_size_in_memory 8 KB
> cache_replacement_policy heap LFUDA
> memory_replacement_policy heap LFUDA
> # ipcache_size 1024
> # fqdncache_size 1024
>
> > Which storage scheme are you using?
> >
> aufs
>
> >>
> >> Number of clients accessing cache:    517
> >> Normally load is within 500-1500 clients.
> >
> > How long is your Squid process been running?
> >
> 3 to 4 days, but it doesn't matter: I've had weeks or months of uptime,
> too. Eventually the process hits its memory size limit (kern.maxdsiz)
> set at 2.5 gigs at the moment and croaks (and restarts) unless I
> decrease cache_mem. There's little point in using less RAM as the box
> has ~3.3 gigs of it, and is dedicated to Squid (and its dedicated dnscache).
>
> > Your server's memory usage seems unusually high even for 1500 clients.
> > My proxy server which serves 2000-3000 clients is currently using 650 MB
> > of memory despite running for more than 55 days.
> >
> How big is your cache store?
>
> >
> >>
> >> Squid 2.6.16
> >> FreeBSD 6.2-RELEASE-p8
> >
> > What is your machines specs?
> >
> # grep -e ^CPU: -e memory -e ^ad /var/run/dmesg.boot
> CPU: Intel(R) Pentium(R) D CPU 2.80GHz (2813.85-MHz 686-class CPU)
> real memory  = 3489595392 (3327 MB)
> avail memory = 3414970368 (3256 MB)
> ad4: 238475MB <Seagate ST3250824AS 3.AAE> at ata2-master SATA150
> ad6: 238475MB <Seagate ST3250824AS 3.AAE> at ata3-master SATA150
>
> Two cache_dir's lie on both disks (25 gigs each at the moment, but I'm
> planning for more).
>
> >>
> >> Port compiled with all options unchecked and both AUFS & KQUEUE checked
> >> (as per "make config" and  /var/db/ports/squid/options)
> >
> > Can you post the full output of "squidclient  mgr:info"?
> >
> Squid Object Cache: Version 2.6.STABLE16
> Start Time:     Thu, 18 Oct 2007 17:10:09 GMT
> Current Time:   Sun, 21 Oct 2007 09:39:51 GMT
> Connection information for squid:
>          Number of clients accessing cache:      517
>          Number of HTTP requests received:       9410288
>          Number of ICP messages received:        0
>          Number of ICP messages sent:    0
>          Number of queued ICP replies:   0
>          Request failure ratio:   0.00
>          Average HTTP requests per minute since start:   2431.8
>          Average ICP messages per minute since start:    0.0
>          Select loop called: 74113837 times, 3.133 ms avg
> Cache information for squid:
>          Request Hit Ratios:     5min: 35.6%, 60min: 37.1%
>          Byte Hit Ratios:        5min: 21.4%, 60min: 18.1%
>          Request Memory Hit Ratios:      5min: 12.0%, 60min: 15.0%
>          Request Disk Hit Ratios:        5min: 22.9%, 60min: 26.2%
>          Storage Swap size:      22427274 KB
>          Storage Mem size:       1023900 KB
>          Mean Object Size:       13.62 KB
>          Requests given to unlinkd:      0
> Median Service Times (seconds)  5 min    60 min:
>          HTTP Requests (All):   0.08265  0.08265
>          Cache Misses:          0.17711  0.18699
>          Cache Hits:            0.00463  0.00562
>          Near Hits:             0.12106  0.14252
>          Not-Modified Replies:  0.00286  0.00379
>          DNS Lookups:           0.11405  0.10906
>          ICP Queries:           0.00000  0.00000
> Resource usage for squid:
>          UP Time:        232181.468 seconds
>          CPU Time:       5971.253 seconds
>          CPU Usage:      2.57%
>          CPU Usage, 5 minute avg:        3.98%
>          CPU Usage, 60 minute avg:       3.55%
>          Process Data Segment Size via sbrk(): -1583756 KB
>          Maximum Resident Size: 2549632 KB
>          Page faults with physical i/o: 3799
> Memory accounted for:
>          Total accounted:       1333488 KB
>          memPoolAlloc calls: 1090270339
>          memPoolFree calls: 1082572188
> File descriptor usage for squid:
>          Maximum number of file descriptors:   11072
>          Largest file desc currently in use:   1715
>          Number of file desc currently in use: 1622
>          Files queued for open:                   0
>          Available number of file descriptors: 9450
>          Reserved number of file descriptors:   100
>          Store Disk files open:                  41
>          IO loop method:                     kqueue
> Internal Data Structures:
>          1652462 StoreEntries
>          200285 StoreEntries with MemObjects
>          200125 Hot Object Cache Items
>          1646504 on-disk objects
>
>
> >
> > Thanking you...
> >
> Thank you too!
>


-- 

Sds.
Alexandre J. Correa
Onda Internet / OPinguim.net
http://www.ondainternet.com.br
http://www.opinguim.net

[Index of Archives]     [Linux Audio Users]     [Samba]     [Big List of Linux Books]     [Linux USB]     [Yosemite News]

  Powered by Linux