Amos, I am having problems with Squid everyday.. twice everyday to be precise. Squid stops responding.. I have to restart squid service to resume service. Even the old cache_mem = 100MB setting had the same problem, the current setting of cache_dir = null /tmp is also giving the same problem. How do i resolve this? Avinash On Fri, Sep 11, 2009 at 12:10 PM, Avinash Rao <avinash.aol@xxxxxxxxx> wrote: > > On Fri, Sep 11, 2009 at 10:29 AM, Avinash Rao <avinash.aol@xxxxxxxxx> wrote: > > On Thu, Sep 10, 2009 at 4:31 PM, Amos Jeffries <squid3@xxxxxxxxxxxxx> wrote: > >> Avinash Rao wrote: > >>> > >>> On Thu, Sep 10, 2009 at 10:54 AM, Avinash Rao <avinash.aol@xxxxxxxxx> > >>> wrote: > >>>> > >>>> On Wed, Sep 9, 2009 at 5:45 PM, Amos Jeffries <squid3@xxxxxxxxxxxxx> > >>>> wrote: > >>>>> > >>>>> Avinash Rao wrote: > >>>>>> > >>>>>> Dear all, > >>>>>> > >>>>>> I am sure this question would have been posted many times. I read a > >>>>>> few threads, but my requirement or setup is a bit different. I am > >>>>>> running Squid2.6stable18 on Ubuntu Server 8.04 Server 64-bit installed > >>>>>> on Sun Fire X4150 Server with 8GB RAM + 8 SAS HDD's - RAID 5 + 2 Quad > >>>>>> Core Intel Xeon Processors. > >>>>>> > >>>>>> I have both LTSP and WinXP clients using Squid. Many times i have > >>>>>> noticed, squid stops responding, the browser keeps trying to connect > >>>>>> and i don't see any error in cache.log or store.log. My only way out > >>>>>> is to restart squid. > >>>>> > >>>>> Usually means Squid is doing something with its on-disk storage. > >>>>> > >>>>>> I read through cache_mem, my current configuration is 100MB, i > >>>>>> changed it to 128MB, but squid couldn't start saying the cache_mem is > >>>>>> more than cache_disk size. > >>>>>> > >>>>>> Why does this happen and what is the recommended configuration for the > >>>>>> hardware i have? > >>>>> > >>>>> You are missing a cache_dir option. Which means Squid-2 will be using > >>>>> the > >>>>> default and very inefficient 100 MB ufs formatted storage. > >>>>> > >>>>> Squid-3.1 and later are the only releases of Squid where cache_dir can > >>>>> be > >>>>> fully removed from the config. > >>>>> > >>>>> Either define a cache_dir to use the disks or setup the "null" cache_dir > >>>>> type for memory-only storage. > >>>>> > >>>>>> squid.conf: Please donot compare this config to my other posts, as > >>>>>> this is on a different server and it has a very basic configuration. > >>>>>> > >>>>>> visible_hostname sunserver > >>>>>> hierarchy_stoplist cgi-bin ? > >>>>>> acl QUERY urlpath_regex cgi-bin \? > >>>>>> no_cache deny QUERY > >>>>> > >>>>> Drop 'no_cache' use instead: > >>>>> cache deny QUERY > >>>>> > >>>>>> hosts_file /etc/hosts > >>>>>> http_port 10.10.10.10:3128 > >>>>>> refresh_pattern ^ftp: 1440 20% 10080 > >>>>>> refresh_pattern ^gopher: 1440 0% 1440 > >>>>>> refresh_pattern . 0 20% 4320 > >>>>>> > >>>>>> acl all src 0.0.0.0/0.0.0.0 > >>>>>> acl manager proto cache_object > >>>>>> acl localhost src 127.0.0.1/255.255.255.255 > >>>>>> acl to_localhost dst 127.0.0.0/8 > >>>>>> acl SSL_ports port 443 563 > >>>>>> acl Safe_ports port 80 # http > >>>>>> acl Safe_ports port 21 # ftp > >>>>>> acl Safe_ports port 443 563 # https, snews > >>>>>> acl Safe_ports port 70 # gopher > >>>>>> acl Safe_ports port 210 # wais > >>>>>> acl Safe_ports port 1025-65535 # unregistered ports > >>>>>> acl Safe_ports port 280 # http-mgmt > >>>>>> acl Safe_ports port 488 # gss-http > >>>>>> acl Safe_ports port 591 # filemaker > >>>>>> acl Safe_ports port 631 # cups > >>>>>> acl Safe_ports port 777 # multiling http > >>>>>> acl Safe_ports port 901 # SWAT > >>>>>> acl Safe_ports port 993 # IMAP > >>>>>> acl Safe_ports port 587 # SMTP > >>>>>> acl Safe_ports port 22 # SSH > >>>>>> acl purge method PURGE > >>>>>> acl special_urls url_regex "/etc/squid/squid-noblock.acl" > >>>>>> acl extndeny url_regex -i "/etc/squid/blocks.files.acl" > >>>>>> acl malware_block_list url_regex -i "/etc/squid/malware_block_list.txt" > >>>>>> acl badurl url_regex -i teen orkut youtube sex mp3 mp4 > >>>>>> acl lan src 10.10.10.0/24 > >>>>>> acl stud ident_regex babu > >>>>>> acl download method GET > >>>>>> acl CONNECT method CONNECT > >>>>>> cache_mem 100 MB > >>>>>> ident_lookup_access allow all > >>>>>> deny_info http://malware.hiperlinks.com.br/denied.shtml > >>>>>> malware_block_list > >>>>>> http_access allow manager localhost > >>>>>> http_access deny manager > >>>>>> http_access allow purge localhost > >>>>>> http_access allow special_urls > >>>>>> http_access deny extndeny download > >>>>>> http_access deny extndeny > >>>>>> http_access deny purge > >>>>>> http_access deny !Safe_ports > >>>>>> http_access deny CONNECT !SSL_ports > >>>>>> http_access deny badurl > >>>>>> http_access deny malware_block_list > >>>>>> http_access allow localhost > >>>>>> http_access allow lan > >>>>>> http_access deny all > >>>>>> http_reply_access allow all > >>>>>> icp_access allow all > >>>>>> coredump_dir /var/spool/squid > >>>>>> > >>>>>> > >>>>>> Many Thanks > >>>>>> Avinash > >>>>> > >>>>> -- > >>>>> Please be using > >>>>> Current Stable Squid 2.7.STABLE6 or 3.0.STABLE18 > >>>>> Current Beta Squid 3.1.0.13 > >>>>> > >>>> Thank you all for the information. I read the documentation. > >>>> To begin with I have set cache_dir to 256MB and cache_mem also to 256 > >>>> MB. Which takes the precedence? I guess the pages are stored/retrieved > >>>> from the RAM. Does this setting mean that, once 256MB is reached in > >>>> RAM it will start storing the pages in cache_dir? > >>>> > >>>> Thanks, > >>>> Avinash > >>>> > >>> > >>> Hi Guys, > >>> > >>> I just tested it, but it was pretty slow, the page was not loading > >>> only. Strange coz, > >>> the cache_mem is increased to 256MB and its still slow? How does this > >>> work? > >> > >> Everything gets stuffed into cache_mem first. > >> - objects which are labeled as too large for memory, or those unlabeled > >> which grow too large, get pushed to disk. This happens even if not > >> completely downloaded yet, which can be one cause of slowness on big stuff. > >> - objects which have not been used longest get pushed to disk when more > >> memory space is needed. > >> - all memory objects are pushed to disk during shutdown, restart, > >> reconfigure. > >> > >>> According to the squid Documentation, i recommended size for cache_dir > >>> is 7000 or 8000! > >>> > >>> I set cache_dir to null /tmp and i could see a lot of difference and > >>> it worked pretty well. > >> > >> Seems to me that the issue was some things being sent to disk storage. > >> Combined with severe speed problems reading/waiting from that disk storage. > >> > >> You said you have RAID5 so I'm not surprised its slow. > >> RAID and Squid do NOT play well together. Squid treats the disk as > >> random-access media using as many access threads as it can obtain in > >> parallel. Doing 4KB chunk operations. > >> > >> Amos > >> -- > >> Please be using > >> Current Stable Squid 2.7.STABLE6 or 3.0.STABLE18 > >> Current Beta Squid 3.1.0.13 > >> > > > > > > Thank you for the explanation. Its working well now, LTSP users are > > satisfied with the speed. I awaiting feedback from Windows Users as > > more than 25users login at the same time and use Internet. > > > > Cheers > > Avinash > > > > > I just noticed that LTSP is behaving a bit strange, today morning all > the applications were openly very slowly and none of the ltsp users > are able to lock their computers. Applications like Mozilla, > Openoffice are not responding properly. Is this bcoz, i set cache_dir > to null. > > will all the free memory in the system be used with this setting? > How can i resolve this? > > Avinash
