Re: Sudden but sustained high bandwidth usage

Heiler Bemerguy <heiler.bemerguy@xxxxxxxxxxxxxx> · Tue, 8 Mar 2016 12:26:39 -0300



    This way it won't cache any "range" downloads as "range_offset_limit
    0" is the default option and it will make squid only download what
    the client requested.

    
    From squid-cache.org: "A size of 0 causes Squid to never fetch more
    than the client requested. (default)"

      
    What I'm trying to accomplish here, and have done while using AUFS,
    is to make squid CACHE/STORE RANGED REQUESTS for windowsupdate.com,
    instead of its default action of aborting.

    
    How can I monitor whats the reason of all the "TCP_SWAPFAIL_MISS" on
    range downloads like these:

    
    1457381845.725    241 10.101.1.23 TCP_SWAPFAIL_MISS/206 33123 GET http://www.stf.jus.br/arquivo/biblioteca/NovasAquisicoes/2015-10/1043520/sumario.pdf
    - HIER_DIRECT/201.49.144.135 application/pdf

    1457381846.036    293 10.101.1.23 TCP_SWAPFAIL_MISS/206 151352 GET http://www.stf.jus.br/arquivo/biblioteca/NovasAquisicoes/2015-10/1043520/sumario.pdf
    - HIER_DIRECT/201.49.144.135 application/pdf

    1457381846.120     66 10.101.1.23 TCP_SWAPFAIL_MISS/206 33129 GET http://www.stf.jus.br/arquivo/biblioteca/NovasAquisicoes/2015-10/1043520/sumario.pdf
    - HIER_DIRECT/201.49.144.135 application/pdf

    1457381846.310     66 10.101.1.23 TCP_SWAPFAIL_MISS/206 33129 GET http://www.stf.jus.br/arquivo/biblioteca/NovasAquisicoes/2015-10/1043520/sumario.pdf
    - HIER_DIRECT/201.49.144.135 application/pdf

    
    Best Regards,

    -- 
Heiler Bemerguy - (91) 98151-4894
Assessor Técnico - CINBESA (91) 3184-1751
    

    Em 08/03/2016 05:04, L.P.H. van Belle
      escreveu:

    
        I had this problem to. 
         
        I fixed this as followed
         
        - Updated my windowsupdate acl
        acl windowsupdate dstdomain
              windowsupdate.microsoft.com
        acl windowsupdate dstdomain .update.microsoft.com
        acl windowsupdate dstdomain
              download.windowsupdate.com
        acl windowsupdate dstdomain
              redir.metaservices.microsoft.com
        acl windowsupdate dstdomain
              images.metaservices.microsoft.com
        acl windowsupdate dstdomain c.microsoft.com
        acl windowsupdate dstdomain
              www.download.windowsupdate.com
        acl windowsupdate dstdomain wustat.windows.com
        acl windowsupdate dstdomain crl.microsoft.com
        acl windowsupdate dstdomain sls.microsoft.com
        acl windowsupdate dstdomain
              productactivation.one.microsoft.com
        acl windowsupdate dstdomain
              ntservicepack.microsoft.com
        acl windowsupdate dstdomain
              au.download.windowsupdate.com
        acl windowsupdate dstdomain
              ds.download.windowsupdate.com
        acl windowsupdate dstdomain
              ctldl.windowsupdate.com
        acl windowsupdate dstdomain .data.microsoft.com
        acl windowsupdate dstdomain .l.windowsupdate.com
        acl windowsupdate dstdomain
              .microsoft.com.akadns.net
        acl windowsupdate dstdomain
              .deploy.akamaitechnologies.com
         
         
        I updated the refresh_pattern… 
        refresh_pattern -i
              windowsupdate.com/.*\.(cab|exe|ms[i|u|f|p]|[ap]sf|wm[v|a]|dat|zip|psf)
              43200
              80% 129600 reload-into-ims
        refresh_pattern -i
              microsoft.com/.*\.(cab|exe|ms[i|u|f|p]|[ap]sf|wm[v|a]|dat|zip|psf)
              43200 80%
              129600 reload-into-ims
        refresh_pattern -i
              windows.com/.*\.(cab|exe|ms[i|u|f|p]|[ap]sf|wm[v|a]|dat|zip|psf)
              43200 80%
              129600 reload-into-ims
        refresh_pattern -i
              microsoft.com.akadns.net/.*\.(cab|exe|ms[i|u|f|p]|[ap]sf|wm[v|a]|dat|zip|psf)
43200
              80% 129600 reload-into-ims
        refresh_pattern -i
              deploy.akamaitechnologies.com/.*\.(cab|exe|ms[i|u|f|p]|[ap]sf|wm[v|a]|dat|zip|psf)
43200
              80% 129600 reload-into-imsI change above 
         
        and i change these :
        range_offset_limit 0
         
        quick_abort_min 0 KB
        quick_abort_max 0 KB
        quick_abort_pct 90
         
        now the download for windows updates wont eat up
              your bandwith.. 
         
        Greetz, 
         
        Louis
         
         
        > -----Oorspronkelijk bericht-----
        > Van: squid-users
              [mailto:squid-users-bounces@xxxxxxxxxxxxxxxxxxxxx] Namens
        > Alex Rousskov
        > Verzonden: dinsdag 8 maart 2016 6:05
        > Aan: squid-users@xxxxxxxxxxxxxxxxxxxxx
        > Onderwerp: Re:  Sudden but
              sustained high bandwidth
              usage
        > 
        > On 03/07/2016 07:00 PM, Amos Jeffries wrote:
        > > Its a minor bug in the report display
              that they are not
              having more
        > > columns with separate numbers for each
              worker.
        > 
        > IMHO, the *summary* page should not include
              such noise. There
              should be
        > a way to request worker-specific stats
              instead.
        > 
        > Even for stats at the lower than mgr:info
              level, it may be a
              design bug
        > to start including per-worker "columns" in
              human
              readable output format.
        > Such "zooming" and "scoping" is best done by
              wrapper tools that can use
        > HTML tables, links, _javascript_ boxes, and
              other visualization
              tools
        > meant for navigating complex multi-layered
              information.
        > 
        > 
        > On 03/07/2016 07:57 PM, Eliezer Croitoru
              wrote:
        > > I didn't found any bug report that is
              related to the subject.
        > > I will try to add it into the bugzilla
              later.
        > 
        > If you do, please copy my objections there as
              well.
        > 
        > 
        > Thank you,
        > 
        > Alex.
        > 
        >
              _______________________________________________
        > squid-users mailing list
        > squid-users@xxxxxxxxxxxxxxxxxxxxx
        >
              http://lists.squid-cache.org/listinfo/squid-users
      
      
      _______________________________________________
squid-users mailing list
squid-users@xxxxxxxxxxxxxxxxxxxxx
http://lists.squid-cache.org/listinfo/squid-users

    
_______________________________________________
squid-users mailing list
squid-users@xxxxxxxxxxxxxxxxxxxxx
http://lists.squid-cache.org/listinfo/squid-users