Hi I apologize for my late reply. I guess I wasn't fully clear about my reason for why I need to stop the contents from being cached. First, here in Iraq the internet service is extremely expensive for ISP to provide services for home users. The ISP usually pay 25$ per 1Mbit/sec of bandwidth to the government on the other hand the end users expect to pay 2$ per 1Mbit/sec. so the ISPs need to rely heavily on caching and CDNs. Most of CDN companies hesitate heavily before operating their services in Iraq and most of ISPs can't provide the infrastructure for CDN operations ( namely high bandwidth required by CDN vendors such us Akamai, CDN77, etc. ) this led us to make our company specialized in providing caching and CDN traffic for ISPs. The issue we are facing here is some of the CDNs we have provide cacheable HTTP content, the ISPs that use our services just cache these contents on their local cache engines thus their traffic consumption from our CDNs will drop significantly causing us huge revenue losses because the CDN is still consuming bandwidth and minimal bandwidth. For this I am asking is there a way by using transparent Squid proxy to turn this cacheable content to non-cacheable one?. Thanks in Advance Regards Muhanad Abdullah -----Original Message----- From: squid-users <squid-users-bounces@xxxxxxxxxxxxxxxxxxxxx> On Behalf Of squid-users-request@xxxxxxxxxxxxxxxxxxxxx Sent: Thursday, July 28, 2022 3:00 PM To: squid-users@xxxxxxxxxxxxxxxxxxxxx Subject: squid-users Digest, Vol 95, Issue 41 Send squid-users mailing list submissions to squid-users@xxxxxxxxxxxxxxxxxxxxx To subscribe or unsubscribe via the World Wide Web, visit http://lists.squid-cache.org/listinfo/squid-users or, via email, send a message with subject or body 'help' to squid-users-request@xxxxxxxxxxxxxxxxxxxxx You can reach the person managing the list at squid-users-owner@xxxxxxxxxxxxxxxxxxxxx When replying, please edit your Subject line so it is more specific than "Re: Contents of squid-users digest..." Today's Topics: 1. Re: adding cache_control = nocache to http request using squid transparent proxy (ngtech1ltd@xxxxxxxxx) 2. Re: adding cache_control = nocache to http request using squid transparent proxy (Amos Jeffries) ---------------------------------------------------------------------- Message: 1 Date: Thu, 28 Jul 2022 10:41:42 +0300 From: <ngtech1ltd@xxxxxxxxx> To: <squid-users@xxxxxxxxxxxxxxxxxxxxx> Subject: Re: adding cache_control = nocache to http request using squid transparent proxy Message-ID: <008b01d8a255$7bdfbd10$739f3730$@gmail.com> Content-Type: text/plain; charset="utf-8" Hey Amos, I support what you wrote and I do not know why the service provider wants this but there are some cases which there is a need to lower the cache ratio of the clients. Usually fast service is what ISPs want but there are couple use cases that I have seen which makes sense to somehow try to disable cache in the client side. In these specific cases the relationship of the ISP and the client should be fully understood by both side and the ISP should OVER COMMIT their services to the client to compensate for the client limitations. I would assume it should be some 50-100% of the package over commit. In the last years I have seen that 1080HD videos uses usually 3Mbps VBR in cases of real time transcoding of the video ( both in server and client side ) while 6Mbps in CBR for the exact same pre-transcoded videos. (which reduces the client side CPU and device requirements). So, in case I would have couple CDNs pushing data to my network while the one is overloading my clients current hardware There is a right to push back this CDN performance since he somehow in-directly forces my clients to upgrade their hardware. To my understanding many ISPs and CDNs won't see their actions to give better service coverage as bad but what's next? We won't be able to snoop in our noses between commercials that are popping into our screen or eyes or head? I just put this really faint conversation in my head: Son: ohh my head hurts dad! Dad: Who hit you? Son: I don't know, I was sitting Infront of the **device** and the video was 4k fps. Dad: You should use a lower image fps rendering, in my days we used to watch matrix in 15-30 fps and it was fun. Hope It Helps to give someone a smile. Eliezer ---- Eliezer Croitoru NgTech, Tech Support Mobile: +972-5-28704261 Email: ngtech1ltd@xxxxxxxxx Web: https://ngtech.co.il/ My-Tube: https://tube.ngtech.co.il/ -----Original Message----- From: squid-users <squid-users-bounces@xxxxxxxxxxxxxxxxxxxxx> On Behalf Of Amos Jeffries Sent: Wednesday, 27 July 2022 3:46 To: squid-users@xxxxxxxxxxxxxxxxxxxxx Subject: Re: adding cache_control = nocache to http request using squid transparent proxy On 27/07/22 07:52, muhanad wrote: > Hello > > I am trying to edit the header of http headers to set the > cache_control option to " no-cache" to prevent users from being able > to cache the contents This will not do what you think it does. The "no-cache" control actually *enables* caching by recipients. It just requires a quick revalidation check before the cached content is used. > even if they are using any type of caching engines. the squid > proxy will work in a transparent mode. The traffic is originated from > one of our CDNs, This does not make sense. Just publish the Squid machine IP in DNS instead of the CDN server IP. No need for interception. > also the connection is direct between the clients and > the CDN servers, thus the proxy will work in transparent mode with IP > spoofing so the in the header the IP address is stays the IP address of > the client and not the proxy server. This may not do what you think it does. When traffic is arriving *from* Internet the source-IP indicates which route to deliver the response packets. You do not want the origin server(s) bypassing Squid on the TCP SYNACK packets - that will break all traffic. > PS: We are an ISP company based in Iraq, Baghdad and we are trying to > prevent the clients from caching all HTTP data. > Why? This is typically a very bad idea. All it does is: * lower the amount of bandwidth available to your clients - given them a bad service/experience. * increase the traffic delays across your network - even worse service/experience. * encourage other ISP to erase the cache limitations on traffic from your servers even on traffic where it is correct - even worse service/experience. Even if you are charging clients for bandwidth used. You want to be able to service *more* clients as quickly as possible, not scare them away with a bad service. HTH Amos _______________________________________________ squid-users mailing list squid-users@xxxxxxxxxxxxxxxxxxxxx http://lists.squid-cache.org/listinfo/squid-users ------------------------------ Message: 2 Date: Thu, 28 Jul 2022 20:39:26 +1200 From: Amos Jeffries <squid3@xxxxxxxxxxxxx> To: squid-users@xxxxxxxxxxxxxxxxxxxxx Subject: Re: adding cache_control = nocache to http request using squid transparent proxy Message-ID: <d6575308-739f-629e-c7be-f8b07cf4a574@xxxxxxxxxxxxx> Content-Type: text/plain; charset=UTF-8; format=flowed On 28/07/22 19:41, ngtech1ltd wrote: > Hey Amos, > > I support what you wrote and I do not know why the service provider wants this but there are some cases > which there is a need to lower the cache ratio of the clients. Yes I know. This is a query where we could make things worse by jumping to assumptions and providing immediate answers to the question as-asked. Thus I'm pointing out the potential issues with the concept and waiting on clarification from OP to the "Why?" question before providing a solution to their actual need. Cheers Amos ------------------------------ Subject: Digest Footer _______________________________________________ squid-users mailing list squid-users@xxxxxxxxxxxxxxxxxxxxx http://lists.squid-cache.org/listinfo/squid-users ------------------------------ End of squid-users Digest, Vol 95, Issue 41 ******************************************* _______________________________________________ squid-users mailing list squid-users@xxxxxxxxxxxxxxxxxxxxx http://lists.squid-cache.org/listinfo/squid-users
