Hi Eliezer... would you mind sharing the scripts, so i can test it on my squid 3.5.28 version? i have a store-id.pl script already running and caching certain files on https sites.. but on youtube its only caching images.. not the videos format from local CDN server from ISP in the region i only get this on my log Apr 14 23:06:58 32 172.255.255.1 TCP_MISS/200 6502 GET https://i.ytimg.com/vi/yqQwH_Qj1x0/hqdefault.jpg? - HIER_DIRECT/170.254.11.57 image/webp Apr 14 23:06:58 170 172.255.255.1 TCP_MISS/200 650 GET https://www.youtube.com/pcs/activeview? - HIER_DIRECT/172.217.30.110 image/gif Apr 14 23:06:58 97 172.255.255.1 TAG_NONE/200 0 CONNECT i.ytimg.com:443 - HIER_DIRECT/170.254.11.57 - Apr 14 23:06:58 99 172.255.255.1 TAG_NONE/200 0 CONNECT i.ytimg.com:443 - HIER_DIRECT/170.254.11.57 - Apr 14 23:06:58 191 172.255.255.1 TCP_MISS/204 515 GET https://www.youtube.com/api/stats/ads? - HIER_DIRECT/172.217.30.110 text/html Apr 14 23:06:58 146 172.255.255.1 TCP_MISS/200 618 GET https://www.google.com/pagead/lvz? - HIER_DIRECT/172.217.28.228 image/gif Apr 14 23:06:58 55 172.255.255.1 TCP_MISS/200 8997 GET https://i.ytimg.com/vi/k5Zu898lbVU/hqdefault.jpg? - HIER_DIRECT/170.254.11.57 image/webp Apr 14 23:06:58 28 172.255.255.1 TCP_MISS/200 8231 GET https://i.ytimg.com/vi/z260XtnMJks/hqdefault.jpg? - HIER_DIRECT/170.254.11.57 image/webp Apr 14 23:06:58 299 172.255.255.1 TAG_NONE/200 0 CONNECT i.ytimg.com:443 - HIER_DIRECT/170.254.11.57 - Apr 14 23:06:58 82 172.255.255.1 TAG_NONE/200 0 CONNECT i.ytimg.com:443 - HIER_DIRECT/170.254.11.57 - Apr 14 23:06:58 2 172.255.255.1 TCP_HIT/200 4697 GET https://i.ytimg.com/vi/iVEvf-tR1os/hqdefault.jpg? - HIER_NONE/- image/webp Apr 14 23:06:58 41 172.255.255.1 TCP_MISS/200 6536 GET https://i.ytimg.com/vi/WqiYXdRNIdM/hqdefault.jpg? - HIER_DIRECT/170.254.11.57 image/webp Apr 14 23:06:58 62 172.255.255.1 TAG_NONE/200 0 CONNECT i.ytimg.com:443 - HIER_DIRECT/170.254.11.57 - Apr 14 23:06:58 59 172.255.255.1 TAG_NONE/200 0 CONNECT i.ytimg.com:443 - HIER_DIRECT/170.254.11.57 - Apr 14 23:06:58 2 172.255.255.1 TCP_HIT/200 8658 GET https://i.ytimg.com/vi/E9dls93E6MI/hqdefault.jpg? - HIER_NONE/- image/webp Apr 14 23:06:58 374 172.255.255.1 TCP_MISS/200 618 GET https://www.google.com.br/pagead/lvz? - HIER_DIRECT/172.217.28.227 image/gif Apr 14 23:06:58 26 172.255.255.1 TCP_MISS/200 8509 GET https://i.ytimg.com/vi/BmoEIyw1HFU/hqdefault.jpg? - HIER_DIRECT/170.254.11.57 image/webp Apr 14 23:06:59 164 172.255.255.1 TAG_NONE/200 0 CONNECT static.doubleclick.net:443 - HIER_DIRECT/172.217.162.102 - Apr 14 23:06:59 22 172.255.255.1 TCP_MISS/304 283 GET https://static.doubleclick.net/instream/ad_status.js - HIER_DIRECT/172.217.162.102 - Apr 14 23:06:59 164 172.255.255.1 TAG_NONE/200 0 CONNECT www.youtube.com:443 - HIER_DIRECT/172.217.30.110 - Apr 14 23:06:59 363 172.255.255.1 TAG_NONE/200 0 CONNECT www.youtube.com:443 - HIER_DIRECT/172.217.30.110 - Apr 14 23:06:59 22 172.255.255.1 TCP_MISS/204 250 GET https://www.youtube.com/generate_204? - HIER_DIRECT/172.217.30.110 - Apr 14 23:06:59 178 172.255.255.1 TCP_MISS/200 1394 POST https://www.youtube.com/service_ajax? - HIER_DIRECT/172.217.30.110 application/json Apr 14 23:07:00 143 172.255.255.1 TAG_NONE/200 0 CONNECT www.youtube.com:443 - HIER_DIRECT/172.217.30.110 - Apr 14 23:07:00 147 172.255.255.1 TAG_NONE/200 0 CONNECT www.youtube.com:443 - HIER_DIRECT/172.217.30.110 - Apr 14 23:07:01 172 172.255.255.1 TCP_MISS/200 618 GET https://www.youtube.com/pagead/conversion/? - HIER_DIRECT/172.217.30.110 image/gif Apr 14 23:07:01 164 172.255.255.1 TCP_MISS/200 618 GET https://www.youtube.com/pagead/conversion/? - HIER_DIRECT/172.217.30.110 image/gif Apr 14 23:07:02 139 172.255.255.1 TAG_NONE/200 0 CONNECT www.youtube.com:443 - HIER_DIRECT/172.217.30.110 - Apr 14 23:07:02 278 172.255.255.1 TAG_NONE/200 0 CONNECT r2---sn-uxjioxucg-cnce.googlevideo.com:443 - HIER_DIRECT/170.254.11.45 - Apr 14 23:07:02 45 172.255.255.1 TCP_MISS/200 1987 GET https://r2---sn-uxjioxucg-cnce.googlevideo.com/videoplayback? - HIER_DIRECT/170.254.11.45 video/mp4 Apr 14 23:07:03 64 172.255.255.1 TAG_NONE/200 0 CONNECT r2---sn-uxjioxucg-cnce.googlevideo.com:443 - HIER_DIRECT/170.254.11.45 - Apr 14 23:07:03 162 172.255.255.1 TCP_MISS/204 595 POST https://www.youtube.com/api/stats/qoe? - HIER_DIRECT/172.217.30.110 text/html Apr 14 23:07:03 39 172.255.255.1 TCP_MISS/200 1414 GET https://r2---sn-uxjioxucg-cnce.googlevideo.com/videoplayback? - HIER_DIRECT/170.254.11.45 audio/webm Apr 14 23:07:03 421 172.255.255.1 TAG_NONE/200 0 CONNECT www.youtube.com:443 - HIER_DIRECT/172.217.30.110 - Apr 14 23:07:03 129 172.255.255.1 TCP_MISS/200 6027 GET https://www.youtube.com/sw.js - HIER_DIRECT/172.217.30.110 text/javascript Apr 14 23:07:05 162 172.255.255.1 TAG_NONE/200 0 CONNECT www.youtube.com:443 - HIER_DIRECT/172.217.30.110 - Apr 14 23:07:05 124 172.255.255.1 TCP_MISS/200 507 POST https://www.youtube.com/youtubei/v1/log_event? - HIER_DIRECT/172.217.30.110 application/json Apr 14 23:07:06 164 172.255.255.1 TAG_NONE/200 0 CONNECT www.youtube.com:443 - HIER_DIRECT/172.217.30.110 - Apr 14 23:07:06 174 172.255.255.1 TCP_MISS/200 618 GET https://www.youtube.com/pagead/conversion/? - HIER_DIRECT/172.217.30.110 image/gif Apr 14 23:07:08 151 172.255.255.1 TAG_NONE/200 0 CONNECT www.youtube.com:443 - HIER_DIRECT/172.217.30.110 - Apr 14 23:07:08 8781 172.255.255.1 TAG_NONE/200 0 CONNECT s.ytimg.com:443 - HIER_DIRECT/172.217.162.110 - Apr 14 23:07:09 1 172.255.255.1 TCP_MEM_HIT/200 904 GET https://s.ytimg.com/yts/img/favicon-vfl8qSV2F.ico - HIER_NONE/- image/x-icon Eliezer Croitoru wrote > Hey All, > > After quite some time I have compiled a solution for YouTube videos > caching > for PC's. > The next step would be to cache it for mobile devices but I am looking for > someone who wants this solution. > The only drawback is that this solution is designed for > intercept\transparent proxies and not tproxy but it might work on these > too. > > The installation is pretty simple on a systemd based OS like Debian 8+9, > Ubuntu 16.04, CentOS\RHEK 7, Oracle Enterprise Linux 7 and OpenSUSE leap > and > above. > It consists of four components: > - local redis DB > - ICAP service binary > - ICAP service system service unit file > - ruby StoreID script > > And of course a special squid.conf with ssl_bump enabled. > > For now I will not package it using RPM or DEB and will use a shell script > or README.md that describes the installation and usage steps. > Contact me here or by a PM. > > Eliezer > > ---- > Eliezer Croitoru > Linux System Administrator > Mobile: +972-5-28704261 > Email: > eliezer@.co > > _______________________________________________ > squid-users mailing list > squid-users@.squid-cache > http://lists.squid-cache.org/listinfo/squid-users Eliezer Croitoru wrote > Hey All, > > After quite some time I have compiled a solution for YouTube videos > caching > for PC's. > The next step would be to cache it for mobile devices but I am looking for > someone who wants this solution. > The only drawback is that this solution is designed for > intercept\transparent proxies and not tproxy but it might work on these > too. > > The installation is pretty simple on a systemd based OS like Debian 8+9, > Ubuntu 16.04, CentOS\RHEK 7, Oracle Enterprise Linux 7 and OpenSUSE leap > and > above. > It consists of four components: > - local redis DB > - ICAP service binary > - ICAP service system service unit file > - ruby StoreID script > > And of course a special squid.conf with ssl_bump enabled. > > For now I will not package it using RPM or DEB and will use a shell script > or README.md that describes the installation and usage steps. > Contact me here or by a PM. > > Eliezer > > ---- > Eliezer Croitoru > Linux System Administrator > Mobile: +972-5-28704261 > Email: > eliezer@.co > > _______________________________________________ > squid-users mailing list > squid-users@.squid-cache > http://lists.squid-cache.org/listinfo/squid-users -- Sent from: http://squid-web-proxy-cache.1019090.n4.nabble.com/Squid-Users-f1019091.html _______________________________________________ squid-users mailing list squid-users@xxxxxxxxxxxxxxxxxxxxx http://lists.squid-cache.org/listinfo/squid-users
