Search squid archive

Re: YouTube\GoogleVideo caching is here, tested and verified.

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



Hi Eliezer...

would you mind sharing the scripts, so i can test it on my squid 3.5.28
version?

i have a store-id.pl script already running and caching certain files on
https sites..

but on youtube its only caching images.. not the videos format from local
CDN server from ISP in the region

i only get this on my log

Apr 14 23:06:58     32 172.255.255.1 TCP_MISS/200 6502 GET
https://i.ytimg.com/vi/yqQwH_Qj1x0/hqdefault.jpg? -
HIER_DIRECT/170.254.11.57 image/webp
Apr 14 23:06:58    170 172.255.255.1 TCP_MISS/200 650 GET
https://www.youtube.com/pcs/activeview? - HIER_DIRECT/172.217.30.110
image/gif
Apr 14 23:06:58     97 172.255.255.1 TAG_NONE/200 0 CONNECT i.ytimg.com:443
- HIER_DIRECT/170.254.11.57 -
Apr 14 23:06:58     99 172.255.255.1 TAG_NONE/200 0 CONNECT i.ytimg.com:443
- HIER_DIRECT/170.254.11.57 -
Apr 14 23:06:58    191 172.255.255.1 TCP_MISS/204 515 GET
https://www.youtube.com/api/stats/ads? - HIER_DIRECT/172.217.30.110
text/html
Apr 14 23:06:58    146 172.255.255.1 TCP_MISS/200 618 GET
https://www.google.com/pagead/lvz? - HIER_DIRECT/172.217.28.228 image/gif
Apr 14 23:06:58     55 172.255.255.1 TCP_MISS/200 8997 GET
https://i.ytimg.com/vi/k5Zu898lbVU/hqdefault.jpg? -
HIER_DIRECT/170.254.11.57 image/webp
Apr 14 23:06:58     28 172.255.255.1 TCP_MISS/200 8231 GET
https://i.ytimg.com/vi/z260XtnMJks/hqdefault.jpg? -
HIER_DIRECT/170.254.11.57 image/webp
Apr 14 23:06:58    299 172.255.255.1 TAG_NONE/200 0 CONNECT i.ytimg.com:443
- HIER_DIRECT/170.254.11.57 -
Apr 14 23:06:58     82 172.255.255.1 TAG_NONE/200 0 CONNECT i.ytimg.com:443
- HIER_DIRECT/170.254.11.57 -
Apr 14 23:06:58      2 172.255.255.1 TCP_HIT/200 4697 GET
https://i.ytimg.com/vi/iVEvf-tR1os/hqdefault.jpg? - HIER_NONE/- image/webp
Apr 14 23:06:58     41 172.255.255.1 TCP_MISS/200 6536 GET
https://i.ytimg.com/vi/WqiYXdRNIdM/hqdefault.jpg? -
HIER_DIRECT/170.254.11.57 image/webp
Apr 14 23:06:58     62 172.255.255.1 TAG_NONE/200 0 CONNECT i.ytimg.com:443
- HIER_DIRECT/170.254.11.57 -
Apr 14 23:06:58     59 172.255.255.1 TAG_NONE/200 0 CONNECT i.ytimg.com:443
- HIER_DIRECT/170.254.11.57 -
Apr 14 23:06:58      2 172.255.255.1 TCP_HIT/200 8658 GET
https://i.ytimg.com/vi/E9dls93E6MI/hqdefault.jpg? - HIER_NONE/- image/webp
Apr 14 23:06:58    374 172.255.255.1 TCP_MISS/200 618 GET
https://www.google.com.br/pagead/lvz? - HIER_DIRECT/172.217.28.227 image/gif
Apr 14 23:06:58     26 172.255.255.1 TCP_MISS/200 8509 GET
https://i.ytimg.com/vi/BmoEIyw1HFU/hqdefault.jpg? -
HIER_DIRECT/170.254.11.57 image/webp
Apr 14 23:06:59    164 172.255.255.1 TAG_NONE/200 0 CONNECT
static.doubleclick.net:443 - HIER_DIRECT/172.217.162.102 -
Apr 14 23:06:59     22 172.255.255.1 TCP_MISS/304 283 GET
https://static.doubleclick.net/instream/ad_status.js -
HIER_DIRECT/172.217.162.102 -
Apr 14 23:06:59    164 172.255.255.1 TAG_NONE/200 0 CONNECT
www.youtube.com:443 - HIER_DIRECT/172.217.30.110 -
Apr 14 23:06:59    363 172.255.255.1 TAG_NONE/200 0 CONNECT
www.youtube.com:443 - HIER_DIRECT/172.217.30.110 -
Apr 14 23:06:59     22 172.255.255.1 TCP_MISS/204 250 GET
https://www.youtube.com/generate_204? - HIER_DIRECT/172.217.30.110 -
Apr 14 23:06:59    178 172.255.255.1 TCP_MISS/200 1394 POST
https://www.youtube.com/service_ajax? - HIER_DIRECT/172.217.30.110
application/json
Apr 14 23:07:00    143 172.255.255.1 TAG_NONE/200 0 CONNECT
www.youtube.com:443 - HIER_DIRECT/172.217.30.110 -
Apr 14 23:07:00    147 172.255.255.1 TAG_NONE/200 0 CONNECT
www.youtube.com:443 - HIER_DIRECT/172.217.30.110 -
Apr 14 23:07:01    172 172.255.255.1 TCP_MISS/200 618 GET
https://www.youtube.com/pagead/conversion/? - HIER_DIRECT/172.217.30.110
image/gif
Apr 14 23:07:01    164 172.255.255.1 TCP_MISS/200 618 GET
https://www.youtube.com/pagead/conversion/? - HIER_DIRECT/172.217.30.110
image/gif
Apr 14 23:07:02    139 172.255.255.1 TAG_NONE/200 0 CONNECT
www.youtube.com:443 - HIER_DIRECT/172.217.30.110 -
Apr 14 23:07:02    278 172.255.255.1 TAG_NONE/200 0 CONNECT
r2---sn-uxjioxucg-cnce.googlevideo.com:443 - HIER_DIRECT/170.254.11.45 -
Apr 14 23:07:02     45 172.255.255.1 TCP_MISS/200 1987 GET
https://r2---sn-uxjioxucg-cnce.googlevideo.com/videoplayback? -
HIER_DIRECT/170.254.11.45 video/mp4
Apr 14 23:07:03     64 172.255.255.1 TAG_NONE/200 0 CONNECT
r2---sn-uxjioxucg-cnce.googlevideo.com:443 - HIER_DIRECT/170.254.11.45 -
Apr 14 23:07:03    162 172.255.255.1 TCP_MISS/204 595 POST
https://www.youtube.com/api/stats/qoe? - HIER_DIRECT/172.217.30.110
text/html
Apr 14 23:07:03     39 172.255.255.1 TCP_MISS/200 1414 GET
https://r2---sn-uxjioxucg-cnce.googlevideo.com/videoplayback? -
HIER_DIRECT/170.254.11.45 audio/webm
Apr 14 23:07:03    421 172.255.255.1 TAG_NONE/200 0 CONNECT
www.youtube.com:443 - HIER_DIRECT/172.217.30.110 -
Apr 14 23:07:03    129 172.255.255.1 TCP_MISS/200 6027 GET
https://www.youtube.com/sw.js - HIER_DIRECT/172.217.30.110 text/javascript
Apr 14 23:07:05    162 172.255.255.1 TAG_NONE/200 0 CONNECT
www.youtube.com:443 - HIER_DIRECT/172.217.30.110 -
Apr 14 23:07:05    124 172.255.255.1 TCP_MISS/200 507 POST
https://www.youtube.com/youtubei/v1/log_event? - HIER_DIRECT/172.217.30.110
application/json
Apr 14 23:07:06    164 172.255.255.1 TAG_NONE/200 0 CONNECT
www.youtube.com:443 - HIER_DIRECT/172.217.30.110 -
Apr 14 23:07:06    174 172.255.255.1 TCP_MISS/200 618 GET
https://www.youtube.com/pagead/conversion/? - HIER_DIRECT/172.217.30.110
image/gif
Apr 14 23:07:08    151 172.255.255.1 TAG_NONE/200 0 CONNECT
www.youtube.com:443 - HIER_DIRECT/172.217.30.110 -
Apr 14 23:07:08   8781 172.255.255.1 TAG_NONE/200 0 CONNECT s.ytimg.com:443
- HIER_DIRECT/172.217.162.110 -
Apr 14 23:07:09      1 172.255.255.1 TCP_MEM_HIT/200 904 GET
https://s.ytimg.com/yts/img/favicon-vfl8qSV2F.ico - HIER_NONE/- image/x-icon


Eliezer Croitoru wrote
> Hey All,
> 
> After quite some time I have compiled a solution for YouTube videos
> caching
> for PC's.
> The next step would be to cache it for mobile devices but I am looking for
> someone who wants this solution.
> The only drawback is that this solution is designed for
> intercept\transparent proxies and not tproxy but it might work on these
> too.
> 
> The installation is pretty simple on a systemd based OS like Debian 8+9,
> Ubuntu 16.04, CentOS\RHEK 7, Oracle Enterprise Linux 7 and OpenSUSE leap
> and
> above.
> It consists of four components:
> - local redis DB
> - ICAP service binary
> - ICAP service system service unit file
> - ruby StoreID script
> 
> And of course a special squid.conf with ssl_bump enabled.
> 
> For now I will not package it using RPM or DEB and will use a shell script
> or README.md that describes the installation and usage steps.
> Contact me here or by a PM.
> 
> Eliezer
> 
> ----
> Eliezer Croitoru
> Linux System Administrator
> Mobile: +972-5-28704261
> Email: 

> eliezer@.co

> 
> _______________________________________________
> squid-users mailing list

> squid-users@.squid-cache

> http://lists.squid-cache.org/listinfo/squid-users


Eliezer Croitoru wrote
> Hey All,
> 
> After quite some time I have compiled a solution for YouTube videos
> caching
> for PC's.
> The next step would be to cache it for mobile devices but I am looking for
> someone who wants this solution.
> The only drawback is that this solution is designed for
> intercept\transparent proxies and not tproxy but it might work on these
> too.
> 
> The installation is pretty simple on a systemd based OS like Debian 8+9,
> Ubuntu 16.04, CentOS\RHEK 7, Oracle Enterprise Linux 7 and OpenSUSE leap
> and
> above.
> It consists of four components:
> - local redis DB
> - ICAP service binary
> - ICAP service system service unit file
> - ruby StoreID script
> 
> And of course a special squid.conf with ssl_bump enabled.
> 
> For now I will not package it using RPM or DEB and will use a shell script
> or README.md that describes the installation and usage steps.
> Contact me here or by a PM.
> 
> Eliezer
> 
> ----
> Eliezer Croitoru
> Linux System Administrator
> Mobile: +972-5-28704261
> Email: 

> eliezer@.co

> 
> _______________________________________________
> squid-users mailing list

> squid-users@.squid-cache

> http://lists.squid-cache.org/listinfo/squid-users





--
Sent from: http://squid-web-proxy-cache.1019090.n4.nabble.com/Squid-Users-f1019091.html
_______________________________________________
squid-users mailing list
squid-users@xxxxxxxxxxxxxxxxxxxxx
http://lists.squid-cache.org/listinfo/squid-users




[Index of Archives]     [Linux Audio Users]     [Samba]     [Big List of Linux Books]     [Linux USB]     [Yosemite News]

  Powered by Linux