My suggestion is to run every minute a curl request into a tmp file and then compare to the existing one, then sort and uniq and replace the existing DB In the external acl helper script use some kind of version testing by the last date updated. You can use a simple comparison to do that. So two scripts: 1 - update by a crontab 2 - external_acl helper Will update later. Eliezer ---- Eliezer Croitoru Linux System Administrator Mobile: +972-5-28704261 Email: eliezer@xxxxxxxxxxxx -----Original Message----- From: squid-users [mailto:squid-users-bounces@xxxxxxxxxxxxxxxxxxxxx] On Behalf Of Jason B. Nance Sent: Tuesday, March 21, 2017 5:53 PM To: squid-users@xxxxxxxxxxxxxxxxxxxxx Subject: URL list from a URL Hello, I'm using Squid 3.5.20 and wonder if it is possible to define an ACL which retrieves the list of URLs from another URL (similar to pointing to a file). In this specific use case it is to allow a Foreman server to sync Yum content from the CentOS mirrors. I tell Foreman to use the following URL: http://mirrorlist.centos.org/?release=7&arch=x86_64&repo=updates Which returns a list of URLs, such as: http://repo1.dal.innoscale.net/centos/7.3.1611/updates/x86_64/ http://linux.mirrors.es.net/centos/7.3.1611/updates/x86_64/ http://reflector.westga.edu/repos/CentOS/7.3.1611/updates/x86_64/ http://mirror.jax.hugeserver.com/centos/7.3.1611/updates/x86_64/ http://ftp.linux.ncsu.edu/pub/CentOS/7.3.1611/updates/x86_64/ http://mirror.nexcess.net/CentOS/7.3.1611/updates/x86_64/ http://mirror.web-ster.com/centos/7.3.1611/updates/x86_64/ http://centos.host-engine.com/7.3.1611/updates/x86_64/ http://mirror.raystedman.net/centos/7.3.1611/updates/x86_64/ http://mirror.linux.duke.edu/pub/centos/7.3.1611/updates/x86_64/ Foreman then starts a new HTTP connection (not a redirect) to attempt to connect to those in turn until it works. So I would like to configure Squid to allow the Foreman server access to any of those URLs (the list changes somewhat often). I started to go down the external_acl_type but am wondering if I'm missing something obvious. Regards, j _______________________________________________ squid-users mailing list squid-users@xxxxxxxxxxxxxxxxxxxxx http://lists.squid-cache.org/listinfo/squid-users _______________________________________________ squid-users mailing list squid-users@xxxxxxxxxxxxxxxxxxxxx http://lists.squid-cache.org/listinfo/squid-users
