Search squid archive

Re: Regex optimization

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 





On 6/16/2016 3:28 PM, Yuri Voinov wrote:
-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA256
 
I propose to nominate for the second place of the contest "The most
inefficient use of computing resources - 2016." :-!:-D

Because first place already occuped. :-D 30 millions pornsites in one
squid's ACL and 7 minutes for squid -k refresh. 8-)
Yeah and Ill bet about 27 Million of them are dead, expired, parked or redirected because your list sucks.

If you really intend to use blacklists tailored for Squid proxy Native ACL, we are the leading and only provider of such lists.
And we actually query each domain daily with batch updates, dead domains are placed into a holding pool to be queried again cyclically and re added
as necessary.

Shallalist is a joke, urlblacklist is garbage, if you are serious and need a better blacklist, we would be happy to serve you.



17.06.2016 1:20, Antony Stone пишет:
On Thursday 16 June 2016 at 21:11:50, Alfredo Rezinovsky wrote:

Well.. I tried.
I need to ban 8613 URLs. Because a law.
Have you considered https://www.urlfilterdb.com/products/ufdbguard.html ?

If I put one per line in a file and set the filename for an url_regex acl
it works. But when the traffic goes up the cpu load goes 100% (even using
workers) and the proxy turns unusable.
Er, I'm not surprised.

I tested and saw my squid can't parse regexes with more than 8192
characters.
I managed to combine the 8000 uris in 34 regexes using a ruby gem,
and the
cpu load stays almost at the same level it is without any acl (same
traffic).
That must be *way* past anything to be described as "maintainable".

the regex is:
Er, thanks, that confirms my suspicions above :)


Antony.

-----BEGIN PGP SIGNATURE-----
Version: GnuPG v2
 
iQEcBAEBCAAGBQJXYwv7AAoJENNXIZxhPexGn9QH/R2ino1lTfOWrd4E8Z+UUsuH
wjEfi4e96ptkkye57mcOTHXiLgrau+x+vXVS35CNgpwsB3daN1/E6DvAZz/XwABJ
O6/aqIn/JNKmkwLj/XPB0nD0lsrWXoOdknGpL7r/E9un2N2mfAdBVKUbItAuUM+G
DQeKfnRjCDS0Pgt4zlNIQjo0xxSxrjrHThKoWlAi00v2LzWkSmJtbZyW1WtzNbNf
qH8j1LlTbiOg9FmOpp+GVQ8XKEjGnWnhjnydKdVlPr9mXCA6XN5Kn5L6tmckqSc/
Snn9jKZfJAtTg97gTzOJpw9BuGw7pqSRyARcV0/t4PsySNTD/4NpJz/HVKhlT+E=
=Mgx4
-----END PGP SIGNATURE-----



_______________________________________________
squid-users mailing list
squid-users@xxxxxxxxxxxxxxxxxxxxx
http://lists.squid-cache.org/listinfo/squid-users

-- 
Signed,

Benjamin E. Nichols
http://www.squidblacklist.org

1-405-397-1360
_______________________________________________
squid-users mailing list
squid-users@xxxxxxxxxxxxxxxxxxxxx
http://lists.squid-cache.org/listinfo/squid-users

[Index of Archives]     [Linux Audio Users]     [Samba]     [Big List of Linux Books]     [Linux USB]     [Yosemite News]

  Powered by Linux