Hey Listee's
I am trying to write a shell script to sort and compare my blacklist
for squidGuard with the nightly updates that come down in a tar ball.
It should be rather simple but I'm not to grate at this. The script is
to run nightly, it will download the latest blacklist tarball, un tar
it and then add any new entries to the existing black list. The
blacklists work by having a folder for each filtered category so the
folder "db" contains the subfolders "adult", "gambling", "drugs" etc
and each sub folder has two files, "domains" and "urls" (pretty self
explanitory). This is how far I have gotten (I haven't tested this
script yet as I haven't had a chance I have only gotten as far as
writting it, this is what I have so far:
#!/bin/bash
#This will be running from home directory
wget http://www.blacklistsite.com/blacklist.tar
tar -cxf blacklist.tar
cd BL
find ./ -type d -maxdepth 1 | while read FOLDER; do
SQUIDDB="usr/local/squidGuard/db/$FOLDER"
sort_db($SQUIDDB)
comm -3 $SQUIDDB/domains $FOLDER/domains > $SQUIDDB/domains.missing
comm -3 $SQUIDDB/urls $FOLDER/urls > $SQUIDDB/urls.missing
cat $SQUIDDB/domains.missing >> $SQUIDDB/domains
cat $SQUIDDB/urls.missing >> $SQUIDDB/urls
rm $SQUIDDB/domains.missing
rm $SQUIDDB/urls.missing
sort_db($SQUIDDB)
done
sort_db(){
sort -f $1/domains > $1/domains.sorted
sort -f $1/urls > $1/urls.sorted
rm $1/domains
rm $1/urls
mv $1/doamins.sorted $1/domains
mv $1/urls.sorted $1/urls
}
Is it obvious I'm new to this? Hehe, I would also love to hear how
people would do this in a more efficient manner because obvisouly this
is pretty sloppy and as I said I haven't tested it yet so it might not
even run?!
Thanks, James ;)
-----BEGIN GEEK CODE BLOCK-----
Version: 3.1
GIT/MU/U dpu s: a--> C++>$ U+> L++> B-> P+> E?> W+++>$ N K W++ O M++>$ V-
PS+++ PE++ Y+ PGP t 5 X+ R- tv+ b+> DI D+++ G+ e(+++++) h--(++) r++ z++
------END GEEK CODE BLOCK------
_______________________________________________
CentOS mailing list
CentOS@xxxxxxxxxx
http://lists.centos.org/mailman/listinfo/centos
