Thanks for your reply again Amos,I am familiar with wget and curl for fetching headers and files. I think I can come up with a solution using either wget or curl to create a static cache. I will write a simple server application to serve the snapshot of the headers and content. The simple server could fetch files not in the cache as requested. I could redirect traffic to the simple server using iptables.
Cheers, Dan
