Hi Eliezer, > Since squid has new outputs in the access log I was wondering what > analyzer are you using? > > I want to write a simple scripting (for practice) tool that will do > things in a similar way that calamaris do. > > What statistics would be needed from such a tool? I use SARG (that is, my customer uses), but it could be better. I've worked with Calamaris before, and it did one thing SARG does not: update reports without re-parsing past log entries. So I can run Calamaris every 5 minutes to have reports updated in near real-time, even for high traffic proxies. But my SARG takes almost half an hour to generate a daily report. Neither Calamaris nor SARG does one thing I want/need: upload bandwidth reports. Both of them (and all other ones I researched) do only download reports, but in today web, where too many apps upload data to servers, upload bandwith is not so low anymore. Currently I have to generate two sets of acces logs, the regular one for download reports, and another one where I replace downloaded bytes by uploaded bytes, to generate a second set of reports. Having one tool do both from the same logs, without wasting time processing what is essentially the same log twice, would be a big plus. PS: There's also the issue of squid not reporting upload bytes for CONNECT requests, that is, https requests. This would leave of the report all upload bandwidth consume by Google services and other APIs, which I suspect are the biggest consumers. :-( []s, Fernando Lozano
