mod_log_spread is great, but what I have also done in the past is to use cronolog as a pipe to place logs into .../hostname/YYYY/MM/DD/hh-access_log. Then run a cron job from your stats server to move the files onto the stats server that are >1h old (ie rotated), merge them with the other machines' logs, then run stats. That works well, and tends to not have issues if spread fails. rsync pull over ssh tunnel from a read-only user (with no other rights) works for the copies. -B On 5/16/06, David Salisbury <salisbury@xxxxxxxxx> wrote:
try looking into http://www.backhand.org/mod_log_spread/ -Dave ----- Original Message ----- From: "Dan Trainor" <dan@xxxxxxxxx> To: <users@xxxxxxxxxxxxxxxx> Sent: Tuesday, May 16, 2006 2:47 PM Subject: [users@httpd] Keeping multiple logs in central location > Hello, all - > > I've browsed the archives a bit, but have not been able to come up with > a good solution, so I'll go ahead and ask. > > We've got quite a few webservers, on which we're comfortable using > AWStats. The server pool is part of a load balance cluster, and it's > very difficult to generate statistics on the data as a whole - rather, > we're generating statistics based on several different servers. > > What I guess I'm looking for here is a way to keep all my Apache logs in > a central location, where I can run stats for the total of the pool. > > A while ago, I used mod_log_mysql to store all logs in a SQL database. > While this worked, it was difficult to extract the data from the > database and parse that for something like AWStats. Besides, this was > very slow. > > I think that if I was able to manage logs and keep them in one location, > I could take it from there and find something to run statistics against > the logs which might be more "friendly". > > If anyone has any experience in this, I would greatly appreciate it. > > Thanks > -dant > > --------------------------------------------------------------------- > The official User-To-User support forum of the Apache HTTP Server Project. > See <URL:http://httpd.apache.org/userslist.html> for more info. > To unsubscribe, e-mail: users-unsubscribe@xxxxxxxxxxxxxxxx > " from the digest: users-digest-unsubscribe@xxxxxxxxxxxxxxxx > For additional commands, e-mail: users-help@xxxxxxxxxxxxxxxx > > --------------------------------------------------------------------- The official User-To-User support forum of the Apache HTTP Server Project. See <URL:http://httpd.apache.org/userslist.html> for more info. To unsubscribe, e-mail: users-unsubscribe@xxxxxxxxxxxxxxxx " from the digest: users-digest-unsubscribe@xxxxxxxxxxxxxxxx For additional commands, e-mail: users-help@xxxxxxxxxxxxxxxx
--------------------------------------------------------------------- The official User-To-User support forum of the Apache HTTP Server Project. See <URL:http://httpd.apache.org/userslist.html> for more info. To unsubscribe, e-mail: users-unsubscribe@xxxxxxxxxxxxxxxx " from the digest: users-digest-unsubscribe@xxxxxxxxxxxxxxxx For additional commands, e-mail: users-help@xxxxxxxxxxxxxxxx
|