Search Postgresql Archives

High inserting by syslog

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



Hello all, I have a perl script thats load a entire day squid log to a 
postgres table. I run it at midnight by cronjob and turns off the indexes 
before do it (turning it on after). The script works fine, but I want to 
change this to a diferent approach.

I'd like to insert on the fly the log lines, so long it be generated to have 
the data on-line. But the table has some indexes and the load of lines is 
about 300.000/day, so the average inserting is 3,48/sec. I think this could 
overload the database server (i did not test yet), so if I want to create a 
no indexed table to receive the on-line inserting and do a job moving all 
lines to the main indexed table at midnight.

My question is, Does exists a better solution, or this tatic is a good way to 
do this?

-- 
Valter Douglas Lisbôa Jr.
Sócio-Diretor
Trenix - IT Solutions
"Nossas Idéias, suas Soluções!"
www.trenix.com.br
contato@xxxxxxxxxxxxx
Tel. +55 19 3402.2957
Cel. +55 19 9183.4244


[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]
[Index of Archives]     [Postgresql Jobs]     [Postgresql Admin]     [Postgresql Performance]     [Linux Clusters]     [PHP Home]     [PHP on Windows]     [Kernel Newbies]     [PHP Classes]     [PHP Books]     [PHP Databases]     [Postgresql & PHP]     [Yosemite]
  Powered by Linux