Search Postgresql Archives

Re: Performance large tables.

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



To be more specific, there are two types of commands that are run on the system. There are application commands that do all different types of joins and etc but for the most part are fast enough to meet user expectations. On the other hand there is a weekly update (This is the problem) that updates all of the modified records for a bunch of finacial data such as closes and etc. For the most part they are records of the type name,date,value. The update currently takes almost two days. The update does deletions, insertion, and updates depending on what has happened from the previous week.

For the most part the updates are simple one liners. I currently commit in large batch to increase performance but it still takes a while as stated above. From evaluating the computers performance during an update, the system is thrashing both memory and disk. I am currently using Postgresql 8.0.3.

Example command "UPDATE data where name=x and date=y;".

Martijn van Oosterhout wrote:

On Sat, Dec 10, 2005 at 03:22:47PM -0800, Benjamin Arai wrote:
My issue actually stems from the fact that I cannot do large weekly updates on fast enough to meet a weekend window for the following work week. I am currently using a machine with a raid 1, 4GB RAM, and dual opteron. I could go 0+1 but peroformance increase is only about 20% from the benchmarks I have read. ANY suggestions would be greatly appreciated.

Since you have given us no information to work with you're not going to
get any specific recommendations either. If you can tell is the things
you do most commonly and are most performance sensetive (exact
commands, timings, versions and settings please) we may be able to
help.


[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]
[Index of Archives]     [Postgresql Jobs]     [Postgresql Admin]     [Postgresql Performance]     [Linux Clusters]     [PHP Home]     [PHP on Windows]     [Kernel Newbies]     [PHP Classes]     [PHP Books]     [PHP Databases]     [Postgresql & PHP]     [Yosemite]
  Powered by Linux