Re: Hardware/OS recommendations for large databases (

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



Title: Re: Hardware/OS recommendations for large databases (
Oops,

Last point should be worded: “All CPUs on all machines used by a parallel database”

- Luke


On 11/16/05 9:47 AM, "Luke Lonergan" <llonergan@xxxxxxxxxxxxx> wrote:

Scott,

On 11/16/05 9:09 AM, "Scott Marlowe" <smarlowe@xxxxxxxxxxxxxxxxx> wrote:

The biggest gain is going from 1 to 2 CPUs (real cpus, like the DC
Opterons or genuine dual CPU mobo, not "hyperthreaded").  Part of the
issue isn't just raw CPU processing power.  The second CPU allows the
machine to be more responsive because it doesn't have to context switch
as much.

While I've seen plenty of single CPU servers start to bog under load
running one big query, the dual CPU machines always seem more than just
twice as snappy under similar loads.

I agree, 2 CPUs are better than one in most cases.

The discussion was kicked off by the suggestion to get 8 dual core CPUs to process a large database with postgres.  Say your decision support query takes 15 minutes to run with one CPU.  Add another and it still takes 15 minutes.  Add 15 and the same ...

OLTP is so different from Business intelligence and Decision Support that very little of this thread’s discussion is relevant IMO.

The job is to design a system that can process sequential scan as fast as possible and uses all resources (CPUs, mem, disk channels) on each query.  Sequential scan is 100x more important than random seeks.

Here are the facts so far:

These are the conclusions that follow about decision support / BI system architecture for normal Postgres:

In other words, big SMP doesn’t address the problem at all.  By contrast, having all CPUs on multiple machines, or even on a big SMP with lots of I/O channels, solves all of the above issues.

Regards,

- Luke

[Postgresql General]     [Postgresql PHP]     [PHP Users]     [PHP Home]     [PHP on Windows]     [Kernel Newbies]     [PHP Classes]     [PHP Books]     [PHP Databases]     [Yosemite]

  Powered by Linux