Re: Any tool/script available which can be used to measure scalability of an application's database.

[John Jones <idolchatter@xxxxxxxxx>]

Hammerora is a good start but does have some issues when trying to get it started. You can also try PGBench. As someone said, there is a plethora of choices. It all depends on what you want to measure or accomplish.

John Jones

On Sat, Jul 14, 2012 at 1:48 AM, Craig Ringer <ringerc@xxxxxxxxxxxxx> wrote:

On 07/14/2012 09:26 AM, B Sreejith wrote:

Dear Robert,

We need to scale up both size and load.
Could you please provide steps I need to follow.

For load, first you need to build a representative sample of your application's querying patterns by logging queries and analysing the logs. Produce a load generator based on that data, set up a test copy of your database, and start pushing the query rate up to see what happens.

For simpler loads you can write a transaction script for pgbench based on your queries.

For size: Copy your data set, then start duplicating it with munged copies. Repeat, then use the load generator you wrote for the first part to see how scaling the data up affects your queries. See if anything is unacceptably slow (the "auto_explain" module is useful here) and examine it.

The truth is that predicting how complex database driven apps will scale is insanely hard, because access patterns change as data sizes and user counts grow. You're likely to land up tuning for a scenario that's quite different to the one that you actually face when you start hitting scaling limitations. This doesn't mean you should not investigate, it just means your trials don't prove anything and the optimisations you make based on what you learn may not gain you much.

--
Craig Ringer