[nospam@xxxxxxxxxxxx - Thu at 06:37:12PM -0600] > As my dataset has gotten larger I have had to throw more metal at the > problem, but I have also had to rethink my table and query design. Just > because your data set grows linearly does NOT mean that the performance of > your query is guaranteed to grow linearly! A sloppy query that runs OK > with 3000 rows in your table may choke horribly when you hit 50000. Then some limit is hit ... either the memory cache, or that the planner is doing an unlucky change of strategy when hitting 50000. Anyway, it's very important when testing queries that they actually are tested on a (copy of the) production database, and not on an empty database or a database containing some random test data. If testing queries off the production database, it's important to have equal hardware and configuration on both servers.
