Re: Database size growing over time and leads to performance impact

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



On 03/27/2010 08:00 AM, Gnanakumar wrote:
Hi,

We're using PostgreSQL 8.2. Recently, in our production database, there
was a severe performance impact.. Even though, we're regularly doing both:

1. VACUUM FULL ANALYZE once in a week during low-usage time and

2. ANALYZE everyday at low-usage time

Also, we noticed that the physical database size has grown upto 30 GB.
But, if I dump the database in the form of SQL and import it locally in
my machine, it was only 3.2 GB. Then while searching in Google to
optimize database size, I found the following useful link:

http://www.linuxinsight.com/optimize_postgresql_database_size.html

It says that even vacuumdb or reindexdb doesn't really compact database
size, only dump/restore does because of MVCC architecture feature in
PostgreSQL and this has been proven here.

So, finally we decided to took our production database offline and
performed dump/restore. After this, the physical database size has also
reduced from 30 GB to 3.5 GB and the performance was also very good than
it was before.

Physical database size was found using the following command:

du -sh /usr/local/pgsql/data/base/<database-oid>

I also cross-checked this size using
"pg_size_pretty(pg_database_size(datname))".

Questions

1. Is there any version/update of PostgreSQL addressing this issue?

2. How in real time, this issues are handled by other PostgreSQL users
without taking to downtime?

3. Any ideas or links whether this is addressed in upcoming PostgreSQL
version 9.0 release?


The "issue" is not with PG's.  Any newer version of PG will act exactly the same.  I don't think you understand.  Vacuum is not meant to reduce size of the db, its meant to mark pages for reuse.  VACUUM FULL is almost never needed.  The fact it didnt reduce your db size is probably because of something else, like an open transaction.  If you have a transaction left open, then your db will never be able to shrink or re-use pages.  You'd better fix that issue first.  (run ps -ax|grep postgres  and look for "idle in transaction")

You need to vacuum way more often than once a week.  Just VACUUM ANALYZE, two, three times a day.  Or better yet, let autovacuum do its thing.  (if you do have autovacuum enabled, then the only problem is the open transaction thing).

Dont "VACUUM FULL", its not helping you, and is being removed in newer versions.

-Andy

--
Sent via pgsql-performance mailing list (pgsql-performance@xxxxxxxxxxxxxx)
To make changes to your subscription:
http://www.postgresql.org/mailpref/pgsql-performance

[Postgresql General]     [Postgresql PHP]     [PHP Users]     [PHP Home]     [PHP on Windows]     [Kernel Newbies]     [PHP Classes]     [PHP Books]     [PHP Databases]     [Yosemite]

  Powered by Linux