Re: Heavy contgnous load

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



On 10/18/2011 08:09 PM, kzsolt wrote:

What is important think for this task I do not need any tranasction. So the
COMMIT and ROLLBACK feature is useless.
The question is how I minimize the rollback activity to free resoureces?

Actually, you do need transactions, because they're what prevents your database from being corrupted or left in a half-updated state if/when the database server loses power, crashes, etc.

Presumably when you say "rollback activity" you mean the overheads involved in supporting transactional, atomic updates? If so, there isn't much you can do in an INSERT-only database except try to have as few indexes as possible and do your inserts inside transactions in batches, rather than one-by-one as individual statements.

Consider logging to a flat file to accumulate data, then COPYing data in batches into PostgreSQL.

An alternative would be to write your data to an unlogged table (PostgreSQL 9.1+ only) then `INSERT INTO ... SELECT ...' it into the main table(s) in batches. Unlogged tables avoid most of the overheads of the write-ahead log crash safety, but they do that by NOT BEING CRASH SAFE. If your server, or the PostgreSQL process, crashes then unlogged tables will be ERASED. If you can afford to lose a little data in this case, you can use unlogged tables as a staging area.

--
Craig Ringer

--
Sent via pgsql-performance mailing list (pgsql-performance@xxxxxxxxxxxxxx)
To make changes to your subscription:
http://www.postgresql.org/mailpref/pgsql-performance


[Postgresql General]     [Postgresql PHP]     [PHP Users]     [PHP Home]     [PHP on Windows]     [Kernel Newbies]     [PHP Classes]     [PHP Books]     [PHP Databases]     [Yosemite]

  Powered by Linux