Search Postgresql Archives

Re: INSERTing lots of data

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



On 28/05/10 17:41, Joachim Worringen wrote:
Greetings,

my Python application (http://perfbase.tigris.org) repeatedly needs to
insert lots of data into an exsting, non-empty, potentially large table.
Currently, the bottleneck is with the Python application, so I intend to
multi-thread it.

That may not be a great idea. For why, search for "Global Interpreter Lock" (GIL).

It might help if Python's mostly blocked on network I/O, as the GIL is released when Python blocks on the network, but still, your results may not be great.

will I get a speedup? Or will table-locking serialize things on the
server side?

Concurrent inserts work *great* with PostgreSQL, it's Python I'd be worried about.


--
Craig Ringer

--
Sent via pgsql-general mailing list (pgsql-general@xxxxxxxxxxxxxx)
To make changes to your subscription:
http://www.postgresql.org/mailpref/pgsql-general


[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]
[Index of Archives]     [Postgresql Jobs]     [Postgresql Admin]     [Postgresql Performance]     [Linux Clusters]     [PHP Home]     [PHP on Windows]     [Kernel Newbies]     [PHP Classes]     [PHP Books]     [PHP Databases]     [Postgresql & PHP]     [Yosemite]
  Powered by Linux