Re: postgres crashes on insert in 40 different threads

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



Yes- I need so many threads, every night I need load jobs from xml to DB.
I need do it as fast as I can, currently it take 4h to load all of
them(around 1000000 jobs).
CPU/IO wait/percent is about 25%. Do you know how can I check other params
related to IO wait ?

Thanks,
  Dzmitry





On 8/19/13 5:59 PM, "Frank Lanitz" <frank@xxxxxxxxxxxxxx> wrote:

>Am 19.08.2013 10:07, schrieb Dzmitry:
>> I am doing a lot of writes to DB in 40 different threads ­ so every
>> thread check if record exists ­ if not => insert record, if exists =>
>> update record. 
>> During this update, my disk IO almost always ­ 100% and sometimes it
>> crash my DB with following message:
>
>Is this really needed to have so many threads and chances for race
>conditions?
>
>Beside the mention RAM thing you box might have to low IO capacities for
>this kind of trnasactions. What is the load and in detail the iowait
>saying?
>
>Cheers,
>Frank
>
>
>-- 
>Sent via pgsql-admin mailing list (pgsql-admin@xxxxxxxxxxxxxx)
>To make changes to your subscription:
>http://www.postgresql.org/mailpref/pgsql-admin




-- 
Sent via pgsql-admin mailing list (pgsql-admin@xxxxxxxxxxxxxx)
To make changes to your subscription:
http://www.postgresql.org/mailpref/pgsql-admin





[Index of Archives]     [KVM ARM]     [KVM ia64]     [KVM ppc]     [Virtualization Tools]     [Spice Development]     [Libvirt]     [Libvirt Users]     [Linux USB Devel]     [Linux Audio Users]     [Yosemite Questions]     [Linux Kernel]     [Linux SCSI]     [XFree86]

  Powered by Linux