On 2/15/21 12:22 PM, Karthik K wrote:
yes, I'm using \copy to load the batch table,
with the new design that we are doing, we expect updates to be less
going forward and more inserts, one of the target columns I'm updating
is indexed, so I will drop the index and try it out, also from your
suggestion above splitting the on conflict into insert and update is
performant but in order to split the record into batches( low, high) I
need to do a count of primary key on the batch tables to first split it
into batches
I don't think you need to do a count per se. If you know the
approximate range (or better, the min and max) in the incoming/batch
data you can approximate the range values.