Thanks, I had looked into pg_bulkload a bit but it does not seem to be available for PG 12? It's not in the extension directory, it's not available through apt-cache search, and I have all kinds of issues with it finding pgcommon and pgport when I try to build from source. Using Ubuntu 18 LTS...
On Wed, Jan 8, 2020 at 9:09 AM Ron <ronljohnsonjr@xxxxxxxxx> wrote:
On 1/8/20 10:54 AM, Wells Oliver wrote:
> I have a CSV that's ~30GB. Some 400m rows. Would there be a meaningful
> performance difference to run COPY from STDIN using: cat f.csv | psql
> "COPY .. FROM STDIN WITH CSV" versus just doing "COPY ... FROM 'f.csv'
> WITH CSV"?
>
> Thanks. It took about four hours to copy one and I felt that was a little
> much.
catting the file starts another process, and opens a pipe. That can't be
faster than "COPY ... FROM ... WITH CSV".
pg_bulkload (which might be in your repository) is probably what you really
want.
--
Angular momentum makes the world go 'round.
--
Wells Oliver
wells.oliver@xxxxxxxxx
wells.oliver@xxxxxxxxx
