Search Postgresql Archives

Re: importing downloaded data

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



On 04/22/2014 07:39 AM, Sim Zacks wrote:
Postgresql 9.3
I am downloading data that I want to import into a table. The data comes
in tab delimited, CRLF format.
I am using plpython to get the data and I wanted to use copy with stdin
to import it without having to save it to a file.
To do this, I am setting sys.stdin to a StringIO object with my data inside.


Not sure that is going to work as:

STDIN

    Specifies that input comes from the client application.

I would say a plpython function is actually running as the server and is not a client.


However, when I call copy I am getting SPI_ERROR_COPY, which the docs
define as "if COPY TO stdout or COPY FROM stdin was attempted" which is
exactly what I am trying to do (so the error is logical).

Is there another method of loading delimited data in bulk without saving
it as a file?

I do it by pushing the data in using a Python script that uses the the COPY FROM/TO methods of psycopg2:

http://initd.org/psycopg/docs/usage.html#using-copy-to-and-copy-from


Thanks
Sim


--
Adrian Klaver
adrian.klaver@xxxxxxxxxxx


--
Sent via pgsql-general mailing list (pgsql-general@xxxxxxxxxxxxxx)
To make changes to your subscription:
http://www.postgresql.org/mailpref/pgsql-general




[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]
[Index of Archives]     [Postgresql Jobs]     [Postgresql Admin]     [Postgresql Performance]     [Linux Clusters]     [PHP Home]     [PHP on Windows]     [Kernel Newbies]     [PHP Classes]     [PHP Books]     [PHP Databases]     [Postgresql & PHP]     [Yosemite]
  Powered by Linux