Thanks for the response. I'm not sure, how long does this tool takes for the 70GB data.
I used node to stream the xml files into inserts.. which was very slow.. Actually the xml contains 40 million records, out of which 10Million took around 2 hrs using nodejs. Hence, I thought will use COPY command, as suggested on the internet.
Definitely, will try the code and let you know.. But looks like it uses the same INSERT, not copy.. interesting if it runs quick on my machine.
On Sun, Jun 24, 2018 at 9:23 PM, Adrien Nayrat <adrien.nayrat@xxxxxxxxxxxx> wrote:
Hello Anto,On 06/24/2018 05:25 PM, Anto Aravinth wrote:
> Hello Everyone,
>
> I have downloaded the Stackoverflow posts xml (contains all SO questions till
> date).. the file is around 70GB.. I wanna import the data in those xml to my
> table.. is there a way to do so in postgres?
>
>
> Thanks,
> Anto.
I used this tool :
https://github.com/Networks-Learning/stackexchange-dump- to-postgres
Regards,
--
Adrien NAYRAT
https://blog.anayrat.info
