On Tuesday, April 26, 2011, Tomas Vondra <tv@xxxxxxxx> wrote: > Dne 25.4.2011 18:16, Phoenix Kiula napsal(a): >> Sorry, spoke too soon. >> >> I can COPY individual chunks to files. Did that by year, and at least >> the dumping worked. >> >> Now I need to pull the data in at the destination server. >> >> If I COPY each individual file back into the table, it works. Slowly, >> but seems to work. I tried to combine all the files into one go, then >> truncate the table, and pull it all in in one go (130 million rows or >> so) but this time it gave the same error. However, it pointed out a >> specific row where the problem was: >> >> COPY links, line 15272357: >> "16426447 9s2q7 9s2q7 N http://www.amazon.com/gp/search?camp=1789&creative=9325&ie=UTF8&i..."; >> server closed the connection unexpectedly >> This probably means the server terminated abnormally >> before or while processing the request. >> The connection to the server was lost. Attempting reset: Failed. >> >> Is this any use at all? Would appreciate any pointers! > > So the dump worked fina and it fails when loading it back into the DB? > Have you checked the output file (just see the tail). Can you post the > part that causes issues? Just the line 16426447 and few lines around. > > regards > Tomas > > -- > Sent via pgsql-general mailing list (pgsql-general@xxxxxxxxxxxxxx) > To make changes to your subscription: > http://www.postgresql.org/mailpref/pgsql-general > Ok let me explain. Pg_dumpall did not work. It kept on crashing. So I did copy, with conditional commands, copying one year at a time. This process took me a day and a half but I now have files with copy dumps for last 11 years. On the fresh server, instead of 'copy from' with 11 files I cocatenated the files into one. Then in a transaction, I imported this file into the new database, which has: Begin Truncate table Copy from into table Commit This worked. I confirmed by checking for new disk usage in the ~/data folder. it has gone up by 64gig. Yet that SQL gives me no rows. -- Shashank Tripathi +1 646 755 9860 +65 932 55 600 -- Sent via pgsql-general mailing list (pgsql-general@xxxxxxxxxxxxxx) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-general
