Search Postgresql Archives

Problem with large bytea fields in windows

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



I have been having a lot of trouble with postgres and large bytea fields
under windows and would appreciate any suggestions.

I have a large database (22 GB) that I have slowly grown on one machine.  It
is currently running postgres 8.2.3 under windows xp.  It is a simple db
with one table that has a serial column and a large bytea column.  It is a
repository for scanned documents.  A few of these documents are over 250
pages and take up at least 100 Mb per row.  A backup takes almost a whole
day and almost as long to copy onto usb drive.  I have not had any trouble
with these large inserts (using libpq calls) or in making a backup.

Recently I started using slony, first for a 400 MB database, and then I
attempted to use it on this large database.  The slave machine is running
windows vista and the same version of postgres.  The copy failed at about
12GB with a windows error 10055, ran out of buffer space.  I have now tried
over 30 times, all without success.  I tried using just two machines sitting
next to each other and an ethernet switch.  I tried adjusting the tcp
parameters in the registry following microsoft's advice in a few of the
knowledgebase articles.  I tried running the slony process on a third linux
machine.  Always the same problem.  I ran the process with no one logged
onto these machines so no other processess were running.  I shut off all
unecessary services.  Stil the copies failed after 12GB to 15GB.  Same
error.  I turned off autovacuum, I increase all of the memory configs in
postgres.conf.  I added memory to both machines so they both have 2GB.

I posted this problem to the slony.info list.  The main suggestion seems to
be that it is really a libpq error.  Darcy Buskermolen suggested that the
problem was with libpq since the initial subscribe process mimics a pg_dump
| psql.  He suggested a postgres mailing list post:
http://archives.postgresql.org/pgsql-ports/2005-11/msg00000.php, which
describes a winsock problem in libpq.  No resolution is given howerver.

Does anyone have any suggestions?  At the moment I am all out of ideas.

Thank you for any help

Al Rosenthal
arosnethal at AtlantaHand dot com



[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]
[Index of Archives]     [Postgresql Jobs]     [Postgresql Admin]     [Postgresql Performance]     [Linux Clusters]     [PHP Home]     [PHP on Windows]     [Kernel Newbies]     [PHP Classes]     [PHP Books]     [PHP Databases]     [Postgresql & PHP]     [Yosemite]
  Powered by Linux