Andrew Chernow <pg-job@xxxxxxxxx> writes:
>>I mean, how do you handle integrity with data
>> outside the database?
> You don't, the file system handles integrity of the stored data. Although,
> one must careful to avoid db and fs orphans. Meaning, a record with no
> corresponding file or a file with no corresponging record. Always
> write()/insert an image file to the system within a transaction, including
> writing the image out to the fs. Make sure to unlink any paritally written
> image files.
And how do you guarantee that after a failure? You're restoring two
different sets of data here:
- backup from your database
- backup from your files
How do you link them together on that specific operation? Or even on a daily
basis, if you get corrupted data...
>>>How do you plan your backup routine
> In regards to backup, backup the files one-by-one. Grab the lastest image
> file refs from the database and start backing up those images. Each
> successfully backed up image should be followed by inserting that file's
> database record into a remote db server. If anything fails, cleanup the
> partial image file (to avoid orphaned data) and rollout the transaction.
>
> just one idea. i'm sure there are other ways of doing it. point is, this is
> completely possible to do reliably.
Wouldn't replication with, e.g., Slony be easier? And wouldn't letting the
database handle all the integrity be easier? I mean, create an "images" table
and then make your record depends on this table, so if there's no record with
the image, you won't have any references to it left.
It would also make the backup plan easier: backup the database.
Not counting that depending on your choice of filesystem and image size you
might get a very poor performance.
--
Jorge Godoy <jgodoy@xxxxxxxxx>
