Thanks for all the people who answered.
It turned out to be as simple as attaching a "gimp-comment" and "jpeg-exif-data" parasites to the image.
(of course generating jpeg-exif-data is not trivial. Only implemented for my Nikon D70 at the moment. I guess others who like more formats will have to implement their own)
-Joseph
