On Wed, Aug 26, 2020 at 9:00 PM Scott Ribe <scott_ribe@xxxxxxxxxxxxxxxx> wrote:
I have no Hadoop, no HDFS. Just looking for the easiest way to export some PG tables into Parquet format for testing--need to determine what kind of space reduction we can get before deciding whether to look into it more.
Any suggestions on particular tools? (PG 12, Linux)
For simple exporting, the simplest thing is a single-node instance of Spark.
You can read parquet files in Postgres using https://github.com/adjust/parquet_fdw if you so desire but it does not support writing as parquet files are basically immutable.
--
Scott Ribe
scott_ribe@xxxxxxxxxxxxxxxx
https://www.linkedin.com/in/scottribe/
Best Wishes,
Chris Travers
Efficito: Hosted Accounting and ERP. Robust and Flexible. No vendor lock-in.
