Hacker News
new
|
past
|
comments
|
ask
|
show
|
jobs
|
submit
login
teej
on April 19, 2022
|
parent
|
context
|
favorite
| on:
How we upgraded our 4TB Postgres database
For ETL out of Postgres, it is very hard to beat psql. Something as simple as this will happily saturate all your available network, CPU, and disk write. Wrapping it in Python helps you batch it out cleanly.
psql -c "..." | pigz -c > file.tsv.gz
Guidelines
|
FAQ
|
Lists
|
API
|
Security
|
Legal
|
Apply to YC
|
Contact
Search: