Hacker News
new
|
past
|
comments
|
ask
|
show
|
jobs
|
submit
login
cm2187
on April 4, 2023
|
parent
|
context
|
favorite
| on:
Parquet: An efficient, binary file format for tabl...
To be honest any file format that would do 1) strong typing/binary data, 2) string deduplication would capture most of the advantages of parquet, except being a column store format which helps in some cases and hurts in others.
julik
on April 4, 2023
|
next
[–]
And even using a columnar format but without all the complexity of Parquet would be comparatively easy (when writing using buffers)
nomadluap
on April 4, 2023
|
prev
[–]
At that point just start using an SQLite database as a data format.
jonstewart
on April 5, 2023
|
parent
|
next
[–]
SQLite is a row-oriented store, not a column-oriented store, ie, there are fundamental tradeoffs between the two.
cm2187
on April 5, 2023
|
parent
|
prev
[–]
But sqlite has no compression by default.
Guidelines
|
FAQ
|
Lists
|
API
|
Security
|
Legal
|
Apply to YC
|
Contact
Search:
