Hacker News new | past | comments | ask | show | jobs | submit login

OP should have a look at ZFS. With large amounts of data I feel that ZFS snapshots might be far more time efficient to compare than diffing full directories.

Bonus: FreeBSD is currently considering adding Rust to their base system. They have ZFS natively in FreeBSD already. Perhaps OP will find joy in FreeBSD :D




Yes, zfs rules. If you are doing this regularly you should consider a fs like zfs or use other solution like Borg (which is based on git).

Though this has the convenience of being a more universal solution.


I haven’t looked into ZFS yet, but thanks to your comment, it’s now on my todo list.

One idea behind my implementation was to have something that’s more agnostic of specific file systems. But I guess that’s an aspect that may be worth to reconsider.


This appears to be filesystem agnostic and could be quite useful in scenarios where switching to ZFS is not an easy option.




Join us for AI Startup School this June 16-17 in San Francisco!

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: