Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

It's not new but I like "Miller":

> Miller is a command-line tool for querying, shaping, and reformatting data files in various formats including CSV, TSV, JSON, and JSON Lines.

https://miller.readthedocs.io/en/latest/



I got very excited about this tool. It's exactly what I need. I wrote a custom calendar app in it. But I got disappointed by performance. A list of 10 items takes 3 seconds to draw. I yet have to check if that is not caused by some other tool in the call stack. I wonder what is others people experience with performance of mlr?


I also use regularly miller/mlr with files having 1M+ lines and I never had problems with the hardcoded processing (i.e. "verbs") nor the DSL language which is know to be much less efficient compared to verbs.

Both visidata and miller are essential tools to process/view CSV/TSV files, way better than LibreOffice or Excel in terms of performance on large files.


If you can reproduce that reliably you should open a bug for it, eh? I'm sure John Kerl would want to know.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: