> if you don't mind having an ordered file at output. I needed to remove duplica... | Hacker News

Hacker News new | past | comments | ask | show | jobs | submit

login

zimpenfish on May 29, 2019 | parent | context | favorite | on: Removing duplicate lines from files keeping the or...

> if you don't mind having an ordered file at output.

I needed to remove duplicates from a sequenced CSV file yesterday but couldn't figure out the flags for "remove duplicates, output sorted by field 1 asciily, 2 numerically, 3 numerically".

The AWK version worked perfectly.

_lwad on May 29, 2019 [–]

The awk version does not order it. If your output was ordered the way you wanted, it was because the input already was.

Consider applying for YC's Spring batch! Applications are open till Feb 11.
Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact