What social contract? Technically, archive.org is in violation of copyright. It does not matter if robots.txt allows it or not. Pointing people to "content" like a search engine is fine. Displaying "content" on another website is not.
Even worse is nyud.net, which essentially steals credit.
Even worse is nyud.net, which essentially steals credit.