Hacker News new | past | comments | ask | show | jobs | submit login

In which case, why not just provide a paid API? The content provider will then make extra revenue that would otherwise go to the endless arms race.

As others have mentioned, there is nothing (that I know of) that can thwart a motivated and resourceful scraper.




Some services have actually gone down that exact road. pastebin.com is one of them.

But in other cases you simply don't want anyone to be able to extract your info automatically. A good example would be e-commerce sites which don't want anyone to be able to scrape their pricing information in large scale and real time.




Consider applying for YC's Spring batch! Applications are open till Feb 11.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: