Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

IIRC, their crawler pushes (or pushed) a lot of page into the Internet Archive Wayback Machine. What kind of effect will this shutdown have on it?


No effect, I believe, since Alexa haven't been providing crawl data to the Internet Archive since January 2021.

You can see this by looking at the "Items" graph on the Alexa Crawls collection [0]

(I am not associated with the Internet Archive - just a very happy user!)

[0] https://archive.org/details/alexacrawls?tab=about


> No effect, I believe, since Alexa haven't been providing crawl data to the Internet Archive since January 2021.

Were they still providing value to the Wayback Machine at that point? Has their cessation had a significant impact on the Wayback Machine's crawling ability?




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: