Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

But I could change my clients User Agent to match the Google Crawler?


Nope. Because your IP address is not one of Google's. This trick worked years ago but not today.


use a GCP instance


I'm pretty sure that CGP instances don't allocate IP addresses from the same range as google crawlers.

See also: https://developers.google.com/search/docs/advanced/crawling/...


Sure, and then you've got a cat-and-mouse game with all the other ways that sites can fingerprint you.




Consider applying for YC's Winter 2026 batch! Applications are open till Nov 10

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: