Hacker News
new
|
past
|
comments
|
ask
|
show
|
jobs
|
submit
login
dalbasal
on Sept 12, 2018
|
parent
|
context
|
favorite
| on:
EU approves internet copyright law, including ‘lin...
If I'm not mistaken, it's still an option out basis. Google crawl, index and search everything by default and allow content owners some controls, either via site manager or via flags in your html.
dawnerd
on Sept 12, 2018
|
next
[–]
Yeah but I didn't think they'd show news there unless you actually agreed to the news terms.
https://support.google.com/news/publisher-center/answer/7526...
1024core
on Sept 12, 2018
|
prev
[–]
Haven't they heard of robots.txt ?
Consider applying for YC's Spring batch! Applications are open till Feb 11.
Guidelines
|
FAQ
|
Lists
|
API
|
Security
|
Legal
|
Apply to YC
|
Contact
Search: