Tom, that most likely wasn't us. We don't spider retailer websites. That means w... | Hacker News

Hacker News new | past | comments | ask | show | jobs | submit

login

sradu on Nov 13, 2014 | parent | context | favorite | on: Why scraping and ecommerce are a perfect fit

Tom, that most likely wasn't us.

We don't spider retailer websites. That means we don't follow links or go hardcore on building a database of products.

We hit your website:

* if someone has asked us information about a product url

* when we place an order

* weekly for regression tests

Ping us on contact@ and we're more than happy to jump on a call and describe exactly what we're doing. Most of the time we're completely un-noticeable except for the fact that you're getting more orders.

We know for sure nobody is spidering through us.

tommccabe on Nov 13, 2014 [–]

thanks for the confirmation. how do you get the product URL in the first place?

razvanr on Nov 13, 2014 | [–]

That's the app developer's responsibility.

Jake232 on Nov 13, 2014 | | [–]

Is there any caching that goes on here? I would presume not as the vendors prices could change prices / details at any point.

Consider applying for YC's Spring batch! Applications are open till Feb 11.
Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact