I think there's a market for search engine competitors, maybe not in the "general public" category, but certainly so for some verticals - I was recently asked to build something that requires either a crawler or access to a search engine API, and I don't know if Google is what I want (probably will start with Bing if we end up doing the project).
> I was recently asked to build something that requires either a crawler or access to a search engine API
By the way, is it possible to get deep query results from Google or another search engine? Say I need to see top 1000 results for 100K keywords and use that as a seed for my own crawler. Is anyone offering that?
I think there's a market for search engine competitors, maybe not in the "general public" category, but certainly so for some verticals - I was recently asked to build something that requires either a crawler or access to a search engine API, and I don't know if Google is what I want (probably will start with Bing if we end up doing the project).