www. scraoer and indexed based on code search strings
$100-500 USD
Inställt
Publicerad nästan 14 år sedan
$100-500 USD
Betalning vid leverans
I would like to build a search engine and scraper
The engine needs to do the following
- scrape search engine results( google / yahoo/ bing/ aol/ ) on demand and add them in to the main database
- indexed pages/url will have all their code indexed
- the search engine needs to be able to search the database of indexed pages based on code search strings
it needs:
proxy support
operator support ( and OR inurl: etc )
multi user agent support
reg ex support
fast searching capability
AJAX interface with smooth transitions
## Deliverables
You need to make sure this app is compatible and doesn't get blocked by the search engines mentioned earlier when scraping/indexing
It needs to have a smart search capability that recognizes near matches of the search string not only exact match