Hello everyone,
Were looking to either purchase, or have a programmer custom build a metasearch engine, and crawler application.
Crawler should be designed in perl, and have a freindly admin panel so that a novice beginer will be able to use the system.
Crawler features should include
#1The ability to seed the crawl from the [login to view URL] database
#2Should be able to parse the rdf files
#3should be able to inject them into a predifined database.
#4Should be able to set the depth of the crawl
#5functions for setting the host timeout,
#6 settings for user agent
Were basically looking for as many options as we can possibly get.
For the search engine front end we want it to also to be in perl if possible.
We are open to both premade solutions that are built for commercial strength or a custom built solution built by you.