Simple web spider, mass downloader

Design and implement a web spider, mass downloader program that is used to download files from the Internet, the program runs until it is stopped or it runs out links to follow (unlikely). The program must have the following features: * User can set one or more starting URLs, when started the web spider downloads the URLs and finds all [links and continues to crawl also these pages. * When analyzing the pages, the program downloads to user's computer to a pre-defined directory all .exe, .com, .scr, .zip and .rar files it finds on these websites. * The program must be multi-threaded, so it can download and analyze multiple pages/files at the same time. It must be possible to define the max number of threads used. It must be possible to change this setting when the program is running. * The program must support a black list of URLs. For example, should we add "[login to view URL]" to the blacklist, then the program would not access any file or page whose url contains "[login to view URL]". It must be possible to change modify the blacklist while the program is running. * The program must support simple status reporting, it should report to user how many files it has downloaded so far, how many web pages it has crawled so far etc. * The program must support duplicate checking in a way it doesn't analyze same web pages over and over again, and that it doesn't download same files many times. * If the program is downloading a file calld "[login to view URL]" and "[login to view URL]" already exists in the defined download directory, the application must create a new unique filename to the new file, such as "[login to view URL]". You can implement the program in any common language, such as C, C++, Java, Visual Basic, C#, Delphi. When placing your bid, please tell me what language you are thinking of using and how many days you need to complete the project. The program can be a command line utility or have a GUI, it's up to you.]() ## [Deliverables]() [1) Complete and fully-functional working program(s) in executable form as well as complete source code of all work done. 2) Deliverables must be in ready-to-run condition, as follows? (depending on the nature? of the deliverables): a)? For web sites or? other server-side deliverables intended to only ever exist in one place in the Buyer's environment--Deliverables must be installed by the Seller in ready-to-run condition in the Buyer's environment. b) For all others including desktop software or software the buyer intends to distribute: A software? installation package that will install the software in ready-to-run condition on the platform(s) specified in this bid request. 3) All deliverables will be considered "work made for hire" under U.S. Copyright law. Buyer will receive exclusive and complete copyrights to all work purchased. (No GPL, GNU, 3rd party components, etc. unless all copyright ramifications are explained AND AGREED TO by the buyer on the site per the coder's Seller Legal Agreement). ]() ## [Platform]() [Windows Vista Ultimate 64 bits, world wide web.]()