Hi, I will build a Java application to scrape data from websites. I will design MySQL database to save scraped data.
I will automate the entire process of scraping.
The application can be run on Windows or Linux/UNIX. I will use Proxy Servers to scrape data.
If needed I will also develop a Dashboard application to login, view scraper progress, trigger scraper manually, view and download scraper data etc.
I will take care of Software installation on remote Linux/UNIX server, Database Installation & Creation, Proxy Set up, Set up cron jobs and write script files to automate the process, Dashboard creation etc.
Contact me to discuss more about my proposal.
Looking forward to hear from you soon.
Thank You