Installing , Setting up and Running BuBING Web Crawler on Digital Ocean Droplet

Stängt Publicerat 5 år sedan Betalades vid leverans
Stängt Betalades vid leverans

As a company we have some droplets hosted on Digital Ocean and we have already a very long list of websites and domains (and subdomains) that need to be crawled: from every url, the crawler need to fetch webpage title and metatags (if any).

In order to do so, there is a crawler that is already there, [login to view URL] but it is quite hard for our team to deploy it, install it and run it.

This job requires the installation of BuBing crawler into the droplet, the correct setup in order to not get blocked by webpages and run it. After that, for each page the title and metatags need to be saved into a file that will be then parsed by one of our scripts and given to the databases.

Long story short: install, setup and run BuBing given a list of urls.

Shell-skript Web Crawling Webbskrapning

Projekt-id: #18537468

About the project

6 offerter Distansprojekt Aktivt 5 år sedan

6 frilansare har lagt bud på i genomsnitt €201 för det här jobbet

kkc264043kkc

can do your job. These are my skills related to web scraping and crawling Have done scraping in CasperJS Phantomjs, python. Have done testing and automation with selenium also. Know to deal with database like mon Mer

€277 EUR inom 2 dagar
(44 omdömen)
6.0
brianconey

I am very interested in your project, because I have much experience in web Scraping I have good skills with the program language including python, C# , JAVA ,PHP . So I am a expert with web scraping (1000 over pro Mer

€333 EUR inom 3 dagar
(18 omdömen)
5.6
lightingdavid

Hello? How are you? I have good experiences in "Installing , Setting up and Running BuBING Web Crawler on Digital Ocean Droplet" as you can see my profile for these (Shell Script, Web Crawling, Web Scraping). I have Mer

€155 EUR inom 3 dagar
(15 omdömen)
4.7
debianguy

Hi. BuBing crawler is a little hard to install because it need do a lot of adjust on system variables and install extra dependencies. I can help you installing it and running it. Better is you're using ubunt Mer

€133 EUR inom 2 dagar
(6 omdömen)
3.1
emicsoft211

Hello, I can install, configure and setup the BuBING Web Crawler in the digital ocean server. Please let me know if you are interested so we can discuss the project further. Waiting for your reply. Thank you

€154 EUR inom 3 dagar
(2 omdömen)
2.9
ekoomitsolution

Hi, We would like to Design and Build your online store / personal website / simple website / Management CRM application, We would like to provide you Website Design and then you select it and then if changes need we c Mer

€155 EUR inom 3 dagar
(0 omdömen)
0.0