Find Jobs
Hire Freelancers

Data scraping 7x24 for public ecommerce site (2 sites) and Database

$30-250 USD

Slutfört
Publicerad nästan tre år sedan

$30-250 USD

Betalning vid leverans
I need a customized program to scrap data from an online ecommerce platform and handle in a proper database. Objective : To estimate and find out the "Sold quantity" and "sales trend" of top selling product of selected categories of ecommerce platform, via a fully automated program scraping data 7x24 under all conditions, and good database management. Efficiency, data accuracy, proper database management, and reliability are key factors for the project. Support and service are crucial factors to be considered. I want to scrap data from designated ecommerce sites , esp. inventory and estimate sales quantity. The program shall read user input excel file (in Google drive) every day to check what categories are required for scrapping data. I need at least 80 categories within 20 hours, first 2 pages of products (SKU) for each category, i.e. 100 SKU for each category, total 8,000 SKU for 1 site. The same for the other sites. 2 programs shall run independently, 1 for each site, to scrap the data. The program shall be able to run 7x24 in a VPS environment. Developer shall suggest a reliable and reasonable cost VPS provider. Output excel file for each scraping data shall be uploaded to Google Drive and sent by auto-mail. Only the latest file shall be stored in Google Drive - that is old file shall be cleared from Google Drive. There is NO API available from ecommerce site. The sites are blocking IP address, proxy etc. Developer shall be able to handle platform robot detection, captcha, proxy blocking, rate limitation etc. If proxy service is required, developer shall advise such service provider and monthly cost. Good database design and management are necessary. Developer shall provide 3 months warranty to ensure the program can run 7x24 in VPS server. Developer shall also quote monthly maintenance cost after 3 months warranty period for another 12 months. Document and all necessary information shall be provided to ensure buyer can have 3rd party to do maintenance work (both the script and VPS set up details) in another VPS server if required. Developer shall support to have additional VPS server to run additional categories data without additional charge. Developer shall check his own work before submission of the work. Buyer will pay for VPS and proxy service every month after deploy. Developer shall include the cost for 1 month proxy service required (in addition to free proxy service) during development and testing. 1st milestone payment 5% - is to cover 1 month proxy service 2nd milestone payment 75% - when the project testing is completed (7x24). If problems occurs, it shall be counted from beginning. Full documentation and code provided. 3rd milestone payment 20% - after 3 months warranty Additional milestone - 12 months warranty support Applicant shall submit a sample of data fetching result (50 SKU) in order to understand data requirement and corresponding ecommerce site. Applicant shall also recommend the selected VPS and Proxy service. Base on recommendation, applicant shall inform buyer the monthly charge of such service after deployment. Buyer confirmation of such charge is a pre-requisite to start any work. Only serious and professional shall contact me for detail and project requirement documentation. Please include 7 days verification in VPS environment in project time. Seller shall adhere to committed project completion date. Only serious seller shall apply. DO NOT auto bid the project. Only serious seller who provide sample files, suggested VPS, proxy service will be considered. Seller shall be able to offer response within 24 hours during warranty period.
Project ID: 30434604

Om projektet

6 anbud
Distansprojekt
Senaste aktivitet tre år sedan

Ute efter att tjäna lite pengar?

Fördelar med att lägga anbud hos Freelancer

Ange budget och tidsram
Få betalt för ditt arbete
Beskriv ditt förslag
Det är gratis att registrera sig och att lägga anbud på uppdrag
Tilldelad till:
Använd avatar
Hi there, we have discussed project details. Please accept this and I will add milestones. Budget is $700. Thanks.
$50 USD Om 3 dagar
5,0 (5 omdömen)
3,8
3,8
6 frilansar lägger i genomsnitt anbud på $258 USD för detta uppdrag
Använd avatar
Hi there, I Have Scraped Amazon, Aliexpress, Yellow Pages, Yelp, Etc. I Have Unlimited Internet.I Have 6 Systems. I can do it. I have done many related projects like this. If you are provide this work, it will help my career also. Give me a chance to do this. Waiting for your precious reply. Thank you. Please Check my mastery work at:- https://www.freelancer.in/u/Stephenrajs *Why you are choose me 1. 24/7 hours support 2. Quick response 3. Deliver on time 4. Smooth communication. I assure that I can satisfy you completely and want to have a long term relationship with you. Best Regards Stephenrajs
$250 USD Om 5 dagar
4,9 (132 omdömen)
6,0
6,0
Använd avatar
Hello there. i can scrap your targeted e-commerce website. i have deep knowledge in python scrapy. i can scrap product name,SKU,price,description and other detail correctly and can arrange in your desired place like excel,csv etc. looking forward to Your desired for furthermore discussion. thanks
$30 USD Om 3 dagar
5,0 (1 omdöme)
3,3
3,3
Använd avatar
Hello Dear I have read your project. I have the experience to do this type of project earlier. I have worked many platform before. So I have the confidence to do this. If you want we can work together. I have the experience to work in Data Scrap and Developing. I did this kind of work before. So please let me know if you want to work with me.
$150 USD Om 7 dagar
0,0 (0 omdömen)
0,0
0,0

Om kunden

Flagga för HONG KONG
Kowloon, Hong Kong
2,8
7
Medlem sedan juli 29, 2019

Kundverifikation

Tack! Vi har skickat en länk för aktivering av gratis kredit.
Något gick fel med ditt e-postmeddelande. Vänligen försök igen.
Registrerade Användare Totalt antal jobb publicerade
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
Laddar förhandsgranskning
Tillstånd beviljat för geolokalisering.
Din inloggningssession har löpt ut och du har blivit utloggad. Logga in igen.