Data mining (Data Scraping) from Amazon API

$250-750 USD

Inställt

Publicerad

över sex år sedan

$250-750 USD

Betalning vid leverans

Hi guys, We need to scrape Amazon and build a big list of author names from some specific book categories we want. **** DO NOT APPLY UNLESS you can scrap Amazon products using their API/XML product feeds they provide to developers! We ALREADY built Zenno bots to scrape front-end results pages using proxies, captcha-solving etc and it is NOT enough. We are NOT interested in front-end webpage scraping. ***** We need to scrape data of all the English language books published in certain categories filtered by: 1. books published in last 30 days. 2. "new releases" - books published from current date descending till 2015 3. "coming soon" books We do NOT want to scrape listings of books published from 3 years ago or older! You need to scrape through all the available listings. Front-end scraping is strictly limited by Amazon, so you MUST do it via their API [Amazon Products Feed API /associate XML]. We tried front-end scraping [and we know to build Zenno bots] but this will not provide ALL the data needed. We need only the following data from scraping: 1. Author name 2. Author Amazon page url (if available. If the book's author has an Author page on Amazon, his name will be linked to his page.) 3. Book publication date 4. Main category name (such as "Romance" not sub-categories like: "Romance>Historical>Paranormal>Contemporary") 5. Book format (Kindle or Paperback/Hardcover etc.) No need for any other info such as images, book title, pricing, reviews etc. Just real basic light data. DB must be made Clear of Duplicates (no matter the book names, we ONLY need UNIQUE Author Names). All the delivered excel files need to be sorted by publication date descending. Delivery needs to be in excel file format with the following deliverables: [a] 1 big Excel file with ALL the scraped data, sorted by publication date descending. [b] 3 Excel files per genre/category: One excel for "coming soon" One excel for books published in last 30 days One Excel for all the books published from 2015 to current date. Example: "Romance_Coming Soon", Romance_last 30 days", "Romance_2015-2017". We're not some big merchant/company, just starting our little service for authors and need a list of leads. We may need ongoing gigs for scraping newly published books each month. We need this big list ASAP. Is it possible within 1 week? How much will scraping Amazon cost? We may also want to scrape Barnes & Noble to find additional author names. How much will scraping Barnes & Noble cost?

Project ID: 14872534

Om projektet

18 anbud

Distansprojekt

Senaste aktivitet sju år sedan

Ute efter att tjäna lite pengar?

E-postadress

Fördelar med att lägga anbud hos Freelancer

Ange budget och tidsram

Få betalt för ditt arbete

Beskriv ditt förslag

Det är gratis att registrera sig och att lägga anbud på uppdrag

18 frilansar lägger i genomsnitt anbud på $581 USD för detta uppdrag

@ramzitra

Hi, I have checked your project related to amazon books scraping. Actually, I have about 2 millions books scrapped last month using Amazon API. All the data are in CSV file and ready to be delivered. Relevant Skills and Experience Web scraping, Python, Amazon API Proposed Milestones $500 USD - deliver all data

$500 USD Om 10 dagar

5,0

(98 omdömen)

6,9

@seaanddream

Hi, my name is Sevinc. I am expert with Amazon API and AWS... I read your "Data mining (Data Scraping) from Amazon API" project descriptions carefully before bidding. I checked your requirements as well... I got what you need and ready to go ahead as soon as we can clarify further project details. I am 5-star web scraping & API integration expert here at freelancer.com. Pls check my profile and feedbacks first to have some idea about the quality of my previous businesses. I had many similar web scraping tasks, including extraction of large product databases from various ecommerce websites, all achieved with 5/5 rating. Kindly get back to me if you wish to proceed with a top-rated and reliable partner here...pls note that I only deliver best quality at a reasonable price, and I am open for longterm partnerships, if you wish too... I bid my best for you to start business, and I am ready to prepare a sample task for you to check & validate, once you give me a reply...regards.

$500 USD Om 7 dagar

4,9

(57 omdömen)

6,1

@helmot

Hello. I have worked with all of Amazon APIs before. You can't get "coming soon"/"new release" lists from API. The solution is to scrape ISBNs from Amazon and then get book details from API. Relevant Skills and Experience I can't explain the details here because of character limit issues. If you contact me we can talk about the details. - Amazon PA API - Amazon MWS API - Amazon scraping and bypassing capcha/bot-detec.. Proposed Milestones $866 USD - final

$866 USD Om 10 dagar

5,0

(8 omdömen)

5,8

@Yknox

Dear. i am a developer in china . i have a great of experience amazon api. i can do your job as top as you want. Please let's start with me. I have good reviews over 750. Thanks.

$750 USD Om 10 dagar

5,0

(8 omdömen)

4,8

@cybersolutionvw

Hi, I am ready to do this for you as per according to your requirements. I have lots of experience in doing such kind of projects. You can check my profile for my work experience. Thanks Relevant Skills and Experience Big Data, Data Extraction, Data Mining, Data Science, Data Scraping Proposed Milestones $1333 USD - Project Milestone Lets discuss further on chat and get stated

$1 333 USD Om 7 dagar

5,0

(8 omdömen)

4,4

@narsim3128

With respect to this project I would like to present myself as a candidate for your consideration. I have more than 8 years of IT experience. I have successfully completed few projects for US clients Relevant Skills and Experience 1) Programming/Scripting 2) Application/Web development 3) Web Scraping/Web research Proposed Milestones $555 USD - This task will be completed within schedule

$555 USD Om 7 dagar

5,0

(4 omdömen)

3,4

@furqanorpiv

Hi, I am FURKAN, a CERTIFIED Big Data, Data Extraction, Data Mining, Data Science, Data Scraping, WEB SCRAPPING EXPERT . I would love to provide you Quality data by scraping Amazon and build a list of AUTHOR NAME'S from some specific book categories filtered by : books published in last 30 days ,new releases" - books published from current date descending till 2015 and "coming soon" books AND ALL THE DATA that you need as per your requirements. I can complete your project with perfection, in time, and will charge you a reasonable PRICE. I have 5+ experience in Big Data, Data Extraction, Data Mining, Data Science, Data Scraping, WEB SCRAPPING, Website Scraping, Screen Scraping, Internet Research. I can do scarping using any language like Python,PHP,JAVA etc. You can go through my Portfolio and can check my reviews and my ratings that i have ALREADY successfully completed such projects in the past with 100% customer Satisfaction, so it my pleasure to work on your project. I think i am the Right person who can take responsibility for you project and can complete it according to your REQUIREMENTS , As i got all the skills that you need for this project. You can Test the Quality of my work if needed, and provided that i can also show you my SAMPLE works. I do bidding on your project with the hope that you will hire me so that we can work together for a long time. Waiting for your positive response. Regards... Furkan wani

$250 USD Om 1 dag

4,3

(6 omdömen)

4,1

@tomkusvw

Hi! My name is Tomasz Kustra, and I am from Poland. I have plenty experience with amazon, check my profile: http://www.freelancer.com/u/tomkusvw.html Relevant Skills and Experience What you want to do is impossible with API because API does not have such capabilities Only web scraping, but it also can't be simply used in such case there would have to be plenty of "overhead". Proposed Milestones $750 USD - milestone At least first step have to be done using web-scraping, than "polishing" could be done through API.

$750 USD Om 10 dagar

5,0

(1 omdöme)

2,9

@tracygearth

I have read entire description and would do my best to create a generic script to produce Excel sheet using API. with regards,

$385 USD Om 10 dagar

5,0

(1 omdöme)

2,6

@josersosa

I can do it in R languaje with a oauth, xml an other scraping packages. After analyzing the problem, I will send you an estimate of the hours required to resolve it. Habilidades y experiencia relevante I'm a R programmer and Data scientist with degree in Computer Science, strong mathematical background and teaching experience in Statistic at the Central University of Venezuela (UCV) Htos propuestos $15 USD - Analysis of requirements $15 USD - Solution design $525 USD - Implementation and testing

$555 USD Om 10 dagar

0,0

(0 omdömen)

0,0

@MisterWatson

EDIT: whether a developer knows or doesn't know Amazon Advertising Product API. is irrelevant because they won't know the complete syntax/parameter/whatever and will refer to the documentation anyways. it's not like just because a programmer hasn't used the API he'll have great difficulties doing so. you should know that one of a developer's jobs is to take on challenges by learning new things. I do primarily front-end scraping jobs that require the use of automation browsers, but as a web developer with a strong background in full stack development (RESTful APIs, frontend frameworks, and so forth) I'm able to do extraction jobs through dedicated AP. . As the number of book listings on Amazon is substantial and I'm certain Amazon Products Feed API has a daily call limit I'm looking to complete the job in around 1-2week for $555. When hiring is confirmed, I'll go grab a developer's API key from Amazon and review their documentation. The final data will be de-duplicated I would have to look into Barnes and Noble for an estimate but I am expecting a similar cost/timeframe as they specialize in books. About me: I'm a web developer with more than 3 years of experience. While developing a website I was quite fond of the data collection aspect of it and for my career I decided to focus more on scraping/automation/data entry.

$555 USD Om 10 dagar