Find Jobs
Hire Freelancers

Build a FB Scraper using Macros, PHP cURL or anything else!

$1500-3000 USD

Avslutat
Publicerad över fem år sedan

$1500-3000 USD

Betalning vid leverans
** As FB uses Ajax to load its content, it is important that you make sure that you are able to do this job before placing a bid. ** SUMMARY: This project is to build a scraper using macros – ie. iMacros – or PHP Curl’s for Facebook’s Newsfeed ("NF") ads OR any other safer method, and other types of ads to be decided later. GOAL: Visit specified FB page URLs and collect ads data (e.g. number of likes, comments, shares, number of comments in the past hour of a particular ad, corresponding page info, etc.) and present them neatly and in well-organized manner (e.g. can filter data based on a given rule i.e. show data based on page owner/competitor. -- IDENTIFYING NF ADS Facebook's NF ads the ones that show between status updates of your friends here: [login to view URL] The challenge is, there's several different formats of NF ads as can be seen here: [login to view URL] [login to view URL] What we're looking to do is identify story/update DIVs that contain the word "Sponsored" - as this is the common attribute among all NF ads. Then extract data from those DIVs only. Here are a few sample NF ads: [login to view URL] We will provide you with the accounts that are display these ads. -- LOGGING INTO ACCOUNTS Application will require the usage of multiple FB accounts to scrape data; hence application must have the ability to link up (and delete) with multiple FB accounts. When logging in to each account, the macro will need to ensure that the appropriate proxy for each account is used – which we will provide. When switching between accounts, the macro will need to clear all Temporary Internet Files (including Cookies) to ensure that the accounts aren't linked together. -- EXTRACTING NF ADS The scraper will need to continue scrolling to the bottom of the page, until it encounters the following messages: - Old FB Format: "Add your friends to see more of their photos and stories in your news feed." - New FB Format: "There are no more posts to show right now." It will then need to identify the DIVs that contain the text "Sponsored" and: - Identify a unique parameter (to keep track of when it was first seen, last seen, times seen) - Extract all the content within the DIV - Click the advertiser's link and record all URL redirects - Load and save any images displayed within the DIV - Save which account saw the advertisement - When the advertisement was first seen - When the advertisement was last seen - if the same ad has been seen several times - The number of times the advertisement was seen - if the same ad has been several times - Record social information such as the number of likes, comments, etc. All this information will need to be saved in the database. DEVELOPER SKILLS SET (MINIMUM REQUIREMENTS): 1. 3-4 years’ experience in web development using PRIMARILY PHP 2. Profound knowledge of related frameworks (e.g. Laravel for PHP) for faster development 3. 2-3 years’ experience with Facebook Graph API 4. Strong knowledge on writing AJAX requests 5. Must be well-versed in HTML5, CSS3/SASS, and JavaScript 6. Must have experience using git for version control (experience in using some git branching strategy is an advantage) 7. Experience with NPM and task runners is required for faster development NICE TO HAVE: 1. Experience with some basic project management application like Trello, etc. ** As FB uses Ajax to load its content, it is important that you make sure that you are able to do this job before placing a bid. ** SKILLS REQUIRED: AJAX, Anything Goes, PHP, Web Scraping, Website Design BUDGET: Flexible/Negotiable
Project ID: 18291027

Om projektet

18 anbud
Distansprojekt
Senaste aktivitet fem år sedan

Ute efter att tjäna lite pengar?

Fördelar med att lägga anbud hos Freelancer

Ange budget och tidsram
Få betalt för ditt arbete
Beskriv ditt förslag
Det är gratis att registrera sig och att lägga anbud på uppdrag
18 frilansar lägger i genomsnitt anbud på $2 276 USD för detta uppdrag
Använd avatar
Hello how are you? last time, i have built a php scraper engine for twitter page. twitter page have javascript loading when scroll down. let's discuss more details if this is your concern. Thank you
$2 833 USD Om 30 dagar
5,0 (241 omdömen)
8,8
8,8
Använd avatar
Hello How are you My name is Xu it is possible on python and selenium it is not a problem for me please buzz me i have full time and I can start to work immediately Please contact me and do let us discuss about your project Thanks for your posting
$2 500 USD Om 30 dagar
4,9 (211 omdömen)
7,2
7,2
Använd avatar
Hi, I have gone through your requirement to scrape lots of websites. I am EXPERT in building scraping tools /scripts. Hence, I can SURELY work on your project. I am having 4 YEARS of EXPERIENCE in developing PHP-PYTHON (Scrapy, Selenium) based web scraper as well as WINDOWS BASED web scraping software through which I have crawled many sites such as Craigslist, Amazon, Yelp and many others. I have also worked on complex site to bypass CAPTCHA with the use of PROXY IP bouncing techniques.. Let's work together :) Have a great day! I am glad to see your WORK HISTORY and positive reviews of other freelancers. I am really excited to work with you and would love to have a long-term business association for any of your data related needs less
$1 500 USD Om 7 dagar
4,9 (110 omdömen)
6,0
6,0
Använd avatar
Hello, I am very good at web scraping and network automation tasks. I can scrape almost any website wether it applied anti-scraping mechanism nor not. I hope you can choose me.
$1 874 USD Om 10 dagar
4,7 (14 omdömen)
4,9
4,9
Använd avatar
Customer's satisfaction is my goal *** *** Also 100% Completion is happy of me and client. *** *** Rest 1% is my creative idea and honest effort. *** Looking to be your Good Venture along with your project! Best Regards.
$2 500 USD Om 30 dagar
3,9 (20 omdömen)
4,8
4,8
Använd avatar
Hi, I am python developer with expertise in web automation and data extraction. I use Selenuim and beautiful soup to extract data, Selenuim works as a bot that will take input of facebook id login details and the url that is to be scraped, I have done scraping of Facebook and other social platforms before and ready to present you a demonstration before starting the actual project. Demo that I am ready to provide, includes extraction of data from the url you provide, also I will screen record the bot to show its steps during extraction. Hope to hear more from you, thanks
$1 666 USD Om 30 dagar
4,2 (4 omdömen)
3,8
3,8
Använd avatar
Hello, It looks like you are looking for an experienced PHP developer expertise who can dedicatedly work on your project to build a Web Scraping script using macros or PHP Curl for Facebook’s Newsfeed where it can visit specified FB page URLs and collect ads data and present them neatly and in a well-organized manner. Currently, we are working on one of the same project, where we are mining websites in different groups of the scrape. Credibility, the developer will be responsible to work on AJAX, Anything Goes, Facebook API, PHP, Web Scraping. I have worked on similar projects to what you are looking for, and I am confident I can exceed your expectations. So, from our end, we have +12 years experience team and has good working hands-on in PHP, React, Redux, CSS3, HTML5, full stack development, frontend and backend development, React.js, Phalcon, Laravel, Symfony, Yii, Javascript, MVC, Ajax, Typescript, Magento, CSS3, PHP cake, Wordpress, Codeigniter, CSS3, Angular Js, Node JS, and UI/UX. Awaiting for a positive response :) Regards! Akash
$2 722 USD Om 31 dagar
5,0 (1 omdöme)
1,6
1,6
Använd avatar
Hi, I m truly excited to be working with you on your new project. We trying to fulfill your all ideas/plans. It will vary on every project. I'll look forward to your response. Thanks.
$2 500 USD Om 30 dagar
0,0 (0 omdömen)
0,0
0,0
Använd avatar
Hi there, Love this job. Lets start with me coz i will create an automation tools that will help you to do this job. faster and without any human interventions. Text me soon and lets start. Waiting your feedback and thanks
$1 666 USD Om 10 dagar
0,0 (0 omdömen)
0,0
0,0

Om kunden

Flagga för INDIA
Sacramento, India
4,9
53
Verifierad betalningsmetod
Medlem sedan aug. 20, 2005

Kundverifikation

Tack! Vi har skickat en länk för aktivering av gratis kredit.
Något gick fel med ditt e-postmeddelande. Vänligen försök igen.
Registrerade Användare Totalt antal jobb publicerade
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
Laddar förhandsgranskning
Tillstånd beviljat för geolokalisering.
Din inloggningssession har löpt ut och du har blivit utloggad. Logga in igen.