Best ec2 instance for web scrapingJobb

Hej BEST SEO 4 RANKING, jag la märke till din profil och skulle vilja erbjuda dig mitt projekt. Vi kan diskutera detaljerna över chatten.

Hej, Vi håller på med ett projekt som är en bättre lösning till nuvarande prisjämförelsesajter. Det vi söker är någon som kan driva den tekniska utvecklingen för vår MVP. Tjänsten kräver förståelse för molnbaserade tjänster, erfarenhet inom databaser som stödjer stora flöden av data från olika källor men framförallt bred kunskap inom webb/data scraping. Målet med uppdraget är att få fram vår MVP men det finns möjlighet för ett längre samarbete framöver. Låter detta intressant så hör gärna av er så berättar vi mer om iden och detaljerad information om arbetet.

...need to scale it down to a single instance. - Compute resources: The reduction should align proportionately with the decrease in application instances. This is an IBM Maximo Application Suite installation that was done with an AWS Marketplace Template "IBM Maximo Application Suite (BYOL)". The template built all the instances (9 including 3 masters, 3 workers, and 3 workers (using m5.2Xlarge and m5.4xlarge) along with a boot node and bastion host) and the volumes (26 of them with 6.23 TB of storage being used) and it is way overkill for just using as a sandbox to learn in and educate. They had no other Template option when installing. Ideal Skills & Experience: - Expertise in handling the Red Hat OpenShift environment - Strong knowledge of AWS and instan...

I need a Python developer to create a bot that scrapes data from APIs on an hourly basis. - The bot's primary function is to scrape data - The data will be sourced from APIs - The bot needs to run on an hourly basis Ideal candidate: - Proficient in Python and API data scraping - Familiarity with creating bots - Able to ensure smooth hourly operation, possibly using a scheduling library such as APScheduler

I am Building AWX Server on AWS EC2 Here is the method I am using: So far, I have: I have already Created an EC2 instance for this server. Cloned the AWX Repo, I have completed all installations required (installed Docker, Docker-Compose, I have used pipx to install the Ansible package) I need help with the rest of the instructions from that link. I am building this server in VS Code Ideal skills for the job include strong understanding of AWS, proficiency in AWX tasks and familiarity with Ubuntu server.

Simple authentication and authorization app wirh sample user/role in python/flex/dynmoDB hosted in aws ec2 instance.

I'm looking for a proficient professional who can effectively scrape leads from LinkedIn, Facebook, and Instagram and all over the internet Key responsibilities: * Extracting Email leads, Phone number leads, and Social media leads. * Collecting specific data - Name, Job title, Company, and Location, email and phone numbers Ideal freelancers for this project should have: * Extensive experience in data scraping, especially on the platforms mentioned above. * Proficiency in data mining techniques and possessing advanced analytical skills. * Understanding of ethical data scraping practices. * Strong attention to detail - ensuring all data is accurate and up-to-date. * Proven track record of delivering quality leads in a short timeframe. Get in touch if you...

necesito persona que me ayude a hacer scripting en PHP- I need someone to help me do PHP scraping

I need a skilled Web Scraping specialist to write code in Python (preferably) that scrapes a specific table from a website for me (Website: ). The table contains WNBA player statistics, The goal is to extract all columns of this table, which is approximately 7 columns and write it to a CSV file (in the same column format). I'm a beginner level coder, and noticed that the table was created with that looks like a Shiny App in R. (I'm not even sure if extracting the table is possible). If it was only possible to use R, then I could potentially work with that. Website: I would like the data to go from the year 2020 to current. Regular Season data. Key Requirements: - Scraping Tables on websites If you're

I am looking to establish a long-term relationship with a talented person to scrap thousands of dating profiles from popular dating websites. This person should have years of experience dealing with the various countermeasures these sites will employ to discourage scraping. The use of proxies may be needed to achieve satisfactory results. The end goal to to have a system capable of delivering 20K - 40K profiles per day.

I need a VRBO scraper to extract property details, pricing, and availability. - The scraper should be built with Python and the output should be in CSV format. - The data points I need include property title, description, amenities, pricing, and availability. ...to extract property details, pricing, and availability. - The scraper should be built with Python and the output should be in CSV format. - The data points I need include property title, description, amenities, pricing, and availability. - The scraper should be able to handle multiple URLs at once. - The code should be well-structured and commented for easy maintenance. Ideal skills: - Proficiency in Python - Experience in web scraping - Understanding of VRBO website structure - Ability to handle and ...

I need a web scraping professional to create a script to extract specific data from , a popular online marketplace for trading cards, please check attachement to get the idea. Key Requirements: - Scrapping: The primary task is to scrape the following information from the platform: - Card properties 1. Hero score for last 7 days 2. Hero rank for last 7 days 3. Stars 4. Rarity 5. Name 6. Quantity listed to purchase 7. Inflation data 8. Minted count - Buy prices List Price Last Price Order book (price and quantity see picture attached) - Bidding details bids book (bid and quantity see picture attached) - Twitter activity per card View Views+ Likes Likes+ Retweets Retweets+ Replies Replies+ Quotes Quotes+ Bookmarks Bookmarks+

...processing - Previous experience with developing chatbots - Familiarity with sentiment analysis - Ability to create personalized recommendations for users - Skilled in extracting and understanding content from PDF files - Strong problem-solving skills and attention to detail Details - Upload Excel file containing Expediente Codes - Use automation and OpenCV to solve Captcha and download files - Upload files to s3 bucket - Integration with existing system - use google to authenticate to the system (maybe change to office 365) Requirements: - REMOTE SERVER: Existing server - Access to S3 Bucket - Access to chatgpt api - Access mysql aws instance We need access to final git repository Project Completion: 2 weeks This project is an exciting opportunity to...

Hi Saira Arif M., as discussed this involves configuring Nginx on an AWS EC2 instance to properly serve a frontend React app under a custom domain while addressing SSL issues. Nginx configuration files need to be set up to ensure seamless access to the React site via the specified domain, resolving any SSL-related issues to ensure secure connections. my price is 10$ and I have one conditions: If you are happy we can do it right now

I'm seeking a Python developer experienced with web scraping. This job involves setting up a Python script that can scrape a popular review site. Key details to extract: - Review text - Star rating - Date of review - Reviewer name - Star-ratings for sub-categories - Review ID - Reviewed person - Reviewed product name The site does not use captchas, so it should be reasonably straightforward. All reviews for a given provider should be scraped. It would be good to have an option to start with the newest and stop at a certain date. The specific review site can be seen in the sample URL in the attached PDF. I can send further details in a private message including screenshots. Preferred frameworks would be Beautifoulsoup 4 / Scrapy if sufficient and Selen...

...then ask for more money. The Project: Develop the project in NodeRed Monitoring specific "HTML div elements" from different web pages using Node-Red (different flows). Objective: Identify when there is any change in the DIV section of the webpages (every "x" seconds) and notify me of the change. It is not necessary to show what the change was. Just send the hyperlink by Telegram, including the subject of the flow. Requirements: Create a Node-Red project that can detect changes on multiple websites by creating flows. Include 2 example flows to demonstrate how the monitoring works. Provide detailed instructions on how to create a new flow for a different webpages, indicating what needs to be extracted/copied to set up the new flow bymysel...

...data scraping project completed on multiple websites. - TASK: The task involves scraping text content from: Google searches: Commercial Real estate agency Saudi Arabia Commercial Real estate agency UAE Commercial Real estate agency Qatar Commercial Real estate agency Kuwait Commercial Real estate agency Bahrain I have made a start to the spreadsheet with a template for each of the regions which can be continued to be filled in. In the Google searches, just take the first 3 pages with the main agent listings and see what agent names/ email addresses you can find. - DATA REQUIRED: The primary data needed is text content. - TIMELINE: This is a one-time task, with no ongoing scraping requirements. Skills/Experience: - Proficiency in web scrapin...

I have two websites that need to be merged with a main focus on consolidating information. The current websites are different in design and themes, and I'm looking for a professional who can successfully merge them into a cohesive, user-friendly site. Key requirements: - Consolidate information: The primary goal is to combine and organize the content from both websites into a single, easily navigable platform. The new website should provide a clear and seamless user experience. - Prioritize by relevance: The content should be arranged in a way that is most relevant to the user. This may involve restructuring and reorganizing information to ensure that the most important details are easily accessible. Ideal skills and experience: - Proficiency in website design and deve...

I'm looking to test database scraping on a website to extract names and potentially contact emails (if available). The data doesn't necessarily need to be organized or cleaned post-extraction. Ideal Skills: - Proficiency in web scraping tools - Understanding of database structures - Familiarity with handling contact information The data should be organized in an excel and csv based on the desired layout.

I require a specialized web scraping professional with experience in extracting text and images from multiple websites. Your task will involve the following: - Scrape data from Sephora, Cult Beauty, Space nk - Extract specifically the Text, Images, Titles, Descriptions, and Prices A strong background in web scraping, data extraction, and working proficiently across different websites is critical for this project. Knowledge in web parsing methods and ability to bypass potential anti-scraping tools or blocks set up on these websites will be highly advantageous. Your goal is to accurately scrape the necessary information without causing disruption to the target websites, and ensure the data is comprehensible and ready for further us...

I need an experienced Python developer to assist with a project. The specific tasks will be discussed directly with the successful bidder. I am looking for someone who is well-versed in Python and has a strong foundation in programming. Expectations: - Ability to work independently and problem-solve - Can communicate effectively and provide updates - Previous experience with Python is a must - Familiarity with data analysis, web scraping, or automation is a plus.

Start your offer with the word in the attachment, otherwise we dropp you out. We are looking for a database with websites, HAVING EMBEDDED YOUTUBE Videos on their sites. Prepare a list with : Name of the company, youtube Channel, Link to the first youtube video you find on the site, PLZ, City, State, Phone, Mail, Website Niches: Construction Systems in Austria, Germany and Switzerland Phsiotherapeuts in Austria, Germany and Switzerland I would like to have at least 2000 websites with top-quality data. Delivered in 1 day. Delivery in one Excel file. Time of delivery is a key element in our decision. Offer a price for 2.000 data entries. We extend our partners for this kind of task´s. With all of them we have a longterm Partnership. To decide who is our partn...

Our business website is currently experiencing a server down or unreachable issue on Amazon EC2. We need a skilled individual to address this problem promptly to avoid extended downtime. Key Requirements: - Demonstrated experience working with Amazon EC2 - Familiarity with troubleshooting and resolving server down or unreachable issues - Ability to work quickly and efficiently to restore website functionality Please provide a clear overview of how you plan to approach this task and your previous experience with similar issues. A prompt and effective resolution is crucial for our business.

...dynamo/alternator for bicycles. The primary objective of this project is to create a device that can generate and store significant power for storage in high-capacity batteries. This dynamo/alternator should deliver a high power output, mainly focusing on efficiency, ease of use and weight. Key requirements: - Designing a high-power dynamo/alternator that can support extensive power needs. - The device should be attachable to a standard bicycle without impacting its performance or aesthetics. - Prioritizing power output over size or weight, meaning the final product can be robust as needed. Your role will be to: - Combine your expertise in electrical and mechanical engineering to create a prototype. - Ensure the final product is not only functional but also practical ...

I urgently need a skilled professional to set up a E-commerce website on AWS. Website is already hosted in AWS instance but due to some error website is stop, We need to start website Tools : php Mysql

scrape data from darty site and export it into excel file.

I'm looking for a Python developer to assist with a variety of tasks on a medium-scale project. This would include web development, data analysis, automation scripting, and web scraping. Your responsibilities would cover: - Web Development: Creating and maintaining web applications using Python frameworks. - Data Analysis: Handling and analyzing data to derive insights. - Automation Scripting: Developing scripts to automate manual tasks. - Web Scraping: Extracting and structuring data from websites. Communication is key, and I'd prefer to receive regular updates and progress reports via email. The ideal candidate for this position will have experience with each of these tasks and be able to work on a medium-sized pr...

I need a Python Selenium application that can scrape blog posts from Site A and post them on Site B. Key Requirements: - The Python app should be built using Selenium for web scraping and automation. - It should be able to extract blog posts from Site A, specifically. - The extracted data must be posted on an existing blog section of Site B. Ideal Skills & Experience: - Proficient in Python, with experience in building web scrapers. - Strong knowledge of Selenium for web automation. - Previous experience with data extraction and manipulation. - Understanding of web protocols and site structures. - Familiarity with blog post formatting and publishing is a plus.

I'm in need of a membership portal that will store and display user profiles and membership levels. Key Requirements: - Data Display User profiles should be displayed in a detailed view Membership Levels Manage...membership levels Analytics: The membership portal should include analytics tracking to monitor membership trends and engagement. Ideal Skills: Proficiency in backend development Experience with data storage and retrieval - UX/UI Design skills for sophisticated data display - Knowledge of membership management systems - Understanding of analytics implementation in web applications Your involvement in this project would contribute significantly to my business's efficiency in managing and understanding member data. Expertise needed in Express j...

...integrating relational databases and APIs from web services is crucial. - Data Consolidation: You should be able to create a cohesive, consolidated dataset from these different sources applying appropriate design principles. - Medium-sized project: The data needing integration and consolidation is between 1GB and 10GB, so experience handling medium-sized data sets is ideal. Your main aim will be to ensure that the data warehouse is efficient and can handle the needs of our data integration and consolidation. Experience in similar projects is essential. You will be working with roughly 5 databases, some direct access, some via API (including basic XML feed in 1 instance). We do not have expectations on the total timeframes (may be up to 3 weeks for 2-3 days per week...

I'm in need of a skilled freelancer who can perform daily scraping of job titles from Indeed. Ideal Skills and Experience: - Proficient in web scraping, particularly from Indeed - Able to automate the scraping process on a daily basis - Competent in delivering data in CSV format Data Update Frequency: - It's essential that the scraping is carried out daily Delivery Format: - The scraped data should be provided in a CSV file Looking forward to your proposals.

I'm in need of a membership portal that will store and display user profiles and membership levels. Key Requirements: - **Data Display**: User profiles should be displayed in a detailed view. - **Membership Lev...**Analytics**: The membership portal should include analytics tracking to monitor membership trends and engagement. Ideal Skills: - Proficiency in backend development - Experience with data storage and retrieval - UX/UI Design skills for sophisticated data display - Knowledge of membership management systems - Understanding of analytics implementation in web applications Your involvement in this project would contribute significantly to my business's efficiency in managing and understanding member data. Looking forward to receiving your bids. Express j...

...addresses for an upcoming email marketing campaign. The ideal candidate will have experience and expertise in web scraping, particularly from social media profiles, professional networking sites, and company websites. Key Responsibilities: - Collect email addresses from social media profiles, professional networking sites, and company websites. - Ensure the collection is accurate and up-to-date. - Provide the email addresses in a well-organized manner, making it easy to integrate into our marketing campaign. Target Industries: The primary focus for this collection is media, video production, photo production, TV production, film production, and music production. This means that your understanding of the sectors is crucial for the success of this pro...

I'm seeking a skilled Senior Python Developer to assist with a project that involves a blend of web scraping and data analysis, with a focus on the following tasks: - Extracting data from multiple websites - Automating data extraction and parsing - Analyzing and visualizing scraped data The ideal candidate should have: - Proficiency in Python, with a strong understanding of AI and Machine Learning - Hands-on experience with web scraping, particularly working with diverse data sources - Ability to automate data extraction and processing efficiently - Adept at data analysis, with the ability to visualize and interpret data Although I haven't specified any particular tools or libraries, your familiarity with tools like BeautifulSoup, Scrapy and Selenium...

In this project, I'm searching for an experienced Python Developer who exhibits strong proficiency in web scraping, artificial intelligence, and machine learning. Key Responsibilities: - Utilize your expertise in Python, specifically focusing on AI-related tasks. - Web scraping will also be a significant part of the project, though details on the targeted data type are yet to be defined. Ideal Skillset: - Extensive experience with Python - High proficiency with AI and machine learning algorithms - Proven record of successful web scraping projects Please include samples of relevant Python, AI, or web scraping projects you've completed as part of your bid. I look forward to collaborating on this project.

I'm a digital affiliate marketer who needs a comprehensive product cross-referencing and price comparison tool developed for my e-commerce website. The tool should be capable of processing data from around 30,000 products across 5-10 different stores. Key Requirements: - Cross-reference 30,000 products from 5-10 stores: The tool should be able to analyze and compare prices for a substantial number of products across multiple listed stores. - Avoiding Captcha and ad blockers: The tool should be designed to function effectively while avoiding common barriers like Captcha or ad blockers. - User-friendly filters: The tool should offer a variety of filters to help users refine their search results. - Display results directly on product pages: The comparison results shoul...

I am looking for a freelancer who can help me automate my web search for bid opportunities (RFPs) for my telecom company. Currently, I rely on searching manually, but this process is time-consuming and not as efficient as I'd like. Key Project Requirements: - You will be responsible for setting up an automated search that looks for RFPs related to "fiber optic" or other telecom-specific keywords, which are due every May 2024 or similar queries. - This automated search needs to run every 2-3 weeks, ensuring that I stay up-to-date with new bid opportunities and future due dates. - You should have a deep understanding of web scraping and automation to accomplish this task. Additional Information: - I would like to re...

We’re on the lookout for Senior Java Developers who can effectively refactor Lombok by changing its base package structure from lombok.* to io.gilly.* . We need a specialist who can: - Change the base package of all classes, config files and build scripts - Ensure that the unit tests pass after the change You’ll know that the job is complete when: - The final repository must have no mention of “Lombok” (except for places where it’s unavoidable, such as downloading artefacts from the web, eg: “”) - the generated jar can be added as a dependency on a Dummy Java app, and it should work exactly like Lombok. For instance, when I annotate a POJO with @, getter methods are added to the .class - Additionally, we will a...

...make the initial Contact and then ask for more money. The Project: Monitoring specific "HTML div elements" from different web pages using Node-Red (different flows). Objective: Identify when there is any change in the DIV section of the webpage (every "x" seconds) and notify me of the change. It is not necessary to show what the change was. Just send the hyperlink by Telegram, including the subject of the flow. Requirements: Create a Node-Red project that can detect changes on multiple websites by creating flows. Include 2 example flows to demonstrate how the monitoring works. Provide detailed instructions on how to create a new flow for a different webpage, indicating what needs to be extracted/copied to set up the new flow. For...

I'm searching for a skilled individual who can help me scrape data from a website. The data I'm interested in is text content and tables, specifically contact information. Ideal Skills: - Proficiency in web scraping tools - Strong experience with scraping text content and tables - Expertise in extracting specific information - Familiarity with structured data formats The contact information on the website is in a structured format. Your ability to navigate this and provide me with a clean, organized dataset will be crucial. Looking forward to collaborating with a detail-oriented and reliable professional. Attached is a sample format. The site is: Final file must contain all records for all schools on all pages

I'm looking for an AWS DevOps engineer with experience in key AWS services to help with infrastructure provisioning, automated deployments, and setting up a Continuous integration/continuous deployment (CI/CD) pipeline. Key Project Requirements: - Infrastructure provisioning: You should have the ability to set up and manage cloud resources efficiently. - Automated deployments: Experience with automating deployment processes is crucial for the success of this project. - Continuous integration/continuous deployment (CI/CD) setup: The ideal candidate should have a solid understanding of CI/CD principles and be able to implement them effectively. Security Requirements: In addition to the technical requirements, you should be familiar with compliance standards such as ...

I'm in need of a Chrome extension that can automate certain tasks within the browser. Here's what I'm looking for: (I have some 3-5 extensions I want, so if you give attractive bid and do good work, you can expect to get more chrome extension projects from me) - **Functionality:** The primary purpose of this extension would be to check specific elements on the pages the user visits. - **Elements to Check:** The extension should be able to read and process the text content and links on the page. Ideal candidates should have experience in: - Chrome extension development - Web scraping and automation - JavaScript and possibly other relevant technologies for extension development. Please provide examples of your previous Chrome extension work.

I am planning to set up a new application on AWS ECS using Docker and I am looking for a skilled expert to assist with the initial setup. Key Project Requirements: - Proficiency setting up and configuring AWS services, particularly ECS and EC2. - Strong understanding and practical experience with Docker. Ideal Skills and Experience: - Extensive experience with AWS ECS and Docker. - Good understanding of best practices for AWS service configuration. - Ability to troubleshoot and provide solutions for potential issues. - Strong communication skills to explain the setup process to me in a clear and understandable way. Please get in touch if you have the skills and experience to support this project.

...Chrome extension - Implement data extraction techniques to collect and organize information from various web sources. The ability to filter and manage this data is crucial. - Set up the extension for browser automation tasks. It should be able to perform repetitive actions on a webpage without manual intervention. Communication: I prefer to manage communication with the selected freelancer through the messaging feature available on Freelancer.com. Ideal Candidate: The ideal candidate for this project should have a proven track record in developing Chrome extensions, particularly those involving web scraping and data extraction. Experience in browser automation is a plus. I am looking for someone who can demonstrate their expertise through t...

...an expert developer who can take the lead on the development of CrewAI, a platform intended to boost productivity by implementing autonomous agents. These agents will be responsible for several important tasks, mainly focused on data analysis, process automation, and digital marketing. Key Responsibilities: - Develop and implement an autonomous agent platform with Libraries of tasks, agents, tools to be organized by a user into Crews. - Ensure the agents are capable of accessing and interpreting data from a variety of sources, including databases, APIs, and websites. - Create a user-friendly Panel front end for the CrewAI platform that presents the user insights and controls of Crews in a clear and intuitive manner. Ideal Skills and Experience: - Proven experience in dev...

I need help configuring my instance of to reach out to contacts and inquire about their clients, specifically business owners who may be interested in selling their businesses. Key Requirements: - Configuring : I am seeking a professional who can set up my instance of to effectively reach out to a wide network of professionals (accountants, financial advisors, bankers, wealth managers) with the aim to identify potential sellers among their clientele. - Contacting Professionals: Your role will be to utilize to establish contact with these professionals and to inquire about any potential business owners among their clients who might be interested in selling their businesses. - Handling Large Scale: You should be able to manage a large number

...assist in completing a database for over +14000 companies. The goal of this project is to generate high-quality sales leads. Key Project Details: - You will be required to include accurate and up-to-date contact information including phone numbers and email addresses. - In addition to the contact details, each company's key contact person's name must also be included in the database. The ideal freelancer for this project will have: - Prior experience with database generation and management. - Proficiency in data mining and web scraping techniques. - Exceptional attention to detail to ensure accuracy of information. - Proven track record in generating sales leads through database creation. This project is crucial for our sales outreach and ...

I need assistance with scraping data from a website and delivering it in an Excel file. The specifics of the project are as follows: I am looking for a person who will conduct scraping sessions for our business on a regular basis. Desired skills are knowledge of screen-scraper software, sql, Someone with Python knowledge will be better. Willing to follow instructions. Not cramped up with other jobs or other side hustles. Need to have solid internet connection. Expected work takes 5-10 hours per week, once fully trained. Must be responsible. Able to accept PayPal. - The source of the data is a website. This means the freelancer needs to have experience in web scraping. - The data should be delivered in an Excel file. Proficiency in handling and...

I'm looking for a freelancer to help me with email scraping to build a targeted email list in the education sector. Specifically, I'm interested in parents who are seeking tuition services for their children. Key Responsibilities: - Conducting research online to identify and extract email addresses of parents seeking tuition services for their children - Organizing the list in an easily accessible format that I can utilize for email marketing campaigns Skills and Experience: - Proficiency in email scraping and list-building - Prior experience in targeting the education sector is desirable - Understanding of lead generation and email marketing best practices