Pyspark scJobb
Vänligen Vänligen Registrera dig eller Logga in för att se mer information.
Committee and Legislative testimony on a bill passed by MN in 1990. Written record, submitted testimony, and audio or anything else that exists. Determine if an 1989 MN SC case is still good law?
Confirmis () is a Singapore-based business information provider specializing in connecting businesses with global capabilities; comprised of industry veterans, Confirmis business model is designed to overcome perennial lack of data (let alone quality data) to support effective decision making, particularly in developing economies. JOB DESCRIPTION: Targeted party(s): 1 SC, 1 Related Company -Conduct research the provided [individual(s) or Party(s)] in all litigation sources in both native language and English; -Conduct research the provided [individual(s) or Party(s)] in all bankruptcy and insolvency sources in both native language and English; -Conduct research the provided [individual(s) or Party(s)] in all local and national news medias and social media in both native
I'm in need of a Machine Learning Engineer who can migrate our existing notebooks from RStudio and PySpark to AWS Sagemaker. Your task will be to: - Understand two models I have running locally. One is a Rstudio logistic regression model, and the other is a pySpark XGboost also running on local. - Migrate These two models to AWS SAGEMAKER. Data will be on S3 -Prepare models to run on sagemaker totally, so that we can do training and testing 100% on sagemaker.-Models are already running on a local computer, but I need to move them to Sagemaker 100%. Data is on S3 already. -You need to configure and prepare Sagemaker from end to end, and teach me how you did it, since I need to replicate it in another system. -I will give you the data and access to AWS Ideal Skills and...
I'm looking for a talented designer who can create an engaging flyer for a community outreach event hosted by our church. Evergreen Baptist Church Community Outreach Saturday. April 20, 12:00 PM 1527 S Main St, Anderson, SC 29624 Please join in with us as we distribute food, clothing, hygiene products, etc. Proverbs 19:17 Whoever is kind to the poor lends to the Lord, and he will reward them for what they have done. Please contact Minister Travis Boyd. Minister Anne Merriweather, Angela Anderson for more information
The Data Engineer contractor role will be a project based role focused on migrating data pipelines from legacy infrastructure and frameworks such as Scalding to more modern infrastructure we support such as Spark Scala. This role will be responsible for: Analyzing existing data pipelines to understand their architecture, dependenci...Requirements The ideal candidate is a Data Engineer with considerable experience in migrations and Big Data frameworks. Must-Haves Scala programming language expertise Spark framework expertise Experience working with BigQuery Familiarity scheduling jobs in Airflow Fluency with Google Cloud Platform, in particular GCS and Dataproc Python programming language fluency Scalding framework fluency Pyspark framework fluency Dataflow(Apache Beam) framewor...
Hi, Please apply only individual. Agency can apply but budget should not be more than mentioned. Role : GCP Engineer (OTP) Exp : 7 + yrs SHIFT: IST Cloud Storage Buckets, BigQuery (SQL, Data Transformations and movement) Airflow (python, DAGs), DBT IAM Policies PyCharm Databricks (pySpark), Azure DevOps Clear and confident communication
I'm in need of a Machine Learning Engineer who can migrate our existing notebooks from RStudio and PySpark to AWS Sagemaker. Your task will be to: - Understand two models I have running locally. One is a Rstudio logistic regression model, and the other is a pySpark XGboost also running on local. - Migrate These two models to AWS SAGEMAKER. Data will be on S3 -Prepare models to run on sagemaker totally, so that we can do training and testing 100% on sagemaker.-Models are already running on a local computer, but I need to move them to Sagemaker 100%. Data is on S3 already. -You need to configure and prepare Sagemaker from end to end, and teach me how you did it, since I need to replicate it in another system. -I will give you the data and access to AWS Ideal Skills and...
The Data Engineer contractor role will be a project based role focused on migrating data pipelines from legacy infrastructure and frameworks such as Scalding to more modern infrastructure we support such as Spark Scala. This role will be responsible for: Analyzing existing data pipelines to understand their architecture, dependenci...Requirements The ideal candidate is a Data Engineer with considerable experience in migrations and Big Data frameworks. Must-Haves Scala programming language expertise Spark framework expertise Experience working with BigQuery Familiarity scheduling jobs in Airflow Fluency with Google Cloud Platform, in particular GCS and Dataproc Python programming language fluency Scalding framework fluency Pyspark framework fluency Dataflow(Apache Beam) framewor...
I am looking for a dedicated specialist well-versed in using Databricks and PySpark for data processing tasks, with a primary focus on data transformation. With the provision of JSON format files, you will perform following tasks: - Carry out complex data transformations - Implement unique algorithms to ensure efficient data processing - Test results against required benchmarks Ideal Skills: - Proficient in Databricks and PySpark. - Must possess a solid background in data transformation. - Experience handling large JSON datasets. The end goal is to achieve seamless data transformation leveraging the power of Databricks and PySpark, enhancing our ability to make informed business decisions. Please provide your completed projects, and the strategies you've used ...
I am looking for a Microsoft OneDrive consultant with extensive experience on file organization, sharing, syncing, backup, and collaboration features. I am especially interested in merging several OneDrive accounts into one and need your expertise to set up automatic synchronization. MUST BE A RESIDENT IN THE GREENVILLE, SC AREA AS AN OFFICE VISIT WOULD BE REQUIRED Your role would be: - Consolidating multiple OneDrive accounts into one single account - Ensuring all files are correctly organized, shared, backed-up, and set up for collaboration - Setting up automatic synchronization among all the files across the accounts It is crucial you have significant experience in managing and troubleshooting OneDrive. Quick and efficient work, with attention-to-detail in preserving file perm...
Confirmis () is a Singapore-based business information provider specializing in connecting businesses with global capabilities; comprised of industry veterans, Confirmis business model is designed to overcome perennial lack of data (let alone quality data) to support effective decision making, particularly in developing economies. JOB DESCRIPTION: Targeted party(s): 1 SC, 1 Related Company -Conduct research the provided [individual(s) or Party(s)] in all litigation sources in both native language and English; -Conduct research the provided [individual(s) or Party(s)] in all bankruptcy and insolvency sources in both native language and English; -Conduct research the provided [individual(s) or Party(s)] in all local and national news medias and social media in both native
Creating a promotional flyer for our church Evergreen Baptist Church invites everyone to join us on Sunday April 21, 2024 for morning worship service at 10:30. Associate Minister Travis Boyd will be bringing the word! 1305 Evergreen Road Anderson, SC 29621 Rev. Johnny M. Sellers, Pastor
I am looking for a LABEL design for honey jars. Please read the requirements. Size is 2 inches x 3 inches landscape. Additional layouts will be a square and a round version. Our logo and colors must be in the design. - they are attached. Additional label requi...logo and colors must be in the design. - they are attached. Additional label requirements Statement of Identity must read: Pure Local Honey It must be in bold print, the type size must be comparable to the most prominent part of the label (larger than other type) and must be placed on the Principal Display (Front) Panel. Business address is required. The address is 1348 Pet Sites Rd, Chapin SC 29036 Net Weight must be placed at the bottom 1/3 of the design, to read 48 oz Must provide editable files when ...
...financial contributions. At the commencement of our relationship of our relationship I was self employed , doing Rio patios , bathrooms , sheds ect , to establish and support my business. Other benefits came from selling my machinery , livestock and other assets as my property was for sale . Once my bussines was established I took on several high income contracts for Endeavour building and SC Building my gross for the year 2022was $231,277.60 . I contributed to all house hold expenses 50% . First was cash , then a join bank account between Rachel and myself which we each put in $250 a week and after that we went back to bank/cash transactions as Rachel didn't like the joint account. In April 2021 I completed my dream of 15 years and purchased my property in the Nor...
...functions to handle data quality and validation. -Should have good understanding on S3,Cloud Formation, Cloud Watch, Service Catalog and IAM Roles -Perform data validation and ensure data accuracy and completeness by creating automated tests and implementing data validation processes. -Should have good knowledge about Tableau, with creating Tableau Published Datasets and managing access. -Write PySpark scripts to process data and perform transformations.(Good to have) -Run Spark jobs on AWS EMR cluster using Airflow DAGs.(Good to have)...
...Stay current with new technology options and vendor products, evaluating which ones would be a good fit for the company Troubleshoot the system and solve problems across all platform and application domains Oversee pre-production acceptance testing to ensure the high quality of a company’s services and products Skill Sets: Strong development experience in AWS Step Functions, Glue, Python, S3, Pyspark Good understanding of data warehousing, Large-scale data management issues, and concepts. Good experience in Data Analytics & Reporting and Modernization project Expertise in at least one high-level programming language such as Java, Python Skills for developing, deploying & debugging cloud applications Skills in AWS API, CLI and SDKs for writing applications Knowledge...
I'm seeking highly skilled developers to create real-money earning games on both Android and iOS games in question are Ludo and Cricket. Key Features: - Player Matchmaking: The game should match players of similar skill level. - Real-time Multipl...com/store/apps/details?id= Cricket League I want the above games graphics as it is in a single app. But there will be a change in gameplay. where users play with real money and win real money. Ludo has 3 types a. Single Token ( for fast game finishing) b. Four tokens (regular ludo) c. Play with friends Cricket has 2 types sc a. Play with online players b. Play with AI Login/signup Home page Gameplay Deposit amount... Withdraw amount Profile
I am in need of a proficient PySpark coder to aid in debugging errors present within my current code. The main focus of this project is optimization and troubleshooting. Unfortunately, I can't specify the type of errors– I need a professional to help identify and rectify them. If you are an experienced PySpark coder with a keen eye for bug identification and problem solving, I'd appreciate your expertise.
I am in need of a proficient PySpark coder to aid in debugging errors present within my current code. The main focus of this project is optimization and troubleshooting. Unfortunately, I can't specify the type of errors– I need a professional to help identify and rectify them. If you are an experienced PySpark coder with a keen eye for bug identification and problem solving, I'd appreciate your expertise.
I'm searching for a PySpark expert who can provide assistance on optimizing and debugging current PySpark scripts. I am specifically focused on PySpark, so expertise in this area is crucial for the successful completion of this project. Key Responsibilities: - Optimizing PySpark scripts to improve efficiency - Debugging current PySpark scripts to resolve existing issues Ideal Candidate: - Proficient with PySpark - Experience in big data management, data ingestion, processing, analysis, visualization, and reporting - Strong problem-solving skills to identify and resolve issues effectively - Knowledgeable in performance tuning within PySpark.
I'm looking for a skilled freelancer to create a Spark script that transfers data from a Hive metastore to an S3 bucket. The goal of this project is to enable backup and recovery. Skills and Experience: - Proficiency in Spark and Hive - Extensive experience with S3 buckets - Understanding of data backup strategies Project Details: - The script needs to read the schema and perform metadata transfer for selected schema to s3 bucket. - Only bid if you have work experience with spark, hive, s3 - 4 schemas needs to be migrated - I have already got access to s3 configured - I have local instance of netapp s3 available and bucket created. - Server is Ubuntu
I am looking for an experienced data analyst who is well-versed in PySpark to clean up a medium-sized dataset in a CSV file format. The file contains between 10k-100k rows, and your primary role will be to: - Remove duplicate data entries - Deduplicate the dataset - Handle missing values - Aggregate the resultant data Your proficiency in using PySpark to automate these processes efficiently will be critical to the success of this project. Therefore, prior experience in handling and cleaning similar large datasets would be beneficial. Please note, this project requires precision, meticulousness, and a good understanding of data aggregation principles.
I am looking for an Arabic-speaking graphic designer who can create a dynamic, creative LinkedIn post. we are saba clinics and we need to design a post that announce that we are serving in Saudia Airlines ( covered by Bupa insurance patients ) in our clinics. ...clinics. نرحب بمنسوبي شركة الخطوط السعودية (تأمين بوبا ) في عيادات سابا و تالة font: din text Arabic english Identity: use our logo colors and use sharp straight lines and shapes only Attached Saba clinics logo and footer, and you can find saudia and bupa logos and creatives from their websites : ين+بوبا&qs=n&form=QBRE&sp=-1&lq=0&pq=ين+بوب&sc=2-6&sk=&cvid=125F9CE02FB8461BB060B2D4E703E412&ghsh=0&ghacc=0&ghpl=
This vital task entails cleaning and sorting two CSV files of approximately 100,000 rows and second one of about 1.5million rows using pyspark (Python) in Jupyter Notebook(s). The project consists of several key tasks: Read in both datasets and then: - Standardizing data to ensure consistency - Removal of duplicate entries - Filtering columns we need - Handling and filling missing values - Aggregating data on certain groupings as output Important requirement: I also need unit tests to be written for the code at the end. Ideal Skills: Candidates applying for this project should be adept with Pyspark in Python and have experience in data cleaning and manipulation. Experience with working on datasets of similar size would also be preferable. Attention to detail in ensuring ...
I'm in need of an expert graphic designer to assist me in creating a colorful, vibrant flyer that catches the eye and demands attention. This will be for an upcoming event targeted at the general public, so the design needs to be easily understandable and appealing to a broad aud...audience. Skills and Experience: Everyone is Welcome to Join Evergreen Baptist Church for Easter Weekend Services! Our Annual Easter Egg Hunt will be held on Saturday March 30, 2024 at 12:00 PM for kids all ages! Lunch will be provided. Sunrise Services will begin at 7:00 AM Sunday March 31, 2024 followed by the annual Easter Play! M Sellers, Pastor 1305 Evergreen Road Anderson, SC 29621 Please use bright colors and keep the flyer religious based . Family friendly and bright! Please use or...
I'm seeking an experienced Data Engineer with proficiency in SQL and PySpark. Key Responsibilities: - Develop and optimize our ETL processes. - Enhance our data pipeline for smoother operations. The ideal candidate should deliver efficient extraction, transformation, and loading of data, which is critical to our project's success. Skills and Experience: - Proficient in SQL and PySpark - Proven experience in ETL process development - Previous experience in data pipeline optimization Your expertise will significantly improve our data management systems, and your ability to deliver effectively and promptly will be highly appreciated.
Projec...needs to be visualized realtime as the data collection takes place preferably on a rolling chart with "x" axes being time and "y" axis being the value read. The distinct points should be connected on the graph with a straight line. The time delay between measurements should be as little as practically possible. Available hardware for the task: - "node mcu ESP32s3", or "Panlee WT32 SC-01 plus" the latter has built in RS485. - Nvidia jetson nano - Raspberry Pi - Ordinary PC with a USB to RS485 converter. Software requirements: - the project can be completed on any platform as long as it satisfies the requirements set in the description. - suggested languages to use are Python with visualizat...
- Conversion of the entire Python code into PySpark. Skills and experience required: - Proficient knowledge in Python.
...seeking the expertise of a professional civil engineer who is knowledgeable with TRC regulations and requirements in Charleston, SC. As part of your role: - You will be tasked with undertaking the civil engineering components of a 3-story triplex apartment building designed for residential use. - Soil testing has already been completed and is available for your reference. - A full blueprint of the triplex is available which should aid the planning and execution of the project. Ideal Skills & Experience: - Extensive experience in civil engineering, specifically in the realm of residential buildings. - Familiarity with TRC regulations and codes in Charleston, SC. - Prior experience handling civil engineering projects from blueprint to execution. - Strong o...
...competent in either PySpark or RDD, using Python to create versatile code fitting for several scenarios. Your main task will be to write code to compare rows using Python in line with the clear set of rules I provide. These rules are detailed in an attached Word document and are based on comparisons encompassing specific columns, presence or absence of particular data, and multiple criteria comparisons. The expected output is a reversal logic for claim_opened_timestamp_utc. I need output that are in right side. I need either in pyspark or in rdd to compare rows. spark - spark-3.3.0-bin-hadoop3 py4j-0.10.9.5 I am using I need your support till I execute it in my office computer I need it in 3 days. Ideal Skills and Experience: - Proficiency in Python - Experience with...
I'm beginer user of Azure Databricks and Pyspark. I'm looking to boost my skills to the next level and need an expert to guide me through advanced techniques. Ideal freelancers should have vast experience and profound knowledge in data manipulation using Pyspark, Azure Databricks, data pipeline construction, and data analysis and visualization. If you've previously tutored or mentored in these areas, it'll be a plus.
Y'all, don't laugh: I need a set of stamped drawings for a 24 x 36 pole barn. 8x8 posts, 4/12 pitch on the roof, Roof to be shingles. That's it. No walls, no electricity, no water/plumbing. This needs to pass muster with the Planning Department in Aiken County, South Carolina.
I need an inventive and striking logo for my startup, Smart Circuit. I am interested in designers who can bring creativity while incorporating elements that signify our brand and industry. What is Smart Circuit ? - It is a chain of Smart Electric stores. - Electricians are made available in 15 minutes. What I'm looking for: - The design should include the initials of the company, SC - I want a specific color scheme to be used, which we can discuss in more detail during the project. - Simple and Sober Skills and Experience required: - Proven graphic design skills with a strong portfolio - Ability to interact, communicate and present ideas - Up to date with industry-leading software and technologies (In Design, Illustrator, Dreamweaver, Photoshop, etc.) - Highly prof...
...engaging activities and games. "MathVenture Quest" emphasizes the exploration of math concepts in an exciting and interactive way, promising a blend of learning and enjoyment tailored to elevate their math skills. I am looking for a fun, kid-friendly, yet professional flyer with the colors, orange, blue, navy, green and white. What to Include: Call to Action: Be sure your child is ready to take on SC READY! Slogan: "Learning Elevated, Fun Activated" Logo: See attached photo Targeted audience: 3rd grade students Website: Phone: -- Email: -- Main Requirements: - The flyer should be on a letter-size page - I would like it to be designed for single-sided printing Ideal Candidate: - Advanced proficiency in graphic design - Experience in designing marketi...
I need complete 2 small projects done. The data needs to be pulled from API using python. The pulled data needs to be unnested, then transformed to answer some insights with medallion architecture. Here, you need to showcase SCD-type 2 ingestions, incremental joins,...to be pulled from API using python. The pulled data needs to be unnested, then transformed to answer some insights with medallion architecture. Here, you need to showcase SCD-type 2 ingestions, incremental joins, managing PII information, aggregation. Final deliverable needed for 1st project (databricks): Data model designed and architecture overview Notebooks of transformations in Python and PySpark/Spark Scala Final deliverable needed for 2nd project (dbt): Data model designed and architecture overview dbt sql and ...
Hello dear, Nice to meet you. Pls be noted that we need AI-based IVR and SMS Chat bot to answer to calls and SMS while calling a number like 333 or sending SMS to SC like 333 with questions. We are receiving a call traffic landing in the customer care department (around 110K calls daily). As per the call traffic analysis, the majority of customers are seeking Information or requesting activation and deactivation of products. To reduce this traffic we are going to implement an AI solution that could efficiently interact with customers over the texts and voices (something like virtual agents) to deflect a remarkable portion of calls from live agents. Thus, we look forward to receiving a proposal along with the PPT in this regard if you are interested and have the solution available....
I am seeking a highly experienced blockchain developer who can confidently deploy and verify a smart contract on the Neon platform. Key Requirements: - Expertise in Solidity programming language is a must as this is the chosen language for the smart contract development. - The smart contract should include specific functionalities such as token transfer, contract ownership transfer,...specifically on Neon - Excellent command of Solidity programming language - An understanding of token transfer dynamics, contract ownership transfer, and how to implement time-locked transactions within a smart contract. Your demonstration of a strong technical understanding and previous experience with similar projects will be key. need to done in an hour start the proposal with "sc"
Looking for someone with good skills in Airflow, Pyspark and SQL.
I am looking for a skilled professional in Python, with a comprehensive understanding of PySpark, Databricks, and GCP. A primary focus of the project is to build a data pipeline and apply time series forecasting techniques for revenue projection, using historical sales data. Key tasks will include: - Constructing a robust data pipeline using Python, PySpark, and Databricks. - Applying time series forecasting to produce revenue predictions. - Using Mean Squared Error (MSE) to measure model accuracy. The ideal candidate for this project would have: - Proven experience with Python, PySpark, Databricks, and GCP. - Expertise in time series forecasting models. - Practical understanding and use of Mean Squared Error (MSE) for model accuracy. - Experience with large scale ...
I am looking to develop a sophisticated and efficient data pipeline for revenue forecasting. This pipeline will be implemented using Python, pyspark, databrics, and gcp Big Data. Here is what you need to know about this task: - Data Source: The data originates from Google Cloud Platform's Big Data service. As such, the freelancer should have solid experience and understanding of working with Big Data services on GCP. - Data Update Frequency: The frequency of data updates will be confirmed during the project, but suffice to say frequency could be high. Prior experience with real-time or near-real-time data processing will be highly beneficial. - Performance Metrics: The key performance metric I'm focusing on is data processing speed. The freelancer should have a strong kn...
I'm in need of a specialist, ideally with experience in data science, Python, PySpark, and Databricks, to undertake a project encompassing data pipeline creation, time series forecasting and revenue forecasting. #### Goal: * Be able to extract data from GCP BigData efficiently. * Develop a data pipeline to automate this process. * Implement time series forecasting techniques on the extracted data. * Use the time series forecasting models for accurate revenue forecasting. #### Deadline: * The project needs to be completed ASAP, hence a freelancer with a good turnaround time is preferred. #### Key Skill Sets: * Data Science * Python, PySpark, Databricks * BigData on GCP * Time series forecasting * Revenue forecasting * Data Extraction and Automation Qualification in...
Maintaining Sc Finder App. will fix any future bugs that may appear will also maintain the scalability also including minor changes only
I need a freelancer to design a captivating flyer to promote an upcoming event. The tone should swing towards fun and energetic, perfectly resonating with the lively nature of the event. Here's what I am looking for in this project: You've asked f...flyer to promote an upcoming event. The tone should swing towards fun and energetic, perfectly resonating with the lively nature of the event. Here's what I am looking for in this project: You've asked for it, and here it is! Artful Foodie and Iris Suber Events proudly present Champagne and Charcuterie! The Details! Saturday April 20, 2024 @12:00 The Social Suite 114 East Earle Street Anderson, SC 29621 Get ready for a fun filled afternoon and learn how to impress your guests with beautifully designed Charcuter...
Hello freelancers, I am looking for a designer to create a logo for my Charleston-based tour company that specializes in Civil War history. The name if the company is Big Red Tours. The logo should of course include the company name and have the Civil War Battle Flag - (South Carolina Flag Red). This client specializes in historic walking and private tours in Charleston, SC. The walking tours are downtown Charleston, SC and the private tours are at the Citadel. Top Desired Elements: • The design should feature the battle flag of the Civil War era, particularly the iconic red South Carolina flag. • The logo needs to incorporate some elements of Charleston's skyline or a historic landmark, both of which are significant to our brand and contribute to the ed...
I am looking for a developer to create an AWS Glue and Pyspark script that will strengthen the data management of my project. The task involves moving more than 100GB of text data from a MySQL RDS table to my S3 storage account, on a weekly basis. Additionally, the procured data needs to be written on parquet files, for easy referencing. The developer will also need to send scripts to deploy the AWS Glue pipelines on Terraform, fitting all parameters. Skilled expertise in AWS Glue, PySpark, Terraform, MySQL and experience in handling large data is required. There is no compromise on the quality and completion timeline. Effective performance on this project will open doors to more work opportunities on my various projects.
Hi We developed a new form of "stable coin", that we want to develop, market and launch, as an NFT and sister Defi Token We are funded, with a strong and unique product offering, and no competition We are also aiming for full regulation and compliance, as our SC, will be the footprint for Bank & Institutional CBDC's Ideally we need the full spectrum of a team, but individual skills will be considered, however, we need devs that are fully docx'd and visible and daily voice and video calls in english to GMT Please reply, with proof of experience and portfolio
I am seeking a skilled professional proficient in managing big data tasks with Hadoop, Hive, and PySpark. The primary aim of this project involves processing and analyzing structured data. Key Tasks: - Implementing Hadoop, Hive, and PySpark for my project to analyze large volumes of structured data. - Use Hive and PySpark for sophisticated data analysis and processing techniques. Ideal Skills: - Proficiency in Hadoop ecosystem - Experience with Hive and PySpark - Strong background in working with structured data - Expertise in big data processing and data analysis - Excellent problem-solving and communication skills Deliverables: - Converting raw data into useful information using Hive and Visualizing the results of queries into the graphical representation...
...currently searching for an experienced AWS Glue expert, proficient in PYsPARK with data frames and Kafka development. The ideal candidate will have: • Expertise in data frame manipulation. • Experience with Kafka integration. • Strong PYsPARK development skills. The purpose of this project is data integration, and we will be primarily processing data from structured databases. The selected freelancer should be able to work with these databases seamlessly, ensuring efficient and effective data integration using AWS Glue. The required work would involve converting structured databases to fit into a data pipeline, setting up data processing, and integrating APIs using Kafka. This project requires a strong background in AWS Glue, PYSPARK, data frame ...
