Sr Data Engineer

Hi there! My name is Mayank and I'm a fast growing freelancer. I understand that you're looking for a Sr Data Engineer to help with your project of moving ETL jobs from existing AB Initio systems to AWS Cloud. With my experience in data structures, AWS, spark SQL and NoSQL databases, along with software development skills in Pyspark I believe I am the perfect fit for this project. Plus I have experience building and deploying cloud-based solutions at scale as well as developing Big Data solutions (migration storage processing). I'm confident that my technical roadmap, challenges and mitigation strategies will be able to deliver the required results for your project. In addition to this, I'm also experienced in design dimensional models for data warehouses and data marts as well as version control systems build automation and CI/CD tools frameworks . Finally I offer good payment terms and availability 24/7 so you can rest assured that you'll get good service with no headaches along the way. Thanks Mayank

Dear Client, We hope this proposal finds you in good health and high spirits. N&T Negocios y Tecnologias s.r.l. is a reputable company with 20 years of experience in the IT industry, specializing in the development of web, mobile, blockchain, and AI projects. We pride ourselves in delivering high-quality solutions to our clients. Having carefully reviewed the requirements for the Sr Data Engineer project, we believe we are well-equipped to handle the tasks and responsibilities outlined. Our team of experienced professionals has a deep understanding of cloud technologies, particularly AWS, and vast expertise in big data solutions, ETL migration, and storage and compute strategies. To ensure the success of the project, we propose the following solutions: 1. Collaborative Approach: We will work closely with cloud engineers and your team to understand and solve big data problems through the development of utilities for migration, storage, and processing on AWS Cloud. 2. Offshore Support: Our offshore team will be delegated specific tasks and responsibilities to efficiently meet project requirements. 3. ETL Migration: We will migrate ETL jobs from the existing AB Initio system to the AWS Cloud, ensuring a smooth transition and minimal disruption to the workflow. 4. Cloud Migration Strategy: Our experts will design and build a robust cloud migration strategy tailored to your specific needs, ensuring seamless integration and optimal performance. 5. Scalable Solutions: We will build tools to handle the ingestion and processing of several terabytes of data per day, ensuring high efficiency and scalability. 6. Next-Gen Solutions: Our team will design and develop cutting-edge storage and compute solutions to meet the needs of large-scale customers, utilizing the latest technologies and best practices. 7. Effective Communication: We will maintain clear and efficient communication channels with various teams, including Infrastructure, DevOps, and cloud customers, to ensure smooth coordination and collaboration throughout the project. 8. Automation and Efficiency: We will build advanced tooling for automation, testing, monitoring, administration, and data operations to optimize performance and productivity across multiple cloud clusters. In terms of required skills, our team possesses: - 4+ years of hands-on experience in data structures, AWS, Spark, SQL, and NoSQL databases. - Strong software development skills in Pyspark. - Extensive experience in building and deploying cloud-based solutions at scale. - Proficiency in developing Big Data solutions, including migration, storage, and processing. - Expertise in SQL and query optimization. - Exceptional ability to communicate

Hi there, I hope this message finds you well. I am reaching out to express my interest in the role and responsibilities mentioned. With over several years of experience in data structures, AWS, Pyspark, and SQL, I have a strong background in developing and deploying cloud-based solutions at scale, including migration, storage, and processing of big data. I have successfully designed and implemented ETL pipelines using AWS Glue and Redshift. Here are a few examples of my relevant experience. I look forward to discussing the details further and showcasing my expertise. Thank you, Jyoti

Hello greetings, After going through your project description, I feel confident and excited to work on this project for you. But I have some important things and queries to clear out. Can you please leave a message on chat, so that we can discuss and I can share my recent work which is similar to your requirements? Thanks for your time! I look forward to hearing from you soon. Best Regards

I understand that you are looking for a Sr Data Engineer to help you with your project. I believe that I am the most qualified candidate for this position due to my extensive experience in data structures, AWS, spark and NoSQL databases as well as software development. I have 4+ years of experience in hands-on in data structures andAWS Cloud. This has given me the ability to develop utilities for migration, storage and processing on AWS Cloud. Additionally, I am skilled in software development life cycles and Agile programming methodologies which will be useful for understanding your requirements from the clients and for delegating it to the offshore team. Furthermore, I have experience in building and deploying cloud-based solutions at scale which will be required for solving for big data problems. Additionally, I am proficient in Java IDE tools such as NetBeans and IntelliJ IDEA which will be useful for developing & amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amping;& amp; amp; amp; amp; amp; amp; amp <a href="http://tenderloin

Hi, I have reviewed the project details and understand your requirement of a Python, PySpark developer who has expertise in Data Pipeline and ETL. I am capable of completing this task in a timely and cost-effective manner. Let's connect and discussion more on it. Short Into about Me: Currently working in one of the Big4 Companies and solving Big Data Business problem using AWS Cloud and Pyspark Engine. I have expertise on the following Tools/Technologies: - Apache Spark (PySpark) - Python3, unit test script, Numpy, Pandas - AWS Cloud Services (EMR, DynamoDB, S3, Glue Lambda, EBS, Athena, IAM, Step function, EC2, ECS, secret manager (kms), s3, sns, ses, sqssqs, cloudwatch etc) - Creation of cloud formation templates for various AWS Services - CI/CD Pipelines - SQL/MySQL - Git, GitHub, BitBucket - Big Data Pipelines - IBM DB2 - MS Excel, MS Office - PyCharm, VSCode, Databricks, Jupyter Notebook, MS Excel, Putty Please provide more details if it's more than what you have given in the project details. Thank you! Thanks & Regards, Prakash

Hi, I can create Sr Data Engineer I am an experienced Web developer and work on crypto currency development and equipped with all the necessary skills to provide you best website that completely satisfies your business needs. Please share your requirements with me over chat so we can proceed further. Best Regards, Neha

Narinder Alliance Technologies LLC USA | Canada | India An IT Consulting and Software Development company. We have a team expert in Software Development, Application Development and Databases. Major offerings include Digital Transformation, Application Development & Maintenance, Enterprise Application Integration, Product Engineering, Business Intelligence, Independent Testing and Infrastructure Management Services. We have worked on various projects across various industry verticals. We are specialized in IT Projects and have a team to handle various applications and provide IT support after the application goes live. We can provide you offshore support from US & India and in US & Europe Timings. We believe in Innovation and R&D. We provide quality Project support after its up and running.

You are looking for a Sr Data Engineer to help you with your project. I understand that you are looking to migrate ETL jobs from your existing AB Initio system to AWS Cloud and design and build a cloud migration strategy. Additionally, you need tools to ingest and jobs to process several terabytes per day. You also need to design and develop next-gen storage and compute solutions for several large customers. I have 4+ years of experience in data structures, AWS, spark, SQL and NoSQL databases and have strong software development skills in Pyspark. With my extensive experience in data migration, storage and processing I am able to provide the best solution for your project needs. I would be delighted if you could contact me for more information about this project!

I have 5 years of experience in building data pipelines for major MNC companies. Let's connect to understand this better. I have experience on leading a data team. Have knowledge on various cloud tools and big data tools. I can say this with very high confidence that i will be able to do this work within the given timeline effieciently. I have expertise in pyspark, python, sql and various AWS services.

Hi Greetings! We are team of software developers. We have developers working on almost all the technologies. We will assign you a project manager who will assist you during entire process of project completion. We will provide you fast,timely and on time delivery with reasonable and minimum cost. We are a registered company located in Indore,India. We are available right now for the project discussion and can start the project on an immediate basis. We have understood your project requirement We have 9 ++ years of experience in design and development. We can handle projects from small styling to full development from scratch. We will provide a good result in a short time and satisfy you fully. We have experienced developers in Python AWS Lambda ETL Ab Initio PySpark WHY-Us: » Ready to Start on Immediate basis &provide proper Testing. » Keep your Data & Website Secure: Daily Progress Updates. » You will get 30-days FREE BUG-SUPPORT even after Project-Completion Please come in touch and let's discuss more detail about your task via chat. Project milestones will be decided during chat. Thanks and Regards Tech India

Hi, I have 5+ years of big data engineering experience with Python and Spark. I have a total of 8+ years of professional experience. I am trying out new as a freelancer. I would be happy to go the extra mile to understand your needs and deliver on the requirements. I have team building and managing experience and can help to work out a large project in a scalable and optimized manner. Regards Kushal

• Totally 9 years of overall experience in Web Application Development, BI Dashboards, and ETL. • Experience in Power BI, Pentaho, Core Java, J2EE, PYTHON, MySQL, Oracle, MS SQL Server. • Experience in Pentaho BI dashboards, reports, data-Integration, scheduling reports, schema-workbench, and design studio for XACTION operations. • Experience in AWS ( Lambda, API Gateway, S3, Batch, EC2, Redshift, Workdocs). • Experience in Restful web services. • Experience in JSON and XML. • Experience in the processing API request and response using OAuth 2.0 • Experience in UDP TCP/IP and other aspects of network programming. • Experience in PDFBox, Jasper Report. • Experience in database objects (Stored Procedures, Functions, and Triggers). • Experience in RDBMS Concepts, Dimensional Data Modeling (Star Schema, Fact, and Dimension tables). • Experience in Power BI Dashboard, Reports, Custom Data Connector, DAX, and SSIS. • Experience in installation and configuration of Pentaho, Power BI, and database servers in UNIX and WINDOWS environment.

Hi , I'm kavita Thorat I have 5 years experience as an data engineer. I have hands on knowledge on complex SQL query, pyspark, data bricks, python and AWS service. I work on migration data from sap Hana to SQL and S3 bucket and for that convert SQL query into pyspark. I have hands on experience on AWS service like S3 bucket, lambda, SNS, redshift and AWS glue etc Having good understanding on data warehouse technology and tool. For more information you can go through my profile. Thank you.