Senior Data Engineer
₹37500-75000 INR
Betalades vid leverans
Job Description: Data Engineer
We are seeking an experienced Data Engineer with a minimum of 5 years of expertise in their field. As a Data Engineer specializing in AWS Glue, you will primarily focus on the review, setup, modification, and continuous improvement of data pipelines. Your proficiency in PySpark, Python, AWS Glue, crawler, SQL, as well as knowledge of SAP and CRM systems, will be instrumental in managing the pipelines between data lakes.
Key Responsibilities:
Review and assess the existing pipelines to ensure their effectiveness and efficiency.
Set up robust data pipelines using AWS Glue, adhering to industry best practices and standards.
Continuously modify and enhance existing pipelines to meet evolving business requirements.
Collaborate with cross-functional teams to identify opportunities for optimizing data integration and transformation processes.
Troubleshoot and resolve any pipeline issues or discrepancies in a timely manner.
Perform data validation, quality assurance, and data integrity checks throughout the pipelines.
Utilize PySpark, Python, SQL, and other relevant tools to implement data transformations and manipulations.
Effectively manage pipelines that involve SAP and CRM systems, ensuring seamless data flow between these systems and data lakes.
Stay up to date with the latest industry trends, technologies, and best practices in data engineering and analytics.
Qualifications and Skills:
Bachelor's degree in Computer Science, Engineering, or a related field. Equivalent work experience will also be considered.
Minimum of 5 years of hands-on experience as a Data Engineer, with a focus on AWS Glue.
Strong proficiency in PySpark, Python, AWS Glue, and SQL for data manipulation and transformation.
Familiarity with SAP and CRM systems, with the ability to integrate them into data pipelines.
Experience in managing data pipelines and workflows using AWS Glue and related tools.
Solid understanding of data warehousing concepts and best practices.
Strong problem-solving and analytical skills, with the ability to identify and resolve data-related issues efficiently.
Excellent communication and collaboration skills, with the ability to work effectively in a team-oriented environment.
Proven ability to adapt to changing priorities and deliver high-quality results within tight deadlines.
AWS certification in Glue or other relevant areas is a plus.
Join our team of skilled professionals and contribute to the successful execution of data engineering projects. Apply now and embark on an exciting journey of driving data-driven insights for our organization.
Projekt-id: #36882844
About the project
13 frilansare har lagt bud på i genomsnitt ₹61500 för det här jobbet
Hi, I will be the best fit for your project as I am a Data Engineer with 5+ years of experience. I would be glad to assist you in the project based on review, setup, modification, and continuous improvement of data Mer
Hello, Thank you for posting this job. I am an experienced data engineer with more than 5 years of expertise in my field. My expertise includes Python, CRM, SAP, Web Crawling, and PySpark, which I believe makes me an Mer
Dear Client, My name is Pankaj and I am a professional full-stack developer with 7 years of experience in this field. With positive reviews and great working capacity, I am serving clients globally. I believe that I Mer
Already have something to show live to show you. Hi there! My name is prakhar and I represent a high-experienced team that has strong skills in mobile IOS and Android development and Website Development. We understand Mer
I am a professional software developer with 8+ years of experience. I have worked on below technologies in these 6 years. 1. Java 2. Python 3. AI 4. Spring 5. Spring boot 6. C,C++ 7. Docker 8. Kubernetes 9. Node js 10. Mer
I understand that you are seeking an experienced Data Engineer with a minimum of 5 years of expertise in their field. As a Data Engineer specializing in AWS Glue, you will primarily focus on the review, setup, modifica Mer
Hii, I am kavita Thorat I have 5+ years of experience as and data engineer. I have hand on knowledge on python, pyspark, AWS service, data bricks and SQL server. I work on end to end projects. I have hands on experienc Mer
Hi I have 8+ years of experience in the industry specialised in data. I’m a complete data engineer with the knowledge to write complex sql queries, perform etl, write stored procedures, create databricks notbooks using Mer
Hi Greetings! We are team of software developers. We have developers working on almost all the technologies. We will assign you a project manager who will assist you during entire process of project completion. We wil Mer
