AWS Data Engineer
Experience
Salary
Location
Job Description
JOB DESCRIPTION:
- AWS Data Engineer with minimum of 5 to 7 years of experience.
- Collaborate with business analysts to understand and gather requirements for existing or new ETL pipelines.
- Connect with stakeholders daily to discuss project progress and updates.
- Work within an Agile process to deliver projects in a timely and efficient manner.
- Design and develop Airflow DAGs to schedule and manage ETL workflows.
- Transform SQL queries into Spark SQL code for ETL pipelines.
- Develop custom Python functions to handle data quality and validation.
- Write PySpark scripts to process data and perform transformations.
- Perform data validation and ensure data accuracy and completeness by creating automated tests and implementing data validation processes.
- Run Spark jobs on AWS EMR cluster using Airflow DAGs.
- Monitor and troubleshoot ETL pipelines to ensure smooth operation.
- Implement best practices for data engineering, including data modeling, data warehousing, and data pipeline architecture.
- Collaborate with other members of the data engineering team to improve processes and implement new technologies.
- Stay up to date with emerging trends and technologies in data engineering and suggest ways to improve the team's efficiency and effectiveness.
Designation
AWS Data Engineer
Key Skills
Industry
IT-ITeS
Functional Area
IT Services
Employment Type
Full Time
Education
Bachelor Degree
Job Type
Work From Office
Related Jobs
Social Media Manager
Squadra Media Pvt. Ltd.
Join the Squadra Media Pvt. Ltd. team as a Full Time Social Media Manager on Erekrut, specializing in Social M...
6-10 Lakhs
4-6 Years
Karnataka-..
Agile Develo...
Sales Manager
Squadra Media Pvt. Ltd.
Join the Squadra Media Pvt. Ltd. team as a Full Time Sales Manager on Erekrut, specializing in Sales Manager i...
Confidential
1-3 Years
Karnataka-..
Agile Develo...
Internship – Webinar
Vijesha IT Services LLP
Join the multiple team as a Internship Internship - webinar at Erekrut, specializing in IT Services and consul...
3-6 Lakhs
0-1 Years
Karnataka-..
Agile Develo...
Regional Sales Manager
Times Microwave Systems
Join the Times Microwave Systems team as a Full Time Regional Sales Manager on Erekrut, specializing in Region...
15-25 Lakhs
11-15 Years
Karnataka-..
Agile Develo...
Client Relationship Manager
Squadra Media Pvt. Ltd.
Join the Squadra Media Pvt. Ltd. team as a Full Time Client Relationship Manager on Erekrut, specializing in L...
6-10 Lakhs
4-6 Years
Karnataka-..
Agile Develo...
BDM- Media Sales
Squadra Media Pvt. Ltd.
Join the Squadra Media Pvt. Ltd. team as a Full Time BDM- Media Sales on Erekrut, specializing in Media Sales ...
Confidential
1-3 Years
Karnataka-..
Agile Develo...
Lead Client Servicing
Squadra Media Pvt. Ltd.
Join the Squadra Media Pvt. Ltd. team as a Full Time Lead Client Servicing on Erekrut, specializing in Client ...
6-10 Lakhs
4-6 Years
Karnataka-..
Agile Develo...
Digital Project Team Leader
Digital Hiring Agency
Join the Team Management team as a Full Time Digital Project Team Leader at Erekrut, specializing in HR Servic...
3-6 Lakhs
0-1 Years
Delhi-New ..
Agile Develo...
