AWS Data Engineer
Experience
Salary
Location
Job Description
JOB DESCRIPTION:
- AWS Data Engineer with minimum of 5 to 7 years of experience.
- Collaborate with business analysts to understand and gather requirements for existing or new ETL pipelines.
- Connect with stakeholders daily to discuss project progress and updates.
- Work within an Agile process to deliver projects in a timely and efficient manner.
- Design and develop Airflow DAGs to schedule and manage ETL workflows.
- Transform SQL queries into Spark SQL code for ETL pipelines.
- Develop custom Python functions to handle data quality and validation.
- Write PySpark scripts to process data and perform transformations.
- Perform data validation and ensure data accuracy and completeness by creating automated tests and implementing data validation processes.
- Run Spark jobs on AWS EMR cluster using Airflow DAGs.
- Monitor and troubleshoot ETL pipelines to ensure smooth operation.
- Implement best practices for data engineering, including data modeling, data warehousing, and data pipeline architecture.
- Collaborate with other members of the data engineering team to improve processes and implement new technologies.
- Stay up to date with emerging trends and technologies in data engineering and suggest ways to improve the team's efficiency and effectiveness.
Designation
AWS Data Engineer
Key Skills
Industry
IT-ITeS
Functional Area
IT Services
Employment Type
Full Time
Education
Bachelor Degree
Job Type
Work From Office
Related Jobs
Medical Representative
Inex Medicaments Private Limited
Join the Inex Medicaments Private Limited team as a Full Time Medical Representative on Erekrut, specializing ...
0-3 Lakhs
0-1 Years
Tamil Nadu..
Sales & ...
Home Loan Sales Executive
LIVE CONNECTIONS PLACEMENTS PVT LTD
Join the banking industry team as a Full Time Home loan Sales executive on Erekrut, specializing in Home loa...
0-3 Lakhs
1-3 Years
Tamil Nadu..
Sales & ...
Sales Executive
Calling24o7
Join the Calling24o7 team as a Full Time Sales Executive on Erekrut, specializing in Sales Executive in the BP...
0-3 Lakhs
1-3 Years
Maharashtr..
Sales
Senior Resident & Professo...
Quench Techno
Join the Quench Techno team as a Full Time Senior Resident & Professor on Erekrut, specializing in Senior Resi...
Confidential
0-1 Years
Tamil Nadu..
Healthcare
MuleSoft Platform Admin
2 COMS
Join the 2 COMS team as a Full Time MuleSoft Platform Admin on Erekrut, specializing in MuleSoft Platform Admi...
15-25 Lakhs
4-6 Years
Tamil Nadu..
IT / Softwar...
Sales Executive
HEPL
Join the Hepl team as a Full Time Sales Executive on Erekrut, specializing in Sales Executive in the HR Serv...
3-6 Lakhs
0-1 Years
Tamil Nadu..
Sales
Customer Support
LIVE CONNECTIONS PLACEMENTS PVT LTD
Join the Live Connections Placements Pvt Ltd team as a Full Time Customer Support on Erekrut, specializing in ...
0-3 Lakhs
0-1 Years
Tamil Nadu..
Customer Sup...
Sales Executive
Sanjay Automobile Engineers Pvt Ltd
Join the Sanjay Hyundai team as a Full Time Sales Executive on Erekrut, specializing in Sales Executive in the...
0-3 Lakhs
1-3 Years
Maharashtr..
Sales