SENIOR DATA ENGINEER
Experience
Salary
Location
Job Description
Roles and Responsibilities
- Design and develop scalable and efficient data pipelines using Azure Data Factory, Azure Databricks, Kafka, and other relevant tools.
- Extract data from various applications using APIs, webhooks, or other methods.
- Ingest and process real-time data streams using Kafka.
- Transform and clean data to ensure data quality and consistency.
- Load data into ADLS Gen2 in optimized formats (e.g., Parquet, Delta Lake).
- Build and maintain data models and schemas.
- Collaborate with data analysts and business stakeholders to understand data requirements and deliver actionable insights.
- Optimize data pipelines for performance and cost-efficiency.
- Implement data governance and security best practices.
- Mentor junior data engineers and provide technical guidance.
Skills and Qualifications
- Strong proficiency in Python, Scala, or Java programming languages.
- Expertise in data engineering tools and technologies such as Azure Data Factory, Azure Databricks, ADLS Gen2, Kafka, and Delta Lake.
- Experience with cloud computing platforms, preferably Azure.
- Knowledge of data modelling, ETL/ELT processes, data warehousing, and real-time data processing concepts.
- Strong problem-solving and analytical skills.
- Ability to work independently and as part of a team.
- Excellent communication and interpersonal skills.
- Bachelor's degree in computer science, engineering, or a related field.
Preferred Qualifications
- Knowledge of machine learning and AI concepts.
- Certifications in Azure or related technologies.
- Experience with Node.js, Java or .NET Core for developing connector APIs.
Must-Have Technologies
- Python
- Scala or Java
- Azure Data Factory
- Azure Databricks
- ADLS Gen2
- Kafka
- Delta Lake
- SQL
This role offers a unique opportunity to work on challenging data engineering projects and contribute to the growth of our data-driven organization.
Designation
SENIOR DATA ENGINEER
Key Skills
Industry
Software Development
Functional Area
Technology, Information and Internet
Employment Type
Full Time
Education
Bachelor Degree
Job Type
Work From Office
Related Jobs
Snowflake & DBT Data Engi...
Greenrich Consulting Ltd.
Join the Greenrich Consulting Ltd. team as a Full Time Snowflake & DBT Data Engineer on Erekrut, specializing ...
15-25 Lakhs
7-10 Years
Karnataka-..
Program Deve...
Senior Data Scientist
Agivant Technologies
Join the Agivant Technologies team as a Full Time Senior Data Scientist on Erekrut, specializing in Senior Dat...
15-25 Lakhs
4-6 Years
Maharashtr..
Data Analyst
Senior BDE
GREYTIP SOFTWARE PRIVATE LIMITED
Join GREYTIP SOFTWARE PRIVATE LIMITED as a Senior BDE in the IT-ITeS industry. This full-time role focuses on ...
6-10 Lakhs
1-3 Years
Tamil Nadu..
Sales
AWS Connect & AWS Pindrop ...
AWS Connect & AWS Pindrop Expert
Join the AWS Connect & AWS Pindrop Expert team as a Full Time AWS Connect & AWS Pindrop Expe on Erekrut, speci...
10-15 Lakhs
7-10 Years
Maharashtr..
IT / Softwar...
Finance Executive
Ezone India
Join the Ezone India team as a Full Time Finance Executive on Erekrut, specializing in Finance Executive in th...
0-3 Lakhs
0-1 Years
Tamil Nadu..
Accounting
Senior RPA Developer
HCL Technologies
Join the HCL Technologies team as a Full Time Senior RPA Developer on Erekrut, specializing in RPA Development...
25-50 Lakhs
4-6 Years
Karnataka-..
Program Deve...
Customer Care Executive
Taurus BPO Services India
Join the Taurus BPO services India team as a Full Time Customer care executive on Erekrut, specializing in C...
0-3 Lakhs
0-1 Years
Tamil Nadu..
Telecalling ...
Join the JumpQ team as a Full Time Machine Learning Engineer on Erekrut, specializing in Machine Learning Engi...
15-25 Lakhs
1-3 Years
Maharashtr..
Information ...