SENIOR DATA ENGINEER

Experience

11-15 Years

Salary

15-25 Lakhs

Location

Tamil Nadu-Chennai
Posted - 94 days ago
Applications - 2
Vacancies- 15
Join the IT, Software, Analytics team as a Full Time SENIOR DATA ENGINEER on Erekrut, specializing in SENIOR DATA ENGINEER in the Software Development industry. We are seeking talented individuals with a passion for Technology, Information and Internet and educational qualifications ranging from 11-15 Years. Apply now on Erekrut to take the next step in your career with a leading global company.
Job Description

Roles and Responsibilities

  • Design and develop scalable and efficient data pipelines using Azure Data Factory, Azure Databricks, Kafka, and other relevant tools.
  • Extract data from various applications using APIs, webhooks, or other methods.
  • Ingest and process real-time data streams using Kafka.
  • Transform and clean data to ensure data quality and consistency.
  • Load data into ADLS Gen2 in optimized formats (e.g., Parquet, Delta Lake).
  • Build and maintain data models and schemas.
  • Collaborate with data analysts and business stakeholders to understand data requirements and deliver actionable insights.
  • Optimize data pipelines for performance and cost-efficiency.
  • Implement data governance and security best practices.
  • Mentor junior data engineers and provide technical guidance.

Skills and Qualifications

  • Strong proficiency in Python, Scala, or Java programming languages.
  • Expertise in data engineering tools and technologies such as Azure Data Factory, Azure Databricks, ADLS Gen2, Kafka, and Delta Lake.
  • Experience with cloud computing platforms, preferably Azure.
  • Knowledge of data modelling, ETL/ELT processes, data warehousing, and real-time data processing concepts.
  • Strong problem-solving and analytical skills.
  • Ability to work independently and as part of a team.
  • Excellent communication and interpersonal skills.
  • Bachelor's degree in computer science, engineering, or a related field.

Preferred Qualifications

  • Knowledge of machine learning and AI concepts.
  • Certifications in Azure or related technologies.
  • Experience with Node.js, Java or .NET Core for developing connector APIs.

Must-Have Technologies

  • Python
  • Scala or Java
  • Azure Data Factory
  • Azure Databricks
  • ADLS Gen2
  • Kafka
  • Delta Lake
  • SQL

This role offers a unique opportunity to work on challenging data engineering projects and contribute to the growth of our data-driven organization.

Designation

SENIOR DATA ENGINEER

Key Skills
.NET CoreAzureAzure Data bricksAzure Data LakeAzure Data Lake Storagedata warehousingETL ProcessesJavaNode.jsPythonSCALASQLSQL Azure
Industry

Software Development

Functional Area

Technology, Information and Internet

Employment Type

Full Time

Education

Bachelor Degree

Job Type

Work From Office

Related Jobs
PHP Developer

Crayon Infotech

0-3 Lakhs

1-3 Years

Maharashtr..

Software Dev...

Vacancies - 15 Candidates Applied - 2
AWSAWSAzure

10-15 Lakhs

1-3 Years

Work from ..

IT / Compute...

Vacancies - 15 Candidates Applied - 2
.NET.NET.NET

3-6 Lakhs

1-3 Years

Tamil Nadu..

IT / Softwar...

Vacancies - 15 Candidates Applied - 2
AndroidAppApplication
Devops Engineer

HR Recruiter

10-15 Lakhs

4-6 Years

Karnataka-..

Program Deve...

Vacancies - 15 Candidates Applied - 2
AWSAWSAWS

10-15 Lakhs

7-10 Years

Karnataka-..

IT

Vacancies - 15 Candidates Applied - 2
AdvancedAzureAzure
UI Developer

Aroha Group

10-15 Lakhs

7-10 Years

Karnataka-..

Software Dev...

Vacancies - 15 Candidates Applied - 2
AmazonAzureAzure

15-25 Lakhs

7-10 Years

Karnataka-..

IT / Softwar...

Vacancies - 15 Candidates Applied - 2
.NET.NET.NET
Senior Full Stack Developer

Mounee Consulting Service

25-50 Lakhs

4-6 Years

Telangana-..

IT

Vacancies - 15 Candidates Applied - 2
.NET.NET.NET
© 2019-24 Erekrut HR Automation Solutions Private Limited