SENIOR DATA ENGINEER

Experience

11-15 Years

Salary

15-25 Lakhs

Location

Tamil Nadu-Chennai
Posted - 108 days ago
Applications - 2
Vacancies- 15
We are seeking a highly skilled Senior Data Engineer to design, develop, and maintain robust data pipelines that extract, transform, and load data from disparate applications into our Azure-based data platform. The ideal candidate will have a strong foundation in data engineering principles, a deep understanding of cloud technologies, and a passion for solving complex data challenges.
Job Description

Roles and Responsibilities

  • Design and develop scalable and efficient data pipelines using Azure Data Factory, Azure Databricks, Kafka, and other relevant tools.
  • Extract data from various applications using APIs, webhooks, or other methods.
  • Ingest and process real-time data streams using Kafka.
  • Transform and clean data to ensure data quality and consistency.
  • Load data into ADLS Gen2 in optimized formats (e.g., Parquet, Delta Lake).
  • Build and maintain data models and schemas.
  • Collaborate with data analysts and business stakeholders to understand data requirements and deliver actionable insights.
  • Optimize data pipelines for performance and cost-efficiency.
  • Implement data governance and security best practices.
  • Mentor junior data engineers and provide technical guidance.

Skills and Qualifications

  • Strong proficiency in Python, Scala, or Java programming languages.
  • Expertise in data engineering tools and technologies such as Azure Data Factory, Azure Databricks, ADLS Gen2, Kafka, and Delta Lake.
  • Experience with cloud computing platforms, preferably Azure.
  • Knowledge of data modelling, ETL/ELT processes, data warehousing, and real-time data processing concepts.
  • Strong problem-solving and analytical skills.
  • Ability to work independently and as part of a team.
  • Excellent communication and interpersonal skills.
  • Bachelor's degree in computer science, engineering, or a related field.

Preferred Qualifications

  • Knowledge of machine learning and AI concepts.
  • Certifications in Azure or related technologies.
  • Experience with Node.js, Java or .NET Core for developing connector APIs.

Must-Have Technologies

  • Python
  • Scala or Java
  • Azure Data Factory
  • Azure Databricks
  • ADLS Gen2
  • Kafka
  • Delta Lake
  • SQL

This role offers a unique opportunity to work on challenging data engineering projects and contribute to the growth of our data-driven organization.

Designation

SENIOR DATA ENGINEER

Key Skills
.NET CoreAzureAzure Data bricksAzure Data LakeAzure Data Lake Storagedata warehousingETL ProcessesJavaNode.jsPythonSCALASQLSQL Azure
Industry

Software Development

Functional Area

Technology, Information and Internet

Employment Type

Full Time

Education

Bachelor Degree

Job Type

Work From Office

Related Jobs
Field Sales

LIVE CONNECTIONS PLACEMENTS PVT LTD

3-6 Lakhs

0-1 Years

Tamil Nadu..

Sales

Vacancies - 15 Candidates Applied - 2
CallCallsEffective

10-15 Lakhs

4-6 Years

Karnataka-..

Computer and...

Vacancies - 15 Candidates Applied - 2
AWSAZ-900Azure
Medical Representative

Inex Medicaments Private Limited

0-3 Lakhs

0-1 Years

Tamil Nadu..

Sales & ...

Vacancies - 15 Candidates Applied - 2
CommunicationMedicalNegotiating
Home Loan Sales Executive

LIVE CONNECTIONS PLACEMENTS PVT LTD

0-3 Lakhs

1-3 Years

Tamil Nadu..

Sales & ...

Vacancies - 15 Candidates Applied - 2
BankingFieldLoan

Confidential

0-1 Years

Tamil Nadu..

Healthcare

Vacancies - 15 Candidates Applied - 2
GeneralMDMD

15-25 Lakhs

4-6 Years

Tamil Nadu..

IT / Softwar...

Vacancies - 15 Candidates Applied - 2
APICloudMuleSoft

3-6 Lakhs

0-1 Years

Tamil Nadu..

Sales

Vacancies - 15 Candidates Applied - 2
CustomerCustomerEffective
Customer Support

LIVE CONNECTIONS PLACEMENTS PVT LTD

0-3 Lakhs

0-1 Years

Tamil Nadu..

Customer Sup...

Vacancies - 15 Candidates Applied - 2
CustomerCustomerCustomer
© 2019-24 Erekrut HR Automation Solutions Private Limited
https://filexray.com/ http://braze.dmit.co.th/ https://expertechinternational.com/ mega4d mega4d https://linkmega4d.id/ https://mega4dweb.id/ mega4d https://www.omenubio.fr mega4d mega4d mega4d mega4d https://alonabondarenko.org/ https://www.amicideimusei.org/ http://astraviec.org/ https://www.bdtlb.org/ https://beautynetworkindia.com/ https://www.boisleux-saint-marc.com/ https://caledonia-village.com/ https://certapropainterscomplaints.com/ https://chagosconservationtrust.org/ https://citasonlinegratis.com/ https://codeliverance.org/ https://diocesisdetacambaro.mx/ https://directyourpower.com/ https://www.disbudparmaluku.org/ https://www.frightnightsky.com/ https://www.gmniyogyakarta.com/ https://gobibrighton.com/ https://www.hhsnopek.com/ https://www.homeguardsales.com/ https://ian-harding.org/ https://www.ibupintargopay.com/ https://jayesun4uscongress.com/ https://www.jessicabiggsdesign.com/ https://kesultananbanjar.com/ https://kofcwhiteakeragency.com/ https://www.lasberlanas.com/ https://moamie.com/ https://www.mresidencejogja.com/ https://nomadinparis.com/ https://www.opstinabijeljina.com/ https://www.paparazzieyeinthedark.com/ https://profimatics.com/ https://purbakalajawatengah.org/ https://www.roslynflowers.com/ https://www.saintgermaindemarencennes.org/ https://santamariadelaisla.com/ https://www.senatusjakarta.org/ https://shought.com/ http://sporcasinoadres.com/ https://standupdepok.com/ https://super-suplementos.com/ https://thedigitalken.com/ https://www.thinkbigtaguig.com/ https://tkohomerevival.com/ https://tunisianembassyjakarta.com/ https://undemocracy.org/ link daftar mega4d mega4d mega4d prediksi togel situs toto