DataMesh Engineer
Experience
Salary
Location
Job Description
Responsibilities:
Microsoft Fabric Integration: Leverage Microsoft Fabric components (such as Lakehouse, Warehouse or ML models) to create resilient, standardised data pipelines. o Data Mesh Implementation: Collaborate with cross-functional teams to implement data mesh principles, including providing best practices and templates for decentralized data processing taking different data domain skill levels into account. o Data Pipeline Development: Design, optimize, and manage ETL pipelines for ingesting, transforming,and loading data from various sources according to our standardized medallion architecture o Database Management: Implement and maintain databases (SQL, NoSQL) to store structured and unstructured data. o Performance Optimization: Optimize data processing performance using Microsoft Fabric’s distributed architecture. o Data Governance and Security: Ensure compliance with data privacy regulations and implement security measures.
Experience:
• 3+ years of practical experience as a full-time data engineer or business intelligence developer in a fast-paced environment
• Prior work as part of an agile and interdisciplinary team within a startup or an international corporate Mandatory Capabilities:
• Microsoft Fabric Expertise: In-depth knowledge of Microsoft Fabric and its components (or Azure Synapse) and their application in data engineering.
• Data Modelling & Access: Deep know how in modelling data across medallion layers and providing data products
• Problem-Solving: Ability to troubleshoot complex data engineering challenges
• Collaboration: Effective communication and teamwork skills and experience in agile methods Beneficial Capabilities:
• Data Mesh Principles: Understanding of domain-driven design, data product thinking, and decentralized data ownership
• Big Data Technologies: Exposure to big data technologies (Hadoop, Spark) within the Microsoft ecosystem
• Real-Time Data Processing: Familiarity with streaming platforms (Azure Stream Analytics, Kafka)
• Machine Learning Integration: Knowledge of integrating ML pipelines with data mesh architecture
• DevOps Practices: Experience with containerization (Docker, Kubernetes) and CI/CD pipelines Personality:
• Proactive and self-driven, always looking for ways to improve and innovate • Structured, independent and goal-oriented approach in working
• Great team working and communication skills • Service oriented hands-on mentality • Passionate for digital technology, staying updated with the latest trends Qualification: • Bachelor's or Master's degree in Computer Science, Information Technology, or a related discipline • International experience good to have Miscellaneous: • 100% availability at our local office in Malad, MumbaI.
Designation
DataMesh Engineer
Key Skills
Industry
IT-ITeS
Functional Area
IT Services
Employment Type
Full Time
Education
Bachelor Degree
Job Type
Work From Office
Related Jobs
PHP Developer
Crayon Infotech
Join the Crayon Infotech team as a Full Time PHP Developer on Erekrut, specializing in PHP Developer in the ...
0-3 Lakhs
1-3 Years
Maharashtr..
Software Dev...
.jpg)
Telesales Executive
A2A RECRUITMENT
Join the team as a Full Time Urgently hiring for Telesales Executive: SBI Life Insurance Open Roles: 400+ _- ...
0-3 Lakhs
1-3 Years
Maharashtr..
Telecalling ...
Site Supervisior
Adhijai Manpower Consultancy
Join the Adhijai Manpower Consultancy team as a Full Time Site Supervisior on Erekrut, specializing in Site S...
3-6 Lakhs
4-6 Years
Maharashtr..
Architecture
Network Engineer
Vysystems
Join the Vysystems team as a Full Time Network Engineer on Erekrut, specializing in Network Engineer in the IT...
15-25 Lakhs
7-10 Years
Tamil Nadu..
Associate
International Support
Jobillusplus
Join the Jobillusplus team as a Full Time International Support on Erekrut, specializing in International Sup...
3-6 Lakhs
1-3 Years
Maharashtr..
Customer Sup...
Customer Service Associate
International BPO
Join the International BPO team as a Full Time Customer Service Associate on Erekrut, specializing in Customer...
3-6 Lakhs
0-1 Years
Maharashtr..
ITES / BPO