Experience
Salary
Location
Responsibilities:
Microsoft Fabric Integration: Leverage Microsoft Fabric components (such as Lakehouse, Warehouse or ML models) to create resilient, standardised data pipelines. o Data Mesh Implementation: Collaborate with cross-functional teams to implement data mesh principles, including providing best practices and templates for decentralized data processing taking different data domain skill levels into account. o Data Pipeline Development: Design, optimize, and manage ETL pipelines for ingesting, transforming,and loading data from various sources according to our standardized medallion architecture o Database Management: Implement and maintain databases (SQL, NoSQL) to store structured and unstructured data. o Performance Optimization: Optimize data processing performance using Microsoft Fabric’s distributed architecture. o Data Governance and Security: Ensure compliance with data privacy regulations and implement security measures.
Experience:
• 3+ years of practical experience as a full-time data engineer or business intelligence developer in a fast-paced environment
• Prior work as part of an agile and interdisciplinary team within a startup or an international corporate Mandatory Capabilities:
• Microsoft Fabric Expertise: In-depth knowledge of Microsoft Fabric and its components (or Azure Synapse) and their application in data engineering.
• Data Modelling & Access: Deep know how in modelling data across medallion layers and providing data products
• Problem-Solving: Ability to troubleshoot complex data engineering challenges
• Collaboration: Effective communication and teamwork skills and experience in agile methods Beneficial Capabilities:
• Data Mesh Principles: Understanding of domain-driven design, data product thinking, and decentralized data ownership
• Big Data Technologies: Exposure to big data technologies (Hadoop, Spark) within the Microsoft ecosystem
• Real-Time Data Processing: Familiarity with streaming platforms (Azure Stream Analytics, Kafka)
• Machine Learning Integration: Knowledge of integrating ML pipelines with data mesh architecture
• DevOps Practices: Experience with containerization (Docker, Kubernetes) and CI/CD pipelines Personality:
• Proactive and self-driven, always looking for ways to improve and innovate • Structured, independent and goal-oriented approach in working
• Great team working and communication skills • Service oriented hands-on mentality • Passionate for digital technology, staying updated with the latest trends Qualification: • Bachelor's or Master's degree in Computer Science, Information Technology, or a related discipline • International experience good to have Miscellaneous: • 100% availability at our local office in Malad, MumbaI.
DataMesh Engineer
IT-ITeS
IT Services
Full Time
Bachelor Degree
Work From Office
Vysystems
Join the Vysystems team as a Full Time Network Engineer on Erekrut, specializing in Network Engineer in the IT...
15-25 Lakhs
7-10 Years
Tamil Nadu..
Associate
Jobillusplus
Join the Jobillusplus team as a Full Time International Support on Erekrut, specializing in International Sup...
3-6 Lakhs
1-3 Years
Maharashtr..
Customer Sup...
International BPO
Join the International BPO team as a Full Time Customer Service Associate on Erekrut, specializing in Customer...
3-6 Lakhs
0-1 Years
Maharashtr..
ITES / BPO
Winwire Technologies
Join the Winwire Technologies team as a Full Time Azure Lead Data Engineer on Erekrut, specializing in Azure L...
15-25 Lakhs
11-15 Years
Karnataka-..
IT / Softwar...
Shashwath Solution
Join the Shashwath Solution team as a Full Time Sr. Python Developer on Erekrut, specializing in Sr. Python De...
Confidential
4-6 Years
Karnataka-..
Program Deve...
Walk Out Counsultanty
Join the Walk Out Counsultancy team as a Full Time RPA Developer on Erekrut, specializing in RPA Developer i...
10-15 Lakhs
4-6 Years
Karnataka-..
Program Deve...
Your Corporate Life
Join the Your Corporate Life team as a Full Time Manager Data Engineering DE on Erekrut, specializing in Manag...
25-50 Lakhs
7-10 Years
Karnataka-..
Data Analyst