Data Infrastructure Engineer
Experience
Salary
Location
Job Description
Job Description
Title: Senior Data Infrastructure Engineer
About the role
- As a Senior Data Infrastructure engineer, you will be working with Data Engineering, Analyst
- and Operations teams to build and maintain a secure, scalable and reliable data platform that
- powers our Enterprise Data Hub. The position requires thorough working knowledge of public
- cloud, big data fundamentals, excellent programming skills, experience with relational & non-
- relational databases, containerization, IAM & networking security and troubleshooting.
What You'll Do
Responsible for building and managing our cloud infrastructure (AWS) with code first
mindset.
Design and architect ETL/ELT pipelines running on AWS EMR and Snowflake
Performance tune data pipelines using technologies such as Apache Spark, Hive and Trino
Write and maintain high-quality code and participate in design discussions and code reviews.
Implement data storage solutions such as S3, ERDS and NoSQL databases.
Automate workflows using orchestration systems like airflow, oozie etc.
Build monitoring and observability dashboards.
Cost optimization and management.
Enforce security (create and maintain users and roles, assign privileges), establish procedures to ensure data integrity and availability.
Perform on-call duties to keep the lights up 24x7.
Setup and maintain documentation and standards.
About you
BS degree in Computer Science or equivalent
5+ years experience on public cloud such as AWS (preferred), Azure or GCP
Solid programming skills in Java or Python and Shell
Hands-on with Infrastructure as Code tools like Terraform or CloudFormation
Experience with performance diagnostics, debugging and performance tuning.
Familiarity with container software & platforms like Kubernetes, ECS etc.
Excellent verbal, written and interpersonal communication
Designation
Data Infrastructure Engineer
Key Skills
Industry
IT-ITeS
Functional Area
IT Services
Employment Type
Full Time
Education
Graduation/Diploma
Job Type
Work From Office
Related Jobs
Network & Digital Marketin...
International USA MNC
Join the International USA MNC team as a Full Time Network & Digital Marketing at Erekrut, specializing in Be...
0-3 Lakhs
0-1 Years
Pan India
AWS
BDA
For BDA Position, We Preferred Only Those Candidate Who Are Interested In Pursuing An MBA Along With Job
Join the for Twoss Learning Pvt Ltd team as a Full Time BDA on Erekrut, specializing in BDA in the Education i...
6-10 Lakhs
0-1 Years
Pan India
AWS
Winter Internship For Freshers
My Nonu
Join the My Nonu Pvt Ltd. team as a Internship Winter Internship for Freshers on Erekrut, specializing in Wint...
0-3 Lakhs
0-1 Years
Delhi-Cent..
AWS
Freelance Trainer
Freelance
Join the Freelance team as a Part Time Freelance Trainer on Erekrut, specializing in Freelance Trainer in the ...
0-3 Lakhs
4-6 Years
Pan India ..
AWS
Work From Home
Health And Wellness
Join the Health and wellness team as a Full Time Work from home on Erekrut, specializing in Work from home ...
0-3 Lakhs
0-1 Years
Pan India
AWS
