Experience
Salary
Location
What You'll Do :
- Design and implement data management services for data trust, data compliance, data access, and metadata management in the form of scalable and configurable while clearly articulating the technical rationale behind your design and implementation choices
- Selecting and integrating any Big Data tools and frameworks required to provide requested capabilities
Implementing ELT processes
- Monitoring performance and advising any necessary infrastructure changes
- Build data platforms and services to handle both real-time and batch processing of large data sets.
- Take end-to-end ownership of the design and implementation of core product functionality and key technical initiatives.
You are perfect for the role if you have :
- 3 to 8 years of data engineering experience in a fast-paced company that delivers software a deep understanding of designing and building highly scalable Data warehouses and Data pipelines.
- Hands-on Experience in SQL, Java/Scala programming languages.
- Deep understanding of Apache Spark, Spark tuning, creating RDDs, and building data frames.
- Create Java/Scala Spark jobs for data transformation and aggregation.
- Experience in building distributed environments using any of Kafka, Spark, Hive, Hadoop, etc.
- Good understanding of the architecture and functioning of Distributed database systems
- Experience working with various file formats like Parquet, Avro, etc for large volumes of data
- Experience with one or more NoSQL databases
- Strong understanding of engineering best practices and design principles
Data Engineer
Software Development
B2B
Full Time
Bachelor Degree
Work From Office
Risk Resources LLP
Join the Risk Resources LLP team as a Full Time Python Developer –API Platform on Erekrut, specializing in P...
10-15 Lakhs
4-6 Years
Karnataka-..
IT / Softwar...
Proconnxt
Join the Proconnxt team as a Full Time Lead backend Engineer on Erekrut, specializing in Lead backend Engineer...
25-50 Lakhs
7-10 Years
Karnataka-..
Software Dev...
Raadm
Join the Raadm team as a Full Time Flutter Developer on Erekrut, specializing in Flutter Developer in the IT-I...
3-6 Lakhs
0-1 Years
Karnataka-..
Program Deve...
Freshers
Join the Freshers team as a Full Time Talent Acquisition Executive on Erekrut, specializing in Talent Acquisit...
0-3 Lakhs
0-1 Years
Karnataka-..
HR/ Human Re...
Teamlease
Join the staffing team as a Full Time field sales exicutive on Erekrut, specializing in field sales exicutiv...
3-6 Lakhs
0-1 Years
Karnataka-..
Field Execut...
Homzinterio
Join the Homzinterio team as a Full Time Senior Interior Designer on Erekrut, specializing in Senior Interior...
3-6 Lakhs
1-3 Years
Karnataka-..
Interior Des...
Object IT
Join the Object IT team as a Full Time Customer Support on Erekrut, specializing in Customer Support in the HR...
0-3 Lakhs
0-1 Years
Karnataka-..
Customer Sup...
Talent Trackers
Join the leadssquare team as a Full Time Product Support Engineer on Erekrut, specializing in Product Support ...
6-10 Lakhs
1-3 Years
Karnataka-..
Customer Sup...