Data Engineer
Experience
Salary
Location
Job Description
What You'll Do :
- Design and implement data management services for data trust, data compliance, data access, and metadata management in the form of scalable and configurable while clearly articulating the technical rationale behind your design and implementation choices
- Selecting and integrating any Big Data tools and frameworks required to provide requested capabilities
Implementing ELT processes
- Monitoring performance and advising any necessary infrastructure changes
- Build data platforms and services to handle both real-time and batch processing of large data sets.
- Take end-to-end ownership of the design and implementation of core product functionality and key technical initiatives.
You are perfect for the role if you have :
- 3 to 8 years of data engineering experience in a fast-paced company that delivers software a deep understanding of designing and building highly scalable Data warehouses and Data pipelines.
- Hands-on Experience in SQL, Java/Scala programming languages.
- Deep understanding of Apache Spark, Spark tuning, creating RDDs, and building data frames.
- Create Java/Scala Spark jobs for data transformation and aggregation.
- Experience in building distributed environments using any of Kafka, Spark, Hive, Hadoop, etc.
- Good understanding of the architecture and functioning of Distributed database systems
- Experience working with various file formats like Parquet, Avro, etc for large volumes of data
- Experience with one or more NoSQL databases
- Strong understanding of engineering best practices and design principles
Designation
Data Engineer
Key Skills
Industry
Software Development
Functional Area
B2B
Employment Type
Full Time
Education
Bachelor Degree
Job Type
Work From Office
Related Jobs
HK Executive, Steward
Quess Corp
Join the Reliance, R-Media, Workshala team as a Full Time HK Executive, Steward on Erekrut, specializing in HK...
0-3 Lakhs
0-1 Years
Karnataka-..
Hotels / Hos...
HR Supervisor And Executive
ACS Group
Join the ACS Group team as a Full Time HR Supervisor and Executive on Erekrut, specializing in HR Supervisor a...
3-6 Lakhs
1-3 Years
Delhi-New ..
HR/ Human Re...
Financial Service Consultant
ICICI Prudential Private Limited
Join the ICICI Prudential Private Limited team as a Full Time Financial Service Consultant on Erekrut, speci...
0-3 Lakhs
1-3 Years
Karnataka-..
Sales
Sales Consultant
Lavish Holidays
Join the Lavish Holidays team as a Full Time Sales Consultant on Erekrut, specializing in Sales Consultant in ...
0-3 Lakhs
0-1 Years
Karnataka-..
Sales
Video Editor And Animator
9MediaOnline
Join the 9MediaOnline team as a Full Time Video Editor and Animator on Erekrut, specializing in Video Editor a...
6-10 Lakhs
1-3 Years
Karnataka-..
Advertising
Relationship Manager
Optimhire
Join the Optimhire team as a Full Time Relationship manager on Erekrut, specializing in Relationship manager ...
6-10 Lakhs
4-6 Years
Karnataka-..
Marketing, M...
Join the tcs team as a Full Time sa fico end user on Erekrut, specializing in sa fico end user in the Accounts...
0-3 Lakhs
0-1 Years
Karnataka-..
Software Dev...
Male Field Sales Executive
PORClean India Private Limited
Join the PORClean India Private Limited team as a Full Time Field Sales Executive on Erekrut, specializing in...
0-3 Lakhs
1-3 Years
Chandigarh..
Field Execut...