Job Description

My client, a premier international software development company is looking out for a Staff/Lead Data Engineer to join their team.
The incumbent will be supporting the product team, data analysts and business team on desiging,leading and implementing a data architecture that can provide reliable data systems and clean data. Job Responsibilities:

• Identifying patterns in code and refactor them into modules that are easy to extend / reuse
• Creating and ensuring that guidelines to uphold and maintain the quality of the codebase and system is being adhered to by the team, and lead the way in doing so
• Making calls on when to take up tech debt, vs paying it off, and ensuring that we’re maintaining healthy levels of debt
• Creating reusable and extensible automation test suite that makes it easy for the team to add, and maintain a robust test suite for all services and pipelines

• Working with product and analytics teams and the engineering manager to understand the business, technical direction and make system/architecture decisions that support longer term needs and extensibility of the data architecture
• Evaluating SaaS and PaaS platforms that can be used to solve parts of the data architecture and integrate them into the architecture
• Providing subject matter expertise with designing the pipelines to be efficient and scalable to grow with the 3 Vs of Data (volume, velocity and variety), as well as with data modeling

Job Requirements:

• 8-12+ years of experience in developing professional grade software. This includes

o 6-8+ years of experience in data engineering
o Strong knowledge of software concepts, design patterns, refactoring and automated testing
o Great judgment and diligence to know what patterns to use, when and where, and are able to confidently hold constructive conversations on it with the team, and peers

• Advanced SQL knowledge and experience working on query optimization, data modeling in Data Lake and Data Warehouse architectures
• Advanced knowledge and experience building and scaling both batch and streaming pipelines, and challenges that come with it

• Experience establishing Data Governance policies and practices
• Added advantage if you have experience working with Delta Lake, Streaming-only architectures, Data Marts and operationalising ML Models.

How to Apply Interested applicants may apply by sending in your updated résumé (in MS Word format) to my email or apply directly:
Consultant: Tan Jun Jie
EA personnel reg. no.R1878852
EA License No. 17C8502