Lead Data Engineer

Singapore, Singapore

Job Description

Job Summary

  • Singapore
  • Permanent
  • BBBH826056
  • Aug 26, 2022
  • Competitive

Data Engineering opportunity to join the Financial Services industry as a Senior/Lead Data Engineer. Designing and Developing complex Data pipelines.

Responsilibilities
  • Partner with teammates to create complex data processing pipelines in order to solve complex challenges
  • Follow best practices for Data Architecture and Design Patterns for Data Engineering Use-Cases.
Design, Develop and Maintain: * Real-time data feeds from database sources like MySQL, Oracle, and MS SQLServer
  • Sub-Second Real-Time Data Pipelines using AWS Kinesis, Glue, Spark, Kinesis, Lambda .
  • Code Repo Pipeline to automate Continuous Integration and Continuous Deployment (CI / CD).
  • Running Containerized ETL workflow at scale.
Requirements
  • Bachelor Degree of Computer Science, IT or equivalent.
  • 6 Years of data engineering experience with team leading/guiding/mentoring experience
  • Advance knowledge of Python and SQL.
  • Sound knowledge in running a data processing pipelines on either of these: Google BigQuery, Redshift, Hadoop, Presto, Spark, or KSQ
  • Good understanding of how Kubernetes clusters work and scale on-demand.
  • Have Good Interpersonal and Presentation Skills to explain and promote Best Practices across the organization with both technical as well as non-technical stakeholders.
Those who are keen for the role and would like to discuss the opportunity further, please click "Apply Now" or email Kin Long at kfok@morganmckinley.com with your updated CV.

Only shortlisted candidates will be responded to, therefore if you do not receive a response within 14 days, please accept this as notification that you have not been shortlisted.

Morgan McKinley Pte Ltd
EA Licence No: 11C5502 | EAP Registration No: R2095054

Beware of fraud agents! do not pay money to get a job

MNCJobz.com will not be responsible for any payment made to a third-party. All Terms of Use are applicable.


Related Jobs

Job Detail

  • Job Id
    JD1197668
  • Industry
    Not mentioned
  • Total Positions
    1
  • Job Type:
    Full Time
  • Salary:
    Not mentioned
  • Employment Status
    Permanent
  • Job Location
    Singapore, Singapore
  • Education
    Not mentioned