Data Engineering opportunity to join the Financial Services industry as a Senior/Lead Data Engineer. Designing and Developing complex Data pipelines.
Responsilibilities
Partner with teammates to create complex data processing pipelines in order to solve complex challenges
Follow best practices for Data Architecture and Design Patterns for Data Engineering Use-Cases.
Design, Develop and Maintain: * Real-time data feeds from database sources like MySQL, Oracle, and MS SQLServer
Sub-Second Real-Time Data Pipelines using AWS Kinesis, Glue, Spark, Kinesis, Lambda .
Code Repo Pipeline to automate Continuous Integration and Continuous Deployment (CI / CD).
Running Containerized ETL workflow at scale.
Requirements
Bachelor Degree of Computer Science, IT or equivalent.
6 Years of data engineering experience with team leading/guiding/mentoring experience
Advance knowledge of Python and SQL.
Sound knowledge in running a data processing pipelines on either of these: Google BigQuery, Redshift, Hadoop, Presto, Spark, or KSQ
Good understanding of how Kubernetes clusters work and scale on-demand.
Have Good Interpersonal and Presentation Skills to explain and promote Best Practices across the organization with both technical as well as non-technical stakeholders.
Those who are keen for the role and would like to discuss the opportunity further, please click "Apply Now" or email Kin Long at kfok@morganmckinley.com with your updated CV.
Only shortlisted candidates will be responded to, therefore if you do not receive a response within 14 days, please accept this as notification that you have not been shortlisted.
Morgan McKinley Pte Ltd EA Licence No: 11C5502 | EAP Registration No: R2095054
Beware of fraud agents! do not pay money to get a job
MNCJobz.com will not be responsible for any payment made to a third-party. All Terms of Use are applicable.