Data Engineer (dart), Data Science & Artificial Intelligence Division

Singapore, Singapore

Job Description


The Government Technology Agency (GovTech) aims to transform the delivery of Government digital services by taking an "outside-in" view, putting citizens and businesses at the heart of everything we do. We also develop the Smart Nation infrastructure and applications and facilitate collaboration with citizens and businesses to co-develop technologies.

Join us as we support Singapore\xe2\x80\x99s vision of building a Smart Nation - a nation of possibilities empowered through info-communications technology and related engineering.

The Data Science & Artificial Intelligence Division partners with public sector agencies to improve policy outcomes, service delivery and operational efficiency by harnessing data science and AI. We extract data-driven insights and build intelligent platforms to add value to the work of our partner agencies. We also help them transform through building data science expertise, formulating data strategies, and setting up the necessary data infrastructure.

How we work:

Outcome Driven \xe2\x80\x93 Our projects are not academic exercises. We are driven by the \xe2\x80\x9cso what\xe2\x80\x9d, and seek to ensure that our findings and models can translate into tangible impact.

Start Small and Move Fast - We build things fast. If it works, we quickly move on to the question of how we can scale it further. If it doesn\xe2\x80\x99t work, what went wrong and what can we do better next time?

Ownership \xe2\x80\x93 You\xe2\x80\x99re not just here to write code. Team members help to figure out what we should be building, and how we should build.

Continuous Learning \xe2\x80\x93 Working on new ideas often means not fully understanding what you are working on. Taking time to learn new architectures, frameworks, technologies, and even languages are not just encouraged, but essential.

In this Together - We draw from the deep domain knowledge of our partners and apply best practices from our community of experts.

As a Data Engineer in GovTech\xe2\x80\x99s Data Science & Artificial Intelligence Division, you will be involved in architecting, managing and running advanced analytics and data platforms. For this role, you will be working in CDO Team within GovTech, where you will help drive GovTech\xe2\x80\x99s Data Transformation efforts. You will assist to establish and implement effective operational workflows, data pipelines, procedures and best practices in accordance with government infrastructure and security policies to ensure that the platforms are monitored, secure, available and reliable.

We are looking for an independent and motivated data engineer who has experience in both small and large-scale analytics platform projects, and in building and maintaining the infrastructure.

What you will be working on:

Design, Architect, Deploy, and maintain solutions on AWS and Databricks to provide secure and governed access to data for data scientist, data analysts and business users.

Manage the full life-cycle of a data lakehouse project from requirement gathering to data modelling, design of the data architecture and deployment.

Collaborate with data stewards, data analysts and data scientists to build data pipelines to ingest data from enterprise systems for both batch and real-time streaming data.

Establish and manage the complete machine learning lifecycle using MLFlow.

Where we are looking for:

Degree in Computer Science or Information Technology or related disciplines

Have more than 4 years of experience in a technical role

Hands-on experience in implementing Data Lake/Data Warehouse with technologies like \xe2\x80\x93 Databricks, Azure Synapse Analytics, SQL Database, AWS Lake formation.

Understanding on OLTP, Data Lake and Lakehouse technologies that may include knowledge of S3, AWS Glue, DeltaLake or DataBricks

Proficient in SQL, PySpark and Python.

Experience in Big Data management & processing using tools such as Spark

Knowledge in Machine Learning Frameworks and the use of ML Flow to manage the machine learning lifecycle

Comfortable with DevOps tools like AWS Cloud Formation/Terraform, Docker and Git for CI/CD development.

Prior experience with data engineering tools and frameworks like Airflow, Kafka, Hadoop, Spark, Kubernetes.

Familiar in building REST services is good to have.

Experience in the public sector is a bonus

We are an equal opportunity employer and value diversity at our company as we believe that diversity is meaningful to innovation. Our employee benefits are based on a total rewards approach, offering a holistic and market-competitive suite of perks. This includes generous leave benefits to meet your work-life needs. We trust that you will get the job done wherever you are, and whatever works best for you \xe2\x80\x93 so work from home or take a break to exercise if you need to*. We also believe it\xe2\x80\x99s important for you to keep honing your craft in the constantly-evolving tech landscape, so we provide and support a plethora of in-house and external learning and development opportunities all year round

*Subject to the nature of your job role that might require you to be onsite during fixed hours

Government Technology Agency

Beware of fraud agents! do not pay money to get a job

MNCJobz.com will not be responsible for any payment made to a third-party. All Terms of Use are applicable.


Job Detail

  • Job Id
    JD1278282
  • Industry
    Not mentioned
  • Total Positions
    1
  • Job Type:
    Full Time
  • Salary:
    Not mentioned
  • Employment Status
    Permanent
  • Job Location
    Singapore, Singapore
  • Education
    Not mentioned