Job Description

Data Engineer | Contract

Summary

We are seeking experienced

Data Engineer

to support a high-impact project involving database migration to a cloud-native data lake environment. This is a

client-facing, on-site role

based in

Singapore

, requiring strong technical expertise, excellent communication skills, and a problem-solving mindset. The ideal candidates will bring hands-on experience in Python, Apache Spark, SQL optimization, and DevOps practices.

Responsibilities:

Lead and execute

relational database migration

to cloud-native data lake platforms Develop robust

data processing pipelines

using Python (Pandas, PyArrow) and Apache Spark (PySpark) Optimize complex

SQL queries

, perform performance tuning, and implement efficient data models Collaborate with DevOps teams to build and maintain

Infrastructure-as-Code

(Terraform/CloudFormation) and

CI/CD pipelines

Participate in

hands-on coding sessions

, problem-solving discussions, and stakeholder meetings Communicate technical concepts clearly to non-technical stakeholders and provide project updates Ensure all deliverables meet quality standards through

unit testing

and reconciliation techniques

Requirements:

Python (Pandas, PyArrow)

- Production-grade coding practices: modular, efficient, reusable code

Apache Spark (PySpark)

- Building and optimizing scalable data pipelines

SQL

- Expertise in query optimization, data modeling, and performance tuning

ETL & Data Warehousing

- Proven experience in data migration and warehouse implementations

DevOps

- Hands-on with

Terraform

,

CloudFormation

, and setting up

CI/CD pipelines

Strong

problem-solving

abilities and experience breaking down complex data problems Excellent

communication and stakeholder management

skills (essential for client-facing, onshore role) Experience with

AWS

,

Snowflake

,

Databricks

, or other big data technologies * Understanding of

Master Data Management (MDM)

and its downstream impact