Data Engineer
SG, Singapore
Job Description
JOB DESCRIPTION
Design, develop, and maintain robust ETL/ELT data pipelines Build real-time and batch data processing systems Implement data ingestion from various sources (APIs, databases, files, streaming data) Optimize data pipeline performance and reliability Design and implement scalable data architecture solutions Manage Azure-based data platforms Set up and maintain data warehouses and data lakes Implement data governance and security best practices Programming Languages: Python, SQL Big Data Technologies: Apache Spark, Kafka Azure: Data Factory, Synapse Databases: SQL/Azure Server, Oracle Hands-on experience with Databricks workspace, notebooks, clusters and unity catalog. Knowledge of data visualization tools (Power BI) Version Control: Git, GitLab/GitHub Containerization: Docker, Kubernetes
Location
Singapore
Job Function
TECHNOLOGY
Role
Engineer
Job Id
380229
Desired Skills
Python | ETL Testing
Desired Candidate Profile
Qualifications
: Others
Beware of fraud agents! do not pay money to get a job
MNCJobz.com will not be responsible for any payment made to a third-party. All Terms of Use are applicable.
Related Jobs
Job Detail
-
Job IdJD1673305
-
IndustryNot mentioned
-
Total Positions1
-
Job Type:Full Time
-
Salary:Not mentioned
-
Employment StatusPermanent
-
Job LocationSG, Singapore
-
EducationNot mentioned