Data Engineer (aws + Databricks + Idmc)

SG, Singapore

Job Description

Role and Responsibilities:



Define, develop, and maintain blueprints, roadmaps, and reference architectures for data analytics infrastructure and services.

Analyze new requirements, develop solutions, and manage solution delivery through acquisition or change control.

Enhance cloud capability by designing and implementing cloud-based data analytics architectures and patterns.

Lead data migration and modernization initiatives by leveraging AWS[1]native services, Databricks, and IDMC. Work closely with business leads and system owners to understand solution requirements and identify architectural patterns. Develop and implement automation playbooks for managing and scaling cloud services, containers, and applications. Ensure compliance with industry best practices, governance, and security guidelines for cloud-based analytics solutions. Guide engineering and development teams in AWS-based data transformation, integration, and operational frameworks. Collaborate with DevOps and Data Engineering teams to define, implement, and optimize data pipelines, ETL/ELT processes, and data lakes. Assist in vendor management to ensure that contracted vendors deliver architecturally scalable and sustainable solutions

Qualifications Education & Experience:



Degree/Master's in Computer Science, Information Technology, Computer Engineering, or equivalent.

Minimum 8 years of experience in data warehousing, big data, or advanced analytics solutions.


Technical Skills:



Databases & Data Management:



Experience with databases (e.g., Oracle, MS SQL, MySQL, Teradata, Databricks). Expertise in data repository design (e.g., operational data stores, data marts, data lakes). Proficiency in data query techniques (e.g., SQL, NoSQL, Spark SQL). Hands-on experience with Databricks (Delta Lake, MLflow, Spark). Experience with Informatica Data Management Cloud (IDMC) for data integration, transformation, and governance.

Cloud Data & Analytics:



Must-have: Strong knowledge of AWS cloud services (e.g., AWS Glue, Redshift, S3, Lambda, Kinesis, Athena, EMR).

Experience in building and optimizing ETL/ELT workflows using AWS[1]native tools, Databricks, or IDMC. Understanding of event-driven architectures and microservices.

Data Analytics & Machine Learning:



Data modeling experience (e.g., Star Schema, Snowflake Schema).

Proficiency in Python/R for data transformation, analytics, and statistical computing.

Hands-on experience with ML and AI frameworks for predictive modeling and healthcare analytics.


DevOps & Security:



Infrastructure as Code (IaC): Terraform, CloudFormation. CI/CD & DevOps best practices for data pipelines and cloud infrastructure. Identity and Access Management (IAM), security best practices, and data governance.

Certifications (Preferred but not mandatory):



AWS Certified Solutions Architect - Associate or Professional

Databricks Certified Data Engineer * Informatica IDMC Certification

Beware of fraud agents! do not pay money to get a job

MNCJobz.com will not be responsible for any payment made to a third-party. All Terms of Use are applicable.


Job Detail

  • Job Id
    JD1677179
  • Industry
    Not mentioned
  • Total Positions
    1
  • Job Type:
    Full Time
  • Salary:
    Not mentioned
  • Employment Status
    Permanent
  • Job Location
    SG, Singapore
  • Education
    Not mentioned