Senior Data Engineer (aws Migration Lead)

Singapore, Singapore

Job Description

Key Responsibilities: * Migration & Technical Implementation:

  • Lead migration of on-premises and SharePoint-based data infrastructure to AWS Data Analytics Platform (DAP)
  • Collaborate with AWS teams to develop comprehensive migration strategies and implementation plans
  • Re-architect existing Python scripts and UiPath automation workflows for AWS SageMaker or Glue scripts
  • Design and implement robust data pipelines and ETL processes within AWS environment
  • Migrate Tableau dashboards to AWS QuickSight whilst maintaining full functionality
  • Establish data connections from multiple sources (HRPS, Gateway, SharePoint, Microsoft Lists, FormSG, MS Access)
  • Ensure seamless transition with zero disruption to existing data operations
  • Documentation & Knowledge Transfer:
  • Create comprehensive documentation for all new AWS processes and workflows
  • Develop training materials and conduct knowledge transfer sessions for end users
  • Support HR officers in accessing and utilising dashboards in the new AWS environment
  • Conduct thorough testing and validation of migrated systems
Requirements
1.AWS Services
  • Extensive experience with AWS services (SageMaker, QuickSight, Athena, Lambda, data pipelines).
  • Experience using AWS services in Python and Command Line Interface
  • Proficiency in serverless architecture design and Lambda function development.
2.Infrastructure as Code (IaaC)
  • Experience in Infrastructure-as-Code (eg. CloudFormation, YAML, JSON infrastructure scripts)
  • Lambda function provisioning and management through IaaC templates
  • Integration of serverless components with traditional infrastructure resources
  • Programming and Automation Skills
  • Proficiency in Python programming and UiPath automation
  • Experience developing and deploying Lambda functions for data processing and automation
  • Understanding of event-driven architecture and serverless computing patterns
3.Data Visualisation and Analytics
  • Strong background in Tableau and QuickSight dashboard development
  • Experience with ETL processes and data pipeline design
  • Knowledge of serverless data processing workflows using Lambda
4.DevOps and Collaboration
  • Experience working with DevOps stack (eg. Ship-hats, GitLab, Nexus Repo etc)
  • Understanding of CI/CD pipelines for both application code and infrastructure deployment
  • Experience with infrastructure change management including security groups and network ACLs
  • Technical writing and documentation skills
  • Training delivery and user support capabilities

Skills Required

Beware of fraud agents! do not pay money to get a job

MNCJobz.com will not be responsible for any payment made to a third-party. All Terms of Use are applicable.


Job Detail

  • Job Id
    JD1687826
  • Industry
    Not mentioned
  • Total Positions
    1
  • Job Type:
    Full Time
  • Salary:
    $60,000-140,000 per year
  • Employment Status
    Permanent
  • Job Location
    Singapore, Singapore
  • Education
    Not mentioned