Job Description

Data Engineer





POSITION OVERVIEW : Industry Consulting Consultant


POSITION GENERAL DUTIES AND TASKS :


Position Summary: Person will be working on:


On-prem: As a Developer to work on new requirement and Change requests in BRAIN COSY project which involves changes to be done either Database Oracle source scripts, PowerCenter Informatica as ETL tool and SQL server as On-prem Database. Healix Migration: to be involved in end-to-end migration activity to migrate the ETL code from PC Informatica to IDMC and SQL Server to AWS RDS SQL Server. Involves the SFTP process to transfer the files and also PGP encryption for the files. Identify business needs: o Collaborate with stakeholders to understand business needs and information management requirements across all systems, platforms and applications o Identify users' information seeking behaviour o Determine inter-system interface design based on requirements. o Recommend types of data needed to measure and predict outcomes o Oversee the development of design and specification proposals o Guide feasibility and functional studies o Influence integration of data from across the enterprise o Set guidelines for appropriate structuring and enrichment of data





Design information architecture o Identify the desired state of a coordinated information flow through the organisation o Assess existing systems to evaluate their usability, usefulness, and efficiency o Guide alignment of information management standards with the enterprise architectural plan and information security standards o Design data architecture across varying operating systems (e.g. Windows, Linux) and sites (onsite, cloud, hybrid) o Understand the existing data and relationship in order to identify the gaps between current availabilities and user requirements o Develop strategies for seamless and low-risk migration of data between systems o Design the optimum data storage schema to allow usage for analysis by power users / data scientists o Communicate the design and recommendations to stakeholders.





Develop information systems o Perform organisation of data content and data mapping o Develop prototypes, data schemas, and architecture documents to model the physical layout of the information environment o Support the implementation of information designs into systems o Monitor user-interaction with the implemented information designs o Validate effectiveness of information delivery through usability testing o Perform operational ad-hoc data provision to extract/load data based on stakeholders requirements using ETL tools such as Informatica. oOptimize database queries and/or otherwise optimize system performance based on monitored system performance and user feedbacks (both end users and power users)





Analyse Data o Manage problem definition and hypothesis formulation process o Advise development of data analysis models based on project requirements o Oversee data sourcing, acquisition, cleansing, integration, warehousing, exploration and delivery o Coordinate data quality reviews Report Insights o Set the guidelines for the development of end user reports o Advise the design of complex reporting and analytical solutions o Develop roadmaps for optimising the BI analysis insights





Guide implementation o Provide guidance on the implementation of information architecture o Provide direction on linkages between different systems to ensure the information flow is aligned with the architecture. o Maintain clear and accurate documentation of data store o Recommend innovative solutions to increase efficiencies around the integration of complex systems





Requirements / Qualifications:





Informatica PowerCenter - 8 to 10 years


Database RDMS Oracle - 7 to 8 years


Database RDMS Sql Server - ? 5years





OBIEE Reporting tool - Preferred


Tableau - Preferred


AWS IDMC, S3, EC2 - Preferred


AWS RDS - Preferred


Databricks - Preferred