Job Description

Responsibilities

Data Platform Design and Architecture: - Lead the design and architecture of the enterprise data platform on cloud environments, utilizing the capabilities of Microsoft Azure and AWS to support scalability, reliability, and performance requirements. - Develop data models, data flow diagrams, and data integration strategies to ensure seamless data movement across the cloud-based platform.

Data Integration and ETL Development: - Oversee the development of ETL (Extract, Transform, Load) processes on Azure and AWS platforms to extract data from various sources, transform it into a usable format, and load it into the data platform. - Implement data integration solutions to enable real-time data updates and batch processing as per business needs.

Data Governance and Security: - Establish and enforce data governance policies, data quality standards, and data security measures on Azure and AWS to ensure compliance with industry regulations and protect sensitive data. - Collaborate with the security and compliance teams to implement best practices for data access controls and data privacy in the cloud environment.

Platform Performance and Monitoring: - Monitor the performance and health of the data platform on Azure and AWS, utilizing cloud-native monitoring and analytics tools, to identify and address performance bottlenecks and optimize data processing times. - Conduct regular performance tuning activities on the cloud-based platform to enhance efficiency.

Team Leadership and Collaboration: - Mentor and lead a team of data engineers and technical professionals, providing guidance, support, and technical expertise in Azure and AWS services. - Collaborate with cross-functional teams to understand business requirements and translate them into technical solutions leveraging cloud capabilities.

Technology Evaluation and Implementation: - Stay up-to-date with the latest data technologies, trends, and industry best practices in Azure and AWS cloud services, and evaluate their potential benefits and applicability to the enterprise data platform. - Lead the evaluation and implementation of new Azure and AWS services and tools to enhance the data platform\'s capabilities.

Project Management: - Define project scope, timelines, and deliverables for data platform initiatives on Azure and AWS. - Monitor progress, identify risks, and ensure timely completion of projects on cloud platforms.

Requirements

• Bachelor\'s or Master\'s degree in Computer Science, Information Systems, or a related field.
• Proven experience as a Technical Lead or similar role in designing and implementing large-scale data platforms on Microsoft Azure and AWS.
• Strong expertise in data architecture, data modeling, data integration, and ETL development, with hands-on experience in Azure Data Factory and AWS Glue.
• In-depth understanding of data governance, data security, and data quality principles in cloud environments.
• Proficiency in programming languages such as Python, Java, or Scala for cloud-based data processing.
• Excellent leadership, communication, and team management skills.
• Ability to work in a fast-paced environment and manage multiple priorities effectively.
• Experience with Agile development methodologies is a plus.
• The Enterprise Data Platform Technical Lead plays a crucial role in enabling data-driven decision-making across the organization and ensures the successful implementation and maintenance of the data platform on Microsoft Azure and AWS cloud environments to meet business objectives efficiently
• Experience leading a team of developers
• Experience with automated testing
• Knowledge of CI/CD, DevOps/DevSecOps would be an added advantage
• Thirsty for knowledge and keen to explore new technologies
• Excellent communication skills and strong analytical and conceptual skill

Shortlisted candidates will be offered a 1 Year Agency Contract employment.

Jobline Resources