Job Description

: * Supports the design, implementation and maintenance of data flow channels and data processing systems that support the collection, storage, batch and real-time processing, and analysis of information in a scalable, repeatable, a : Supports the design, implementation and maintenance of data flow channels and data processing systems that support the collection, storage, batch and real-time processing, and analysis of information in a scalable, repeatable, and secure manner. Keep abreast of latest technologies and products in database and data processing software, and technologies. Recommend solutions to improve new and existing data platforms including migration. Experiment with, select, and implement cutting edge Big Data tools and frameworks required to provide requested capabilities. Build, deploy and manage big data tools with solid DevOps functions. Be able to manage CI/CD pipelines. Develop codes and scripts to process structured and unstructured data in real-time from a variety of data sources. Implement and monitor data security and privacy measures on data solutions. Maintenance and support of batch job processing in Data warehouse / data platform Automate and optimize the data collection and analysis processes, data releasing and reporting tools. Gather requirements for data warehouse projects, conducting UAT and to provide training for end users, as and when required. Mentoring junior team members through code review and enablement training Job Requirements Degree in Computer Science/Information Systems or equivalent with minimum 4 years of hands-on experience in the maintaining and supporting an enterprise level data platform. Must have hands-on ETL/ELT experience, specifically on Microsoft SSIS / Azure Data Factory, strong working experience ETL / ELT experience will also be acceptable. Proficiency in SQL and deep understanding of DWH architecture and data/table formats such as parquet/json/csv in distributed data processing and storage systems. Possess good understanding of software development life cycles. Ability to analyze large datasets, data model and interpret data pattern. Working experience in handling projects involving Data Analytics related work is a plus. Knowledgeable on cloud systems like Alicloud, Azure Experienced in managing Tableau Servers is a plus. Good experience with programming languages like Python, R, and scripting languages such as PowerShell and bash is a plus. Experience in machine learning operations, or setting up environments for data scientists/machine learning engineers would be advantageous Strong communication and interpersonal skills. Have a positive attitude and willingness to learn and adapt to a changing environment.