Data Engineer








Job Purpose



We are looking for an experienced data engineer to join our team. You will use various methods to transform raw data into useful data systems. For example, you will create and maintain optimal data pipelines architecture in cloud. Overall, you will strive for efficiency by aligning data systems with business goals.
To succeed in this data engineering position, you should have strong analytical skills and the ability to combine data from different sources. Data engineer skills also include familiarity with several programming languages and knowledge of learning machine methods.
If you are detail-oriented, with excellent organizational skills and experience in this field, we would like to hear from you.




Responsibilities



The duties and responsibilities are listed below. The list is not comprehensive and related duties and responsibilities may be assigned from time to time.

• Understand the data landscape to formulate and complete end-to-end data strategy that includes data gathering, data processing, analysis, ongoing scaled deliverables, and presentations to facilitate decision-making and forward planning.
• Identify opportunities for data acquisition, work with system owners to automate data connection.
• Analyse and organize raw data, combine raw information from different sources, build data systems and data pipelines, perform extract transform and load (ETL) to prepare data for prescriptive and predictive modeling.
• Able to analyze, implement and integrate the right services in cloud based on different data formats (Structured, Semi-Structured and Unstructured)
• Evaluate business needs and objectives, interpret trends, patterns, and conduct complex data analysis and report on results
• Build algorithms and prototypes, explore ways to enhance data quality and reliability; Develop analytical tools and programs
• Collaborate with data scientists and architects on several projects

Qualifications & Work Experience

• Degree in Computer Science, IT, or similar engineering field; a Master is a plus
• Previous experience as a data engineer or in a similar role
• Data engineering certification is a plus

Skills



Technical skills include:

• Strong analytical skills with the ability to collect, clean, organise, analyse, and disseminate significant amounts of information with attention to detail and accuracy
• Technical expertise with data models, data mining, and segmentation techniques.
• Knowledge of programming languages (Python, SQL, R & Java)
• Strong experience in Azure Data Factory and Azure Synapse Workspace.
• Expertise in working with Dedicated and Serverless SQL pool in Azure Synapse Analytics.
• Design, Build and Secure API Endpoints and follow Industry best practices to manage APIs.
• Experience in Azure Functions, Azure IOT hub, and Azure API Management.
• Knowledge in other Azure Cloud technologies (i.e., Azure Analysis Service (AAS), Azure SQL DB, Event Hub, Azure Logic Apps and ARM Templates)
• Familiarity with the technology stack available in the industry for metadata management: Data Governance, Data Quality, MDM, Lineage, Data Catalog etc.
• Hands-on experience with SQL database design.
• Great numerical and analytical skills, experience with data visualization tools such as Power BI, Tableau, Qliksense, etc. would be an advantage
• Nice to have Skills: Containerization, Kubernetes, COSMOS DB, Spark SQL, and Azure Data Bricks.

Generic skills include:

• Critical thinker and problem-solving skills
• Team player
• Good time-management skill
• Great interpersonal and communication skills

SMRT Trains Ltd was incorporated in 1987 and operates Singapore\xe2\x80\x99s first mass rapid transit system. Today, we manage and operate train services on the North-South Line, East-West Line, the Circle Line, the Thomson-East Coast Line, and the Bukit Panjang Light Rail Transit. With over 5,000 employees, more than 250 trains, and 141 km of rail tracks across 108 stations, we serve millions of commuters daily.