Job Description

Job Purpose We are looking for a data engineer to join our team. You will use various methods to transform raw data into useful data systems. For example, you will create and maintain optimal data pipelines architecture in cloud. Overall, you will s Job Purpose We are looking for a data engineer to join our team. You will use various methods to transform raw data into useful data systems. For example, you will create and maintain optimal data pipelines architecture in cloud. Overall, you will strive for efficiency by aligning data systems with business goals. To succeed in this data engineering position, you should have strong analytical skills and the ability to combine data from different sources. Data engineer skills also include familiarity with several programming languages and knowledge of learning machine methods. If you are detail-oriented, with excellent organizational skills and experience in this field, we would like to hear from you. Responsibilities The duties and responsibilities are listed below. The list is not comprehensive and related duties and responsibilities may be assigned from time to time. Understand the data landscape to formulate and complete end-to-end data strategy that includes data gathering, data processing, analysis, ongoing scaled deliverables, and presentations to facilitate decision-making and forward planning. Identify opportunities for data acquisition, work with system owners to automate data connection. Analyze and organize raw data, combine raw information from different sources, build data systems and data pipelines, perform extract transform and load (ETL) to prepare for prescriptive and predicted modeling. Able to analyze, implement and integrate the right services in cloud based on different data formats (structured, semi-structured and unstructured) Evaluate business needs and objective, interpret trends, patterns, and conduct complex data analysis and report on results. Build algorithms and prototypes, explore ways to enhance data quality and reliability Develop analytical tools and programs Collaborate with data scientists and architects on several projects. Qualifications & Work Experience Degree in Computer Science, IT, or similar engineering field a Master is a plus Previous experience as a data engineer, or in a similar role. Data engineering certification is a plus. Skills Technical skills include: Strong analytical skills with the ability to collect, clean, organize, analyze and disseminate significant amounts of information with attention to detail and accuracy Technical expertise with data models, data mining, and segmentation techniques Knowledge of programming languages (Python, SQL, R & Java) Experience in Azure Data Factory Expertise in working with Dedicated and Serverless SQL pool in Azure Synapse Analytics Design, Build and Secure API Endpoints and follow Industry best practices to manage APIs Experience in Azure Functions, Azure IOT Hub, and Azure API Management Knowledge in other Azure Cloud Technologies, (i.e., Azure Analysis Service (AAS), Azure SQL DB, Event Hub, Azure Logic Apps and ARM Templates) Familiarity with the technology stack available in the industry for metadata management: Data Governance, Data Quality, MDM, Lineage, Data Catalog, etc Hands-on experience with SQL database design Great numerical and analytical skills, experience with data visualisation tools such as Power BI, Tableau, Qliksense, etc., would be an advantage Nice to have skills: Containerization, Kubernetes, COSMOS DB, Spark SQL, and Azure Data Bricks Generic skills include: Critical thinking and problem-solving skills Team Player Good time-management skills Great interpersonal and communication skills