Job Description

Responsibilities * Grow and develop data infrastructure * Design and build efficient and resilient data pipelines for batch and streaming data * Manage data engineering solutions, through int Responsibilities Grow and develop data infrastructure Design and build efficient and resilient data pipelines for batch and streaming data Manage data engineering solutions, through integration of data from a variety of data sources and delivering to downstream systems Provide support to data engineering and data infrastructure solutions Maintain high quality engineering standards Drive continuous improvement in the efficiency and flexibility of the services Requirements 5 to 8 years experience in writing code, services and components in Java, Apache Spark and Python is required Good knowledge in data engineering, data platform and data infrastructure Good knowledge in Azure platform is preferred (e.g. Microsoft Azure architecture, DevOps, ETL, Data Lake architecture) Good knowledge in Azure services is required (e.g. Azure Event Hub, Azure Data Factory, Azure Function, Azure App Services, Azure Cosmos DB, Azure Databricks) Experience in various data stores (e.g. HDFS, Azure Cosmos DB, Azure Data Lake, Azure Blob Storage, Azure SQL DB) Experience in messaging systems (e.g. Apache Kafka, Azure Event Hubs, IBM MQ) Strong analytical, interpersonal and collaboration skills Aviation domain knowledge would be an advantage