Job Description

Role Responsibilities

• Provide technical leadership in data engineering, guiding data engineering and analytics team. Drive the high-level technical vision of building data management systems and providing data analytics support.
• Provide support and be a trusted advisor to Data Scientists and other data consumers by identifying data problems and guiding issue resolution with partner Data Engineers and source data providers.
• Adapt quickly to change in requirements and be willing to work with different technologies if required. Lead the effort to build, implement and support the data infrastructure.
• Be an effective implementer and a technical mentor for the team in the following core activities

• Design and develop new systems architecture for data engineering services and their ecosystem, spanning distributed databases (relational, columnar, graph, in-memory); MLOps; orchestration (Apache Airflow); distributed stream / batch data processing (Kafka, Spark); and other big data technologies.
• Onboarding, maintenance and evolution of existing on-premises and AWS cloud data warehouse / data lake system.
• Assist in stakeholder management and resolve resource conflicts within or between agile squads. Lead projects involving high level of coordination among departments and business areas.
• Develop and implement data pipelines that extracts, transforms, and loads data into an information product that helps to inform the organization in reaching strategic goals.
• Ensure high quality design reviews that meet business and architectural goals and drive critical feedback on architecture and design issues.

• 10 years of experience in Java development.
• 5 years of experience in Spring Boot microservices development.
• Strong analytical and problem-solving skills.
• Experience working in banking/ finance industry.
• Strong communication and stakeholder management skills

• Spring Boot microservices development.
• Java development.
• Experience with big data technologies like Spark, Lambda, Kinesis, DynamoDB, Hadoop, Hive, Pig, etc.
• Hands-on technical expertise in cloud based distributed software design and development.
• Experience with Docker and Kubernetes.
• Experience with Kong API Gateway.
• Knowledge of RDMS, Spring Data, Postgres, AWS RDS.
• Experience with backend web development practices and tools, including CI/CD, SQL databases, APIs, GitHub.
• Knowledge of High Availability, Scalable, Fault Tolerant architecture patterns.
• Knowledge of application performance testing, and analysing performance metrics
• Good knowledge of open-source frameworks
• Experience working with JSON Schema, XML, XSD.
• Experience of Apache Camel and Enterprise Service Bus technologies.
• Understanding of Jenkins, CI/CD, app scan and sonar scan.