Job Description

& Requirements

Developing and supporting of data pipelines to process data from various sources. Experience in BAU tasks and work closely with data platform users. Development of dashboards for multiple stakeholders Designing and Developing various ETL/ELT data pipelines, automation processes for data collection (including web data scraping). Extensive experience of building platform which are "horizontally

Primary Skills

Hands-on experience of integrating open-source Big data technologies like Hive, Presto, Spark, Apache Ignite into traditional systems. Hands-on experience in any 1 modern programming language (Java/Python). Must have exp in Google cloud Platform. Extensive experience of building platform which are "horizontally scalable", "highly available (Three 9s or higher)" and "fully automated maintenance" on top of AWS, GCP, Azure or Ali-Cloud. Strong system/schema design, SQL and ETL/ELT implementation skills Must have exp in e-commerce domain. * Experience having developed data engineering capabilities for large and complex franchises