Developing and supporting of data pipelines to process data from various sources
Experience in BAU tasks and working closely with data platform users
Development of dashboards for multiple stakeholders
Designing and developing various ETL/ELT data pipelines, automation processes for data collection (including web data scraping).
Extensive experience in building platforms that are "horizontally
Primary Skills
A degree in computer science, computer engineering, or other technical fields, or equivalent experience, is preferred
Hands-on experience of integrating open-source Big Data technologies like Hive, Presto, Spark, and Apache Ignite into traditional systems.
Hands-on experience in any 1 modern programming language (Java/Python)
Strong system/schema design, SQL, and ETL/ELT implementation skills
Extensive experience in building platforms that are "horizontally scalable", "highly available (Three 9s or higher)", and "fully automated maintenance" on top of AWS, GCP, Azure, or Ali-Cloud
Support the data platform to ensure that the data from various sources is processed and loaded successfully as scheduled
Any one pipeline orchestration tool: AWS Batch, Airflow, Jenkins, Oozie, etc.
Experience having developed data engineering capabilities for large and complex franchises
Must have exp in e-commerce domain.
* Must have exp in Google cloud Platform.
Beware of fraud agents! do not pay money to get a job
MNCJobz.com will not be responsible for any payment made to a third-party. All Terms of Use are applicable.