Job Description

8 November 2023

We are looking for a Senior Data Engineer who will be in charge of planning, implementing, and managing data infrastructure and systems.

Mandatory Skill(s)

• Bachelor\'s degree (BE/B.Tech) in engineering or a similar profession.
• The candidate must have 7-9 years of Data Engineer experience.
• Cloud computing experiences, such as AWS, GCP, Azure, and others.
• 5+ years of expertise in creating batch and streaming pipelines using distributed technology tools such as SQL, Spark, Python, Airflow, and Scala.
• The candidate must have 5+ years of Airflow experience.
• Cloud computing experience, such as AWS, GCP, Azure, and others. Cloud computing experience, such as AWS, GCP, Azure, and others.

Desirable Skill(s)

• Previous experience with the Agile and Scrum development processes.
• Knowledge of EMR/EC2, Databricks, and other similar technologies.
• Working knowledge of data warehousing tools such as SQL database, Presto, and Snowflake.
• Knowledge of Microservices Architecture

Responsibilities

• Designing and constructing scalable reusable components, frameworks, and libraries to support analytics solutions.
• Collaborating with business and technology stakeholders to design and deploy product features.
• Anticipating, detecting, and resolving data management challenges to increase data quality.
• Overseeing the implementation of new data management initiatives as well as the reorganization of the present data architecture.
• Using workflow scheduling tools, implement complicated automated workflows and routines.
• Creating frameworks for continuous integration, test-driven development, and production deployment.
• Driving collaborative evaluations of other data engineers\' design, code, test plans, and dataset implementation in order to maintain data engineering standards.
• Analyzing and profiling the data in order to build scalable solutions.
• Experience creating/configuring Jenkins pipelines for Managed Spark jobs, building Docker images, and so on

If you are interested in this role, click on the \xe2\x80\x9cApply to this job\xe2\x80\x9d button below or you could also write in with your CV to Moinuddin Khaja R. at quoting the job title.

Technology Recruitment Specialist
Let\xe2\x80\x99s connect via

Sciente Consulting