Job Description

Position Overview

This headcount is to support MCDR Ops team as the Hadoop administrator. This is an individual contributor and will also serve as a secondary backup for maintaining Oracle/SQL Databases.

Role & Responsibilities

1.1.1 Job Role Description

The Hadoop Admin supports the administration activities on the Hadoop Infrastructure and Ecosystem, and responsible for configuring Hadoop components, handling cluster related issues, patch upgrades, monitoring health of each Hadoop components and supporting restart of services on various nodes. He/She would also be responsible for monitoring and tuning resource usage, as well as capacity planning for cluster upgrades.

1.1.2 Responsibilities

(a) Perform all Hadoop administration activities on Hadoop clusters.
(b) Monitor health of the components and generate performance reports and provide continuous improvements.
(c) Solve issues related to Hadoop components by investigating and finding solutions/workaround or creating and applying patches.
(d) Configure various Hadoop components which includes Hive, Yarn, Spark, Kafka, Encryptions, Hbase etc.
(e) Configure and troubleshoot ETL/Data Science/Analytics application connections to Hadoop on the Hadoop end.
(f) Plan cluster resource usage, work with users on resource scheduling (Fair /Capacity Scheduler) and conduct capacity planning for cluster expansions.
(g) Tune and configure cluster resources in terms of VCores and default worker resource allocations etc.
(h) Perform node administration using Ambari or similar monitoring tools like Cloudera manager and perform load balancing upon addition / removal of any nodes.
(i) Work closely with data engineering team and operational teams to ensure cluster stability and smooth production releases.
(j) Ensure that the Hadoop platform/components can effectively meet performance & SLA requirements.

Requirements

1.1.1 Requirements

(a) Degree/Master's in Computer Science, Information Technology, Computer Engineering or equivalent.
(b) At least eight (8) years of overall IT Admin experience and three (3) years in Hadoop Admin experience in configuring/maintaining Hadoop clusters.
(c) Experience in Configuring and setting up Hadoop clusters and provide support for Name Node recovery, load balancing in all data nodes and configuring hive metastore for better query performance.
(d) Experience in troubleshooting various Hadoop cluster issues and optimizing the cluster for better performance.
(e) Experience in capacity planning and performance tuning on Hadoop clusters.
(f) Experience in configuring and managing the Hadoop monitoring tools like Ambari or Cloudera Manager.
(g) Hands on experience on Hadoop cluster installations / deployments / upgrades.
(h) Hands on experience on setting up various security features such as Kerberos/AD/LDAP implementation.
(i) Experience in Linux / Unix OS Services, Administration, and Shell scripting.

Apply Now

NOTE: It only takes a few minutes to apply for a meaningful career in HealthTech - GO FOR IT!!