Job Description

Tools

Infrastructure & OS: Well versed with Red hat, Ubuntu, In House Data Center. Database Administration: Experience on CDP, Hadoop, MySQL & SQL. Security: Kerberos, LDAP, TLS, Ranger, SSSD. DevOps: Jenkins, GitLab CI/CD.

Responsibility:

Troubleshoot and resolve complex deployment issues, performance bottlenecks, and system failures across the big data and CI/CD environments. Develop and maintain automation scripts using languages like Bash and Python to streamline system administration and deployment tasks. Collaborate with data engineers, data scientists, and development teams to optimize workflows and provide technical guidance. Document deployment processes, configurations, and troubleshooting steps. Troubleshoot and resolve complex deployment issues, performance bottlenecks, and system failures across the big data and CI/CD environments. Design, implement, and maintain CI/CD pipelines for automating software build, test, and deployment processes using tools like Jenkins, GitLab CI/CD, or other relevant technologies. Proficiency in Linux, with advanced knowledge of Red Hat Enterprise Linux (RHEL) versions. Experience in writing Linux shell scripts. Hands-on experience with big data technologies, particularly Apache Hadoop and Cloudera Data Platform (CDP). Experience with the deployment and administration of Dataiku, including knowledge of the Dataiku DSS and Project Deployer. Strong troubleshooting skills for resolving technical issues during deployments and production operations. Familiarity with cloud platforms (e.g., AWS) is a plus. Excellent problem-solving, communication, and collaboration skills. * Bachelor's degree in computer science, Information Technology, or a related field, or equivalent practical experience.