Job Description

& Requirements





This role will be responsible for designing, developing, and maintaining Applications using Apache Spark open-source framework. They work with different aspects of the Spark ecosystem, including Spark SQL, Data Frames, Datasets, and streaming.

Role

:


Help write analytics code, services and components in Java, Apache Spark and Kafka Responsible for systems analysis - Design, Coding, Unit Testing and other SDLC activities Creating Technical design diagrams for business modules, code review with the peers. Requirement gathering and understanding, Analyze and convert functional requirements into concrete technical tasks and able to provide reasonable effort estimates Work proactively, independently and with global teams to address project requirements, and articulate issues/challenges with enough lead time to address project delivery risks Providing expertise in technical analysis and solving technical issues during project delivery Code reviews, test case reviews and ensure code developed meets the requirements

Responsibilities

Experience with Java essential. Experience with Apache Spark streaming and batch framework Experience with Kafka, Storm, Zookeeper Agile/Scrum methodology experience is required. Service oriented architecture, and data standards like JSON, Avro, Protobuf Strong communication skills, should be able to communicate effectively with business and other stake holders Demonstrate ownership and initiative taking

Qualifications:

Bachelor's degree in computer science, data science, or a related field Experience with Apache Spark, Java, SAS, Hive, Hadoop, and the Hadoop ecosystem Experience with data modeling, data wrangling, and data analysis Experience with cloud computing platforms (e.g., AWS, Azure, GCP) Strong problem-solving and analytical skills Excellent communication and teamwork skills Strong programming skills Experience with data migration Ability to work independently and as part of a team.

Benefits:

Opportunity to work on cutting-edge projects. * Collaborative and supportive work environment