Job Description

Company
Snaphunt Pte. Ltd.
snaphunt.com
Designation
Data Engineer
Date Listed
29 Jun 2022
Job Type
Entry Level / Junior Executive
Full/Perm
Job Period
Immediate Start, Permanent
Profession
IT / Information Technology
Industry
Computer and IT
Location Name
Singapore
Allowance / Remuneration
$850 - 1,350 monthly

Company Profile
Our Client provides Data and AdTech strategy consultation to leading internet websites and apps.

• Opportunity to make a positive impact
• Flexible working options
• Attractive salary & benefits

The Job You will be responsible for :

• Understand long-term and short-term business requirements to precision match it with the capabilities of different distributed storage and computing technologies from the plethora of options available in the ecosystem.
• Create complex data processing pipelines
• Design scalable implementations of the models developed by our Data Scientist.
• Deploy data pipelines in production systems based on CICD practices
• Create and maintain clear documentation on data models/schemas as well as transformation/validation rules
• Troubleshoot and remediate data quality issues raised by pipeline alerts or downstream consumers

Ideal Candidate Skills Required:

• 1-3 years of overall industry experience in building and deploying large scale data processing pipelines in a production environment.
• Experience building data pipelines and data-centric applications using distributed storage platforms such as HDFS, S3, NoSql databases (Hbase, Cassandra, etc) and distributed processing platforms such as Hadoop, Spark, Hive, Oozie, Airflow, etc.
• Hands-on experience with MapR, Cloudera, Hortonworks, and/or Cloud (AWS EMR, Azure HDInsights, Qubole, etc) based Hadoop distributions
• Practical experience working with well-known data engineering tools and platforms - Kafka, Spark, Hadoop
• Solid understanding of Data Modelling, ML and AI concepts
• Proficient in programming language: Python
• Education: B.E, BTech, MTech, MS

Ref: HZFUZZRUCP
Application Instructions
Apply to this role at https://snaphunt.com/jobs/HZFUZZRUCP

Agent Note This position is posted on behalf of a client by a third party agent.