Supports the design, build, implementation, and maintenance of Big Data processing systems to collect, parse and process large datasets and transform them into useful information and insights.
Identify suitable data structures based on business needs to ensure availability and accessibility of data.
Determine technical system requirements based on data needs.
Keep abreast of latest technologies and products in open-source technologies, database and data processing software.
Develop codes and scripts to process structured and unstructured data in real-time from a variety of data sources.
Consolidate and create data storage solutions for storage and retrieval of information.
Assist in the integration of data systems with existing infrastructure.
Requirements
Bachelor / Master\'s degree in Computer Science, Computer Engineering, Information Systems, Information Engineering, or equivalent
At least 2 years of data engineering experience
Experience in open-source technologies, data cleaning
Experience in programming languages such as Java, Python, C++
Experience in building and optimizing architectures and data sets
Experience working with stakeholders to identify business needs and analytics opportunities