Job Description

:

• Design, develop, and maintain efficient and reliable data pipelines for collecting, processing, and storing data from various sources.
• Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and translate them into technical solutions.
• Implement data transformations, cleansing, and enrichment processes to ensure data accuracy and quality.
• Optimize and tune data pipelines for performance, scalability, and reliability.
• Work with both structured and unstructured data, including streaming and batch data processing.
• Ensure data security and compliance with relevant data privacy regulations.
• Monitor and troubleshoot data pipelines to identify and resolve issues in a timely manner.
• Develop and maintain documentation for data pipelines, data flows, and data lineage.

Qualifications:

• Bachelor\xe2\x80\x99s degree in computer science, Engineering, or a related field.
• Minimum 3 years of experience as a Data Engineer, with a focus on building pipelines and configurations.
• Experience with Linux-based systems and shell scripting.
• Proficiency in data modeling and ETL concepts
• Proficiency in Python for data manipulation, scripting, and automation.
• Familiarity with general data integration tools, such as Informatica.
• Solid understanding of databases, both relational and NoSQL.
• Strong SQL skills for data querying and manipulation.

About Us:

Beyondsoft International (Singapore) Pte. Ltd. was set up in 2007 and established as the regional headquarters for the Southeast Asia (SEA) and European markets in September 2015. Based on our vision of "Using technology to promote social progress, economic development and become a global customer preferred partner" and our concept of "Beyond your expectations", Beyondsoft is committed to provide our customers in countries along the "Belt and Road" with comprehensive solutions and products and creating commercial value for customers to realizing continuous businesses development.

Our core business includes: * IT development servicesProviding customers with IT consulting, software research and development, software and hardware testing, system integration and operation and maintenance, data analysis and other services;

• New retail solutions and productsThrough intelligent products, helping small and medium-sized enterprises (SMEs) realize the digital transformation of their daily operations;
• Internet of Things (IoT) platform and solutionsComprehensive use of IoT, artificial intelligence, big data, cloud computing and other technologies to provide IoT solutions for intelligent upgrades in cities, parks, buildings and industries, to create a smart future.

For more information, please visit www.beyondsoft.com.

Beyondsoft