Job Description

COMPANY DESCRIPTION
Beyondsoft (listed by the Shenzhen Stock Exchange, stock code 002649) is a global provider of IT consulting, product and solution services. Relying on strong R&D and innovation capabilities, the company widely adopts emerging technologies based on big data and mobile internet, including big data management platform, enterprise risk warning and public opinion monitoring system, AI-based intelligent operation and maintenance service, and intelligent automated test products. And a wide range of products and solutions, including internationally authoritative software testing qualification training, for a wide range of services in the fields of high technology, internet, finance, retail, logistics, energy, manufacturing, and medical. For more information, please visit www.beyondsoft.com
DESIGNATION : Data Engineer

RESPONSIBILITIES
Role Responsibilities:

• Create and maintain optimal data pipeline.

• Assemble large, complex data sets that meet functional / non-functional business requirements.

• Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing Jobs/code for greater scalability, etc.

• Work with stakeholders including the Product owner, Data and Design teams to assist with datarelated technical issues and support their data infrastructure needs.

• Work with data and analytics experts to strive for greater functionality in our data systems.

QUALIFICATIONS
Education and Experience

• Minimum 5 years of in Data Engineer role

• Bachelor in Computer Science, Statistics, Informatics, Information Systems or another quantitative field

• Advanced working SQL knowledge and experience working with RDBMS, Hadoop and NoSQL DB.

• Experience building and optimizing ‘big data’ data pipelines, Jobs and data sets.

• Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement.

• Strong analytic skills related to working with structured and unstructured datasets.

• Build processes supporting data transformation, data structures, metadata, dependency and workload management.

• A successful history of manipulating, processing and extracting value from large datasets.

• Working knowledge of message queuing, stream processing, and highly scalable ‘big data’ data stores.

• Experience supporting and working with cross-functional teams in a dynamic environment.

• Experience with: o Big data tools: Hadoop, Kafka, etc.

o Relational SQL and NoSQL databases, including Postgres and Cassandra. o Data pipeline and workflow management tools: Airflow, etc. o AWS cloud services or GCP. o Stream-processing systems