Senior Data Engineer (digital)
Singapore, Singapore
Job Description
b'
Why Work for Us We Power the Nation. Make the most of your talents and develop products that can create impact on a national scale. We are an in-house software team, assembled to move with speed and deliver with quality.
We Build Reliable Solutions. For Customers, Company and Country. You will be part of the Digital Technology Team and together, you will innovate, create, and deploy digital products that will empower more than 3,800 employees within SP Group and improve the quality of life for the 1.6 million commercial, industrial and residential customers that SP Group serves. We build solutions that enable sustainable high quality lifestyles and help consumers save energy and cost, as well as supporting national goals for a sustainable livable city. Now, imagine the impact you can create.
What You\xe2\x80\x99ll Do:
- Create and maintain multiple robust and high-performance data processing pipeline within Cloud, Private Data Centre and Hybrid data ecosystem
- Assemble large, complex data sets from a wide variety of data sources
- Collaborate with Data Scientist, Machine Learning Engineer, Business Analyst and Business users to derive actionable insights and reliable foresights into customer acquisition, operational efficiency and other key business performance metrics
- Develop, deploy and maintain multiple microservices, rest API and reporting services
- Design and implement internal processes to automate manual workflow, optimize data delivery and re-designing infrastructure for greater scalability, etc
- Establish expertise in designing, analyzing and troubleshooting large-scale distributed systems
- Experience building and operating large scale data lake and data warehouse
- Experience with Hadoop ecosystem and big data tools, including Spark and Kafka
- Experience with stream-processing systems including Spark-Streaming
- Advance working experience with relational SQL and NoSQL databases, including Hive, Hbase and Postgres
- Deep understanding in SQL and able to optimize data queries
- Experience with object-oriented/object function scripting languages: Python, Java, Scala, etc
- A successful history of manipulating, processing and extracting value from large disconnected datasets
- Experience applying modern development principles (Scrum, TDD, continuous integration, and code reviews)
- Experience with ETL tools such as Talend Big Data, Apache Nifi, etc
- Experience working with Hortonworks Data Platform or Cloudera Data Platform
- Experience with Metadata Management tools
- Exposure to Data Governance processes and tools
- Proven ability in supporting and working with cross-functional teams in a dynamic environment
#LI-DNI
Beware of fraud agents! do not pay money to get a job
MNCJobz.com will not be responsible for any payment made to a third-party. All Terms of Use are applicable.
Related Jobs
Job Detail
-
Job IdJD1294596
-
IndustryNot mentioned
-
Total Positions1
-
Job Type:Full Time
-
Salary:Not mentioned
-
Employment StatusPermanent
-
Job LocationSingapore, Singapore
-
EducationNot mentioned