Senior Dataops Engineer

Singapore, Singapore

Job Description


Singapore, Singapore

Company: Singtel Group

Be a Part of Something BIG!

This role is accountable for running DataOps of Singtel Data & Analytics Platform within

Group IT. He/she will be accountable for ongoing support and maintenance, capacity

management, data availability and data quality, performance and stability of the platform.

Make an Impact by:

  • Run day-to-day operations of Data & Analytics platform
  • Ensure data pipelines run smoothly and efficiently
  • Ensure service availability and data availability as per SLA
  • Ensure proactive monitoring and follow up action to ensure data accuracy, consistency, completeness and timeliness
  • Ensure adherence to security guidelines and audit control measures
  • Investigate, analyze, and resolve data/batch incidents within SLA
  • Conduct RCA and implement proactive preventive measures
  • Technically competent to provide technical advice to the team and to be involved in issue resolution
  • Provide on-call support and afterhours/weekend support as needed
  • Participate in Major Incident calls, and lead the team for incident resolution
  • Fulfill Service Requests related to Data Analytics platform
  • Plan and execute regular housekeeping, maintenance and capacity management
  • Develop and maintain Ops related SOPs and guidelines
  • Work with Group IT domains and relevant outsourced vendors to participate in Group IT Initiatives
  • Drive optimization and continuous improvement initiatives
  • Fine-tuning of existing data pipelines where necessary
  • Schedule and maintain data pipelines
  • Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, etc
  • Understand various data security standards and use secure data security tools to apply and adhere to the required data controls for user access
  • Support and contribute to development guidelines and standards for data ingestion
  • Work with data scientist and business analytics team to assist in data ingestion and data related technical issues
Skills for Success
  • Bachelor\'s degree in IT, Computer Science, Software Engineering, Business Analytics or
  • equivalent.
  • Minimum 8 years of experience in data warehousing and/or cloudbased Data Lakehouse
  • such as Databricks
  • Experience in application support/operation role in BI/DW/Datalake/Data Lakehouse environment
  • Experience with relational SQL and NoSQL DB
  • Expert in building and optimizing \'big data\' data pipelines and data sets
  • Excellent experience in Scala or Python
  • Experience in ETL and / or data wrangling tools for big data environment
  • Ability to troubleshoot and optimize complex queries on the Spark platform
  • Knowledgeable on structured and unstructured data design / modeling, data access and data storage techniques
  • Experience with DevOps tools and environment
  • Experience working in Telco Data Lake and/or Data Lakehouse
  • Data Engineering expertise using Databricks, Python, Hive, Scala, DataWarehouse, Data Lake
  • Experience in Data Observability and Data Quality concepts Technical / Professional Skills
  • Please provide at least 3 Databricks / Cloud Data Lakehouse knowledge and
  • experience
  • Design & Development based on Databricks or similar platform
  • Azure Services
  • Python / Scala / Java /HIVE / HBase / Impala /Parquet /Sqoop, Kafka, Flume /SQL
  • Relational Database Management System (RDBMS)
  • NOSQL database
  • Data warehouse platforms or equivalent
  • Airflow
  • Jenkins
  • Docker
  • Github / Bitbucket
Rewards that Go Beyond
  • Hybrid work arrangements
  • Full suite of health and wellness benefits
  • Ongoing training and development programs
  • Internal mobility opportunities
Your Career Growth Starts Here. Apply Now!

We are committed to a safe and healthy environment for our employees & customers and will require all prospective employees to be fully vaccinated.

Singtel

Beware of fraud agents! do not pay money to get a job

MNCJobz.com will not be responsible for any payment made to a third-party. All Terms of Use are applicable.


Job Detail

  • Job Id
    JD1362988
  • Industry
    Not mentioned
  • Total Positions
    1
  • Job Type:
    Full Time
  • Salary:
    Not mentioned
  • Employment Status
    Permanent
  • Job Location
    Singapore, Singapore
  • Education
    Not mentioned