Job Description

BIG DATA PLATFORM ENGINEER

Important Information

Location: Singapore

KEY FEATURES OF THE POSITION


Operating Global Data Platform components (VM Servers, Kubernetes, Kafka) and applications (Apache stack, Collibra, Dataiku and similar).

Implement automation of infrastructure, security components, and Continuous Integration & Continuous Delivery for optimal execution of data pipelines (ELT/ETL).

Develop solutions to build resiliency in data pipelines with platform health checks, monitoring, and alerting mechanisms, quality, timeliness, recency, and accuracy of data delivery are improved

Apply DevSecOps & Agile approaches to deliver the holistic and integrated solution in iterative increments.

Liaison and collaborate with enterprise security, digital engineering, and cloud operations to gain consensus on architecture solution frameworks.

Review system issues, incidents, and alerts to identify root causes and continuously implement features to improve platform performance.

Be current on the latest industry developments and technology trends to effectively lead and design new features/capabilities


Technical Skills


Bachelor's degree in Computer Science, Information Technology, or related field

At least 5 years of experience in big data engineering, with a focus on cloud-based infrastructure


o Strong proficiency in: o DevOps tools like Jenkins, GitLab CI/CD, or similar


Containerization using Docker and Kubernetes

Apache Spark and big data processing

Real-time data integration using Apache Kafka

Distributed SQL engines like Presto and Trino

Data science platforms like Dataiku

Cloud-based object storage solutions like Amazon S3

Ansible Playbooks to automate infrastructure provisioning, configuration, and deployment

Terraform to manage and provision cloud infrastructure resources

Experience with programming languages like Python

Experience with cloud migration, including assessment, planning, execution, and validation

Experience with disaster recovery setup, including backup and restore processes, replication, and failover mechanisms

About Encora

Encora is a global company that offers Software and Digital Engineering solutions. Our practices include Cloud Services, Product Engineering & Application Modernization, Data & Analytics, Digital Experience & Design Services, DevSecOps, Cybersecurity, Quality Engineering, AI & LLM Engineering, among others.



At Encora, we hire professionals based solely on their skills and do not discriminate based on age, disability, religion, gender, sexual orientation, socioeconomic status, or nationality