Staff Platform Engineer - Big Data Platform Management

On-site

Posted 3 days ago

Software Engineering

AI summary

The Staff Platform Engineer will manage and develop Big Data platforms, focusing on building streaming and batch data pipelines, architecting data warehouses, and deploying AI/ML infrastructure while working with various big data technologies.

Eligible from: Unclear

Job Description

CSIT develops products to advance the national security interests of Singapore. We use our products in a wide range of operations, including but not limited to Counter-terrorism and Computer Network Defence. We are looking for talented Senior Big Data Platform Staff Engineer. Join the awesome CSIT family and use cutting-edge technologies to protect the nation.

Responsibilities

We are seeking an experience Big Data Platform Staff Engineer to join our team, responsible for managing and optimizing our Big Data Infrastructure platform. The successful candidate will have a deep understanding of Big Data technologies, architectures, and systems, as well as experience with managing large-scale data processing and analytics environments. The role will involve designing, implementing, and maintaining the Big Data Infrastructure platform, ensuring high availability, scalability, and performance.

Design, implement and manage the Big Data Infrastructure platform, including Hadoop, Spark, NoSQL databases, and data lakes.

Manage Big Data clusters, including monitoring, troubleshooting, and optimizing cluster performance, as well as managing job scheduling and resource allocation.

Design and implement storage solutions for Big Data workloads, including HDFS, S3, and other object storage systems.

Ensure the security and governance of the Big Data Infrastructure platform, including managing access controls, implementing data encryption, and conducting regular security audits.

Collaborate with data engineers and data scientists to optimize Big Data application performance and provide technical support and guidance on using the Big Data Infrastructure platform.

Plan and manage Big Data resource capacity, including forecasting, procurement, and deployment of new hardware and software.

Nice-to-haves

Certifications in Big Data, such as Hadoop Certified Developer or Spark Certified Developer.

Experience in managing physical and virtual infrastructures.

knowledgeable in deploying and scaling LLM-based and agentic AI/ML applications.

Why join us?

The work is purposeful and meaningful

You will work with the best engineers

We work with modern technologies and tech stacks

We have excellent engineering culture and work-life balance

We aspire to engineering and operational excellence

We empower to innovate

We grow together as a family

Requirements

Requirements (Minimum Qualifications)

Bachelor’s degree in Computer Science, Engineering, or a related field

At least 8 years of experience in managing Big Data Platforms. Proven experience with technologies like Spark, Iceberg, Trino, Elastic Stack, NiFi, Kafka, Airflow.

Expertise in Big Data Engineering, especially in building streaming/batch pipelines, architecting data warehouses, and deploying AI/ML infrastructure.

Capable of managing and utilizing diverse storage protocols, including S3, NFS, SMB, and HDFS.

Strong knowledge in securing applications through SSL/TLS encryption, data at rest encryption, and robust authentication/authorization (AuthN/AuthZ) using OIDC/OAuth2.

Comprehensive understanding of core networking principles, including firewall configuration, DNS management, routing and subnetting.

Experience with scripting languages, such as Bash, Python, Scala and Java.

Proficient in Kubernetes orchestration, leveraging its ecosystem for automated scaling, self-healing, and seamless CI/CD integration.

Experience in supporting search workloads in multi-terabytes and billions of records

Experience with agile development methodologies and version control systems, such as Git.

Experience in leading engineering teams.

Ready to Apply?

Take the next step in your career journey

Apply Now

About the job

Posted on: Sep 24, 2026
Job type: Full-time
Location: Singapore, SingaporeOn-site

Keep looking

Related roles you might like

15 open positions

Manager (Scholarship & Internship Centre)

csit

On-siteInternship4 days ago

Staff Platform Engineer - Big Data Platform Management

AI summary

Job Description

Responsibilities

Responsibilities

Nice-to-haves

Why join us?

Requirements

Requirements (Minimum Qualifications)

Ready to Apply?

About the job

Related roles you might like

Manager (Scholarship & Internship Centre)

Manager People Development

Software Engineer (Corporate Data Tech)

Software Engineer (Finance & Procurement Tech)

Software Engineer (HR & Employee Experience Tech)

Lead/Senior Engineer (IoT/IIoT)

Full Stack Software Engineer (Content Processing)

Data Engineer (Content Processing)

System Reliability Engineer (Data Centre)

Cybersecurity Associate

Product Engineer (Threat Investigation)

Software Engineer (Data Processing and Management)

Software Engineer (Real-time Collaborative Platform – Full Stack)

Software Engineer (AI Assistant Product)

Senior Software Engineer (Big Data Processing)

Browse more jobs like this

Category

Job type

Work arrangement