Senior Data Engineer (Big Data Processing)

csit
Singapore, Singapore
On-site
Full-time
Posted over 1 year ago
Software Engineering

Job Description

CSIT develops products to advance the national security interests of Singapore. We use our products in a wide range of use-cases, including but not limited to Counter-terrorism and Computer Network Defence. We are looking for talented senior data engineers to lead and build mission-critical products that identify, analyse and investigate threats.

Requirements

  • Bachelor's degree in computer science or equivalent
  • 5+ years of experience in data engineering, with a strong focus on building large-scale data pipelines
  • Proven experience in writing optimised ETL code to handle large datasets
  • Proficient in programming languages such as Scala or Java
  • Familiarity with the following technologies: Spark, Kafka, Hadoop, Elastic stack, Kudu
  • Strong understanding of modern data architectures and data modelling paradigms
  • Able to communicate technical details effectively and clearly
  • Good interpersonal, analytical and problem-solving sklils to get things done in a dynamic environment

Responsibilities

  • Design and build data pipelines that are scalable, robust and maintainable to ingest crucial data using cutting-edge platforms and technologies
  • Work with product managers, engineering managers and key stakeholders to deliver impactful data products that meet our business needs
  • Optimise performance of large-scale data pipelines for low-latency, high-throughput and reliability
  • Ensure data integrity, quality and governance through robust design and operational monitoring
  • Troubleshoot and resolve complex issues in critical data pipelines
  • Implement best practices in data engineer, including testing, orchestration and monitoring of data pipelines
  • Lead technical discussions with the team and key stakeholders to shape the future of our data products
  • Mentor junior data engineers and contribute to building a strong data engineering culture within the team
As CSIT is an agency under the Ministry of Defence (Singapore), only Singapore Citizens will be considered.

Responsibilities

Responsibilities

  • Design and build data pipelines that are scalable, robust and maintainable to ingest crucial data using cutting-edge platforms and technologies
  • Work with product managers, engineering managers and key stakeholders to deliver impactful data products that meet our business needs
  • Optimise performance of large-scale data pipelines for low-latency, high-throughput and reliability
  • Ensure data integrity, quality and governance through robust design and operational monitoring
  • Troubleshoot and resolve complex issues in critical data pipelines
  • Implement best practices in data engineer, including testing, orchestration and monitoring of data pipelines
  • Lead technical discussions with the team and key stakeholders to shape the future of our data products
  • Mentor junior data engineers and contribute to building a strong data engineering culture within the team

Requirements

Requirements

  • Bachelor's degree in computer science or equivalent
  • 5+ years of experience in data engineering, with a strong focus on building large-scale data pipelines
  • Proven experience in writing optimised ETL code to handle large datasets
  • Proficient in programming languages such as Scala or Java
  • Familiarity with the following technologies: Spark, Kafka, Hadoop, Elastic stack, Kudu
  • Strong understanding of modern data architectures and data modelling paradigms
  • Able to communicate technical details effectively and clearly
  • Good interpersonal, analytical and problem-solving sklils to get things done in a dynamic environment

Disclaimer: Real Jobs From Anywhere is an independent platform dedicated to providing information about job openings. We are not affiliated with, nor do we represent, any company, agency, or agent mentioned in the job listings. Please refer to our Terms of Services for further details.