Data Engineer (Data & Systems Engineering)

csit
On-site
Posted about 2 years ago
Software Engineering

AI summary

The Data Engineer will enhance and optimize data flow between systems, refining data pipeline architecture and collaborating with cross-functional teams to develop scalable data solutions.

Eligible from: US and Canada

Job Description

We are seeking a Data Engineer to join our Data & Systems Engineering team. In this role, you will be responsible for enhancing and optimizing the data flow between our systems and refining our data pipeline architecture. You will collaborate closely with cross-functional teams to gather requirements, design scalable solutions, and implement cutting-edge data products. The ideal candidate is passionate about driving the development of our next generation of data initiatives.

Responsibilities

Key Responsibilities

  • Develop and maintain robust data pipelines for extracting, transforming, and loading data from diverse sources.
  • Identify, design, and implement process improvements, including automation of manual processes, optimization of data delivery, and design of scalable infrastructure.
  • Gather and analyze telemetry data to provide actionable insights, enhancing the efficiency of data systems and key business performance metrics.
  • Considerations for senior positions

  • Candidates with at least 5 years of proven track record in data engineering development.
  • Experience in technical coaching to junior data engineers.
  • Requirements

    Minimum Requirements

  • A degree or professional qualification in Computer Science, Computer Engineering, Information Systems, or a related field.
  • A minimum of 2 years of hands-on experience with object-oriented programming languages such as Python, Golang, Java, or C++. (Project/internship experience will be considered for recent graduates.)
  • Proficiency with both relational SQL and NoSQL databases.
  • Experience in building ETL flows using tools such as NiFi or Airflow.
  • Familiarity with microservices architecture and RESTful API design.
  • Preferred Qualifications

  • Experience with software development in Agile SCRUM environments, including testing and production error/metrics monitoring.
  • Expertise in building scalable, fault-tolerant, and maintainable data pipelines.
  • Proficiency in big data tools such as Hadoop, Spark, and Kafka.
  • Experience with search engines like Elasticsearch or Solr.
  • Ready to Apply?

    Take the next step in your career journey

    Apply Now

    About the job

    Posted on
    Aug 15, 2024
    Job type
    Full-time
    Location
    Singapore, SingaporeOn-site

    Explore more

    Browse more jobs like this

    Disclaimer: Real Jobs From Anywhere is an independent platform dedicated to providing information about job openings. We are not affiliated with, nor do we represent, any company, agency, or agent mentioned in the job listings. Please refer to our Terms of Services for further details.