Machine Learning Test Engineer, Transformers team - EMEA Remote

This position is posted by Jobgether on behalf of a partner company. We are currently looking for a Machine Learning Test Engineer, Transformers team in EMEA.

As a Machine Learning Test Engineer, you will play a critical role in scaling and advancing testing infrastructure for large-scale AI projects. You will work on complex, high-volume test suites across multiple platforms, ensuring that machine learning frameworks operate reliably and efficiently. This role offers the chance to design robust, growth-oriented testing architectures, integrate testing deeply into CI/CD pipelines, and collaborate with cross-functional teams to elevate testing as a strategic priority. You will influence the scalability, reliability, and maintainability of some of the most widely used ML libraries and models in the industry. The ideal candidate is proactive, strategic, and passionate about enabling engineering teams to deliver high-quality AI systems at scale. Your contributions will directly impact the speed, safety, and robustness of machine learning development across platforms.

Accountabilities:

• Lead the redesign and scaling of testing infrastructure to support high-volume test suites (100K+ tests) across multiple platforms.
• Architect and implement scalable, modular testing systems integrated with CI/CD pipelines.
• Establish best practices for test coverage, reliability, and maintainability, partnering with testing leads and engineering teams.
• Anticipate future testing needs and proactively adapt systems to evolving project complexity and platform diversity.
• Collaborate with engineers, product managers, and other stakeholders to ensure testing is a core component of project planning and execution.
• Continuously monitor and improve testing processes to optimize efficiency and reduce technical debt.

• Proven experience with modern machine learning frameworks (e.g., Transformers, PyTorch) and large-scale software projects.
• Experience managing high-volume test suites and cross-platform testing challenges.
• Strong understanding of CI/CD pipelines and automated testing frameworks.
• Strategic mindset that treats testing as a critical enabler of project growth and reliability.
• Proficiency in designing scalable, modular, and maintainable testing architectures.
• Excellent collaboration and communication skills in English.
• Preferred: background in open-source development and experience re-architecting testing systems for rapidly growing projects.