Strong Junior QA Manual Engineer

Why Join Us?

If you're looking to work on cutting-edge AI products, solve challenging problems, and be part of a fast-moving, high-talent team, you'll love it here.

Join NineTwoThree AI Studio, a remote-first product design, engineering, and marketing studio, founded in 2012 and based in Boston. We build AI-powered web and mobile apps for big brands and fast-moving startups — from Fortune 500 companies to MIT research labs.

You'll work with really smart people — the kind of teammates who challenge you, push you forward, and make you better. We move fast and focus on getting things done.

We've been growing 20% every year for the last 5 years, which means there's plenty of room for career growth and promotions. We run on clear processes and strong leadership — we move quickly, but we don't do chaos. We do high-quality work, and we do it right.

We focus on products with a positive impact: sports, health, logistics, nuclear, and AI. If you're into gambling, adult entertainment, or crypto — we're not your place.

About This Role

This is not a traditional QA role. Most of our products are powered by AI — meaning the system's output is intentionally non-deterministic. There's no single "right answer" to compare against. Your job is to figure out what "correct" looks like for a given business goal, build your own definition of it, and systematically verify whether the system gets there.

You'll be testing things like: does the AI response correctly synthesize data from multiple sources? Does it apply the right organisational rules? Does it stay within its intended boundaries or leak information it shouldn't?

We'll teach you the tools and techniques. What we can't teach is how you think — and that's what we're hiring for.

What This Role Is Not

• It's not pixel-perfect UI checking (though functional correctness is still your baseline)
• It's not pass/fail against a rigid spec
• It's not for someone who is "comfortable with ambiguity" in the sense of being okay with vague conclusions — you'll be expected to resolve ambiguity, not tolerate it

Mindset we're hiring for (this matters more than your CV):

• When requirements are vague, you don't get stuck — you form a hypothesis, define your own acceptance criteria, and test against it
• You understand that AI systems fail in specific, diagnosable ways: hallucination, retrieval gaps, prompt sensitivity, role/permission leakage
• You think in terms of outcomes and business goals, not just functional steps
• You're honest when something is untestable without more information — and you push to get that information

• Review requirements and independently define what "correct output" looks like when none is explicitly stated
• Design test plans, scenarios, and checklists for AI-powered features where expected results are probabilistic
• Perform manual functional, regression, and exploratory testing across web and mobile
• Test AI outputs for hallucinations, incomplete retrieval, confidently wrong answers, and failure to apply business rules
• Inspect API requests and responses via DevTools or Postman to verify what data the system actually used — not just what it showed
• Document and report bugs with enough context that developers can reproduce and diagnose them
• Collaborate closely with developers, product managers, and AI engineers

• Present findings clearly to both technical and non-technical stakeholders

Must-have:

• 1.5+ years in QA or software engineering
• Strong understanding of QA process, methodology, and terminology (test plan, test  cases, SDLC, regression)
• Experience with manual testing of web and mobile applications
• Comfort working with REST API and browser DevTools to inspect what's actually happening under the hood
• Upper-Intermediate English (you'll communicate with international clients daily)
• You ask "why is this the right answer?" before accepting what the screen shows you

Nice to have:

• Basic SQL or ability to query data directly to verify what the system pulled
• Familiarity with how LLMs, RAG pipelines, or AI chatbots work under the hood
• Experience testing products with role-based access control (RBAC)