Job Description
Key Skills Required
Master these to land this role
Want to know if you're a match for this job?
About This Role
This is not a traditional QA role. Most of our products are powered by AI ā meaning the system's output is intentionally non-deterministic. There's no single "right answer" to compare against. Your job is to figure out what "correct" looks like for a given business goal, build your own definition of it, and systematically verify whether the system gets there.
You'll be testing things like: does the AI response correctly synthesize data from multiple sources? Does it apply the right organisational rules? Does it stay within its intended boundaries or leak information it shouldn't?
We'll teach you the tools and techniques. What we can't teach is how you think ā and that's what we're hiring for.
Requirements
- Review requirements and independently define what "correct output" looks like when none is explicitly stated
- Design test plans, scenarios, and checklists for AI-powered features where expected results are probabilistic
- Perform manual functional, regression, and exploratory testing across web and mobile
- Test AI outputs for hallucinations, incomplete retrieval, confidently wrong answers, and failure to apply business rules
- Inspect API requests and responses via DevTools or Postman to verify what data the system actually used ā not just what it showed
- Document and report bugs with enough context that developers can reproduce and diagnose them
- Collaborate closely with developers, product managers, and AI engineers
- Present findings clearly to both technical and non-technical stakeholders
Must-have:
- 1.5+ years in QA or software engineering
- Strong understanding of QA process, methodology, and terminology (test plan, test cases, SDLC, regression)
- Experience with manual testing of web and mobile applications
- Comfort working with REST API and browser DevTools to inspect what's actually happening under the hood
- Upper-Intermediate English (you'll communicate with international clients daily)
- You ask "why is this the right answer?" before accepting what the screen shows you
Benefits
What We Offer:
- Annual paid vacation: 20 days-off per year during the first 3 years, further increasing to 25 days in later years.
- Paid sick leave, 10 national holidays and 2 company days-off.
- Well-being budget.
- Health Insurance allowance.
- Maternity/paternity leave.
- Accounting assistance.
- Reimbursement of expenses for professional development courses/certifications (up to 100% in agreement with the Manager).
- Hardware upon business needs.
- Strong positive engineering culture, a tightly-knit team of professionals with a good sense of humor.
How would you rate this job post?
See what other professionals think about this role.
Similar Opportunities
More Openings at NineTwoThree
Explore Top Companies in this Space
Get Vocal Pbc
Technology / Social Impact Software
GenPeach AI
Artificial Intelligence / Generative AI / Enterprise Software
Clariticloudinc
Permitting Software

Canonical
Computer Software
NineTwoThree
View Company ProfileNineTwoThree (operating at ninetwothree.co) is a product design, engineering & marketing studio engineered for building custom AI solutions. Founded in 2012 by Andrew Amann & Pavel Kirillov and headquartered in Boston, NineTwoThree builds custom AI solutions for established brands & funded startups. Under the hood, the company leverages its experience in building 14 internal startups & 150 products to one billion dollars. This allows companies to achieve positive ROI. Backed by an estimated $16M revenue in 2024 and a valuation of $48M.
Safety First
- Never pay for a job application.
- Do not share sensitive bank info.
- Verify the client before starting work.





