Back to Jobs
NineTwoThree
Data Science & Analytics 2h ago

AI QA Engineer

NineTwoThree
UkraineUkraine
Full-time
Not Disclosed
Mid-Level

Job Description

Key Skills Required

Master these to land this role

SQLBestseller šŸ”„
Learn in 9 Hours
Data AnalystBestseller šŸ”„
Learn in 88 Hours
Power BIBestseller šŸ”„
Learn in 17 Hours
Machine LearningBestseller šŸ”„
Learn in 42 Hours
Business IntelligenceData ScientistTableauAI EngineerBig DataData Scraping

Want to know if you're a match for this job?

Calculate My Match Score

About This Role

This is not a traditional QA role. Most of our products are powered by AI — meaning the system's output is intentionally non-deterministic. There's no single "right answer" to compare against. Your job is to figure out what "correct" looks like for a given business goal, build your own definition of it, and systematically verify whether the system gets there.

You'll be testing things like: does the AI response correctly synthesize data from multiple sources? Does it apply the right organisational rules? Does it stay within its intended boundaries or leak information it shouldn't?

We'll teach you the tools and techniques. What we can't teach is how you think — and that's what we're hiring for.

Requirements

  • Review requirements and independently define what "correct output" looks like when none is explicitly stated
  • Design test plans, scenarios, and checklists for AI-powered features where expected results are probabilistic
  • Perform manual functional, regression, and exploratory testing across web and mobile
  • Test AI outputs for hallucinations, incomplete retrieval, confidently wrong answers, and failure to apply business rules
  • Inspect API requests and responses via DevTools or Postman to verify what data the system actually used — not just what it showed
  • Document and report bugs with enough context that developers can reproduce and diagnose them
  • Collaborate closely with developers, product managers, and AI engineers
  • Present findings clearly to both technical and non-technical stakeholders

Must-have:

  • 1.5+ years in QA or software engineering
  • Strong understanding of QA process, methodology, and terminology (test plan, test cases, SDLC, regression)
  • Experience with manual testing of web and mobile applications
  • Comfort working with REST API and browser DevTools to inspect what's actually happening under the hood
  • Upper-Intermediate English (you'll communicate with international clients daily)
  • You ask "why is this the right answer?" before accepting what the screen shows you

Benefits

What We Offer:

  • Annual paid vacation: 20 days-off per year during the first 3 years, further increasing to 25 days in later years.
  • Paid sick leave, 10 national holidays and 2 company days-off.
  • Well-being budget.
  • Health Insurance allowance.
  • Maternity/paternity leave.
  • Accounting assistance.
  • Reimbursement of expenses for professional development courses/certifications (up to 100% in agreement with the Manager).
  • Hardware upon business needs.
  • Strong positive engineering culture, a tightly-knit team of professionals with a good sense of humor.

How would you rate this job post?

See what other professionals think about this role.

banner

NineTwoThree (operating at ninetwothree.co) is a product design, engineering & marketing studio engineered for building custom AI solutions. Founded in 2012 by Andrew Amann & Pavel Kirillov and headquartered in Boston, NineTwoThree builds custom AI solutions for established brands & funded startups. Under the hood, the company leverages its experience in building 14 internal startups & 150 products to one billion dollars. This allows companies to achieve positive ROI. Backed by an estimated $16M revenue in 2024 and a valuation of $48M.

Safety First

  • Never pay for a job application.
  • Do not share sensitive bank info.
  • Verify the client before starting work.
Learn More
AI QA Engineer at NineTwoThree