AI Quality Analyst (Healthcare)

About the Role: We are looking for an AI Quality Analyst to support live deployments of AI systems for an early-stage company building coordination tools for home care agencies. This is a critical Human-in-the-Loop role where you will ensure AI agents perform reliably in real-world environments by reviewing interactions, stepping in when the system faces ambiguity, and helping the team improve system performance.

What You'll Work On

• Real-Time Monitoring & QA: Review live call transcripts and text messages to ensure accuracy and identify failure patterns or edge cases.
• Human-in-the-Loop Intervention: Step in when AI encounters ambiguity, interpreting nuanced inputs to determine the appropriate next steps.
• Escalation & Communication: Translate technical issues into clear, actionable communication for customers and internal teams via Slack and Teams.
• Continuous Improvement: Surface recurring patterns to inform product updates and document edge cases for future automated handling.
• Maintain a high standard of written and verbal English across all high-volume, real-time workflows.

What You Bring

• 2 to 3 years of experience in operations, QA, technical support, or a similar role.
• Strong ability to spot inconsistencies and failure patterns under high-volume pressure.
• Comfortable making decisions in ambiguous, fast-moving environments without constant direction.
• Highly reliable and responsive, with the ability to navigate multiple communication platforms simultaneously.
• Must be available to work 9 AM to 5 PM Eastern Time (EST).
• Nice to Have: Familiarity with EMR/EHR systems and experience in healthcare or home care environments.

Why You'll Want to Join

• Get paid in USD (bi-monthly: every 15th and 30th).
• 100% remote setup work from Philippines, Mexico, Argentina, Sri Lanka, South Africa and Nigeria.
• Paid Time Off and observance of holidays per company guidelines.
• Opportunity to work directly inside an early stage AI startup building meaningful healthcare infrastructure.
• Be part of a team that moves fast and values independent judgment.