Audio Rater (AI Voice Agent Evaluation)
Job Description
Key Skills Required
Master these to land this role
Want to know if you're a match for this job?
Responsibilities
Listen carefully to recorded conversations between a person and an AI voice agent.
- Rate each of the agent's turns on two independent 1–5 scales:
- Content – Was the response helpful, relevant, and appropriate?
- Prosody – Did the voice sound natural, well-paced, and expressive?
- Write a short, specific, and clear justification for each score given.
What We're Looking For
We are seeking candidates with the following skills and attributes:
- Strong listening and attention-to-detail skills
- Ability to give consistent, well-reasoned ratings
- Clear, concise written communication
- Reliable availability for approximately 10 hours per week
How would you rate this job post?
See what other professionals think about this role.
Similar Opportunities
Audio Rater for AI Voice Agent Evaluation
Welo Global
CanadaAudio Rater (AI Voice Agent Evaluation)
Welo Global
AustraliaNative or Near-Native Malay/Tamil Voice Actor for AI Speech Data Collection (Singapore)
Cloudfactory
SingaporeBilingual Voice Actor (English & Chinese) - Project-Based Opportunity
toloka AI
TaiwanMore Openings at Welo Global
Explore Top Companies in this Space
Planera
Construction Tech & Scheduling Software / Collaborative CPM Analytics / Project Management SaaS / B2B Enterprise Software
Meridian Partners
Enterprise Software / ERP Solutions / Logistics / Business Services
Rare Candy
Ecommerce / Digital Collectibles / Blockchain / Marketplaces
Frontiers
Academic Publishing / Open Access / Research Networks / Scientific Journals
Welo Global
View Company ProfileWelo is a premier, enterprise-grade virtual collaboration powerhouse engineered to orchestrate massive-scale hybrid-work ecosystems and intelligent, frictionless professional-interaction workflows. Operating as a tech-enabled "spatial-first" engagement hub, the company eliminates the operational friction of traditional, legacy video-conferencing models—which frequently suffer from platform-fatigue, fragmented team-connectivity, and disconnected spontaneous-collaboration—by seamlessly deploying advanced "Spatial Audio" telemetry, rigorous virtual-environment interaction architectures, and cohesive cross-departmental community-building frameworks. Moving beyond rigid legacy grid-view paradigms, Welo empowers global remote/hybrid teams to dynamically synchronize their meeting-productivity, creative-brainstorming, and social-connection pipelines with elite, scalable, and audit-ready execution. Under the hood, their sophisticated proprietary operational infrastructure—bolstered by a unique map-based interface—natively manages complex real-time engagement ingestion, instantaneous proximity-based audio routing, and automated presence-optimization workflows, providing the necessary operational foundation to support the modern, distributed-work economy. What sets Welo apart is its uncompromising dedication to frictionless experience-orchestration; by bridging the gap between highly technical, performance-intensive collaboration demands and accessible, high-velocity virtual-office interfaces, the firm empowers modern engineering and creative organizations to radically accelerate their team-cohesion velocity, eliminate systemic isolation-bottlenecks, and build an unassailable foundation for continuous commercial and institutional dominance in the modern, AI-transformed global-digital landscape.
Safety First
- Never pay for a job application.
- Do not share sensitive bank info.
- Verify the client before starting work.


