Audio Rater for AI Voice Agent Evaluation
Job Description
Key Skills Required
Master these to land this role
Want to know if you're a match for this job?
Responsibilities
Listen carefully to recorded conversations between a person and an AI voice agent.
- Rate each of the agent's turns on two independent 1–5 scales:
- Content – Was the response helpful, relevant, and appropriate?
- Prosody – Did the voice sound natural, well-paced, and expressive?
- Write a short, specific, and clear justification for each score given.
What We're Looking For
- Strong listening and attention-to-detail skills
- Ability to give consistent, well-reasoned ratings
- Clear, concise written communication
- Reliable availability for ~10 hours/week
How would you rate this job post?
See what other professionals think about this role.
Similar Opportunities
Bilingual Voice Actor (English & Chinese) - Project-Based Opportunity
toloka AI
CanadaBilingual Voice Actor (English & Chinese) - Project-Based Opportunity
toloka AI
CanadaBilingual Voice Actor (English & Chinese) - Project-Based Opportunity
toloka AI
CanadaBilingual Voice Actor (English & Chinese) - Project-Based Opportunity
toloka AI
CanadaMore Openings at Welo Global
Explore Top Companies in this Space
Planera
Construction Tech & Scheduling Software / Collaborative CPM Analytics / Project Management SaaS / B2B Enterprise Software
Meridian Partners
Enterprise Software / ERP Solutions / Logistics / Business Services
Rare Candy
Ecommerce / Digital Collectibles / Blockchain / Marketplaces
Frontiers
Academic Publishing / Open Access / Research Networks / Scientific Journals
Welo Global
View Company ProfileWelo is a premier, enterprise-grade virtual collaboration powerhouse engineered to orchestrate massive-scale hybrid-work ecosystems and intelligent, frictionless professional-interaction workflows. Operating as a tech-enabled "spatial-first" engagement hub, the company eliminates the operational friction of traditional, legacy video-conferencing models—which frequently suffer from platform-fatigue, fragmented team-connectivity, and disconnected spontaneous-collaboration—by seamlessly deploying advanced "Spatial Audio" telemetry, rigorous virtual-environment interaction architectures, and cohesive cross-departmental community-building frameworks. Moving beyond rigid legacy grid-view paradigms, Welo empowers global remote/hybrid teams to dynamically synchronize their meeting-productivity, creative-brainstorming, and social-connection pipelines with elite, scalable, and audit-ready execution. Under the hood, their sophisticated proprietary operational infrastructure—bolstered by a unique map-based interface—natively manages complex real-time engagement ingestion, instantaneous proximity-based audio routing, and automated presence-optimization workflows, providing the necessary operational foundation to support the modern, distributed-work economy. What sets Welo apart is its uncompromising dedication to frictionless experience-orchestration; by bridging the gap between highly technical, performance-intensive collaboration demands and accessible, high-velocity virtual-office interfaces, the firm empowers modern engineering and creative organizations to radically accelerate their team-cohesion velocity, eliminate systemic isolation-bottlenecks, and build an unassailable foundation for continuous commercial and institutional dominance in the modern, AI-transformed global-digital landscape.
Safety First
- Never pay for a job application.
- Do not share sensitive bank info.
- Verify the client before starting work.



