English (Australia) Audio Rater

We're looking for detail-oriented Audio Raters to evaluate conversations between users and AI voice agents. You'll listen to recorded interactions and assess the quality of the AI agent's responses across two key dimensions.

• →Listen carefully to recorded conversations between a person and an AI voice agent
• →Rate each of the agent's turns on two independent 1–5 scales:
  • →Content – Was the response helpful, relevant, and appropriate?
  • →Prosody – Did the voice sound natural, well-paced, and expressive?
• →Write a short, specific, and clear justification for each score given

• Strong listening and attention-to-detail skills
• Ability to give consistent, well-reasoned ratings
• Clear, concise written communication
• Reliable availability for ~10 hours/week

Thank you for your interest in joining Welo Data’s community and contributing to this exciting project. We look forward to collaborating with you!