QC Reviewer-Video Annotation(Philippines)

RemotePart Time

Other

2 views0 saves0 applied

Apply Now

Quick Summary

Overview

What You'll Do Review completed annotations of robot manipulation videos across three levels of labeling detail (atomic motion, skill/subtask, task/goal).

Technical Tools

Other

Responsibilities

~1 min read

→Review completed annotations of robot manipulation videos across three levels of labeling detail (atomic motion, skill/subtask, task/goal).
→Cross-check annotator descriptions against all three camera views (overhead and both wrist-mounted cameras) to verify accuracy of described actions, object identification, and contact/grasp details.
→Verify full coverage of each video — confirm there are no gaps in labeling, including idle or pause moments.
→Check that descriptions accurately reflect what actually happened in the video, including failures, drops, or slipped grips — flagging any instances where outcomes were inaccurately described or "smoothed over."
→Evaluate annotations for adherence to the style guide: correct vocabulary usage, spatial/directional accuracy, consistent terminology for objects and actions, and appropriate language variation (avoiding repetitive phrasing).
→Identify recurring errors or patterns of confusion among annotators and report them to the team lead for calibration purposes.
→Provide specific, actionable feedback on rejected or revised annotations, referencing the style guide and reference examples.
→Participate in periodic calibration sessions with the team and client to align QC standards with evolving guidelines or edge-case resolutions.
→Maintain a QC log or tracking sheet documenting review outcomes, common error types, and annotator performance trends (as required by the project).

Excellent written English and strong reading comprehension — you'll be evaluating precise, nuanced language choices, not just checking for typos.
Exceptional attention to detail — able to catch subtle mismatches between video content and written description (e.g., a mislabeled grasp type, an incorrect object part, a missed failure event).