AI Operations Lead (Human-in-the-Loop) - NYC-based

Are you a strategic leader who thrives at the intersection of data quality and people operations? Welo Data is seeking a Data Quality Lead to oversee high-impact teams of analysts dedicated to AI model evaluation.

This isn’t just a management role—it’s an opportunity to define how quality is measured in a human-in-the-loop environment. You will act as the bridge between technical stakeholders and analyst teams, translating complex AI guidelines into clear, actionable operational excellence.

• Team Architecture: Lead and mentor a specialized team of Data Quality Analysts, fostering growth and managing high-performance output.
• Quality Ownership: Own the end-to-end quality loop, including audits, calibrations, and the identification of model performance trends.
• Strategic Translation: Turn ambiguous, evolving AI guidelines into structured direction for your teams.
• Stakeholder Partnership: Act as the primary representative for your team, aligning with global stakeholders on quality standards and program goals.
• Operational Innovation: Drive continuous improvement across tooling, evaluation methods, and hiring for specialized linguistic talent.

• Job Title: AI Operations Lead 
• Employment Type: W2 Full-Time Employee
• Hours: 40 hrs/week
• Location: New York City
• Pay Rate: 38$/hour

• Education & Language: University degree (Bachelor’s or higher) and Native-level English proficiency are required.
• The Multilingual Edge: Proficiency in languages other than English is highly preferred, with a particular interest in candidates demonstrating bilingual mastery in French, Italian, German, Spanish, or Brazilian Portuguese.
• Industry Veteran: 5–8 years of experience in Data Quality, QA, or AI/ML operations.
• Proven Leader: 2+ years of experience managing teams in a high-scale data or AI environment.
• Strategic Mindset: Ability to "zoom out" to see patterns while maintaining deep attention to detail.
• Operational Agility: Comfortable navigating ambiguity and balancing speed with rigorous quality standards.
• Technical Interest: A genuine curiosity about how human feedback shapes the behavior of Large Language Models (LLMs).