Senior Software Engineer, AI Training

CanadaRemoteContractsenior

OtherSoftware Engineer Ai

2 views0 saves0 applied

Apply Now

Quick Summary

Overview

This position is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for a Senior Software Engineer, AI Training based in Canada.

Technical Tools

OtherSoftware Engineer Ai

This is a unique opportunity for an experienced software engineer to help evaluate the quality of interactions with modern AI coding agents.
Rather than writing production code, you will assess whether AI systems demonstrate the judgment, reasoning, and communication expected from strong engineers.
You will evaluate coding interactions end to end, from technical outputs to explanations, reasoning, and overall developer experience.
Your feedback will help define what high-quality AI-assisted development should look like in real-world scenarios.
The role requires strong engineering taste, rigorous judgment, and the ability to clearly explain what works, what does not, and why.
You will work remotely on flexible, project-based engagements with opportunities for ongoing assignments based on performance.

Evaluate AI-generated coding interactions from end to end, assessing whether responses are useful, accurate at a high level, and aligned with strong engineering practices.
Assess the quality of AI reasoning, explanations, preambles, and guidance rather than focusing solely on whether generated code is technically correct.
Distinguish between different levels of response quality and articulate what separates an acceptable interaction from an exceptional one.
Provide clear, direct, and well-reasoned written feedback on what worked, what failed, and what felt misleading, ineffective, or inconsistent with experienced engineering judgment.
Help establish standards for what excellent AI-assisted development interactions should look like across tools such as Cursor, Codex, and Claude Code.
Evaluate whether AI interactions demonstrate sound engineering judgment, build user trust, and guide developers effectively rather than simply producing technically valid output.
Record concise video explanations when needed to communicate evaluation findings and reasoning clearly.

Requirements

~1 min read

Senior, Staff, Principal-level software engineering experience, or equivalent depth of professional engineering experience.
Strong background in TypeScript/JavaScript or Python, with a deep understanding of modern software engineering practices.
Hands-on experience with at least one AI-assisted coding tool such as OpenAI Codex, Claude Code, or Cursor.
Strong familiarity with modern AI-assisted development workflows and the ways developers interact with coding agents.
Ability to evaluate code and engineering decisions at a high level without necessarily executing the code or reviewing every individual line.
Strong written and spoken English at B2 level or above, with the ability to provide detailed written feedback and record short video explanations.
Comfortable making subjective but rigorous judgments and communicating direct, well-supported opinions.
High standards for engineering quality, developer experience, technical reasoning, and effective communication.