... Review -- Take an existing annotation, written by our AI tooling or another person, and confirm ... TASKS YOU'LL SEE • Feature build -- Add a working feature to a live library without breaking ...
... Review -- Take an existing annotation, written by our AI tooling or another person, and confirm ... TASKS YOU'LL SEE • Feature build -- Add a working feature to a live library without breaking ...
... Review -- Take an existing annotation, written by our AI tooling or another person, and confirm ... TASKS YOU'LL SEE • Feature build -- Add a working feature to a live library without breaking ...
... Review -- Take an existing annotation, written by our AI tooling or another person, and confirm ... TASKS YOU'LL SEE • Feature build -- Add a working feature to a live library without breaking ...
... Review -- Take an existing annotation, written by our AI tooling or another person, and confirm ... TASKS YOU'LL SEE • Feature build -- Add a working feature to a live library without breaking ...
... Review -- Take an existing annotation, written by our AI tooling or another person, and confirm ... TASKS YOU'LL SEE • Feature build -- Add a working feature to a live library without breaking ...
Software Engineer 3 (AI Assisted Developer Tooling)
Columbia, MD · On-site
$151K/yr
This role emphasizes AI-assisted IDE capabilities, automated code quality workflows, and ... Integrate agent-based systems for repetitive developer tasks such as code reviews, unit test ...
Software Engineer 3 (AI Assisted Developer Tooling)
Columbia, MD · On-site
$151K/yr
This role emphasizes AI-assisted IDE capabilities, automated code quality workflows, and ... Integrate agent-based systems for repetitive developer tasks such as code reviews, unit test ...
This role emphasizes AI-assisted IDE capabilities, automated code quality workflows, and ... Integrate agent-based systems for repetitive developer tasks such as code reviews, unit test ...
This role emphasizes AI-assisted IDE capabilities, automated code quality workflows, and ... Integrate agent-based systems for repetitive developer tasks such as code reviews, unit test ...
Overview BigBear.ai is seeking a Software Engineer 3 to focus on improving the productivity and ... Integrate agent-based systems for repetitive developer tasks such as code reviews, unit test ...
Overview BigBear.ai is seeking a Software Engineer 3 to focus on improving the productivity and ... Integrate agent-based systems for repetitive developer tasks such as code reviews, unit test ...
Primary Responsibilities • Assist in conducting data and literature reviews, including targeted ... Project management experience, including leading AI tasks in multi-agency initiatives or ...
Primary Responsibilities • Assist in conducting data and literature reviews, including targeted ... Project management experience, including leading AI tasks in multi-agency initiatives or ...
Primary Responsibilities Assist in conducting data and literature reviews, including targeted ... Project management experience, including leading AI tasks in multi-agency initiatives or ...
Primary Responsibilities Assist in conducting data and literature reviews, including targeted ... Project management experience, including leading AI tasks in multi-agency initiatives or ...
Commercial Counsel - Remote
Alexandria, VA · Remote
$90 - $130/hr
... AI performance on contract tasks with rigor and consistency. * Collaborate with product and research teams to refine data, guidelines, and best practices for AI-driven contract review solutions.
Commercial Counsel - Remote
Alexandria, VA · Remote
$90 - $130/hr
... AI performance on contract tasks with rigor and consistency. * Collaborate with product and research teams to refine data, guidelines, and best practices for AI-driven contract review solutions.
General Counsel - Remote
Washington, DC · Remote
$90 - $130/hr
... AI performance on contract tasks with rigor and consistency. * Collaborate with product and research teams to refine data, guidelines, and best practices for AI-driven contract review solutions.
General Counsel - Remote
Washington, DC · Remote
$90 - $130/hr
... AI performance on contract tasks with rigor and consistency. * Collaborate with product and research teams to refine data, guidelines, and best practices for AI-driven contract review solutions.
Commercial Counsel - Remote
Washington, DC · Remote
$90 - $130/hr
... AI performance on contract tasks with rigor and consistency. * Collaborate with product and research teams to refine data, guidelines, and best practices for AI-driven contract review solutions.
Commercial Counsel - Remote
Washington, DC · Remote
$90 - $130/hr
... AI performance on contract tasks with rigor and consistency. * Collaborate with product and research teams to refine data, guidelines, and best practices for AI-driven contract review solutions.
General Counsel - Remote
Alexandria, VA · Remote
$90 - $130/hr
... AI performance on contract tasks with rigor and consistency. * Collaborate with product and research teams to refine data, guidelines, and best practices for AI-driven contract review solutions.
General Counsel - Remote
Alexandria, VA · Remote
$90 - $130/hr
... AI performance on contract tasks with rigor and consistency. * Collaborate with product and research teams to refine data, guidelines, and best practices for AI-driven contract review solutions.
Corporate Counsel - Remote
Alexandria, VA · Remote
$90 - $130/hr
... AI performance on contract tasks with rigor and consistency. * Collaborate with product and research teams to refine data, guidelines, and best practices for AI-driven contract review solutions.
Corporate Counsel - Remote
Alexandria, VA · Remote
$90 - $130/hr
... AI performance on contract tasks with rigor and consistency. * Collaborate with product and research teams to refine data, guidelines, and best practices for AI-driven contract review solutions.
Corporate Counsel - Remote
Washington, DC · Remote
$90 - $130/hr
... AI performance on contract tasks with rigor and consistency. * Collaborate with product and research teams to refine data, guidelines, and best practices for AI-driven contract review solutions.
Corporate Counsel - Remote
Washington, DC · Remote
$90 - $130/hr
... AI performance on contract tasks with rigor and consistency. * Collaborate with product and research teams to refine data, guidelines, and best practices for AI-driven contract review solutions.
Transaction Attorney
Washington, DC · Remote
$90 - $130/hr
... AI performance on contract tasks with rigor and consistency. * Collaborate with product and research teams to refine data, guidelines, and best practices for AI-driven contract review solutions.
Transaction Attorney
Washington, DC · Remote
$90 - $130/hr
... AI performance on contract tasks with rigor and consistency. * Collaborate with product and research teams to refine data, guidelines, and best practices for AI-driven contract review solutions.
Transaction Attorney
Alexandria, VA · Remote
$90 - $130/hr
... AI performance on contract tasks with rigor and consistency. * Collaborate with product and research teams to refine data, guidelines, and best practices for AI-driven contract review solutions.
Transaction Attorney
Alexandria, VA · Remote
$90 - $130/hr
... AI performance on contract tasks with rigor and consistency. * Collaborate with product and research teams to refine data, guidelines, and best practices for AI-driven contract review solutions.
Transactional Lawyer
Alexandria, VA · Remote
$90 - $130/hr
... AI performance on contract tasks with rigor and consistency. * Collaborate with product and research teams to refine data, guidelines, and best practices for AI-driven contract review solutions.
Transactional Lawyer
Alexandria, VA · Remote
$90 - $130/hr
... AI performance on contract tasks with rigor and consistency. * Collaborate with product and research teams to refine data, guidelines, and best practices for AI-driven contract review solutions.
Corporate Transactions Attorney - Remote
Alexandria, VA · Remote
$90 - $130/hr
... AI performance on contract tasks with rigor and consistency. * Collaborate with product and research teams to refine data, guidelines, and best practices for AI-driven contract review solutions.
Corporate Transactions Attorney - Remote
Alexandria, VA · Remote
$90 - $130/hr
... AI performance on contract tasks with rigor and consistency. * Collaborate with product and research teams to refine data, guidelines, and best practices for AI-driven contract review solutions.
Corporate Transactions Attorney - Remote
Washington, DC · Remote
$90 - $130/hr
... AI performance on contract tasks with rigor and consistency. * Collaborate with product and research teams to refine data, guidelines, and best practices for AI-driven contract review solutions.
Corporate Transactions Attorney - Remote
Washington, DC · Remote
$90 - $130/hr
... AI performance on contract tasks with rigor and consistency. * Collaborate with product and research teams to refine data, guidelines, and best practices for AI-driven contract review solutions.
Business Law Attorney
Washington, DC · Remote
$90 - $130/hr
... AI performance on contract tasks with rigor and consistency. * Collaborate with product and research teams to refine data, guidelines, and best practices for AI-driven contract review solutions.
Business Law Attorney
Washington, DC · Remote
$90 - $130/hr
... AI performance on contract tasks with rigor and consistency. * Collaborate with product and research teams to refine data, guidelines, and best practices for AI-driven contract review solutions.
Ai Task Reviewer information
What is the difference between Ai Task Reviewer vs Data Annotator?
| Aspect | Ai Task Reviewer | Data Annotator |
|---|---|---|
| Required Credentials | Basic computer skills, training in review guidelines | Basic computer skills, training in annotation tools |
| Work Environment | Remote or office-based, reviewing AI outputs | Remote or office-based, labeling and annotating data |
| Industry Usage | AI development, machine learning projects | Data preparation, machine learning datasets |
| Search & Comparison Intent | Understanding review roles in AI projects | Understanding data labeling roles in AI |
The main difference between an Ai Task Reviewer and a Data Annotator lies in their roles within AI development. Ai Task Reviewers focus on evaluating and validating AI outputs, ensuring quality and accuracy, while Data Annotators are responsible for labeling and preparing data used to train AI models. Both roles are essential in the AI industry, often requiring similar skills but serving different functions in the data pipeline.
Are remote AI task reviewer jobs legit?
Remote AI task reviewer jobs are legitimate positions where individuals evaluate and annotate data to improve AI systems. These roles often require attention to detail, basic computer skills, and sometimes specific training or guidelines, and they are commonly offered by reputable companies in the tech industry.
How to become an AI Task Reviewer?
To become an AI Task Reviewer, candidates typically need strong attention to detail, good understanding of AI and machine learning concepts, and experience with data annotation or content moderation. Relevant skills include familiarity with review platforms, basic knowledge of data labeling tools, and the ability to follow guidelines accurately. Some positions may require a high school diploma or equivalent, with advanced roles favoring prior experience in AI-related tasks.
What are popular job titles related to Ai Task Reviewer jobs in Washington?
For Ai Task Reviewer jobs in Washington, the most frequently searched job titles are:
What job categories do people searching Ai Task Reviewer jobs in Washington look for?
The top searched job categories for Ai Task Reviewer jobs in Washington are:
What cities in Washington are hiring for Ai Task Reviewer jobs?
Cities in Washington with the most Ai Task Reviewer job openings:
AI Agent Trajectory Annotator and Reviewer
Adelphi, MD
Bespoke Labs
$20 - $30/hr
Full-time
Posted 8 days ago
Job description
Type: Contract, hourly
Location: Remote
Hours: 20–30 per week
Pay: $20–30/hour, based on experience and language coverage
Start: Immediate
ABOUT THE ROLE
We evaluate how well advanced AI coding agents solve real engineering problems. An agent is given a real open source codebase inside a container and a hard task, then works on its own for 80 to 250 steps. A trajectory is the full record of that run — every command, result, and decision.
You will do two jobs, and you should expect either on any given day.
•Annotate — Read a trajectory nobody has looked at yet and judge it step by step.
• Review — Take an existing annotation, written by our AI tooling or another person, and confirm, correct, or reject it.
TASKS YOU'LL SEE
• Feature build — Add a working feature to a live library without breaking anything that already worked.
• Rebuild — Work out what a compiled tool does by running it, then rebuild it to match its output, exit codes, and file effects.
• Bug hunt — Find and fix twenty undocumented bugs across a dozen files with no test suite, then record what caused them.
Mostly Python and Go, with some Rust, C, and Ct+. A trajectory runs about 100 steps.
WHAT YOU JUDGE IN A TRAJECTORY
• Was the command right for the state the environment was actually in?
• Did the agent read the previous output correctly?
• Was the step wrong, or only inefficient — these are scored differently.
• Where did the run first go off course — usually earlier than where it visibly broke.
• Did the agent notice its own mistake and recover, or keep building on a false assumption?
• Did it game the grader instead of solving the task (e.g., weakening a test or hardcoding an expected value)?
WHAT WE NEED FROM YOU
• Experience — 2+ years in software engineering, DevOps, or site reliability, with real debugging in real codebases.
• Languages — Strong in Python or Go, and able to read a language you've never used.
• Linux — Comfortable with logs, running processes, build failures, and containers.
• Workflow — Everyday Git, diffs, pull requests, and issue tracking.
• Debugging — Able to work with no test suite and no error message pointing at the cause.
• Focus — Able to hold context across a long run, because step 74 can depend on step 12.
• Writing — Clear English, since every judgement needs an explanation another engineer can check.