TASKS YOU'LL SEE • Feature build -- Add a working feature to a live library without breaking ... WHAT YOU JUDGE IN A TRAJECTORY • Was the command right for the state the environment was actually ...
TASKS YOU'LL SEE • Feature build -- Add a working feature to a live library without breaking ... WHAT YOU JUDGE IN A TRAJECTORY • Was the command right for the state the environment was actually ...
TASKS YOU'LL SEE • Feature build -- Add a working feature to a live library without breaking ... WHAT YOU JUDGE IN A TRAJECTORY • Was the command right for the state the environment was actually ...
TASKS YOU'LL SEE • Feature build -- Add a working feature to a live library without breaking ... WHAT YOU JUDGE IN A TRAJECTORY • Was the command right for the state the environment was actually ...
TASKS YOU'LL SEE • Feature build -- Add a working feature to a live library without breaking ... WHAT YOU JUDGE IN A TRAJECTORY • Was the command right for the state the environment was actually ...
TASKS YOU'LL SEE • Feature build -- Add a working feature to a live library without breaking ... WHAT YOU JUDGE IN A TRAJECTORY • Was the command right for the state the environment was actually ...
AI Agent Trajectory Annotator and Reviewer
Providence, RI · On-site
$20 - $30/hr
TASKS YOU'LL SEE • Feature build -- Add a working feature to a live library without breaking ... WHAT YOU JUDGE IN A TRAJECTORY • Was the command right for the state the environment was actually ...
AI Agent Trajectory Annotator and Reviewer
Providence, RI · On-site
$20 - $30/hr
TASKS YOU'LL SEE • Feature build -- Add a working feature to a live library without breaking ... WHAT YOU JUDGE IN A TRAJECTORY • Was the command right for the state the environment was actually ...
AI Agent Trajectory Annotator and Reviewer
Cranston, RI · On-site
$20 - $30/hr
TASKS YOU'LL SEE • Feature build -- Add a working feature to a live library without breaking ... WHAT YOU JUDGE IN A TRAJECTORY • Was the command right for the state the environment was actually ...
AI Agent Trajectory Annotator and Reviewer
Cranston, RI · On-site
$20 - $30/hr
TASKS YOU'LL SEE • Feature build -- Add a working feature to a live library without breaking ... WHAT YOU JUDGE IN A TRAJECTORY • Was the command right for the state the environment was actually ...
AI Agent Trajectory Annotator and Reviewer
Warwick, RI · On-site
$20 - $30/hr
TASKS YOU'LL SEE • Feature build -- Add a working feature to a live library without breaking ... WHAT YOU JUDGE IN A TRAJECTORY • Was the command right for the state the environment was actually ...
AI Agent Trajectory Annotator and Reviewer
Warwick, RI · On-site
$20 - $30/hr
TASKS YOU'LL SEE • Feature build -- Add a working feature to a live library without breaking ... WHAT YOU JUDGE IN A TRAJECTORY • Was the command right for the state the environment was actually ...
TASKS YOU'LL SEE • Feature build -- Add a working feature to a live library without breaking ... WHAT YOU JUDGE IN A TRAJECTORY • Was the command right for the state the environment was actually ...
TASKS YOU'LL SEE • Feature build -- Add a working feature to a live library without breaking ... WHAT YOU JUDGE IN A TRAJECTORY • Was the command right for the state the environment was actually ...
AI Agent Trajectory Annotator and Reviewer
Pawtucket, RI · On-site
$20 - $30/hr
TASKS YOU'LL SEE • Feature build -- Add a working feature to a live library without breaking ... WHAT YOU JUDGE IN A TRAJECTORY • Was the command right for the state the environment was actually ...
AI Agent Trajectory Annotator and Reviewer
Pawtucket, RI · On-site
$20 - $30/hr
TASKS YOU'LL SEE • Feature build -- Add a working feature to a live library without breaking ... WHAT YOU JUDGE IN A TRAJECTORY • Was the command right for the state the environment was actually ...
TASKS YOU'LL SEE • Feature build -- Add a working feature to a live library without breaking ... WHAT YOU JUDGE IN A TRAJECTORY • Was the command right for the state the environment was actually ...
TASKS YOU'LL SEE • Feature build -- Add a working feature to a live library without breaking ... WHAT YOU JUDGE IN A TRAJECTORY • Was the command right for the state the environment was actually ...
Sr React Software Engineer
Woonsocket, RI · On-site
$100K - $110K/yr
Integrate APIs and manage client-side state efficiently * Participate in design reviews, code ... Exposure to design systems and UI libraries About Us: Branding Brand launched in 2008 as an ...
Quick apply
Sr React Software Engineer
Woonsocket, RI · On-site
$100K - $110K/yr
Integrate APIs and manage client-side state efficiently * Participate in design reviews, code ... Exposure to design systems and UI libraries About Us: Branding Brand launched in 2008 as an ...
Integrate APIs and manage client-side state efficiently * Participate in design reviews, code ... Exposure to design systems and UI libraries About Us: Branding Brand launched in 2008 as an ...
Integrate APIs and manage client-side state efficiently * Participate in design reviews, code ... Exposure to design systems and UI libraries About Us: Branding Brand launched in 2008 as an ...
CNA South County Rhode Island
Warwick, RI · On-site
$19 - $21/hr
A "library" of senior care reference materials and resources in the office and online * On-the-job ... completion of a State approved Certified Nurse Assistant (CNA) course * The Certified Nurse ...
CNA South County Rhode Island
Warwick, RI · On-site
$19 - $21/hr
A "library" of senior care reference materials and resources in the office and online * On-the-job ... completion of a State approved Certified Nurse Assistant (CNA) course * The Certified Nurse ...
Sr React Software Engineer
Woonsocket, RI · On-site
$100K - $110K/yr
Integrate APIs and manage client-side state efficiently * Participate in design reviews, code ... Exposure to design systems and UI libraries About Us: Branding Brand launched in 2008 as an ...
Sr React Software Engineer
Woonsocket, RI · On-site
$100K - $110K/yr
Integrate APIs and manage client-side state efficiently * Participate in design reviews, code ... Exposure to design systems and UI libraries About Us: Branding Brand launched in 2008 as an ...
Sr React Software Engineer
Woonsocket, RI · Hybrid
$100K - $110K/yr
Integrate APIs and manage client-side state efficiently * Participate in design reviews, code ... Exposure to design systems and UI libraries About Us: Branding Brand launched in 2008 as an ...
Sr React Software Engineer
Woonsocket, RI · Hybrid
$100K - $110K/yr
Integrate APIs and manage client-side state efficiently * Participate in design reviews, code ... Exposure to design systems and UI libraries About Us: Branding Brand launched in 2008 as an ...
CNA South County Rhode Island
Warwick, RI · On-site
$19 - $21/wk
A "library" of senior care reference materials and resources in the office and online * On-the-job ... completion of a State approved Certified Nurse Assistant (CNA) course * The Certified Nurse ...
Quick apply
CNA South County Rhode Island
Warwick, RI · On-site
$19 - $21/wk
A "library" of senior care reference materials and resources in the office and online * On-the-job ... completion of a State approved Certified Nurse Assistant (CNA) course * The Certified Nurse ...
Sr React Software Engineer
Woonsocket, RI · On-site
$100K - $110K/yr
Integrate APIs and manage client-side state efficiently * Participate in design reviews, code ... Exposure to design systems and UI libraries About Us: Branding Brand launched in 2008 as an ...
Sr React Software Engineer
Woonsocket, RI · On-site
$100K - $110K/yr
Integrate APIs and manage client-side state efficiently * Participate in design reviews, code ... Exposure to design systems and UI libraries About Us: Branding Brand launched in 2008 as an ...
CNA South County Rhode Island
Warwick, RI · On-site
$15 - $20/hr
A "library" of senior care reference materials and resources in the office and online * On-the-job ... completion of a State approved Certified Nurse Assistant (CNA) course * The Certified Nurse ...
CNA South County Rhode Island
Warwick, RI · On-site
$15 - $20/hr
A "library" of senior care reference materials and resources in the office and online * On-the-job ... completion of a State approved Certified Nurse Assistant (CNA) course * The Certified Nurse ...
Director of IT
Providence, RI · On-site
$120K/yr
Ensure compliance with federal and state regulations, including HUD requirements, regarding ... Education Level * Bachelor's degree in Information Technology, Computer Science, Business ...
Quick apply
Director of IT
Providence, RI · On-site
$120K/yr
Ensure compliance with federal and state regulations, including HUD requirements, regarding ... Education Level * Bachelor's degree in Information Technology, Computer Science, Business ...
React Front-End Architect / Tech Lead
Woonsocket, RI · Hybrid
$100K - $125K/yr
Build and govern reusable component libraries, design systems, and design tokens * Enable platform ... of state management, data fetching, and caching strategies * Experience working in large ...
React Front-End Architect / Tech Lead
Woonsocket, RI · Hybrid
$100K - $125K/yr
Build and govern reusable component libraries, design systems, and design tokens * Enable platform ... of state management, data fetching, and caching strategies * Experience working in large ...
React Front-End Architect / Tech Lead
Woonsocket, RI · On-site
$100K - $125K/yr
Build and govern reusable component libraries, design systems, and design tokens * Enable platform ... of state management, data fetching, and caching strategies * Experience working in large ...
React Front-End Architect / Tech Lead
Woonsocket, RI · On-site
$100K - $125K/yr
Build and govern reusable component libraries, design systems, and design tokens * Enable platform ... of state management, data fetching, and caching strategies * Experience working in large ...
Library In State information
What is a library in state?
What are some common challenges faced by library in state professionals when managing diverse patron needs?
What are the key skills and qualifications needed to thrive as a library assistant, and why are they important?
What are popular job titles related to Library In State jobs in Rhode Island?
For Library In State jobs in Rhode Island, the most frequently searched job titles are:
What job categories do people searching Library In State jobs in Rhode Island look for?
The top searched job categories for Library In State jobs in Rhode Island are:
What cities in Rhode Island are hiring for Library In State jobs?
Cities in Rhode Island with the most Library In State job openings:

AI Agent Trajectory Annotator and Reviewer
Warwick, RI
$20 - $30/hr
Full-time
Posted 10 days ago
Job description
Type: Contract, hourly
Location: Remote
Hours: 20–30 per week
Pay: $20–30/hour, based on experience and language coverage
Start: Immediate
ABOUT THE ROLE
We evaluate how well advanced AI coding agents solve real engineering problems. An agent is given a real open source codebase inside a container and a hard task, then works on its own for 80 to 250 steps. A trajectory is the full record of that run — every command, result, and decision.
You will do two jobs, and you should expect either on any given day.
•Annotate — Read a trajectory nobody has looked at yet and judge it step by step.
• Review — Take an existing annotation, written by our AI tooling or another person, and confirm, correct, or reject it.
TASKS YOU'LL SEE
• Feature build — Add a working feature to a live library without breaking anything that already worked.
• Rebuild — Work out what a compiled tool does by running it, then rebuild it to match its output, exit codes, and file effects.
• Bug hunt — Find and fix twenty undocumented bugs across a dozen files with no test suite, then record what caused them.
Mostly Python and Go, with some Rust, C, and Ct+. A trajectory runs about 100 steps.
WHAT YOU JUDGE IN A TRAJECTORY
• Was the command right for the state the environment was actually in?
• Did the agent read the previous output correctly?
• Was the step wrong, or only inefficient — these are scored differently.
• Where did the run first go off course — usually earlier than where it visibly broke.
• Did the agent notice its own mistake and recover, or keep building on a false assumption?
• Did it game the grader instead of solving the task (e.g., weakening a test or hardcoding an expected value)?
WHAT WE NEED FROM YOU
• Experience — 2+ years in software engineering, DevOps, or site reliability, with real debugging in real codebases.
• Languages — Strong in Python or Go, and able to read a language you've never used.
• Linux — Comfortable with logs, running processes, build failures, and containers.
• Workflow — Everyday Git, diffs, pull requests, and issue tracking.
• Debugging — Able to work with no test suite and no error message pointing at the cause.
• Focus — Able to hold context across a long run, because step 74 can depend on step 12.
• Writing — Clear English, since every judgement needs an explanation another engineer can check.