Immediate ABOUT THE ROLE We evaluate how well advanced AI coding agents solve real engineering problems. An agent is given a real open source codebase inside a container and a hard task, then works ...
Immediate ABOUT THE ROLE We evaluate how well advanced AI coding agents solve real engineering problems. An agent is given a real open source codebase inside a container and a hard task, then works ...
Immediate ABOUT THE ROLE We evaluate how well advanced AI coding agents solve real engineering problems. An agent is given a real open source codebase inside a container and a hard task, then works ...
Immediate ABOUT THE ROLE We evaluate how well advanced AI coding agents solve real engineering problems. An agent is given a real open source codebase inside a container and a hard task, then works ...
Immediate ABOUT THE ROLE We evaluate how well advanced AI coding agents solve real engineering problems. An agent is given a real open source codebase inside a container and a hard task, then works ...
Immediate ABOUT THE ROLE We evaluate how well advanced AI coding agents solve real engineering problems. An agent is given a real open source codebase inside a container and a hard task, then works ...
AI Agent Trajectory Annotator and Reviewer
Carrollton, GA · On-site
$20 - $30/hr
Immediate ABOUT THE ROLE We evaluate how well advanced AI coding agents solve real engineering problems. An agent is given a real open source codebase inside a container and a hard task, then works ...
AI Agent Trajectory Annotator and Reviewer
Carrollton, GA · On-site
$20 - $30/hr
Immediate ABOUT THE ROLE We evaluate how well advanced AI coding agents solve real engineering problems. An agent is given a real open source codebase inside a container and a hard task, then works ...
Immediate ABOUT THE ROLE We evaluate how well advanced AI coding agents solve real engineering problems. An agent is given a real open source codebase inside a container and a hard task, then works ...
Immediate ABOUT THE ROLE We evaluate how well advanced AI coding agents solve real engineering problems. An agent is given a real open source codebase inside a container and a hard task, then works ...
Immediate ABOUT THE ROLE We evaluate how well advanced AI coding agents solve real engineering problems. An agent is given a real open source codebase inside a container and a hard task, then works ...
Immediate ABOUT THE ROLE We evaluate how well advanced AI coding agents solve real engineering problems. An agent is given a real open source codebase inside a container and a hard task, then works ...
AI Agent Trajectory Annotator and Reviewer
Athens, GA · On-site
$20 - $30/hr
Immediate ABOUT THE ROLE We evaluate how well advanced AI coding agents solve real engineering problems. An agent is given a real open source codebase inside a container and a hard task, then works ...
AI Agent Trajectory Annotator and Reviewer
Athens, GA · On-site
$20 - $30/hr
Immediate ABOUT THE ROLE We evaluate how well advanced AI coding agents solve real engineering problems. An agent is given a real open source codebase inside a container and a hard task, then works ...
AI Agent Trajectory Annotator and Reviewer
Valdosta, GA · On-site
$20 - $30/hr
Immediate ABOUT THE ROLE We evaluate how well advanced AI coding agents solve real engineering problems. An agent is given a real open source codebase inside a container and a hard task, then works ...
AI Agent Trajectory Annotator and Reviewer
Valdosta, GA · On-site
$20 - $30/hr
Immediate ABOUT THE ROLE We evaluate how well advanced AI coding agents solve real engineering problems. An agent is given a real open source codebase inside a container and a hard task, then works ...
AI Agent Trajectory Annotator and Reviewer
Macon, GA · On-site
$20 - $30/hr
Immediate ABOUT THE ROLE We evaluate how well advanced AI coding agents solve real engineering problems. An agent is given a real open source codebase inside a container and a hard task, then works ...
AI Agent Trajectory Annotator and Reviewer
Macon, GA · On-site
$20 - $30/hr
Immediate ABOUT THE ROLE We evaluate how well advanced AI coding agents solve real engineering problems. An agent is given a real open source codebase inside a container and a hard task, then works ...
Immediate ABOUT THE ROLE We evaluate how well advanced AI coding agents solve real engineering problems. An agent is given a real open source codebase inside a container and a hard task, then works ...
Immediate ABOUT THE ROLE We evaluate how well advanced AI coding agents solve real engineering problems. An agent is given a real open source codebase inside a container and a hard task, then works ...
Conversational AI Engineer
Alpharetta, GA · On-site
... agent leveraging the latest advancements in Generative AI and Natural Language Processing (NLP ... Develop and optimize a Generative AI-powered virtual assistant to provide accurate, dynamic, and ...
Conversational AI Engineer
Alpharetta, GA · On-site
... agent leveraging the latest advancements in Generative AI and Natural Language Processing (NLP ... Develop and optimize a Generative AI-powered virtual assistant to provide accurate, dynamic, and ...
Immediate ABOUT THE ROLE We evaluate how well advanced AI coding agents solve real engineering problems. An agent is given a real open source codebase inside a container and a hard task, then works ...
Immediate ABOUT THE ROLE We evaluate how well advanced AI coding agents solve real engineering problems. An agent is given a real open source codebase inside a container and a hard task, then works ...
Immediate ABOUT THE ROLE We evaluate how well advanced AI coding agents solve real engineering problems. An agent is given a real open source codebase inside a container and a hard task, then works ...
Immediate ABOUT THE ROLE We evaluate how well advanced AI coding agents solve real engineering problems. An agent is given a real open source codebase inside a container and a hard task, then works ...
AI Agent Trajectory Annotator and Reviewer
Atlanta, GA · On-site
$20 - $30/hr
Immediate ABOUT THE ROLE We evaluate how well advanced AI coding agents solve real engineering problems. An agent is given a real open source codebase inside a container and a hard task, then works ...
AI Agent Trajectory Annotator and Reviewer
Atlanta, GA · On-site
$20 - $30/hr
Immediate ABOUT THE ROLE We evaluate how well advanced AI coding agents solve real engineering problems. An agent is given a real open source codebase inside a container and a hard task, then works ...
AI/ML Platform Engineer
Atlanta, GA · On-site
As the platform foundation of the Applied AI Engineering & Operations team, this role supports classical machine learning, generative AI, agent-based solutions, and enterprise-scale analytics ...
AI/ML Platform Engineer
Atlanta, GA · On-site
As the platform foundation of the Applied AI Engineering & Operations team, this role supports classical machine learning, generative AI, agent-based solutions, and enterprise-scale analytics ...
AI/ML Platform Engineer
Atlanta, GA · On-site
Provide the platform foundations supporting machine learning, generative AI, agent-based solutions ... developer productivity. * Partner with architecture, infrastructure, security, and engineering ...
AI/ML Platform Engineer
Atlanta, GA · On-site
Provide the platform foundations supporting machine learning, generative AI, agent-based solutions ... developer productivity. * Partner with architecture, infrastructure, security, and engineering ...
AI/ML Platform Engineer
Atlanta, GA · On-site
As the platform foundation of the Applied AI Engineering & Operations team, this role supports classical machine learning, generative AI, agent-based solutions, and enterprise-scale analytics ...
New
AI/ML Platform Engineer
Atlanta, GA · On-site
As the platform foundation of the Applied AI Engineering & Operations team, this role supports classical machine learning, generative AI, agent-based solutions, and enterprise-scale analytics ...
New
AI/ML Platform Engineer
Atlanta, GA · On-site
As the platform foundation of the Applied AI Engineering & Operations team, this role supports classical machine learning, generative AI, agent-based solutions, and enterprise-scale analytics ...
AI/ML Platform Engineer
Atlanta, GA · On-site
As the platform foundation of the Applied AI Engineering & Operations team, this role supports classical machine learning, generative AI, agent-based solutions, and enterprise-scale analytics ...
Google Cloud AI Solutions Architect, Gemini Enterprise
Atlanta, GA · On-site
$61 - $83.75/hr
Develop AI agent workflows that support business use cases, internal processes, enterprise ... Bachelor's degree in Computer Science, Engineering, Information Systems, Data Science, Machine ...
Google Cloud AI Solutions Architect, Gemini Enterprise
Atlanta, GA · On-site
$61 - $83.75/hr
Develop AI agent workflows that support business use cases, internal processes, enterprise ... Bachelor's degree in Computer Science, Engineering, Information Systems, Data Science, Machine ...
Design and configure agentic AI solutions within Amazon Connect, including AI agent creation, AI prompt engineering, model selection, guardrail configuration, and tool/action integration. MCP Server ...
Design and configure agentic AI solutions within Amazon Connect, including AI agent creation, AI prompt engineering, model selection, guardrail configuration, and tool/action integration. MCP Server ...
Assistant Ai Agent Developer information
What is an assistant AI agent developer?
What are the key skills and qualifications needed to thrive as an assistant AI agent developer?
What are the typical collaboration practices for an assistant AI agent developer within a software development team?
What are the most commonly searched types of Ai Agent Developer jobs in Georgia?
The most popular types of Ai Agent Developer jobs in Georgia are:
What are popular job titles related to Assistant Ai Agent Developer jobs in Georgia?
For Assistant Ai Agent Developer jobs in Georgia, the most frequently searched job titles are:
What job categories do people searching Assistant Ai Agent Developer jobs in Georgia look for?
The top searched job categories for Assistant Ai Agent Developer jobs in Georgia are:
What cities in Georgia are hiring for Assistant Ai Agent Developer jobs?
Cities in Georgia with the most Assistant Ai Agent Developer job openings:

AI Agent Trajectory Annotator and Reviewer
Macon, GA
$20 - $30/hr
Full-time
Posted 11 days ago
Job description
Type: Contract, hourly
Location: Remote
Hours: 20–30 per week
Pay: $20–30/hour, based on experience and language coverage
Start: Immediate
ABOUT THE ROLE
We evaluate how well advanced AI coding agents solve real engineering problems. An agent is given a real open source codebase inside a container and a hard task, then works on its own for 80 to 250 steps. A trajectory is the full record of that run — every command, result, and decision.
You will do two jobs, and you should expect either on any given day.
•Annotate — Read a trajectory nobody has looked at yet and judge it step by step.
• Review — Take an existing annotation, written by our AI tooling or another person, and confirm, correct, or reject it.
TASKS YOU'LL SEE
• Feature build — Add a working feature to a live library without breaking anything that already worked.
• Rebuild — Work out what a compiled tool does by running it, then rebuild it to match its output, exit codes, and file effects.
• Bug hunt — Find and fix twenty undocumented bugs across a dozen files with no test suite, then record what caused them.
Mostly Python and Go, with some Rust, C, and Ct+. A trajectory runs about 100 steps.
WHAT YOU JUDGE IN A TRAJECTORY
• Was the command right for the state the environment was actually in?
• Did the agent read the previous output correctly?
• Was the step wrong, or only inefficient — these are scored differently.
• Where did the run first go off course — usually earlier than where it visibly broke.
• Did the agent notice its own mistake and recover, or keep building on a false assumption?
• Did it game the grader instead of solving the task (e.g., weakening a test or hardcoding an expected value)?
WHAT WE NEED FROM YOU
• Experience — 2+ years in software engineering, DevOps, or site reliability, with real debugging in real codebases.
• Languages — Strong in Python or Go, and able to read a language you've never used.
• Linux — Comfortable with logs, running processes, build failures, and containers.
• Workflow — Everyday Git, diffs, pull requests, and issue tracking.
• Debugging — Able to work with no test suite and no error message pointing at the cause.
• Focus — Able to hold context across a long run, because step 74 can depend on step 12.
• Writing — Clear English, since every judgement needs an explanation another engineer can check.