Phoenix, AZ · On-site
$20 - $30/hr
Immediate ABOUT THE ROLE We evaluate how well advanced AI coding agents solve real engineering problems. An agent is given a real open source codebase inside a container and a hard task, then works ...
Phoenix, AZ · On-site
$20 - $30/hr
Immediate ABOUT THE ROLE We evaluate how well advanced AI coding agents solve real engineering problems. An agent is given a real open source codebase inside a container and a hard task, then works ...
Chandler, AZ · On-site
$20 - $30/hr
Immediate ABOUT THE ROLE We evaluate how well advanced AI coding agents solve real engineering problems. An agent is given a real open source codebase inside a container and a hard task, then works ...
Chandler, AZ · On-site
$20 - $30/hr
Immediate ABOUT THE ROLE We evaluate how well advanced AI coding agents solve real engineering problems. An agent is given a real open source codebase inside a container and a hard task, then works ...
Flagstaff, AZ · On-site
$20 - $30/hr
Immediate ABOUT THE ROLE We evaluate how well advanced AI coding agents solve real engineering problems. An agent is given a real open source codebase inside a container and a hard task, then works ...
Flagstaff, AZ · On-site
$20 - $30/hr
Immediate ABOUT THE ROLE We evaluate how well advanced AI coding agents solve real engineering problems. An agent is given a real open source codebase inside a container and a hard task, then works ...
Mesa, AZ · On-site
$20 - $30/hr
Immediate ABOUT THE ROLE We evaluate how well advanced AI coding agents solve real engineering problems. An agent is given a real open source codebase inside a container and a hard task, then works ...
Mesa, AZ · On-site
$20 - $30/hr
Immediate ABOUT THE ROLE We evaluate how well advanced AI coding agents solve real engineering problems. An agent is given a real open source codebase inside a container and a hard task, then works ...
Glendale, AZ · On-site
$20 - $30/hr
Immediate ABOUT THE ROLE We evaluate how well advanced AI coding agents solve real engineering problems. An agent is given a real open source codebase inside a container and a hard task, then works ...
Glendale, AZ · On-site
$20 - $30/hr
Immediate ABOUT THE ROLE We evaluate how well advanced AI coding agents solve real engineering problems. An agent is given a real open source codebase inside a container and a hard task, then works ...
Phoenix, AZ · On-site
$20 - $30/hr
Immediate ABOUT THE ROLE We evaluate how well advanced AI coding agents solve real engineering problems. An agent is given a real open source codebase inside a container and a hard task, then works ...
Phoenix, AZ · On-site
$20 - $30/hr
Immediate ABOUT THE ROLE We evaluate how well advanced AI coding agents solve real engineering problems. An agent is given a real open source codebase inside a container and a hard task, then works ...
Phoenix, AZ · On-site
$110K - $140K/yr
... managed launch plans. * At least one AI-enabled capability, intelligent workflow, data-driven ... context engineering, retrieval-augmented generation, structured outputs, agent frameworks ...
Quick apply
Phoenix, AZ · On-site
$110K - $140K/yr
... managed launch plans. * At least one AI-enabled capability, intelligent workflow, data-driven ... context engineering, retrieval-augmented generation, structured outputs, agent frameworks ...
Phoenix, AZ · On-site
... manage AI-driven agents capable of autonomous decision-making and task execution. • Design and ... Experience with Large Language Models (LLMs), AI orchestration frameworks, or AI agent platforms.
Phoenix, AZ · On-site
... manage AI-driven agents capable of autonomous decision-making and task execution. • Design and ... Experience with Large Language Models (LLMs), AI orchestration frameworks, or AI agent platforms.
$50K - $112K/yr
... agent harnesses and implementing context engineering, memory management, retry logic, and structured output validation to support reliable, multi-step AI workflows - Demonstrating proficiency in ...
$50K - $112K/yr
... agent harnesses and implementing context engineering, memory management, retry logic, and structured output validation to support reliable, multi-step AI workflows - Demonstrating proficiency in ...
Phoenix, AZ · On-site
$110K - $140K/yr
... managed launch plans. * At least one AI-enabled capability, intelligent workflow, data-driven ... context engineering, retrieval-augmented generation, structured outputs, agent frameworks ...
Quick apply
Phoenix, AZ · On-site
$110K - $140K/yr
... managed launch plans. * At least one AI-enabled capability, intelligent workflow, data-driven ... context engineering, retrieval-augmented generation, structured outputs, agent frameworks ...
Phoenix, AZ · On-site
$71K - $92K/yr
AI Quality Engineer Lead Role: Onsite, Phoenix, AZ This role will own the end-to-end quality ... and agent lifecycle management. AI/LLM Validation & Assurance Ability to define and implement ...
Phoenix, AZ · On-site
$71K - $92K/yr
AI Quality Engineer Lead Role: Onsite, Phoenix, AZ This role will own the end-to-end quality ... and agent lifecycle management. AI/LLM Validation & Assurance Ability to define and implement ...
Phoenix, AZ · On-site
$60 - $80/hr
Design agent behavior, workflows and safety guards for agentic AI systems. * Create, test and ... Containerize services (Docker), manage orchestration (Kubernetes/GKE), and optimize nodes ...
Phoenix, AZ · On-site
$60 - $80/hr
Design agent behavior, workflows and safety guards for agentic AI systems. * Create, test and ... Containerize services (Docker), manage orchestration (Kubernetes/GKE), and optimize nodes ...
Tempe, AZ · On-site
$150 - $200/hr
Title Product Manager, AI Location Hybrid-New York, Tempe, or San Francisco About Us Wealth.com is ... Partner closely with engineering teams to deliver with quick time-to-market results and optimized ...
Tempe, AZ · On-site
$150 - $200/hr
Title Product Manager, AI Location Hybrid-New York, Tempe, or San Francisco About Us Wealth.com is ... Partner closely with engineering teams to deliver with quick time-to-market results and optimized ...
Phoenix, AZ · On-site
$123K - $215K/yr
... management and bot detection platforms, Threat intelligence feeds and external data sources ... Develop multi-agent systems capable of reasoning, planning, retrieval, tool usage, and workflow ...
Phoenix, AZ · On-site
$123K - $215K/yr
... management and bot detection platforms, Threat intelligence feeds and external data sources ... Develop multi-agent systems capable of reasoning, planning, retrieval, tool usage, and workflow ...
Phoenix, AZ · On-site
Strong knowledge of prompt engineering , AI orchestration, and model evaluation. * Experience with ... Knowledge of MCP (Model Context Protocol) or AI agent architectures. * Experience with Python for ...
Phoenix, AZ · On-site
Strong knowledge of prompt engineering , AI orchestration, and model evaluation. * Experience with ... Knowledge of MCP (Model Context Protocol) or AI agent architectures. * Experience with Python for ...
Phoenix, AZ · Remote
$80 - $150/hr
Evaluate AI agent performance and identify reasoning, workflow, and tool-use gaps. * Develop ... Professional experience in Sales, Growth, Product Management, Project Management, Finance , or a ...
Quick apply
Phoenix, AZ · Remote
$80 - $150/hr
Evaluate AI agent performance and identify reasoning, workflow, and tool-use gaps. * Develop ... Professional experience in Sales, Growth, Product Management, Project Management, Finance , or a ...
Phoenix, AZ · On-site +1
$95K - $142K/yr
AI Agent & Chatbot Projects * AI Workflow Projects * Predictive Modeling Projects * Educate Finance ... Project Documentation and Change Management * Finance SharePoint Site Administration * Ad Hoc ...
Phoenix, AZ · On-site +1
$95K - $142K/yr
AI Agent & Chatbot Projects * AI Workflow Projects * Predictive Modeling Projects * Educate Finance ... Project Documentation and Change Management * Finance SharePoint Site Administration * Ad Hoc ...
Phoenix, AZ · On-site
$64K - $108K/yr
... stakeholder management skills. • Collaborative mindset with experience working in cross ... Key Responsibilities • Agentic AI Engineering • Design and develop autonomous AI agent ...
Phoenix, AZ · On-site
$64K - $108K/yr
... stakeholder management skills. • Collaborative mindset with experience working in cross ... Key Responsibilities • Agentic AI Engineering • Design and develop autonomous AI agent ...
Tucson, AZ · On-site
$125 - $150/hr
Technical Manager - AI, Software & Systems Engineering Job Category : Program Management Requisition Number : TECHN001513 * Posted : August 11, 2026 * Full-Time * On-site Locations Showing 1 location ...
Tucson, AZ · On-site
$125 - $150/hr
Technical Manager - AI, Software & Systems Engineering Job Category : Program Management Requisition Number : TECHN001513 * Posted : August 11, 2026 * Full-Time * On-site Locations Showing 1 location ...
Marana, AZ · On-site
$105K - $130K/yr
Join Our Team as a Manager, IT & AI at Trico Electric Cooperative! Posting Period: Thursday July ... Direct AI agent development and orchestration, including use‑case design, prompt engineering ...
Quick apply
Marana, AZ · On-site
$105K - $130K/yr
Join Our Team as a Manager, IT & AI at Trico Electric Cooperative! Posting Period: Thursday July ... Direct AI agent development and orchestration, including use‑case design, prompt engineering ...
| Aspect | Manager Ai Agent Engineer | Data Scientist |
|---|---|---|
| Required Credentials | Bachelor's or Master's in CS, AI, or related fields; experience with AI/ML tools | Bachelor's or Master's in CS, Statistics, or related fields; proficiency in data analysis and modeling |
| Work Environment | Developing, deploying, and managing AI agents; cross-functional teams | Analyzing data, building models, and deriving insights; research-focused |
| Employer & Industry Usage | Tech companies, AI startups, enterprises implementing AI solutions | Tech firms, finance, healthcare, research institutions |
The Manager Ai Agent Engineer focuses on leading AI agent development and deployment, managing teams, and ensuring AI solutions meet business needs. In contrast, Data Scientists primarily analyze data, build predictive models, and generate insights. Both roles require strong technical skills, but their core responsibilities and work environments differ significantly.
For Manager Ai Agent Engineer jobs in Arizona, the most frequently searched job titles are:
The top searched job categories for Manager Ai Agent Engineer jobs in Arizona are:
Cities in Arizona with the most Manager Ai Agent Engineer job openings:
$20 - $30/hr
Full-time
Posted 7 days ago
Type: Contract, hourly
Location: Remote
Hours: 20–30 per week
Pay: $20–30/hour, based on experience and language coverage
Start: Immediate
ABOUT THE ROLE
We evaluate how well advanced AI coding agents solve real engineering problems. An agent is given a real open source codebase inside a container and a hard task, then works on its own for 80 to 250 steps. A trajectory is the full record of that run — every command, result, and decision.
You will do two jobs, and you should expect either on any given day.
•Annotate — Read a trajectory nobody has looked at yet and judge it step by step.
• Review — Take an existing annotation, written by our AI tooling or another person, and confirm, correct, or reject it.
TASKS YOU'LL SEE
• Feature build — Add a working feature to a live library without breaking anything that already worked.
• Rebuild — Work out what a compiled tool does by running it, then rebuild it to match its output, exit codes, and file effects.
• Bug hunt — Find and fix twenty undocumented bugs across a dozen files with no test suite, then record what caused them.
Mostly Python and Go, with some Rust, C, and Ct+. A trajectory runs about 100 steps.
WHAT YOU JUDGE IN A TRAJECTORY
• Was the command right for the state the environment was actually in?
• Did the agent read the previous output correctly?
• Was the step wrong, or only inefficient — these are scored differently.
• Where did the run first go off course — usually earlier than where it visibly broke.
• Did the agent notice its own mistake and recover, or keep building on a false assumption?
• Did it game the grader instead of solving the task (e.g., weakening a test or hardcoding an expected value)?
WHAT WE NEED FROM YOU
• Experience — 2+ years in software engineering, DevOps, or site reliability, with real debugging in real codebases.
• Languages — Strong in Python or Go, and able to read a language you've never used.
• Linux — Comfortable with logs, running processes, build failures, and containers.
• Workflow — Everyday Git, diffs, pull requests, and issue tracking.
• Debugging — Able to work with no test suite and no error message pointing at the cause.
• Focus — Able to hold context across a long run, because step 74 can depend on step 12.
• Writing — Clear English, since every judgement needs an explanation another engineer can check.
