Ai Rater Jobs in Georgia (NOW HIRING)

About Us

United Contractor Services (UCS) is a national specialty subcontractor and a Top 50 Walls and Ceilings contractor in North America. We self-perform commercial interior construction across metal framing, drywall, acoustical ceilings, EIFS, stucco, painting, and Division 8 & 10 Specialties. As we continue to grow across multiple markets, we're looking for an Agentic AI Engineer to help us continue our growth.

About the Role

We operate a portfolio of businesses united by a single belief: technology, applied well, is a competitive advantage. We run a modern stack-Microsoft 365, Entra ID, Intune, Azure (Functions, Table Storage, Entra Domain Services), Procore, and custom integrations built on Make.com and the Microsoft Graph. We are now investing in agentic AI as a first-class capability across our operating companies, and we are hiring an Agentic AI Engineer to build it.

This is a builder role. You will design, ship, and maintain production AI agents that automate real business processes-document intake, data extraction, system-to-system synchronization, internal copilots, decision-support tools, and workflow orchestration-across multiple business units. You will work directly with the Director of Technology and have a clear line of sight from problem to deployed solution. We are not looking for a PowerPoint AI strategist. We are looking for someone who writes the code, ships the agent, and owns the outcome.

What You'll Do

• Design and build production agentic AI systems: tool calling, multi-step reasoning, sub-agent orchestration, memory, retrieval, and human-in-the-loop checkpoints.
• Partner with leadership and operators across our business units to identify high-value automation opportunities and translate them into shipped agents.
• Build and maintain integrations across our existing stack-Microsoft Graph, Entra, SharePoint, Teams, Procore, Azure Functions, Make.com, and third-party APIs.
• Develop rigorous eval pipelines and observability for every agent in production-cost monitoring, quality tracking, failure-mode detection, and regression testing.
• Implement secure agent identity and authorization patterns: managed identities, service principals, OAuth2 flows, least-privilege Graph permissions, and audit logging.
• Establish and uphold AI governance standards across our entities-data handling, model selection, prompt management, version control, and rollback procedures.
• Document architectures and decisions clearly so the systems you build outlive any single engagement.
• Stay current on the agentic AI landscape (Claude, OpenAI, Azure AI Foundry, Copilot Studio, LangGraph, MCP, etc.) and make pragmatic platform recommendations.

What You BringRequired

• 3–5 years of professional software engineering experience, with at least 1 year shipping production AI/LLM systems (not prototypes, not demos).
• Strong proficiency in Python and/or TypeScript.
• Hands-on experience with at least one major agent framework or SDK: Anthropic Claude SDK, OpenAI Agents SDK, LangGraph, Vercel AI SDK, Semantic Kernel, or Azure AI Foundry.
• Real experience building and interpreting eval harnesses. You can show us how you measure whether an agent is working.
• Working knowledge of the Microsoft cloud stack: Azure Functions, Microsoft Graph API, Entra ID app registrations, OAuth2, and managed identities.
• Backend and integration engineering chops: REST APIs, webhooks, queues, state management, and authentication patterns.
• Strong written communication and the ability to explain trade-offs to a technical leader making investment decisions.
• Comfortable working on-site in Kennesaw, GA.

Strongly Preferred

• Production experience with Microsoft Copilot Studio, Power Automate, or Azure AI Foundry.
• Experience with Model Context Protocol (MCP) servers or comparable tool-server architectures.
• Familiarity with retrieval-augmented generation (RAG) over enterprise document stores (SharePoint, OneDrive, Confluence, etc.).
• Experience working in a multi-entity or multi-tenant environment with cross-cutting identity and data concerns.
• DevOps/IaC exposure: Bicep, Terraform, GitHub Actions, or Azure DevOps pipelines.
• Familiarity with construction-tech (Procore, Bluebeam, etc.) or with verticalized SaaS integrations.

Nice to Have

• Cybersecurity or compliance background-particularly around AI governance, data classification, or zero-trust principles.
• Open-source contributions to agent frameworks or developer tools.
• Prior experience as the first or second AI hire at an organization.

How You'll Be Measured

• Time-to-production for new agents and automations.
• Measurable business impact: hours saved, cycle time reduced, error rates lowered, revenue accelerated.
• System reliability: uptime, eval pass rates, cost efficiency, and incident response.
• Quality of the engineering foundation: maintainability, documentation, security posture, and knowledge transfer.

Why This Role

• Direct reporting relationship to the Director of Technology-no layers between you and decisions.
• A real budget for tooling and platforms. You won't be told to do agentic AI on a free tier.
• A modern, well-managed stack to build on, not a tangle of legacy systems.
• Scope across multiple operating companies-you will see and shape work that touches many parts of the business.
• The ability to point at production systems and say 'I built that.'

Compensation & Benefits

Competitive base salary commensurate with experience, plus a full benefits package including health, dental, vision, retirement, and paid time off. We invest in our people through ongoing learning budgets, conference attendance, and dedicated time for skill development.

How to Apply

Send a resume and -more importantly- a short note describing one agentic AI system you've shipped to production. We want to know: what did it do, what were the hardest parts, how did you evaluate it, and what would you do differently?

Links to public repos, write-ups, or recorded demos are strongly encouraged. Cover letters are not required; the project description is.

United Contractor Services is an Equal Opportunity Employer.

Drug Test and Background Disclaimer:

Candidates who receive a job offer will be required to undergo a drug test and background check in accordance with applicable laws. Providing false information may result in the withdrawal of a job offer or termination of employment. By submitting an application, candidates acknowledge and agree to these requirements.

Job Posted by ApplicantPro