1

Ai Rater Jobs in Virginia (NOW HIRING)

AI Process Integration Engineer

Mclean, VA · On-site

$114K/yr

Establish KPIs tracking AI tool utilization rates, analyst productivity gains, cycle time reductions, and product quality improvements. * Provide leadership with data-driven evidence supporting ...

New

... rates, and lower turnover. At RIVA, people are our #1 priority. Program Overview RIVA Solutions ... The AI-CoE provides AI application development, model lifecycle management, data engineering ...

... rates, and lower turnover. At RIVA, people are our #1 priority. Program Overview RIVA Solutions ... The AI-CoE provides AI application development, model lifecycle management, data engineering ...

As an AI Native Software Engineer, you direct AI agents to build products and solutions, rather ... Ability to read and interpret basic analytics (usage metrics, conversion rates, error rates)

As an AI Native Software Engineer, you direct AI agents to build products and solutions, rather ... Ability to read and interpret basic analytics (usage metrics, conversion rates, error rates)

As an AI Native Software Engineer, you direct AI agents to build products and solutions, rather ... Ability to read and interpret basic analytics (usage metrics, conversion rates, error rates)

... rates, and lower turnover. At RIVA, people are our #1 priority. Program Overview RIVA Solutions ... The AI-CoE provides AI application development, model lifecycle management, data engineering ...

... rates, and lower turnover. At RIVA, people are our #1 priority. Program Overview RIVA Solutions ... The AI-CoE provides AI application development, model lifecycle management, data engineering ...

Full Stack AI Developer

Arlington, VA · On-site

$95K - $115K/yr

Experience implementing monitoring for AI components, including latency, success rate, and retrieval quality * Semantic Web: Exposure to ontology/taxonomy design or management tools (e.g., Progress ...

next page

Showing results 1-20

People also search for

Ai Rater information

What is an AI Rater job?

An AI Rater evaluates and provides feedback on artificial intelligence models, typically improving search engines, chatbots, or recommendation systems. They assess the relevance, accuracy, and quality of AI-generated content based on specific guidelines. This role requires strong analytical skills, attention to detail, and familiarity with the subject matter being reviewed. AI Raters often work remotely and on a flexible schedule.

What are the key skills and qualifications needed to thrive in the Ai Rater position, and why are they important?

To thrive as an AI Rater, you generally need strong attention to detail, analytical thinking, and proficiency in English, often supported by formal education such as a high school diploma or higher. Familiarity with web browsers, online research, and company-specific rating platforms or guidelines is essential. Excellent time management, adaptability, and effective written communication help individuals excel in this position. These skills and qualities ensure accurate and consistent evaluations of AI-generated content, directly impacting the improvement of artificial intelligence systems.

What does a typical day look like for an AI Rater?

A typical day for an AI Rater involves reviewing and evaluating various types of content, such as search engine results, social media posts, advertisements, or chatbot responses, to ensure they meet quality and relevancy standards. You may follow detailed guidelines to rate or annotate content, complete assigned tasks in a web-based platform, and provide feedback to help improve AI performance. Most positions are remote and offer flexible schedules, allowing you to plan your workload around personal commitments. Collaboration is generally limited, as most work is performed independently, but periodic communication with team leads for training or updates is common.

What are the most commonly searched types of Ai Rater jobs in Virginia? The most popular types of Ai Rater jobs in Virginia are:
What are popular job titles related to Ai Rater jobs in Virginia? For Ai Rater jobs in Virginia, the most frequently searched job titles are:
What job categories do people searching Ai Rater jobs in Virginia look for? The top searched job categories for Ai Rater jobs in Virginia are:
What cities in Virginia are hiring for Ai Rater jobs? Cities in Virginia with the most Ai Rater job openings:
Infographic showing various Ai Rater job openings in Virginia as of June 2026, with employment types broken down into 12% Internship, 40% Full Time, 41% Part Time, and 7% Contract. Highlights an 75% In-person, and 25% Remote job distribution.
AI Process Integration Engineer

AI Process Integration Engineer

Peraton

Mclean, VA • On-site

$114K/yr

Full-time

Posted yesterday


Peraton rating

8.3

Company rating: 8.3 out of 10

Based on 52 frontline employees who took The Breakroom Quiz

38th of 204 rated it services


Job description

Responsibilities

Peraton is seeking an AI Process Integration Engineer.  This position will sit at the intersection of artificial intelligence deployment and mission workflow optimization - responsible for bridging the gap between approved, available AI/ML tools and their effective operational use across intelligence analysis, targeting, and screening and vetting workflows. This role does not wait for new tools to be approved; it maximizes the mission value of what is already on the network by redesigning the processes around those tools, configuring them for mission-specific use cases, and ensuring analysts can leverage them from Day 1.

Key Responsibilities

AI Tool Deployment & Configuration

  • Assess approved AI/ML tools currently available on the customer network and evaluate their operational readiness, configuration gaps, and underutilization.
  • Configure, optimize, and integrate approved tools into existing analytic and targeting workflows without introducing unapproved capabilities or triggering additional review board requirements.
  • Develop mission-specific use-case configurations that align tool functionality to analyst tasks - entity triage, credibility scoring, pattern correlation, document production, and RFI processing.
  • Maintain tool performance baselines and identify configuration adjustments that improve output accuracy, speed, and analyst adoption.

Workflow Analysis & Process Redesign

  • Map current-state analytic and operational workflows to identify where approved AI tools can eliminate manual bottlenecks, reduce redundant data entry, and compress cycle times.
  • Design optimized future-state workflows that embed AI tool touchpoints at the highest-friction points in the intelligence production and targeting cycle.
  • Develop before/after process documentation with measurable performance targets tied directly to mission outcomes.
  • Maintain SOPs and workflow guides that reflect the integrated AI-enabled process architecture.

Prompt Engineering & Tool Enablement

  • Build mission-specific prompt libraries, Boolean-to-AI logic translation guides, and structured templates that make approved tools immediately usable by analysts without requiring technical expertise.
  • Develop a Document Support Playbook Suite covering draft assist, tradecraft review, source synthesis, consistency checking, and classification review workflows.
  • Ensure all prompt engineering products are tool-agnostic and adaptable to any customer-approved platform upgrade or replacement.

Performance Measurement & Continuous Improvement

  • Establish KPIs tracking AI tool utilization rates, analyst productivity gains, cycle time reductions, and product quality improvements.
  • Provide leadership with data-driven evidence supporting review board decisions to expand AI tool access or activate additional use cases.
  • Apply Lean Six Sigma and continuous improvement methodologies to iteratively refine AI-integrated workflows based on operational feedback.

Stakeholder Collaboration & Change Management

  • Work directly with analysts, targeters, mission leads, and IT teams to drive adoption of AI-integrated workflows through hands-on demonstration, embedded support, and structured enablement.
  • Develop transition plans and training materials that ensure smooth integration of AI tools into daily mission operations with zero workflow disruption.
  • Serve as the operational bridge between the technical AI/ML engineering team, the analytic workforce, and program leadership.

****This position is contingent on contract award***

Qualifications

Required Qualifications

  • Active TS/SCI with Polygraph required
  • 12 years of experience, may have supervisory or management experience
  • Bachelor's degree in Computer Science, Information Systems, Engineering, or a related field.
  • 10+ years of experience in AI/ML tool deployment, systems integration, or business process engineering; at least 5 years supporting IC, DoD, or Federal law enforcement analytic environments.
  • Proficiency in AI/ML tool configuration, prompt engineering, workflow modeling (BPMN), and data pipeline management; experience with IC-approved analytic platforms and multi-classification network environments.
  • Working knowledge of Lean Six Sigma, Agile, and continuous improvement frameworks applied to operational or intelligence environments.
  • Strong analytical thinking, clear written and verbal communication, and the ability to translate technical AI capability into practical mission value for non-technical analysts.
Peraton Overview

Peraton is a next-generation national security company that drives missions of consequence spanning the globe and extending to the farthest reaches of the galaxy. As the world's leading mission capability integrator and transformative enterprise IT provider, we deliver trusted, highly differentiated solutions and technologies to protect our nation and allies. Peraton operates at the critical nexus between traditional and nontraditional threats across all domains: land, sea, space, air, and cyberspace. The company serves as a valued partner to essential government agencies and supports every branch of the U.S. armed forces. Each day, our employees do the can't be done by solving the most daunting challenges facing our customers. Visit peraton.com to learn how we're keeping people around the world safe and secure.

Target Salary Range$146,000 - $234,000. This represents the typical salary range for this position. Salary is determined by various factors, including but not limited to, the scope and responsibilities of the position, the individual's experience, education, knowledge, skills, and competencies, as well as geographic location and business and contract considerations. Depending on the position, employees may be eligible for overtime, shift differential, and a discretionary bonus in addition to base pay.EEOEEO: Equal opportunity employer, including disability and protected veterans, or other characteristics protected by law.Employment Type: FULL_TIME

What Peraton employees say

Pay

Benefits

Hours and flexibility

Workplace

Get the full story on Breakroom


Peraton logo

About Peraton

Sourced by ZipRecruiter

At Peraton, we re at the forefront of delivering the next big thing every day. We re the partner of choice to help solve some of the world s most daunting challenges, delivering bold, new solutions to keep people around the world safer and more secure.

Industry

It services

Company size

10,000+ Employees

Headquarters location

Herndon, VA, US

Year founded

2017