ZipRecruiter

Log In

1

Ai Rater Jobs in Virginia (NOW HIRING)

Booz Allen Hamilton, Inc.

AI Engineer

Mclean, VA · On-site

$99K - $225K/yr

As an AI engineer, you'll design and deliver production-grade AI systems. You'll own RAG pipelines ... and error rates * Experience optimizing performance using caching layers such as Redis ...

Booz Allen Hamilton

AI Engineer

Mclean, VA · Hybrid

$99K - $225K/yr

AI Engineer The Opportunity: As an AI engineer, you'll design and deliver production-grade AI ... and error rates * Experience optimizing performance using caching layers such as Redis ...

Apex Systems

AI Quality Engineer

Merrifield, VA · On-site

$71K - $92K/yr

Develop and execute evaluation frameworks that measure accuracy, relevance, groundedness, completeness, hallucination rates, and user satisfaction.* Design and maintain AI validation datasets ...

Apex Systems

AI Quality Engineer

Merrifield, VA · On-site

$71K - $92K/yr

Develop and execute evaluation frameworks that measure accuracy, relevance, groundedness, completeness, hallucination rates, and user satisfaction. * Design and maintain AI validation datasets ...

Amentum

AI Solutions Engineer

Chantilly, VA · On-site

$170K - $210K/yr

As the AI SME , you will work with stakeholders to identify bottlenecks, optimize workflows, and ... Compensation Details: $170,000-$210,000 USD Annually The compensation range or hourly rate listed ...

Pae

AI Solutions Engineer

Chantilly, VA · On-site

$170K - $210K/yr

As the AI SME , you will work with stakeholders to identify bottlenecks, optimize workflows, and ... Compensation Details: $170,000-$210,000 USD Annually The compensation range or hourly rate listed ...

The Josef Group

AI Infrastructure Engineer

Chantilly, VA

$110K - $144K/yr

Build and maintain AI serving infrastructure, including gateways, load balancing, authentication, TLS, and rate limiting. * Optimize GPU utilization, memory management, quantization, batching, and ...

ECS

AI Requirements Engineer

Quantico, VA · On-site

$120K - $145K/yr

Everforth ECS is seeking an AI Requirements Engineer to work in our Arlington, VA office (Hybrid ... Proven ability to deliver measurable improvements in user experience, adoption rates, and process ...

TestPros

Senior AI Test Engineer (Remote)

Sterling, VA · On-site +1

$50 - $80/hr

OWASP AI Testing Guide, NIST AI Risk Management Framework (AI RMF), NIST Cybersecurity Framework ... Rate: $50-80/hr. 1099 or Corp. To Corp.). This range represents a good-faith estimate and is not a ...

GRVTY

AI/ML Engineer

Mclean, VA · On-site

$150K - $250K/yr

What You'll be Owning GRVTY is seeking an experienced AI/ML Engineer with a TS/SCI + Poly clearance ... rates, prior experience, skillsets, education, and certifications. We're proud to offer a work ...

GRVTY

AI/ML Engineer

Mclean, VA

$150K - $250K/yr

What You'll be Owning GRVTY is seeking an experienced AI/ML Engineer with a TS/SCI + Poly clearance ... rates, prior experience, skillsets, education, and certifications. We're proud to offer a work ...

GRVTY

AI/ML Engineer

Mclean, VA · On-site

$150K - $250K/yr

What You'll be Owning GRVTY is seeking an experienced AI/ML Engineer with a TS/SCI + Poly clearance ... rates, prior experience, skillsets, education, and certifications. We're proud to offer a work ...

ICF

AI / Automation Engineer

Richmond, VA · Remote

ICF is seeking an AI / Automation Engineer to design, build, and continuously improve the AI ... Track and report on Tier Zero performance metrics, including deflection rate, chatbot resolution ...

DataAnnotation

Programmer - AI Trainer

Alexandria, VA · On-site +1

$50 - $100/hr

Projects are paid hourly starting at $50-$100+/hr, with bonus rates available on some projects Responsibilities: * Give AI chatbots coding challenges and evaluate their outputs * Evaluate the quality ...

Apex Systems

AI Engineer

Norfolk, VA · On-site

Job#: 3040805 AI Engineer Location: Norfolk, VA (Onsite) Role Overview We are seeking an AI ... Message and data rates may apply. Carriers are not liable for delayed or undelivered messages. You ...

IntelliGenesis

Senior AI Engineer

Reston, VA · On-site

IntelliGenesis is seeking a Senior AI Engineer to lead the design, development, and deployment of ... layoff, termination, rates of pay, or other forms of compensation and selection of training.

IntelliGenesis

Senior AI Engineer

Reston, VA · On-site

$215K - $245K/yr

IntelliGenesisis seeking a Senior AI Engineer to lead the design, development, and deployment of ... layoff, termination, rates of pay, or other forms of compensation and selection of training.

IntelliGenesis LLC

Senior AI Engineer

Reston, VA · On-site

$215K - $245K/yr

IntelliGenesis is seeking a Senior AI Engineer to lead the design, development, and deployment of ... layoff, termination, rates of pay, or other forms of compensation and selection of training.

previous page

Showing results 41-60

All JobsAi Rater JobsAi Rater Jobs in Virginia

Ai Rater information

What is an AI Rater?

An AI Rater evaluates and provides feedback on artificial intelligence models, typically improving search engines, chatbots, or recommendation systems. They assess the relevance, accuracy, and quality of AI-generated content based on specific guidelines. This role requires strong analytical skills, attention to detail, and familiarity with the subject matter being reviewed. AI Raters often work remotely and on a flexible schedule.

What does an AI Rater do?

A typical day for an AI Rater involves reviewing and evaluating various types of content, such as search engine results, social media posts, advertisements, or chatbot responses, to ensure they meet quality and relevancy standards. You may follow detailed guidelines to rate or annotate content, complete assigned tasks in a web-based platform, and provide feedback to help improve AI performance. Most positions are remote and offer flexible schedules, allowing you to plan your workload around personal commitments. Collaboration is generally limited, as most work is performed independently, but periodic communication with team leads for training or updates is common.

What skills and qualifications are needed to thrive as an AI Rater?

To thrive as an AI Rater, you generally need strong attention to detail, analytical thinking, and proficiency in English, often supported by formal education such as a high school diploma or higher. Familiarity with web browsers, online research, and company-specific rating platforms or guidelines is essential. Excellent time management, adaptability, and effective written communication help individuals excel in this position. These skills and qualities ensure accurate and consistent evaluations of AI-generated content, directly impacting the improvement of artificial intelligence systems.

How to become an AI Rater?

To become an AI Rater, candidates typically need a high school diploma or equivalent, strong language and analytical skills, and the ability to follow detailed guidelines. The role often involves evaluating search engine results or content for accuracy and relevance, using online platforms or specific assessment tools. Prior experience in data annotation or quality assurance can be beneficial, and flexible scheduling is common.

What are the most commonly searched types of Ai Rater jobs in Virginia?

The most popular types of Ai Rater jobs in Virginia are:

What are popular job titles related to Ai Rater jobs in Virginia?

For Ai Rater jobs in Virginia, the most frequently searched job titles are:

What job categories do people searching Ai Rater jobs in Virginia look for?

The top searched job categories for Ai Rater jobs in Virginia are:

What cities in Virginia are hiring for Ai Rater jobs?

Cities in Virginia with the most Ai Rater job openings:

Ai Rater jobs near you
Infographic showing various Ai Rater job openings in Virginia as of August 2026, with employment types broken down into 42% Full Time, and 58% Part Time. Highlights an 100% Remote job distribution.

AI Engineer

Mclean, VA • On-site

Booz Allen Hamilton, Inc.
IT Services • 10K+ employees
Learn more about Booz Allen Hamilton, Inc.external

$99K - $225K/yr

Full-time, Part-time

Medical, Life, Retirement, PTO

Re-posted 5 days ago

Booz Allen Hamilton rating

8.9

Company rating: 8.9 out of 10

Based on 49 frontline employees who took The Breakroom Quiz

Job description


Remote Work:
Hybrid
Job Number:
R0246911
Location:
Washington,DC,US
Share job via:
Share
Additional Locations:
  • McLean, Virginia, USA

AI Engineer
The Opportunity:
As an AI engineer, you'll design and deliver production-grade AI systems. You'll own RAG pipelines, evaluation systems, and performance optimization leveraging modern AI infrastructure and tooling to build scalable, observable, and efficient services. You'll work across the full AI application lifecycle from enterprise data ingestion and retrieval to prompt engineering, evaluation, deployment, observability, and production operations building secure, scalable AI solutions for mission-critical federal environments.
You Have:
  • 3+ years of experience building production systems, including AI/ML applications
  • Experience building LLM systems using RAG frameworks such as LangChain and LlamaIndex, or custom pipelines and vector stores with Pinecone, Weaviate, FAISS, or OpenSearch Vector Search
  • Experience designing embedding pipelines, including document ingestion, chunking strategies, indexing, metadata filtering, retrieval optimization, and hybrid search, and designing APIs and services using FastAPI, Flask, or Node.js
  • Experience with cloud-native architectures, including AWS services such as Bedrock, SageMaker, EKS or ECS, S3, IAM, Lambda, CloudWatch, and Secrets Manager, and agent frameworks and orchestration patterns such as LangGraph, tool calling, and function calling APIs
  • Experience implementing observability, including logging and tracing with OpenTelemetry, Datadog, or CloudWatch, and metrics pipelines tracking latency, throughput, token usage, cache hit rate, and error rates
  • Experience optimizing performance using caching layers such as Redis, parallelization or async workflows, and chunking and retrieval tuning, and designing automated evaluation pipelines using benchmark datasets, LLM-as-a-judge techniques, regression testing, and human evaluation workflows
  • Experience supporting production AI services, including deployment, monitoring, incident response, debugging, and performance tuning, and managing prompt templates, prompt versioning, model configurations, and structured outputs across development and production environments
  • Knowledge of AI security concepts, including prompt injection, jailbreak resistance, data leakage prevention, guardrails, secure prompt design, and responsible AI practices
  • Ability to obtain a TS/SCI clearance
  • Bachelor's degree

Nice If You Have:
  • Experience supporting DoD clients or other federal mission environments
  • Experience with high-performance inference systems such as vLLM, Ray Serve, or Triton Inference Server
  • Experience with semantic caching and embedding reuse strategies
  • Experience with guardrail frameworks such as Rebuff, Guardrails.ai, or custom filtering systems
  • Experience integrating AI applications with enterprise data platforms and knowledge repositories such as Databricks, Snowflake, OpenSearch, PostgreSQL, SharePoint, Confluence, or S3-based document stores
  • Experience deploying AI workloads into AWS GovCloud, IL4 or IL5 environments, or other secure cloud environments
  • Experience with event-driven architectures and messaging technologies such as Amazon SQS, Kafka, RabbitMQ, or Amazon EventBridge
  • Experience with Model Context Protocol (MCP) or modern AI agent interoperability standards

Clearance:
Applicants selected will be subject to a security investigation and may need to meet eligibility requirements for access to classified information.
Compensation
At Booz Allen, we celebrate your contributions, provide you with opportunities and choices, and support your total well-being. Our offerings include health, life, disability, financial, and retirement benefits, as well as paid leave, professional development, tuition assistance, work-life programs, and dependent care. Our recognition awards program acknowledges employees for exceptional performance and superior demonstration of our values. Full-time and part-time employees working at least 20 hours a week on a regular basis are eligible to participate in Booz Allen's benefit programs. Individuals that do not meet the threshold are only eligible for select offerings, not inclusive of health benefits. We encourage you to learn more about our total benefits by visiting the Resource page on our Careers site and reviewing Our Employee Benefits page.
Salary at Booz Allen is determined by various factors, including but not limited to location, the individual's particular combination of education, knowledge, skills, competencies, and experience, as well as contract-specific affordability and organizational requirements. The projected compensation range for this position is $99,000.00 to $225,000.00 (annualized USD). The estimate displayed represents the typical salary range for this position and is just one component of Booz Allen's total compensation package for employees. This posting will close within 90 days from the Posting Date.
Identity Statement
As part of the hiring process, we will ask you to complete an identity verification process that leverages advanced biometrics and artificial intelligence to ensure authenticity and protect against identity fraud. You are expected to be on camera during interviews and assessments. We reserve the right to take your picture to verify your identity and prevent fraud.
Candidate AI Usage Policy
AI is a part of our daily work at Booz Allen, and we are committed to the responsible and ethical use of AI tools. However, we want to ensure a fair candidate process based on your own skills and knowledge. As part of this commitment, the use of artificial intelligence (AI) or other tools to assist with responses during interviews (whether in-person or virtual) is prohibited unless permission is explicitly provided.
Work Model
Our people-first culture prioritizes the benefits of collaboration, whether it occurs in person or virtually. To support engagement and effective communication, employees working virtually are generally expected to have their cameras on during meetings.
  • Remote: If this position is listed as remote, there may still be occasions when you are required to work in person at a Booz Allen or customer facility.
  • Hybrid: If this position is listed as hybrid, you will be expected to work from a Booz Allen facility frequently, in alignment with leadership expectations and the needs of the role. You may also be required to work from or visit a customer facility.
  • Onsite: If this position is listed as onsite, work will primarily be performed at a Booz Allen office or customer facility, where employees will collaborate directly with colleagues and customers as required by the role.

Commitment to Non-Discrimination
All qualified applicants will receive consideration for employment without regard to disability, status as a protected veteran or any other status protected by applicable federal, state, local, or international law.
Not ready to apply? Join our Talent Community and sign up for job alerts.

What Booz Allen Hamilton employees say

Pay

Benefits

Hours and flexibility

Workplace

Get the full story on Breakroom

Booz Allen Hamilton logo

About Booz Allen Hamilton

Sourced by ZipRecruiter

Booz Allen Hamilton is a leading provider of management and technology consulting services to the US government in defense, intelligence, and civil markets. Headquartered in McLean, Virginia, the firm also serves major corporations, institutions, and not-for-profit organizations. Founded in 1914 by Edwin G. Booz, the company has a long-standing tradition of helping clients achieve success by delivering a wide range of consulting services that include strategic planning, human capital and learning, communication, systems development, and others. The company's mission is to empower people to change the world, and it has a reputation for maintaining the highest standards of integrity and-excellence.

Industry

It services

Company size

10,000+ Employees

Headquarters location

McLean, VA, US

Year founded

1914

View All Booz Allen Hamilton Jobs

Apply