ZipRecruiter

Log In

1

Ai Rater Jobs in Washington, DC (NOW HIRING)

Wisetek Providers INC

AI Engineer

Merrifield, VA · On-site

$110 - $160/hr

  • Medical

  • Dental

  • Retirement

  • PTO

Provide tool functions with RBAC scopes, schema versioning, rate limiting, request/response validation, and audit trails. * Deploy Azure AI Agent Service (AGA) patterns for agent registry/broker ...

New

WISETEK PROVIDERS INC

AI Engineer

Washington, DC · On-site

$80K - $105K/yr

  • Medical

  • Dental

  • Retirement

  • PTO

Provide tool functions with RBAC scopes, schema versioning, rate limiting, request/response validation, and audit trails. * Deploy Azure AI Agent Service (AGA) patterns for agent registry/broker ...

The Josef Group

AI Infrastructure Engineer

Chantilly, VA · On-site

$200 - $250/hr

Build and maintain AI serving infrastructure, including gateways, load balancing, authentication, TLS, and rate limiting. * Optimize GPU utilization, memory management, quantization, batching, and ...

Jobtailor

Lead Agentic AI Engineer

Mclean, VA · On-site

$140 - $210/hr

Own the metrics that matter resolution rate, escalation rate, AI output accuracy, response time, and program satisfaction. Report clearly to program leadership and internal stakeholders, with ...

New

ECS

AI Requirements Engineer

Quantico, VA · On-site

$120K - $145K/yr

Everforth ECS is seeking an AI Requirements Engineer to work in our Arlington, VA office (Hybrid ... Proven ability to deliver measurable improvements in user experience, adoption rates, and process ...

The Josef Group

AI Infrastructure Engineer

Chantilly, VA · On-site

$110K - $144K/yr

Build and maintain AI serving infrastructure, including gateways, load balancing, authentication, TLS, and rate limiting. * Optimize GPU utilization, memory management, quantization, batching, and ...

TestPros

Senior AI Test Engineer (Remote)

Sterling, VA · Remote

OWASP AI Testing Guide, NIST AI Risk Management Framework (RMF) Location: Remote, with occasional ... Rate: $50-80/hr. 1099 or Corp. To Corp.). This range represents a good-faith estimate and is not a ...

INSPYR Solutions

AI Quality Engineer

Merrifield, VA · On-site

$71K - $92K/yr

Hallucination rates * Retrieval quality * Recommendation quality * User satisfaction • Design and maintain AI validation datasets, benchmark scenarios, regression test suites, and golden test ...

Steampunk

AI Evaluation Scientist

Mclean, VA · On-site

$105 - $145/hr

Implement evaluation frameworks for AI models, including accuracy, robustness, relevance, bias, hallucination rate, and safety metrics. * Build and maintain automated evaluation scripts, tests, and ...

ICF Olson

AI / Automation Engineer

Washington, DC · On-site

$108.01 - $183.61/hr

ICF is seeking an AI / Automation Engineer to design, build, and continuously improve the AI ... Track and report on Tier Zero performance metrics, including deflection rate, chatbot resolution ...

New

TestPros

Senior AI Test Engineer (Remote)

Sterling, VA · On-site +1

$50 - $80/hr

OWASP AI Testing Guide Location: Remote, with occasional travel to customer sites or TestPros labs ... Rate: $50-80/hr. 1099 or Corp. To Corp.). This range represents a good-faith estimate and is not a ...

Steampunk

AI Evaluation Scientist

Mclean, VA · On-site

$105K - $145K/yr

Implement evaluation frameworks for AI models, including accuracy, robustness, relevance, bias, hallucination rate, and safety metrics. * Build and maintain automated evaluation scripts, tests, and ...

ManTech

AI Assurance Engineer

Washington, DC · Remote

$141K - $236K/yr

  • Medical

  • Life

  • Retirement

  • PTO

MANTECH seeks motivated, career, and customer-oriented AI Assurance Engineer for a new initiative ... There are differentiating factors that can impact a final salary/hourly rate, including, but not ...

IntelliGenesis

Senior AI Engineer

Reston, VA · On-site

$215 - $245/hr

  • Medical

  • Life

  • Retirement

  • PTO

IntelliGenesisis seeking a Senior AI Engineer to lead the design, development, and deployment of ... layoff, termination, rates of pay, or other forms of compensation and selection of training.

previous page

Showing results 41-60

All JobsAi Rater JobsAi Rater Jobs in Washington, DC

Ai Rater information

What is an AI Rater?

An AI Rater evaluates and provides feedback on artificial intelligence models, typically improving search engines, chatbots, or recommendation systems. They assess the relevance, accuracy, and quality of AI-generated content based on specific guidelines. This role requires strong analytical skills, attention to detail, and familiarity with the subject matter being reviewed. AI Raters often work remotely and on a flexible schedule.

What does an AI Rater do?

A typical day for an AI Rater involves reviewing and evaluating various types of content, such as search engine results, social media posts, advertisements, or chatbot responses, to ensure they meet quality and relevancy standards. You may follow detailed guidelines to rate or annotate content, complete assigned tasks in a web-based platform, and provide feedback to help improve AI performance. Most positions are remote and offer flexible schedules, allowing you to plan your workload around personal commitments. Collaboration is generally limited, as most work is performed independently, but periodic communication with team leads for training or updates is common.

What skills and qualifications are needed to thrive as an AI Rater?

To thrive as an AI Rater, you generally need strong attention to detail, analytical thinking, and proficiency in English, often supported by formal education such as a high school diploma or higher. Familiarity with web browsers, online research, and company-specific rating platforms or guidelines is essential. Excellent time management, adaptability, and effective written communication help individuals excel in this position. These skills and qualities ensure accurate and consistent evaluations of AI-generated content, directly impacting the improvement of artificial intelligence systems.

How to become an AI Rater?

To become an AI Rater, candidates typically need a high school diploma or equivalent, strong language and analytical skills, and the ability to follow detailed guidelines. The role often involves evaluating search engine results or content for accuracy and relevance, using online platforms or specific assessment tools. Prior experience in data annotation or quality assurance can be beneficial, and flexible scheduling is common.

What are the most commonly searched types of Ai Rater jobs in Washington, DC?

The most popular types of Ai Rater jobs in Washington, DC are:

What are popular job titles related to Ai Rater jobs in Washington, DC?

For Ai Rater jobs in Washington, DC, the most frequently searched job titles are:

What job categories do people searching Ai Rater jobs in Washington, DC look for?

The top searched job categories for Ai Rater jobs in Washington, DC are:

Ai Rater jobs near you
Infographic showing various Ai Rater job openings in Washington, DC as of August 2026, with employment types broken down into 49% Full Time, and 51% Part Time. Highlights an 100% Remote job distribution.

AI Engineer

Wisetek Providers INC

Merrifield, VA • On-site

$110 - $160/hr

Other

Medical, Dental, Retirement, PTO

Posted 2 days ago

New

Job description

Benefits:
  • 401(k) matching
  • Dental insurance
  • Health insurance
  • Paid time off
Company Overview
Wisetek Providers, Inc. is a business and Information Technology (IT) consulting firm, located in Fairfax, Virginia. We specialize in providing innovative business and IT services to our clients by leveraging our diverse expertise in business, technology, finance, and management consulting.
We collaborate with our clients to identify their needs and explore new growth opportunities, create innovative and integrated solutions to solve their problems, and optimize their overall performance. In addition to providing IT and business consulting services we also specialize in managing software development projects for our clients.

4 TO 6 YEARS OF EXPERIENCE
Salary Range: Based on the experience
Essential Job Functions:
Architect and Implement AI Solutions
  • Design and build RAG pipelines using Azure AI/Search and vector databases: chunking, embeddings, hybrid/semantic ranking, re-ranking, evaluation, and citation display.
  • Build enterprise conversational systems (multi-turn, retrieval-grounded) with prompt lifecycle management, guardrails, audit logging, and telemetry.
  • Support multiple LLMs and modalities: Azure OpenAI, Llama (Meta), Claude, etc.., and task-specific OSS models (vision, speech), with policy-driven model routing for performance, safety, and cost.
Integrate and Operate AI Infrastructure
  • Implement Model Context Protocol (MCP) servers integrating with project related areas.
  • Provide tool functions with RBAC scopes, schema versioning, rate limiting, request/response validation, and audit trails.
  • Deploy Azure AI Agent Service (AGA) patterns for agent registry/broker/governance with agent telemetry and policy enforcement.
  • Use Azure Batch for large-scale, parallel inferencing/vectorization jobs; leverage AWS EMR for distributed data/feature processing in AI pipelines.
Develop and Manage Data Pipelines
  • Build ingestion and enrichment for RAG connectors and ETL/ELT: document normalization, PII redaction, metadata enrichment, SLA/SLO monitoring, and lineage.
  • Operate large-scale vectorization with quality gates and drift monitoring.
  • Use Azure Data Factory (ADF) and Azure Databricks for orchestrated, scalable data processing; use AWS EMR for Hadoop/Spark workloads supporting AI features.
Build Agentic AI Solutions
  • Design secure tool-calling and multi-agent orchestration using Semantic Kernel, AutoGen, Microsoft Agent Framework, CrewAI, Agno, and LangChain or others.
  • Know how to apply agent governance and MCP-based controls across heterogeneous agents and runtimes (register, observe, govern, retire).
Model Evaluation and Optimization
  • Evaluate and fine-tune open-source and proprietary models; optimize for quality, latency, safety, and cost with A/B and offline eval suites.
  • Implement CI/CD with automated tests, security scans. Have knowledge on how to secure model workloads.
#J-18808-Ljbffr

Apply