1

Ai Rater Jobs in Washington (NOW HIRING)

AI Quality Engineer

Merrifield, VA · On-site

$71K - $92K/yr

Hallucination rates * Retrieval quality * Recommendation quality * User satisfaction • Design and maintain AI validation datasets, benchmark scenarios, regression test suites, and golden test ...

AI Evaluation Scientist

Mclean, VA · On-site

$105K - $145K/yr

Implement evaluation frameworks for AI models, including accuracy, robustness, relevance, bias, hallucination rate, and safety metrics. * Build and maintain automated evaluation scripts, tests, and ...

AI Evaluation Scientist

Mclean, VA · On-site

$105K - $145K/yr

Implement evaluation frameworks for AI models, including accuracy, robustness, relevance, bias, hallucination rate, and safety metrics. * Build and maintain automated evaluation scripts, tests, and ...

AI Evaluation Scientist

Mclean, VA · On-site

$105K - $145K/yr

Implement evaluation frameworks for AI models, including accuracy, robustness, relevance, bias, hallucination rate, and safety metrics. * Build and maintain automated evaluation scripts, tests, and ...

Senior AI Engineer

Reston, VA · On-site

$215 - $245/hr

IntelliGenesisis seeking a Senior AI Engineer to lead the design, development, and deployment of ... layoff, termination, rates of pay, or other forms of compensation and selection of training.

AI Assurance Engineer

Washington, DC · Remote

$141K - $236K/yr

MANTECH seeks motivated, career, and customer-oriented AI Assurance Engineer for a new initiative ... There are differentiating factors that can impact a final salary/hourly rate, including, but not ...

AI Evaluation Scientist

Mclean, VA · On-site

$105K - $145K/yr

Implement evaluation frameworks for AI models, including accuracy, robustness, relevance, bias, hallucination rate, and safety metrics. * Build and maintain automated evaluation scripts, tests, and ...

AI Assurance Engineer

Washington, DC · On-site

$141K - $236K/yr

MANTECH seeks motivated, career, and customer-oriented AI Assurance Engineer for a new initiative ... There are differentiating factors that can impact a final salary/hourly rate, including, but not ...

IntelliGenesis is seeking a Senior AI Engineer to lead the design, development, and deployment of ... layoff, termination, rates of pay, or other forms of compensation and selection of training.

Senior AI Engineer

Reston, VA · On-site

$215K - $245K/yr

IntelliGenesis is seeking a Senior AI Engineer to lead the design, development, and deployment of ... layoff, termination, rates of pay, or other forms of compensation and selection of training.

AI Evaluation Scientist

Mclean, VA · On-site

$105K - $145K/yr

Implement evaluation frameworks for AI models, including accuracy, robustness, relevance, bias, hallucination rate, and safety metrics. * Build and maintain automated evaluation scripts, tests, and ...

AI Evaluation Scientist

Mclean, VA · On-site

$105K - $145K/yr

Implement evaluation frameworks for AI models, including accuracy, robustness, relevance, bias, hallucination rate, and safety metrics. * Build and maintain automated evaluation scripts, tests, and ...

Implement evaluation frameworks for AI models, including accuracy, robustness, relevance, bias, hallucination rate, and safety metrics. * Build and maintain automated evaluation scripts, tests, and ...

Implement evaluation frameworks for AI models, including accuracy, robustness, relevance, bias, hallucination rate, and safety metrics. * Build and maintain automated evaluation scripts, tests, and ...

Implement evaluation frameworks for AI models, including accuracy, robustness, relevance, bias, hallucination rate, and safety metrics. * Build and maintain automated evaluation scripts, tests, and ...

AI Evaluation Scientist

Mclean, VA · On-site

$105K - $145K/yr

Implement evaluation frameworks for AI models, including accuracy, robustness, relevance, bias, hallucination rate, and safety metrics. * Build and maintain automated evaluation scripts, tests, and ...

AI Evaluation Scientist

Mclean, VA · On-site

$105K - $145K/yr

Implement evaluation frameworks for AI models, including accuracy, robustness, relevance, bias, hallucination rate, and safety metrics. * Build and maintain automated evaluation scripts, tests, and ...

AI Evaluation Scientist

Mclean, VA · On-site

$105K - $145K/yr

Implement evaluation frameworks for AI models, including accuracy, robustness, relevance, bias, hallucination rate, and safety metrics. * Build and maintain automated evaluation scripts, tests, and ...

AI Evaluation Scientist

Mclean, VA · On-site

$105K - $145K/yr

Implement evaluation frameworks for AI models, including accuracy, robustness, relevance, bias, hallucination rate, and safety metrics. * Build and maintain automated evaluation scripts, tests, and ...

Showing results 21-40

Ai Rater information

What is an AI Rater?

An AI Rater evaluates and provides feedback on artificial intelligence models, typically improving search engines, chatbots, or recommendation systems. They assess the relevance, accuracy, and quality of AI-generated content based on specific guidelines. This role requires strong analytical skills, attention to detail, and familiarity with the subject matter being reviewed. AI Raters often work remotely and on a flexible schedule.

What skills and qualifications are needed to thrive as an AI Rater?

To thrive as an AI Rater, you generally need strong attention to detail, analytical thinking, and proficiency in English, often supported by formal education such as a high school diploma or higher. Familiarity with web browsers, online research, and company-specific rating platforms or guidelines is essential. Excellent time management, adaptability, and effective written communication help individuals excel in this position. These skills and qualities ensure accurate and consistent evaluations of AI-generated content, directly impacting the improvement of artificial intelligence systems.

What does an AI Rater do?

A typical day for an AI Rater involves reviewing and evaluating various types of content, such as search engine results, social media posts, advertisements, or chatbot responses, to ensure they meet quality and relevancy standards. You may follow detailed guidelines to rate or annotate content, complete assigned tasks in a web-based platform, and provide feedback to help improve AI performance. Most positions are remote and offer flexible schedules, allowing you to plan your workload around personal commitments. Collaboration is generally limited, as most work is performed independently, but periodic communication with team leads for training or updates is common.

What are the most commonly searched types of Ai Rater jobs in Washington? The most popular types of Ai Rater jobs in Washington are:
What cities in Washington are hiring for Ai Rater jobs? Cities in Washington with the most Ai Rater job openings:
Infographic showing various Ai Rater job openings in Washington as of August 2026, with employment types broken down into 69% Full Time, 15% Part Time, 1% Temporary, and 15% Contract. Highlights an 81% In-person, and 19% Remote job distribution.

Cost Accounting Compliance Analyst (R5254)

Shield AI

Washington, DC • On-site

$100K - $150K/yr

Full-time

Re-posted 14 days ago


Job description

Shield AI is a venture-backed defense-tech company with the mission of protecting service members and civilians with intelligent systems. Its products include Hivemind autonomy software, V-BAT and X-BAT aircraft, and Aechelon simulation and synthetic reality technologies. With offices and facilities across the U.S., Europe, the Middle East, and Asia-Pacific, Shield AI's technology actively supports operations worldwide. For more information, visit www.shield.ai. Follow Shield AI on LinkedIn, X, Instagram, and YouTube. 

Job Description:  

We are seeking a detail-oriented Cost Accounting Compliance Analyst to support our government contracting operations. This role is critical in ensuring compliance with Federal Acquisition Regulation (FAR), Defense Federal Acquisition Regulation Supplement (DFARS), and other applicable cost accounting standards.
You will partner closely with Accounting, Finance, Legal, Contracts, and Program Management teams to ensure accurate cost reporting, support audits, and maintain compliant pricing structures across programs.
What You'll Do:
  • Ensure compliance with FAR, DFARS, and Cost Accounting Standards (CAS) in all cost-related activities
  • Lead the preparation of incurred cost submissions (ICS), provisional billing rate (PBR), and forward pricing rate proposals (FPRP)
  • Analyze and validate cost structures, indirect rates, and allocation methodologies
  • Assist in DCAA/DCMA audits, including data requests, documentation, and responses
  • Review contracts and proposals for compliance with government cost/pricing requirements
  • Maintain and improve internal controls related to cost accounting practices
  • Collaborate cross-functionally with Contracts, Pricing, and Program teams to ensure alignment
  • Identify compliance risks and recommend corrective actions
Required Qualifications:
  • Bachelor's degree in Accounting, Finance, or related field
  • 5+years of experience in cost accounting within a government contracting environment
  • Strong working knowledge of FAR, DFARS, and CAS
  • Experience supporting DCAA, DCMA or IPA audits
  • Familiarity with incurred cost submissions and pricing proposals
  •  Experience with Disclosure Statements (CASB DS-1)
  • Advanced proficiency in Excel and financial analysis tools
  • Strong analytical, organizational, and communication skills
Preferred Qualifications:
  • Experience in Aerospace & Defense or similar regulated industry
  • Exposure to ERP systems (e.g., Deltek Costpoint, SAP, Oracle)
  • Experience leveraging AI and automation in core job responsibilities
  • CPA, CMA, or progress toward certification
$100,000 - $150,000 a year
Full-time regular employee offer package:
Pay within range listed + Bonus + Benefits + Equity
 
Temporary employee offer package:
Pay within range listed above + temporary benefits package (applicable after 60 days of employment)
 
Salary compensation is influenced by a wide array of factors including but not limited to skill set, level of experience, licenses and certifications, and specific work location. All offers are contingent on a cleared background and possible reference check. Military fellows and part-time employees are not eligible for benefits. Please speak to your talent acquisition representative for more information.
 
###
 
Shield AI is proud to be an equal opportunity workplace and is an affirmative action employer. We are committed to equal employment opportunity regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, marital status, disability, gender identity or Veteran status. If you have a disability or special need that requires accommodation, please let us know. 
We may use artificial intelligence (AI) tools to support parts of the hiring process, such as reviewing applications, analyzing resumes, or assessing responses and identifying potential inconsistencies or verification signals in application materials based on available information. These tools assist our recruitment team but do not replace human judgment. Final hiring decisions are ultimately made by humans. If you would like more information about how your data is processed, please contact us.
apply for this job