Washington, DC · On-site
$150K - $190K/yr
We are assisting them in seeking an AI Innovation Advisor to drive the adoption, implementation ... We have a direct relationship with our clients and a 95% hire rate! We differentiate ourselves from ...
Quick apply
Washington, DC · On-site
$150K - $190K/yr
We are assisting them in seeking an AI Innovation Advisor to drive the adoption, implementation ... We have a direct relationship with our clients and a 95% hire rate! We differentiate ourselves from ...
Competitive Hourly Rate * Full-Health Benefits You will receive the following benefits: * Medical ... AI/ML experience, including building and deploying production systems * Expert-level Python ...
Competitive Hourly Rate * Full-Health Benefits You will receive the following benefits: * Medical ... AI/ML experience, including building and deploying production systems * Expert-level Python ...
OWASP AI Testing Guide, NIST AI Risk Management Framework (RMF) Location: Remote, with occasional ... Rate: $50-80/hr. 1099 or Corp. To Corp.). This range represents a good-faith estimate and is not a ...
Quick apply
OWASP AI Testing Guide, NIST AI Risk Management Framework (RMF) Location: Remote, with occasional ... Rate: $50-80/hr. 1099 or Corp. To Corp.). This range represents a good-faith estimate and is not a ...
Mclean, VA · On-site
$105 - $145/hr
Implement evaluation frameworks for AI models, including accuracy, robustness, relevance, bias, hallucination rate, and safety metrics. * Build and maintain automated evaluation scripts, tests, and ...
Mclean, VA · On-site
$105 - $145/hr
Implement evaluation frameworks for AI models, including accuracy, robustness, relevance, bias, hallucination rate, and safety metrics. * Build and maintain automated evaluation scripts, tests, and ...
Merrifield, VA · On-site
$71K - $92K/yr
Hallucination rates * Retrieval quality * Recommendation quality * User satisfaction • Design and maintain AI validation datasets, benchmark scenarios, regression test suites, and golden test ...
Merrifield, VA · On-site
$71K - $92K/yr
Hallucination rates * Retrieval quality * Recommendation quality * User satisfaction • Design and maintain AI validation datasets, benchmark scenarios, regression test suites, and golden test ...
Sterling, VA · On-site +1
$50 - $80/hr
OWASP AI Testing Guide, NIST AI Risk Management Framework (RMF) Location: Remote, with occasional ... Rate: $50-80/hr. 1099 or Corp. To Corp.). This range represents a good-faith estimate and is not a ...
Sterling, VA · On-site +1
$50 - $80/hr
OWASP AI Testing Guide, NIST AI Risk Management Framework (RMF) Location: Remote, with occasional ... Rate: $50-80/hr. 1099 or Corp. To Corp.). This range represents a good-faith estimate and is not a ...
Washington, DC · On-site
$108.01 - $183.61/hr
ICF is seeking an AI / Automation Engineer to design, build, and continuously improve the AI ... Track and report on Tier Zero performance metrics, including deflection rate, chatbot resolution ...
Washington, DC · On-site
$108.01 - $183.61/hr
ICF is seeking an AI / Automation Engineer to design, build, and continuously improve the AI ... Track and report on Tier Zero performance metrics, including deflection rate, chatbot resolution ...
Washington, DC · On-site
$72.25 - $92.75/hr
Design and operate evaluation frameworks that continuously measure AI output quality: factual accuracy, context faithfulness, retrieval relevance, hallucination rates, and task completion success ...
New
Washington, DC · On-site
$72.25 - $92.75/hr
Design and operate evaluation frameworks that continuously measure AI output quality: factual accuracy, context faithfulness, retrieval relevance, hallucination rates, and task completion success ...
New
Mclean, VA · On-site
$83/hr
Senior Lead AI Engineer Location ... MCLEAN, VA Duration: 6 Months + Extension Bill Rate: $83/hour Job Type: W-2 Contract Client: To Be ...
New
Mclean, VA · On-site
$83/hr
Senior Lead AI Engineer Location ... MCLEAN, VA Duration: 6 Months + Extension Bill Rate: $83/hour Job Type: W-2 Contract Client: To Be ...
New
Washington, DC · On-site
$72.25 - $92.75/hr
Design and operate evaluation frameworks that continuously measure AI output quality: factual accuracy, context faithfulness, retrieval relevance, hallucination rates, and task completion success ...
New
Washington, DC · On-site
$72.25 - $92.75/hr
Design and operate evaluation frameworks that continuously measure AI output quality: factual accuracy, context faithfulness, retrieval relevance, hallucination rates, and task completion success ...
New
Washington, DC · On-site
$100K - $150K/yr
Shield AI is a venture-backed defense-tech company with the mission of protecting service members ... Lead the preparation of incurred cost submissions (ICS), provisional billing rate (PBR), and ...
Quick apply
Washington, DC · On-site
$100K - $150K/yr
Shield AI is a venture-backed defense-tech company with the mission of protecting service members ... Lead the preparation of incurred cost submissions (ICS), provisional billing rate (PBR), and ...
Washington, DC · On-site
$120K - $180K/yr
Shield AI is a venture-backed defense-tech company with the mission of protecting service members ... Report on demand fulfillment, offer and accept rates, conversion, diversity, and school ROI, and ...
Washington, DC · On-site
$120K - $180K/yr
Shield AI is a venture-backed defense-tech company with the mission of protecting service members ... Report on demand fulfillment, offer and accept rates, conversion, diversity, and school ROI, and ...
Mclean, VA · On-site
$105K - $145K/yr
Implement evaluation frameworks for AI models, including accuracy, robustness, relevance, bias, hallucination rate, and safety metrics. * Build and maintain automated evaluation scripts, tests, and ...
Mclean, VA · On-site
$105K - $145K/yr
Implement evaluation frameworks for AI models, including accuracy, robustness, relevance, bias, hallucination rate, and safety metrics. * Build and maintain automated evaluation scripts, tests, and ...
Washington, DC · Remote
$141K - $236K/yr
MANTECH seeks motivated, career, and customer-oriented AI Assurance Engineer for a new initiative ... There are differentiating factors that can impact a final salary/hourly rate, including, but not ...
Washington, DC · Remote
$141K - $236K/yr
MANTECH seeks motivated, career, and customer-oriented AI Assurance Engineer for a new initiative ... There are differentiating factors that can impact a final salary/hourly rate, including, but not ...
$100K - $150K/yr
Shield AI is a venture-backed defense-tech company with the mission of protecting service members ... Lead the preparation of incurred cost submissions (ICS), provisional billing rate (PBR), and ...
$100K - $150K/yr
Shield AI is a venture-backed defense-tech company with the mission of protecting service members ... Lead the preparation of incurred cost submissions (ICS), provisional billing rate (PBR), and ...
Washington, DC · On-site
$141K - $236K/yr
MANTECH seeks motivated, career, and customer-oriented AI Assurance Engineer for a new initiative ... There are differentiating factors that can impact a final salary/hourly rate, including, but not ...
Washington, DC · On-site
$141K - $236K/yr
MANTECH seeks motivated, career, and customer-oriented AI Assurance Engineer for a new initiative ... There are differentiating factors that can impact a final salary/hourly rate, including, but not ...
Reston, VA · On-site
$215 - $245/hr
IntelliGenesisis seeking a Senior AI Engineer to lead the design, development, and deployment of ... layoff, termination, rates of pay, or other forms of compensation and selection of training.
Reston, VA · On-site
$215 - $245/hr
IntelliGenesisis seeking a Senior AI Engineer to lead the design, development, and deployment of ... layoff, termination, rates of pay, or other forms of compensation and selection of training.
Reston, VA · On-site
IntelliGenesis is seeking a Senior AI Engineer to lead the design, development, and deployment of ... layoff, termination, rates of pay, or other forms of compensation and selection of training.
Quick apply
Reston, VA · On-site
IntelliGenesis is seeking a Senior AI Engineer to lead the design, development, and deployment of ... layoff, termination, rates of pay, or other forms of compensation and selection of training.
Reston, VA · On-site
$215K - $245K/yr
IntelliGenesis is seeking a Senior AI Engineer to lead the design, development, and deployment of ... layoff, termination, rates of pay, or other forms of compensation and selection of training.
Reston, VA · On-site
$215K - $245K/yr
IntelliGenesis is seeking a Senior AI Engineer to lead the design, development, and deployment of ... layoff, termination, rates of pay, or other forms of compensation and selection of training.
Mclean, VA · On-site
$105K - $145K/yr
Implement evaluation frameworks for AI models, including accuracy, robustness, relevance, bias, hallucination rate, and safety metrics. * Build and maintain automated evaluation scripts, tests, and ...
Mclean, VA · On-site
$105K - $145K/yr
Implement evaluation frameworks for AI models, including accuracy, robustness, relevance, bias, hallucination rate, and safety metrics. * Build and maintain automated evaluation scripts, tests, and ...
An AI Rater evaluates and provides feedback on artificial intelligence models, typically improving search engines, chatbots, or recommendation systems. They assess the relevance, accuracy, and quality of AI-generated content based on specific guidelines. This role requires strong analytical skills, attention to detail, and familiarity with the subject matter being reviewed. AI Raters often work remotely and on a flexible schedule.
A typical day for an AI Rater involves reviewing and evaluating various types of content, such as search engine results, social media posts, advertisements, or chatbot responses, to ensure they meet quality and relevancy standards. You may follow detailed guidelines to rate or annotate content, complete assigned tasks in a web-based platform, and provide feedback to help improve AI performance. Most positions are remote and offer flexible schedules, allowing you to plan your workload around personal commitments. Collaboration is generally limited, as most work is performed independently, but periodic communication with team leads for training or updates is common.
To thrive as an AI Rater, you generally need strong attention to detail, analytical thinking, and proficiency in English, often supported by formal education such as a high school diploma or higher. Familiarity with web browsers, online research, and company-specific rating platforms or guidelines is essential. Excellent time management, adaptability, and effective written communication help individuals excel in this position. These skills and qualities ensure accurate and consistent evaluations of AI-generated content, directly impacting the improvement of artificial intelligence systems.
The top searched job categories for Ai Rater jobs in Reston, VA are:
Cities near Reston, VA with the most Ai Rater job openings:
Washington, DC • On-site
$150K - $190K/yr
Full-time
Medical, Dental, Vision, Life, Retirement, PTO
Re-posted 2 days ago
Location: We are looking for local candidates who currently reside in either New York, Chicago, Washington DC, San Francisco, Los Angeles or Houston
Our client is a world class law firm experiencing tremendous growth and success. We are assisting them in seeking an AI Innovation Advisor to drive the adoption, implementation, and optimization of AI solutions within their leading law firm. This individual will work closely with attorneys, firm leadership, and technology teams to identify opportunities for innovation, improve legal workflows, and support the responsible use of generative AI tools.
NOTE: This is a regular w2 full-time, direct hire position which requires the hired individual to work onsite without relocation assistance. Applicants MUST also be either a U.S. Citizen or Green Card holder. No visas or EAD candidates accepted at this time.
Position can be in one of the following locations: Los Angeles, San Francisco, New York, Houston, Chicago, DC, or Salt Lake City
Our client upholds strict performance standards and fosters a culture focused on continuous growth. Individuals who exhibit initiative and dedication will be offered opportunities for increased responsibilities and long-term professional advancement within the organization.
Key Responsibilities
Qualifications
Preferred
How to Apply:
Our client has hired us to help facilitate the initial interview and recruiting process. Please attach your current version of your resume and make sure you complete our initial pre-screening questions that will be used for determining which applicants will be considered at this time. Thank you for your interest.
We Place People is a premiere Executive Search Firm working with leading companies nationwide. We have a direct relationship with our clients and a 95% hire rate! We differentiate ourselves from other firms & work closely with our candidates throughout the interview process. WE PLACE PEOPLE is what we do best!
