ZipRecruiter

Log In

1

Overnight Ai Data Rater Jobs in Reston, VA (NOW HIRING)

Steampunk

AI Evaluation Scientist

Mclean, VA · On-site

$105K - $145K/yr

The AI Evaluation Scientist will work closely with engineers, data scientists, governance analysts ... rate, and safety metrics. * Build and maintain automated evaluation scripts, tests, and pipelines ...

Steampunk

AI Evaluation Scientist

Mclean, VA · On-site

$105K - $145K/yr

The AI Evaluation Scientist will work closely with engineers, data scientists, governance analysts ... rate, and safety metrics. * Build and maintain automated evaluation scripts, tests, and pipelines ...

Nyla Technology Solutions

Data Engineer

Arlington, VA · On-site

$110K - $160K/yr

... AI Officer (DoW CDAO). If you thrive on optimizing cloud infrastructure and building resilient ... rate once you work over 1880 hours on contract! LEAVE - Want to spend more time with the family?

New

Nyla Technology Solutions

Lead Data Scientist

Arlington, VA · On-site

$170K - $200K/yr

As a Data Science Lead , you will own the end-to-end development of AI/ML models--from training and ... rate once you work over 1880 hours on contract! LEAVE - Want to spend more time with the family?

New

Nyla Technology Solutions

Lead Data Engineer

Arlington, VA · On-site

$160K - $230K/yr

... AI Officer (DoW CDAO). Key Responsibilities: * Lead the development and operation of end-to-end ... rate once you work over 1880 hours on contract! LEAVE - Want to spend more time with the family?

New

ManTech

Enterprise AI Security Engineer

Washington, DC · Remote

$141K - $236K/yr

Dive into innovation in Digital Transformation, Cybersecurity, IT, Data Analytics and Software ... There are differentiating factors that can impact a final salary/hourly rate, including, but not ...

previous page

Showing results 41-60

All JobsAi Data Rater JobsOvernight Ai Data Rater JobsOvernight Ai Data Rater Jobs in Reston, VA

Overnight Ai Data Rater information

See Reston, VA salary details

$14

$26

$40

How much do overnight ai data rater jobs pay per hour?

As of Aug 23, 2026, the average hourly pay for overnight ai data rater in Reston, VA is $26.35, according to ZipRecruiter salary data. Most workers in this role earn between $19.28 and $33.27 per hour, depending on experience, location, and employer.

What is an Overnight AI Data Rater?

Overnight AI Data Raters are individuals who work outside of regular business hours to evaluate and label data used to train artificial intelligence systems. Their main responsibilities include reviewing text, images, audio, or video content and providing accurate assessments or categorizations according to specific guidelines. This work is crucial in ensuring AI models can learn from high-quality and unbiased data. Typically, these roles are remote and may require attention to detail, consistency, and adherence to data privacy standards.

What are the key skills and qualifications needed to thrive as an Overnight AI Data Rater?

To thrive as an Overnight AI Data Rater, you need strong analytical skills, attention to detail, and proficiency in following complex guidelines, usually supported by at least a high school diploma or equivalent. Familiarity with data labeling tools, web browsers, and sometimes proprietary platforms is important, as well as the ability to quickly adapt to evolving AI systems. Excellent time management, self-motivation, and clear written communication help individuals excel in this often-remote, independent role. These skills ensure accurate data evaluation, which is crucial for improving AI systems and maintaining quality standards during off-peak hours.

What are some common challenges faced by Overnight AI Data Raters, and how can they be managed?

Overnight AI Data Raters often encounter challenges such as maintaining focus during late-night shifts and accurately evaluating large volumes of data within tight deadlines. Managing these challenges involves establishing a consistent sleep schedule, taking regular breaks to avoid fatigue, and using productivity tools to track progress. Collaborating with team members via chat platforms can also help resolve uncertainties in data interpretation, ensuring high-quality work even during less supervised hours.

What is the difference between Overnight Ai Data Rater vs Data Annotator?

AspectOvernight Ai Data RaterData Annotator
CredentialsBasic computer skills, sometimes high school diplomaBasic computer skills, sometimes high school diploma
Work EnvironmentRemote, flexible hours, often overnight shiftsRemote or on-site, flexible or regular hours
Industry UsageAI training data, machine learning modelsData labeling, training datasets for AI
Job FocusReviewing and rating data for AI modelsLabeling and annotating data for AI training

Both Overnight Ai Data Raters and Data Annotators work in AI data preparation, often remotely, with similar entry-level requirements. The key difference is that Overnight Ai Data Raters primarily review and rate data, often during overnight shifts, while Data Annotators focus on labeling and annotating data to create training datasets. Understanding these distinctions helps job seekers find roles aligned with their skills and preferred work hours.

What cities near Reston, VA are hiring for Overnight Ai Data Rater jobs?

Cities near Reston, VA with the most Overnight Ai Data Rater job openings:

Overnight Ai Data Rater jobs near you
Infographic showing various Overnight Ai Data Rater job openings in Reston, VA as of August 2026, with employment types broken down into 1% As Needed, 84% Full Time, 11% Part Time, and 4% Contract. Highlights an 86% Physical, 4% Hybrid, and 10% Remote job distribution, with an average salary of $54,813 per year, or $26.4 per hour.

AI Evaluation Scientist

Steampunk

Mclean, VA • On-site

$105K - $145K/yr

Other

Re-posted 8 days ago

Job description

Overview
We are looking for an AI Evaluation Scientist to design and execute evaluation processes that ensure our predictive and generative AI systems are accurate, reliable, safe, and aligned with mission requirements. This role is essential for establishing trust in AI solutions and supporting continuous improvement across the AI lifecycle. The AI Evaluation Scientist will work closely with engineers, data scientists, governance analysts, and product teams to develop evaluation metrics, build test harnesses, analyze model behavior, and support responsible deployment.
Contributions
  • Implement evaluation frameworks for AI models, including accuracy, robustness, relevance, bias, hallucination rate, and safety metrics.
  • Build and maintain automated evaluation scripts, tests, and pipelines that assess AI model outputs and detect performance drift over time.
  • Develop benchmark datasets, challenge sets, and scenario-based test cases tailored to mission and user needs.
  • Perform structured error analysis and behavioral audits of LLMs, retrieval-augmented generation (RAG) systems, and predictive models, documenting findings and improvement recommendations.
  • Collaborate with AI Developers, LLMOps Engineers, and Data Scientists to support iterative experimentation, model hardening, and quality improvements.
  • Contribute to the design of human-in-the-loop evaluation workflows, integrating qualitative and quantitative insight into evaluation reports.
  • Assist in mapping evaluation outcomes to responsible AI principles such as fairness, transparency, reliability, and safety.
  • Partner with AI Governance Analysts to ensure evaluation outputs support compliance, documentation, and risk assessments.
  • Stay current with emerging evaluation tools, frameworks, metrics, and research related to LLM assessment and generative AI reliability.
  • Document evaluation processes, criteria, and results for both technical and non-technical audiences.
  • You will contribute to the growth of our AI & Data Exploitation Practice!

Qualifications
  • Ability to hold a position of public trust with the U.S. government.
  • Bachelor's or Master's degree in Computer Science, Statistics, Machine Learning, Cognitive Science, Human-Computer Interaction, Data Science, or a related field.
  • 2+ years of experience evaluating machine learning models, NLP systems, or generative AI models (LLMs preferred).
  • Familiarity with evaluation metrics, statistical testing, dataset creation, and experimental design for AI systems.
  • Proficiency in Python and relevant libraries such as PyTorch, Hugging Face, scikit-learn, LangChain.
  • Proficiency in AI evaluation frameworks such as Ragas or DeepEval.
  • Proficiency in AI traceability/observability tools based on the OpenTelemetry protocol.
  • Experience analyzing structured and unstructured data, including text, documents, and embeddings.
  • Understanding of LLM behavior, prompt evaluation, retrieval pipelines, or RAG architectures.
  • Exposure to responsible AI concepts and governance-aligned evaluation criteria (e.g., fairness, transparency, reliability).
  • Strong analytical skills with the ability to interpret model weaknesses, extract insights, and recommend actionable improvements.
  • Excellent written and verbal communication skills, with the ability to present evaluation findings clearly to technical and non-technical stakeholders.
  • Experience working in agile or iterative development environments is a plus.
  • Familiarity with OWASP LLM Top 10 Risks
  • Relevant certifications (helpful but not required): NIST AI RMF (AISIC), INFORMS CAP, AWS/Azure/Google ML Certifications.

About steampunk
Steampunk relies on several factors to determine salary, including but not limited to geographic location, contractual requirements, education, knowledge, skills, competencies, and experience. The projected compensation range for this position is $105,000 to $145,000. The estimate displayed represents a typical annual salary range for this position. Annual salary is just one aspect of Steampunk's total compensation package for employees. Learn more about additional Steampunk benefits here.
Identity Statement
As part of the application process, you are expected to be on camera during interviews and assessments. We reserve the right to take your picture to verify your identity and prevent fraud.
Steampunk is a Change Agent in the Federal contracting industry, bringing new thinking to clients in the Homeland, Federal Civilian, Health and DoD sectors. Through our Human-Centered delivery methodology, we are fundamentally changing the expectations our Federal clients have for true shared accountability in solving their toughest mission challenges. As an employee owned company, we focus on investing in our employees to enable them to do the greatest work of their careers - and rewarding them for outstanding contributions to our growth. If you want to learn more about our story, visit http://www.steampunk.com.

Apply