ZipRecruiter

Log In

1

Data Evaluation Jobs in Virginia (NOW HIRING)

Steampunk

AI Evaluation Scientist

Mclean, VA · On-site

$105K - $145K/yr

The AI Evaluation Scientist will work closely with engineers, data scientists, governance analysts, and product teams to develop evaluation metrics, build test harnesses, analyze model behavior, and ...

Steampunk

AI Evaluation Scientist

Mclean, VA

$105K - $145K/yr

The AI Evaluation Scientist will work closely with engineers, data scientists, governance analysts, and product teams to develop evaluation metrics, build test harnesses, analyze model behavior, and ...

Steampunk

AI Evaluation Scientist

Mclean, VA · On-site

$105K - $145K/yr

The AI Evaluation Scientist will work closely with engineers, data scientists, governance analysts, and product teams to develop evaluation metrics, build test harnesses, analyze model behavior, and ...

Steampunk

AI Evaluation Scientist

Mclean, VA

$105K - $145K/yr

The AI Evaluation Scientist will work closely with engineers, data scientists, governance analysts, and product teams to develop evaluation metrics, build test harnesses, analyze model behavior, and ...

Steampunk

AI Evaluation Scientist

Mclean, VA

$105K - $145K/yr

The AI Evaluation Scientist will work closely with engineers, data scientists, governance analysts, and product teams to develop evaluation metrics, build test harnesses, analyze model behavior, and ...

Steampunk

AI Evaluation Scientist

Mclean, VA · On-site

$105K - $145K/yr

The AI Evaluation Scientist will work closely with engineers, data scientists, governance analysts, and product teams to develop evaluation metrics, build test harnesses, analyze model behavior, and ...

Steampunk

AI Evaluation Scientist

Mclean, VA

$105K - $145K/yr

The AI Evaluation Scientist will work closely with engineers, data scientists, governance analysts, and product teams to develop evaluation metrics, build test harnesses, analyze model behavior, and ...

Steampunk

AI Evaluation Scientist

Mclean, VA

$105K - $145K/yr

The AI Evaluation Scientist will work closely with engineers, data scientists, governance analysts, and product teams to develop evaluation metrics, build test harnesses, analyze model behavior, and ...

Steampunk

AI Evaluation Scientist

Mclean, VA · On-site

$105K - $145K/yr

The AI Evaluation Scientist will work closely with engineers, data scientists, governance analysts, and product teams to develop evaluation metrics, build test harnesses, analyze model behavior, and ...

VTG

Data Engineer

Chantilly, VA · On-site

$140K - $195K/yr

Experience evaluating data analytic or science technologies and platforms * Experience going through an A&A process or leading modifications * Experience with Cloud Architecture and evaluating and ...

BTI360

Data Scientist - Polygraph Required

Herndon, VA · On-site

Responsibilities : • Lead end-to-end machine learning projects from problem definition to production, leveraging pre-trained models and LLMs for rapid prototyping, then using data-driven evaluation ...

previous page

Showing results 41-60

All JobsData Evaluation JobsData Evaluation Jobs in Virginia

Data Evaluation information

What is a data evaluation?

A Data Evaluation job involves analyzing, assessing, and interpreting data to ensure accuracy, consistency, and relevance for decision-making. Professionals in this role use statistical methods, data validation techniques, and reporting tools to identify patterns and insights. They often work with datasets from various sources, verifying integrity and optimizing data quality. Their findings help organizations improve processes, make informed decisions, and enhance overall efficiency.

What are the key skills and qualifications needed to thrive in data evaluation, and why are they important?

To thrive in Data Evaluation, you need a strong analytical mindset, proficiency with data analysis, and a relevant degree in statistics, mathematics, or a related field. Familiarity with data analytics tools such as Excel, SQL, Python, R, or business intelligence platforms, and certifications like Microsoft Certified Data Analyst Associate, are often valuable. Attention to detail, effective communication, and problem-solving abilities are key soft skills for this role. These skills ensure accurate data interpretation, effective reporting, and actionable insights that help organizations make informed decisions.

What are some common challenges faced in data evaluation roles, and how can candidates prepare for them?

Data Evaluation professionals often encounter challenges such as handling large, complex datasets, ensuring data accuracy, and interpreting ambiguous results. To prepare, candidates should familiarize themselves with industry-standard data cleaning and validation techniques, as well as regularly update their technical skills in analytics tools. Effective communication skills are essential for translating complex findings into actionable recommendations for various stakeholders. Staying proactive about learning new methodologies and collaborating closely with cross-functional teams can also help you overcome these challenges and thrive in this role.

What are popular job titles related to Data Evaluation jobs in Virginia?

For Data Evaluation jobs in Virginia, the most frequently searched job titles are:

What job categories do people searching Data Evaluation jobs in Virginia look for?

The top searched job categories for Data Evaluation jobs in Virginia are:

Data Evaluation jobs near you
Infographic showing various Data Evaluation job openings in Virginia as of August 2026, with employment types broken down into 1% As Needed, 84% Full Time, 12% Part Time, and 3% Contract. Highlights an 86% Physical, 3% Hybrid, and 11% Remote job distribution.

AI Evaluation Scientist

Steampunk

Mclean, VA • On-site

$105K - $145K/yr

Other

Re-posted 18 days ago

Job description

Overview
We are looking for an AI Evaluation Scientistto design and execute evaluation processes that ensure our predictive and generative AI systems are accurate, reliable, safe, and aligned with mission requirements. This role is essential for establishing trust in AI solutions and supporting continuous improvement across the AI lifecycle. The AI Evaluation Scientist will work closely with engineers, data scientists, governance analysts, and product teams to develop evaluation metrics, build test harnesses, analyze model behavior, and support responsible deployment.
Contributions
  • Implement evaluation frameworks for AI models, including accuracy, robustness, relevance, bias, hallucination rate, and safety metrics.
  • Build and maintain automated evaluation scripts, tests, and pipelines that assess AI model outputs and detect performance drift over time.
  • Develop benchmark datasets, challenge sets, and scenario-based test cases tailored to mission and user needs.
  • Perform structured error analysis and behavioral audits of LLMs, retrieval-augmented generation (RAG) systems, and predictive models, documenting findings and improvement recommendations.
  • Collaborate with AI Developers, LLMOps Engineers, and Data Scientists to support iterative experimentation, model hardening, and quality improvements.
  • Contribute to the design of human-in-the-loop evaluation workflows, integrating qualitative and quantitative insight into evaluation reports.
  • Assist in mapping evaluation outcomes to responsible AI principles such as fairness, transparency, reliability, and safety.
  • Partner with AI Governance Analysts to ensure evaluation outputs support compliance, documentation, and risk assessments.
  • Stay current with emerging evaluation tools, frameworks, metrics, and research related to LLM assessment and generative AI reliability.
  • Document evaluation processes, criteria, and results for both technical and non-technical audiences.
  • You will contribute to the growth of our AI & Data Exploitation Practice!

Qualifications
  • Ability to hold a position of public trust with the U.S. government.
  • Bachelor's or Master's degree in Computer Science, Statistics, Machine Learning, Cognitive Science, Human-Computer Interaction, Data Science, or a related field.
  • 2+ years of experience evaluating machine learning models, NLP systems, or generative AI models (LLMs preferred).
  • Familiarity with evaluation metrics, statistical testing, dataset creation, and experimental design for AI systems.
  • Proficiency in Python and relevant libraries such as PyTorch, Hugging Face, scikit-learn, LangChain.
  • Proficiency in AI evaluation frameworks such as Ragas.
  • Experience analyzing structured and unstructured data, including text, documents, and embeddings.
  • Understanding of LLM behavior, prompt evaluation, retrieval pipelines, or RAG architectures.
  • Exposure to responsible AI concepts and governance-aligned evaluation criteria (e.g., fairness, transparency, reliability).
  • Strong analytical skills with the ability to interpret model weaknesses, extract insights, and recommend actionable improvements.
  • Excellent written and verbal communication skills, with the ability to present evaluation findings clearly to technical and non-technical stakeholders.
  • Experience working in agile or iterative development environments is a plus.
  • Familiarity with OWASP LLM Top 10 Risks.
  • NIH experience.
  • Relevant certifications (helpful but not required):
    • NIST AI RMF (AISIC)
    • INFORMS CAP
    • AWS/Azure/Google ML Certifications.
  • Local to Washington, DC metro area preferred.

About steampunk
Steampunk relies on several factors to determine salary, including but not limited to geographic location, contractual requirements, education, knowledge, skills, competencies, and experience. The projected compensation range for this position is $105,000 to $145,000. The estimate displayed represents a typical annual salary range for this position. Annual salary is just one aspect of Steampunk's total compensation package for employees. Learn more about additional Steampunk benefits here.
Identity Statement
As part of the application process, you are expected to be on camera during interviews and assessments. We reserve the right to take your picture to verify your identity and prevent fraud.
Steampunk is a Change Agent in the Federal contracting industry, bringing new thinking to clients in the Homeland, Federal Civilian, Health and DoD sectors. Through our Human-Centered delivery methodology, we are fundamentally changing the expectations our Federal clients have for true shared accountability in solving their toughest mission challenges. As an employee owned company, we focus on investing in our employees to enable them to do the greatest work of their careers - and rewarding them for outstanding contributions to our growth. If you want to learn more about our story, visit http://www.steampunk.com.

Apply