ZipRecruiter

Log In

1

Ai Model Jobs in Virginia (NOW HIRING)

Steampunk

AI Evaluation Scientist

Mclean, VA · On-site

$105 - $145/hr

Implement evaluation frameworks for AI models, including accuracy, robustness, relevance, bias, hallucination rate, and safety metrics. * Build and maintain automated evaluation scripts, tests, and ...

Unissant

Senior AI Systems Architect

Ashburn, VA · On-site

$145K - $208K/yr

Automated model deploymentDrift monitoringRetraining triggersModel governanceSecurity automationCollaborate with DevSecOps and cybersecurity teams to integrate AI solutions into secure enterprise ...

Steampunk

AI Evaluation Scientist

Mclean, VA

$105K - $145K/yr

Implement evaluation frameworks for AI models, including accuracy, robustness, relevance, bias, hallucination rate, and safety metrics. * Build and maintain automated evaluation scripts, tests, and ...

Steampunk

AI Evaluation Scientist

Mclean, VA

$105K - $145K/yr

Implement evaluation frameworks for AI models, including accuracy, robustness, relevance, bias, hallucination rate, and safety metrics. * Build and maintain automated evaluation scripts, tests, and ...

Steampunk

AI Evaluation Scientist

Mclean, VA

$105K - $145K/yr

Implement evaluation frameworks for AI models, including accuracy, robustness, relevance, bias, hallucination rate, and safety metrics. * Build and maintain automated evaluation scripts, tests, and ...

Steampunk

AI Evaluation Scientist

Mclean, VA · On-site

$105K - $145K/yr

Implement evaluation frameworks for AI models, including accuracy, robustness, relevance, bias, hallucination rate, and safety metrics. * Build and maintain automated evaluation scripts, tests, and ...

Steampunk

AI Evaluation Scientist

Mclean, VA · On-site

$105K - $145K/yr

Implement evaluation frameworks for AI models, including accuracy, robustness, relevance, bias, hallucination rate, and safety metrics. * Build and maintain automated evaluation scripts, tests, and ...

Steampunk

AI Evaluation Scientist

Mclean, VA · On-site

$105K - $145K/yr

Implement evaluation frameworks for AI models, including accuracy, robustness, relevance, bias, hallucination rate, and safety metrics. * Build and maintain automated evaluation scripts, tests, and ...

Steampunk

AI Evaluation Scientist

Mclean, VA · On-site

$105K - $145K/yr

Implement evaluation frameworks for AI models, including accuracy, robustness, relevance, bias, hallucination rate, and safety metrics. * Build and maintain automated evaluation scripts, tests, and ...

Steampunk

AI Evaluation Scientist

Mclean, VA · On-site

$105K - $145K/yr

Implement evaluation frameworks for AI models, including accuracy, robustness, relevance, bias, hallucination rate, and safety metrics. * Build and maintain automated evaluation scripts, tests, and ...

Steampunk

AI Evaluation Scientist

Mclean, VA · On-site

$105K - $145K/yr

Implement evaluation frameworks for AI models, including accuracy, robustness, relevance, bias, hallucination rate, and safety metrics. * Build and maintain automated evaluation scripts, tests, and ...

Steampunk

AI Evaluation Scientist

Mclean, VA

$105K - $145K/yr

Implement evaluation frameworks for AI models, including accuracy, robustness, relevance, bias, hallucination rate, and safety metrics. * Build and maintain automated evaluation scripts, tests, and ...

previous page

Showing results 41-60

All JobsAi Model JobsAi Model Jobs in Virginia

Ai Model information

What is an AI model?

AI models are computer programs designed to simulate human intelligence by learning patterns from data and making predictions or decisions based on that learning. These models can perform a variety of tasks, such as recognizing speech, translating languages, analyzing images, and generating text. AI models are created using machine learning algorithms and are trained on large datasets to improve their accuracy and performance. Popular examples include neural networks, decision trees, and support vector machines. The effectiveness of an AI model depends on the quality of the data, the chosen algorithm, and the training process.

What are the key skills and qualifications needed to thrive as an AI model, and why are they important?

To excel as an AI Model Developer, you need strong programming skills (especially in Python), a solid understanding of machine learning algorithms, and typically a degree in computer science, data science, or a related field. Familiarity with ML frameworks like TensorFlow or PyTorch, cloud platforms, and relevant certifications such as TensorFlow Developer or AWS Machine Learning Specialty are valuable. Critical thinking, continuous learning, and effective collaboration with interdisciplinary teams are key soft skills for success. These competencies enable the creation of accurate, reliable AI models that can effectively solve complex real-world problems.

What are some common challenges faced by professionals working as AI model developers, and how can they address them?

Professionals working as AI Model developers often encounter challenges such as managing large and complex datasets, ensuring model accuracy, and addressing issues of bias in algorithms. They may also need to balance the trade-off between model performance and interpretability, especially when deploying models in production environments. To overcome these challenges, AI Model developers typically collaborate closely with data engineers, domain experts, and other stakeholders, regularly validate their models, and stay updated with the latest advancements in the field to adopt best practices.

What is the difference between Ai Model vs Data Scientist?

AspectAi ModelData Scientist
Required CredentialsKnowledge of machine learning, programming skills, sometimes certifications in AI/MLDegree in data science, statistics, computer science; certifications beneficial
Work EnvironmentFocus on developing, training, and deploying AI modelsData analysis, interpretation, and visualization; often collaborates with AI teams
Industry UsageUsed in AI development, automation, and predictive modelingApplied across industries for insights, reporting, and decision-making

While both roles involve working with data and algorithms, an Ai Model primarily focuses on creating and refining AI systems, whereas a Data Scientist analyzes data to generate insights and supports AI development. The roles often overlap but serve distinct functions within the data and AI ecosystem.

What is the easiest AI Model job to get into?

Entry-level AI model jobs often include roles such as data annotator or junior machine learning assistant, which typically require basic programming skills in Python and understanding of data labeling. These positions usually have lower experience requirements and may offer on-the-job training, making them accessible for beginners entering the AI field.

What are popular job titles related to Ai Model jobs in Virginia?

For Ai Model jobs in Virginia, the most frequently searched job titles are:

What job categories do people searching Ai Model jobs in Virginia look for?

The top searched job categories for Ai Model jobs in Virginia are:

What cities in Virginia are hiring for Ai Model jobs?

Cities in Virginia with the most Ai Model job openings:

Ai Model jobs near you
Infographic showing various Ai Model job openings in Virginia as of August 2026, with employment types broken down into 62% Full Time, 24% Part Time, and 14% Contract. Highlights an 93% In-person, and 7% Remote job distribution.

AI Evaluation Scientist

Steampunk

Mclean, VA • On-site

$105 - $145/hr

Other

Re-posted 6 days ago

Job description

Overview

We are looking for anAI Evaluation Scientist to design and execute evaluation processes that ensure our predictive and generative AI systems are accurate, reliable, safe, and aligned with mission requirements. This role is essential for establishing trust in AI solutions and supporting continuous improvement across the AI lifecycle. The AI Evaluation Scientist will work closely with engineers, data scientists, governance analysts, and product teams to develop evaluation metrics, build test harnesses, analyze model behavior, and support responsible deployment.

Contributions
  • Implement evaluation frameworks for AI models, including accuracy, robustness, relevance, bias, hallucination rate, and safety metrics.
  • Build and maintain automated evaluation scripts, tests, and pipelines that assess AI model outputs and detect performance drift over time.
  • Develop benchmark datasets, challenge sets, and scenario-based test cases tailored to mission and user needs.
  • Perform structured error analysis and behavioral audits of LLMs, retrieval-augmented generation (RAG) systems, and predictive models, documenting findings and improvement recommendations.
  • Collaborate with AI Developers, LLMOps Engineers, and Data Scientists to support iterative experimentation, model hardening, and quality improvements.
  • Contribute to the design of human‑in‑the‑loop evaluation workflows, integrating qualitative and quantitative insight into evaluation reports.
  • Assist in mapping evaluation outcomes to responsible AI principles such as fairness, transparency, reliability, and safety.
  • Partner with AI Governance Analysts to ensure evaluation outputs support compliance, documentation, and risk assessments.
  • Stay current with emerging evaluation tools, frameworks, metrics, and research related to LLM assessment and generative AI reliability.
  • Document evaluation processes, criteria, and results for both technical and non‑technical audiences.
  • You will contribute to the growth of our AI & Data Exploitation Practice!
Qualifications
  • Ability to hold a position of public trust with the U.S. government.
  • Bachelor’s or Master’s degree in Computer Science, Statistics, Machine Learning, Cognitive Science, Human‑Computer Interaction, Data Science, or a related field.
  • 2+ years of experience evaluating machine learning models, NLP systems, or generative AI models (LLMs preferred).
  • Familiarity with evaluation metrics, statistical testing, dataset creation, and experimental design for AI systems.
  • Proficiency in Python and relevant libraries such as PyTorch, Hugging Face, scikit‑learn, LangChain.
  • Proficiency in AI evaluation frameworks such as Ragas.
  • Experience analyzing structured and unstructured data, including text, documents, and embeddings.
  • Understanding of LLM behavior, prompt evaluation, retrieval pipelines, or RAG architectures.
  • Exposure to responsible AI concepts and governance‑aligned evaluation criteria (e.g., fairness, transparency, reliability).
  • Strong analytical skills with the ability to interpret model weaknesses, extract insights, and recommend actionable improvements.
  • Excellent written and verbal communication skills, with the ability to present evaluation findings clearly to technical and non‑technical stakeholders.
  • Experience working in agile or iterative development environments is a plus.
  • Familiarity with OWASP LLM Top 10 Risks.
  • NIH experience.
  • Local to Washington, DC metro area preferred.
  • Relevant certifications (helpful but not required):
    • NIST AI RMF (AISIC)
    • INFORMS CAP
    • AWS/Azure/Google ML Certifications.
Compensation & Benefits

Steampunk relies on several factors to determine salary, including but not limited to geographic location, contractual requirements, education, knowledge, skills, competencies, and experience. The projected compensation range for this position is $105,000 to $145,000. The estimate displayed represents a typical annual salary range for this position. Annual salary is just one aspect of Steampunk’s total compensation package for employees.

#J-18808-Ljbffr

Apply