1

Ai Validation Jobs in Virginia (NOW HIRING)

Validate machine learning models and AI agents against defined performance, accuracy, and safety criteria prior to deployment. * Serve as the Human-in-the-Loop (HITL) reviewer, providing structured ...

Validate machine learning models and AI agents against defined performance, accuracy, and safety criteria prior to deployment. * Serve as the Human-in-the-Loop (HITL) reviewer, providing structured ...

AI Architect

Chantilly, VA · On-site

$150 - $200/hr

Experience with AI testing, validation, benchmarking, and evaluation frameworks for both traditional ML and generative AI systems. * Experience implementing practical MLOps pipelines and AI ...

New

Experience with AI testing, validation, benchmarking, and evaluation frameworks for both traditional ML and generative AI systems. * Experience implementing practical MLOps pipelines and AI ...

Experience with AI testing, validation, benchmarking, and evaluation frameworks for both traditional ML and generative AI systems. * Experience implementing practical MLOps pipelines and AI ...

AI/ML Strategist

Arlington, VA · On-site

$139K - $180K/yr

Develop and enforce policies for model development, validation, and deployment, establish review and approval processes for AI/ML models, and implement access controls for model APIs and services.

Prototype and validate advanced AI approaches to prove out architectural direction and de-risk initiatives before teams commit to them. * Run architecture and design reviews across teams, surfacing ...

Prototype and validate advanced AI approaches to prove out architectural direction and de-risk initiatives before teams commit to them. * Run architecture and design reviews across teams, surfacing ...

Sr AI/ML Engineer

Herndon, VA · On-site

$107K - $147K/yr

Explore and validate new approaches for retrieval, indexing, and multimodal document understanding ... Advanced AI/ML Modeling & Technical Leadership: * Architect, train, and optimize advanced models ...

AI Lead

Mclean, VA · On-site

$180 - $260/hr

Implement responsible AI and model risk management practices, including documentation, validation, explainability, fairness, privacy, human oversight, bias mitigation, change control, and periodic ...

New

AI/ML Strategist

Arlington, VA · On-site

$139K - $180K/yr

This person will develop and enforce policies for model development, validation, and deployment, establish review and approval processes for AI/ML models, and implement access controls for model APIs ...

AI/ML Strategist

Arlington, VA · On-site

$139K - $180K/yr

The strategist will develop and enforce policies for model development, validation, and deployment, establish review and approval processes for AI/ML models, and implement access controls for model ...

Develop automated pipelines for model training, validation, testing, deployment, and monitoring * Create reusable frameworks, libraries, and shared components that accelerate AI/ML development

Showing results 21-40

Ai Validation information

What is an AI validation?

An AI Validation job involves testing and verifying artificial intelligence models to ensure they function correctly, reliably, and ethically. This includes evaluating model accuracy, bias, robustness, and compliance with industry standards. AI validation specialists use various techniques such as data validation, performance testing, and adversarial testing to assess AI systems. Their work helps improve model quality, mitigate risks, and ensure AI applications are safe for real-world deployment.

What does an AI validation do?

An AI Validation professional is responsible for evaluating the performance, reliability, and safety of AI models before deployment. This includes designing and executing test cases, analyzing outputs for bias and errors, and documenting results to inform further model refinement. They often collaborate closely with data scientists, engineers, and QA teams to ensure the AI system meets quality and compliance standards. Day-to-day tasks may involve working with datasets, preparing validation reports, and participating in cross-functional review meetings. This role is critical in ensuring that AI systems function as intended in real-world applications.

What are the key skills and qualifications needed to thrive in the AI validation position?

To thrive in AI Validation, you need strong analytical skills, familiarity with machine learning concepts, and typically a degree in computer science, data science, or a related field. Experience with tools such as Python, TensorFlow, PyTorch, and version control systems, as well as knowledge of data annotation and model evaluation frameworks, is highly valuable. Excellent attention to detail, problem-solving skills, and effective communication are important soft skills for success in this role. These competencies are essential to ensure that AI models are robust, accurate, and meet project requirements for deployment.

What are the most commonly searched types of Ai Validation jobs in Virginia?

The most popular types of Ai Validation jobs in Virginia are:

What are popular job titles related to Ai Validation jobs in Virginia?

For Ai Validation jobs in Virginia, the most frequently searched job titles are:

What cities in Virginia are hiring for Ai Validation jobs?

Cities in Virginia with the most Ai Validation job openings:

Infographic showing various Ai Validation job openings in Virginia as of August 2026, with employment types broken down into 71% Full Time, 27% Part Time, and 2% Contract. Highlights an 63% Physical, 4% Hybrid, and 33% Remote job distribution.

Artificial Intelligence / Machine Learning Verification and Validation Engineer

Penn State University

Reston, VA • On-site

$111 - $241/hr

Other

Medical, Dental, Vision, Retirement, PTO

Posted 13 days ago


Penn State University rating

7.8

Company rating: 7.8 out of 10

Based on 104 frontline employees who took The Breakroom Quiz

236th of 628 rated colleges and universities


Job description

POSITION SPECIFICS

We are searching for a talented, experienced, organized, detail-oriented, and highly motivated AI/ML Engineer to join our Independent Verification and Validation (IV&V) and Data Curation Center of Excellence in the Information Science Division within the All-Domain Analytics and Signatures Office (A2SO) at the Applied Research Laboratory (ARL). This team serves as the foundation for effective machine learning—building, curating, and governing the data that directly determines whether AI/ML models succeed in operationally relevant environments. You will focus on hands‑on work with classified multi-modal data, including imagery/FMV, geospatial and AIS tracks, signals and sensor data, and text-based intelligence reports and develop pipelines, annotation frameworks, and quality assurance processes while gaining deep exposure to state-of-the-art AI/ML research. ARL is an authorized DoD Skillbridge partner and welcomes all transitioning military members to apply.

  • Label, annotate, and curate multi‑modal datasets (imagery/FMV, geospatial, signals, text/documents) to support AI/ML model development and evaluation
  • Design and implement data pipelines for ingestion, transformation, quality control, and cataloging of classified and open‑source data
  • Develop and maintain annotation standards, labeling guidelines, and data governance processes to ensure consistency and reproducibility across projects
  • Conduct IV&V of datasets and model outputs to ensure data integrity, label accuracy, and fitness for intended use
  • Collaborate with research scientists, algorithm developers, and program stakeholders to identify, acquire, and prioritize data requirements for specific AI/ML projects
  • Build and maintain data catalogs, metadata schemas, and access‑controlled repositories that make curated datasets discoverable and accessible to the broader research team
  • Employ Python, SQL, and annotation platforms (e.g., CVAT, Label Studio) to automate labeling workflows, perform exploratory data analysis, and develop quality metrics
  • Document data provenance, lineage and known limitations to support model evaluation, reproducibility, and responsible AI practices
  • Collaborate within an Agile development environment as part of a large research team
Required Skills/Experience areas include:
  • Bachelor's Degree in Computer Science, Data Science, Information Science, Engineering, or a related technical field
  • Proficiency in Python and SQL for data manipulation, analysis, and pipeline development
  • Familiarity with data annotation tools and workflows (e.g., CVAT, Label Studio, or equivalent)
  • Understanding of machine learning concepts, including how data quality impacts model training, evaluation, and deployment
Preferred Skills/Experience areas include:
  • Experience working with DoD or Intelligence Community data, workflows, or operational environments
  • Familiarity with geospatial data formats (shapefiles, GeoJSON, AIS), imagery/FMV exploitation, or signals data processing
  • Experience with data versioning tools (e.g., DVC, LakeFS) or data catalog platforms
  • Knowledge of IV&V methodologies and quality assurance practices for data‑driven systems
  • Exposure to containerized development environments (Docker, Kubernetes) and cloud platforms (AWS, Azure)
Minimum Education, Work Experience & Required Certifications

If filled as R&D Engineer - Artificial Intelligence (ARL) - Advanced Professional, this position requires: Bachelor's Degree - Engineering or Science 5+ years of relevant experience; Required Certifications: None

If filled as R&D Engineer - Artificial Intelligence (ARL) - Intermediate Professional, this position requires: Bachelor's Degree - Engineering or Science 2+ years of relevant experience; Required Certifications: None

If filled as R&D Engineer - Artificial Intelligence (ARL) - Professional, this position requires: Bachelor's Degree - Engineering or Science No prior relevant work experience required; Required Certifications: None

ARL’s purpose is to research and develop innovative solutions to challenging scientific, engineering, and technology problems in support of the Navy, the Intel Community (IC), and other federal government customers.

FOR FURTHER INFORMATION on ARL, visit our website at www.arl.psu.edu.

Background Checks/Clearances: Employment with the University will require successful completion of background check(s) in accordance with University policies. Notice regarding employment at the Applied Research Laboratory (ARL): Employees must be eligible to obtain a government security clearance, participate in the ARL drug testing program, and comply with electronic and physical monitoring requirements applicable to federal contractors. ARL operates in a secure information environment involving Unclassified, Controlled Unclassified Information (CUI), and Classified information. Personal electronic devices brought onsite must be registered and may be restricted from certain areas. You must be a U.S. citizen to apply.

Your working location will be fully on-site, located in State College, PA or Reston, VA. Questions related to flexible work should be directed to the hiring manager during the interview process.

SALARY & BENEFITS

The salary range for this position, including all possible grades, is $110,520.00 - $240,960.00. This salary range includes an adjustment based on required geographic work location. Salary Structure - Information on Penn State’s salary structure Penn State provides a competitive benefits package for full-time employees designed to support both personal and professional well‑being. In addition to comprehensive medical, dental, and vision coverage, employees enjoy robust retirement plans and substantial paid time off which includes holidays, vacation and sick time. One of the standout benefits is the generous 75% tuition discount, available to employees as well as eligible spouses and children. For more detailed information, please visit our Benefits Page.

CAMPUS SECURITY CRIME STATISTICS

Pursuant to the Jeanne Clery Disclosure of Campus Security Policy and Campus Crime Statistics Act and the Pennsylvania Act of 1988, Penn State publishes a combined Annual Security and Annual Fire Safety Report (ASR). The ASR includes crime statistics and institutional policies concerning campus security, such as those concerning alcohol and drug use, crime prevention, the reporting of crimes, sexual assault, and other matters. The ASR is available for review here.

EEO IS THE LAW

Penn State is an equal opportunity employer and is committed to providing employment opportunities to all qualified applicants without regard to race, color, religion, age, sex, sexual orientation, gender identity, national origin, disability or protected veteran status. If you are unable to use our online application process due to an impairment or disability, please contact 814-865-1473. Federal Contractors Labor Law Poster PA State Labor Law Poster Penn State Policies Copyright Information Hotlines There’s a reason Penn State consistently ranks among the top one percent of the world’s universities. Across 24 campuses, our 100,000 students and 40,000 faculty and staff know the real measure of success goes beyond the classroom – it’s the positive impact made on communities across the world. Our ideals stem from our origins as Pennsylvania’s sole land‑grant institution, which allow us to continue to bring positive impact to humanity through our teaching, research, and engagement mission. And across the world is a community of Penn Staters – more than half a million strong – driven by that same spirit to serve our local and global communities. At Penn State, passion is met with collaboration in an environment that is rooted in shared pride for the accomplishments of our fellow students, faculty, staff, and alumni. Penn Staters cheer each other on to build a culture committed to service and engagement. Our University values represent our core ethical aspirations for all our daily activities and actions as students, faculty, staff, and volunteers at Penn State. Our values are as follows; Integrity, Respect, Responsibility, Discovery, Excellence, and Community. We Are Penn State. One Community. Impacting Many.

#J-18808-Ljbffr

What Penn State University employees say

Pay

Benefits

Hours and flexibility

Workplace

Get the full story on Breakroom