ZipRecruiter

Log In

1

Ai Test Engineer Jobs (NOW HIRING)

ECS

AI Test Engineer

Ashburn, VA · On-site

The Artificial Intelligence (AI) Test Engineer will be part of a team of experts charged with providing support in the areas of model analysis and model development capabilities in response to Custom ...

Lorven Technologies

Agentic Test Engineer

Manhattan, NY · On-site

This is a time-sensitive request for an AI-driven Agentic Test Engineer (Full stack) who can play an AI Builder role for MedicareIQ projects in AI. * Test engineering foundation 5+ years in QA/test ...

Fortinet, Inc.

AI Test Engineer

Santa Clara, CA · On-site

$100K - $140K/yr

We're looking for an eager, early-career engineer to help build AI agents to improve work efficiency of network security product development. Responsibilities: * Design and implement resilient ...

Fortinet

AI Test Engineer

Santa Clara, CA · On-site

$100K - $140K/yr

We're looking for an eager, early-career engineer to help build AI agents to improve work efficiency of network security product development. Responsibilities: * Design and implement resilient ...

Fortinet, Inc.

AI Test Engineer

Santa Clara, CA · On-site

$100K - $140K/yr

We're looking for an eager, early-career engineer to help build AI agents to improve work efficiency of network security product development. Responsibilities: * Design and implement resilient ...

Comcast

Agentic AI Test Engineer

Mount Laurel, NJ · On-site +1

$114K - $172K/yr

We are seeking a AI Agentic Test Engineer to join our core automation team. This role is designed for a hands-on engineer who is passionate about the intersection of AI and Quality Engineering. You ...

New

Comcast

Agentic AI Test Engineer

Mount Laurel, NJ · On-site +1

We are seeking a AI Agentic Test Engineer to join our core automation team. This role is designed for a hands-on engineer who is passionate about the intersection of AI and Quality Engineering. You ...

New

PlanIT Group, LLC

Senior Software (AI) Test Engineer

$113K - $146K/yr

PlanIT Group, LLC is seeking a Senior Software (AI) Test Engineer to develop AI programs focused on automating requirements and test case preparation. The role involves designing testing procedures ...

RFA Engineering

AI Test Automation Engineer

Urbandale, IA · On-site

$90K - $150K/yr

AI Test Automation Engineer We are seeking multiple AI Test Automation Engineers to help transform and modernize software testing through the use of artificial intelligence, intelligent automation ...

Ranger

Forward-Deployed Test Engineer

San Francisco, CA · On-site

$80K - $120K/yr

Ranger, revolutionizing software testing Ranger is an AI-powered platform redefining QA. Our ... About the role As a Forward Deployed Test Engineer, you'll drive customer success by developing and ...

Ranger

Forward-Deployed Test Engineer

San Francisco, CA

$80K - $120K/yr

Ranger, revolutionizing software testing Ranger is an AI-powered platform redefining QA. Our ... About the role As a Forward Deployed Test Engineer, you'll drive customer success by developing and ...

next page

Showing results 1-20

All JobsAi Test Engineer Jobs

Ai Test Engineer information

See salary details

$17

$44

$74

How much do ai test engineer jobs pay per hour?

As of Aug 8, 2026, the average hourly pay for ai test engineer in the United States is $44.24, according to ZipRecruiter salary data. Most workers in this role earn between $33.41 and $52.40 per hour, depending on experience, location, and employer.

What is the difference between Ai Test Engineer vs Data Scientist?

AspectAi Test EngineerData Scientist
Required CredentialsBachelor's in CS, AI, or related field; knowledge of testing toolsBachelor's or higher in CS, Statistics, or related; proficiency in data analysis
Work EnvironmentSoftware testing teams, AI development projectsData analysis teams, AI research projects
Employer & Industry UsageTech companies, AI startups, software firmsTech companies, finance, healthcare, research institutions
Common Search & ComparisonOften compared for roles in AI testing and quality assuranceCompared for data analysis and AI model development roles

While both roles work within AI and tech environments, Ai Test Engineers focus on testing and validating AI systems, ensuring quality and performance. Data Scientists analyze data to develop models and insights. The roles are complementary but distinct in their core responsibilities.

What is an AI test engineer?

AI Test Engineers are professionals who design, develop, and execute tests to evaluate the performance, accuracy, and reliability of artificial intelligence systems and machine learning models. They work closely with data scientists and software developers to ensure AI solutions function as intended, identifying bugs, biases, and potential risks in algorithms. Their responsibilities often include creating test cases, automating test processes, and analyzing results to improve AI system quality and compliance.

What are some common challenges AI test engineers face when validating machine learning models?

AI Test Engineers often encounter challenges such as ensuring the quality and fairness of machine learning models, identifying edge cases that the model may not handle well, and working with limited labeled data for testing. Additionally, interpreting test results can be complex due to the probabilistic nature of AI outputs, requiring close collaboration with data scientists to understand model behaviors. Effective communication and a strong foundation in both software testing and AI concepts are essential to address these challenges and ensure reliable AI solutions.

What are the key skills and qualifications needed to thrive as an AI test engineer?

To thrive as an AI Test Engineer, you need a strong background in computer science, software testing methodologies, and a good understanding of machine learning concepts, often supported by a relevant degree. Familiarity with programming languages like Python, testing frameworks such as pytest, and tools like TensorFlow or PyTorch, along with certifications in software testing or AI, are typically required. Analytical thinking, attention to detail, and effective communication set top performers apart in this role. These skills and qualities are crucial for ensuring the reliability, accuracy, and ethical deployment of AI systems.
More about Ai Test Engineer jobs
What cities are hiring for Ai Test Engineer jobs? Cities with the most Ai Test Engineer job openings:
What states have the most Ai Test Engineer jobs? States with the most job openings for Ai Test Engineer jobs include:
What job categories do people searching Ai Test Engineer jobs look for? The top searched job categories for Ai Test Engineer jobs are:
Ai Test Engineer jobs near you
Infographic showing various Ai Test Engineer job openings in the United States as of August 2026, with employment types broken down into 10% Internship, 70% Full Time, and 20% Contract. Highlights an 90% In-person, and 10% Remote job distribution, with an average salary of $92,027 per year, or $44.2 per hour.

AI Test Engineer

ECS

Ashburn, VA • On-site

Full-time

Re-posted 2 days ago

Job description

Everforth ECS is seeking an AI Testing Engineer to work minimum of 3 business days onsite at our Fairfax, VA corporate office and/or our Ashburn, VA customer site.
Please Note: This position is contingent upon contract award.
The Artificial Intelligence (AI) Test Engineer will be part of a team of experts charged with providing support in the areas of model analysis and model development capabilities in response to Custom and Border Protection's (CBP) Project Outrider. Program scope includes model analyses and assessments to identify mission and operational impacts and make appropriate performance enhancement recommendations. You will be responsible for:
  • The development and execution of test plans for AI models and applications, identifying, documenting, and analyzing defects, inconsistencies, and anomalies in AI outputs.
  • Collaboration with development teams to improve AI model performance and ensure quality standards.
  • Implementing automation frameworks for AI evaluation, including dataset checks, API testing, and CI/CD integration.
  • Defining AI quality metrics and KPIs such as accuracy, latency, cost, and fairness.

Salary Range: 125,000-150,000
General Description of Benefits
  • U.S. Citizenship; Must be able to obtain and maintain a Public Trust determination.
  • Bachelor's degree in Computer Science, Electrical Engineering, or a related technical field.
  • 2-4+ years of AI Test and Validation experience.
  • Experience working on custom development software projects.
  • Strong collaboration with cross-functional teams to identify testing requirements and optimize test coverage.
  • Experience with system testing metrics, best practices, and methodologies.
  • Utilization of Python and Selenium for automated testing of machine learning models.
  • Experience working with software development teams.
  • Experience analyzing test results and providing actionable insights to improve model accuracy.
  • Experience designing and implementing comprehensive test strategies for AI-driven applications.
  • Experience participating in requirements and design reviews, developing test plans, writing and executing test cases in a fast-paced software development environment.
  • Experience conducting data analysis, data verification and problem-solving.
  • Experience with statistical reporting and analysis.
  • Competency in developing and executing test plans for various AI applications, ensuring compliance with industry standards.
  • Expertise in one or more scripting languages (e.g., Unix/Linux, PERL, Java script) and relational database technologies (SQL, schema design).
  • Ability to work as a member of a self-organizing team without daily direct supervision.
  • Ability to communicate effectively within a large, dynamic team environment.
  • Ability to support three days in-office.
  • Willingness to try new things and grow.

Apply