ZipRecruiter

Log In

1

Ai Test Engineer Jobs (NOW HIRING)

Lorven Technologies

Agentic Test Engineer

Manhattan, NY · On-site

This is a time-sensitive request for an AI-driven Agentic Test Engineer (Full stack) who can play an AI Builder role for MedicareIQ projects in AI. * Test engineering foundation 5+ years in QA/test ...

Fortinet

AI Test Engineer

Santa Clara, CA

$100K - $140K/yr

We're looking for an eager, early-career engineer to help build AI agents to improve work efficiency of network security product development. Responsibilities: * Design and implement resilient ...

Fortinet, Inc.

AI Test Engineer

Santa Clara, CA · On-site

$100K - $140K/yr

We're looking for an eager, early-career engineer to help build AI agents to improve work efficiency of network security product development. Responsibilities: * Design and implement resilient ...

Fortinet, Inc.

AI Test Engineer

Santa Clara, CA · On-site

$100K - $140K/yr

We're looking for an eager, early-career engineer to help build AI agents to improve work efficiency of network security product development. Responsibilities: * Design and implement resilient ...

Comcast

Agentic AI Test Engineer

Mount Laurel, NJ · On-site +1

We are seeking a AI Agentic Test Engineer to join our core automation team. This role is designed for a hands-on engineer who is passionate about the intersection of AI and Quality Engineering. You ...

PlanIT Group, LLC

Senior Software (AI) Test Engineer

$113K - $146K/yr

PlanIT Group, LLC is seeking a Senior Software (AI) Test Engineer to develop an AI program focused on automating requirements and test case preparation. The role involves designing testing procedures ...

RFA Engineering

AI Test Automation Engineer

Urbandale, IA · On-site

$90K - $150K/yr

AI Test Automation Engineer We are seeking multiple AI Test Automation Engineers to help transform and modernize software testing through the use of artificial intelligence, intelligent automation ...

AceStack LLC

AI Test Automation Engineer (Tosca)

$47 - $62.25/hr

AI Test Automation Engineer (Tosca) Location: Remote Contract We are seeking an experienced AI + Tosca Test Automation Engineer to join our quality engineering team in Charlotte, NC. The ideal ...

Ranger

Forward-Deployed Test Engineer

San Francisco, CA · On-site

$80K - $120K/yr

Ranger, revolutionizing software testing Ranger is an AI-powered platform redefining QA. Our ... About the role As a Forward Deployed Test Engineer, you'll drive customer success by developing and ...

Infosys

AI Test Automation Engineer

Washington, DC · On-site

$52 - $68.50/hr

Infosys Public Services is seeking an AI Test Automation Engineer to join our team. The role involves designing and developing test automation scripts using AI technologies to enhance efficiency and ...

Infosys

AI Test Automation Engineer

Washington, DC · On-site

$52 - $68.75/hr

Infosys Public Services is seeking a AI Test Automation Engineer to join our team. Required Qualifications: * Design and develop test automation scripts using Selenium with Python, leveraging ...

Ranger

Forward-Deployed Test Engineer

San Francisco, CA

$80K - $120K/yr

Ranger, revolutionizing software testing Ranger is an AI-powered platform redefining QA. Our ... About the role As a Forward Deployed Test Engineer, you'll drive customer success by developing and ...

next page

Showing results 1-20

All JobsAi Test Engineer Jobs

Ai Test Engineer information

See salary details

$17

$44

$74

How much do ai test engineer jobs pay per hour?

As of Jun 28, 2026, the average hourly pay for ai test engineer in the United States is $44.24, according to ZipRecruiter salary data. Most workers in this role earn between $33.41 and $52.40 per hour, depending on experience, location, and employer.

What is the difference between Ai Test Engineer vs Data Scientist?

AspectAi Test EngineerData Scientist
Required CredentialsBachelor's in CS, AI, or related field; knowledge of testing toolsBachelor's or higher in CS, Statistics, or related; proficiency in data analysis
Work EnvironmentSoftware testing teams, AI development projectsData analysis teams, AI research projects
Employer & Industry UsageTech companies, AI startups, software firmsTech companies, finance, healthcare, research institutions
Common Search & ComparisonOften compared for roles in AI testing and quality assuranceCompared for data analysis and AI model development roles

While both roles work within AI and tech environments, Ai Test Engineers focus on testing and validating AI systems, ensuring quality and performance. Data Scientists analyze data to develop models and insights. The roles are complementary but distinct in their core responsibilities.

What are AI Test Engineers?

AI Test Engineers are professionals who design, develop, and execute tests to evaluate the performance, accuracy, and reliability of artificial intelligence systems and machine learning models. They work closely with data scientists and software developers to ensure AI solutions function as intended, identifying bugs, biases, and potential risks in algorithms. Their responsibilities often include creating test cases, automating test processes, and analyzing results to improve AI system quality and compliance.

What are some common challenges AI Test Engineers face when validating machine learning models?

AI Test Engineers often encounter challenges such as ensuring the quality and fairness of machine learning models, identifying edge cases that the model may not handle well, and working with limited labeled data for testing. Additionally, interpreting test results can be complex due to the probabilistic nature of AI outputs, requiring close collaboration with data scientists to understand model behaviors. Effective communication and a strong foundation in both software testing and AI concepts are essential to address these challenges and ensure reliable AI solutions.

What are the key skills and qualifications needed to thrive as an AI Test Engineer, and why are they important?

To thrive as an AI Test Engineer, you need a strong background in computer science, software testing methodologies, and a good understanding of machine learning concepts, often supported by a relevant degree. Familiarity with programming languages like Python, testing frameworks such as pytest, and tools like TensorFlow or PyTorch, along with certifications in software testing or AI, are typically required. Analytical thinking, attention to detail, and effective communication set top performers apart in this role. These skills and qualities are crucial for ensuring the reliability, accuracy, and ethical deployment of AI systems.
More about Ai Test Engineer jobs
What cities are hiring for Ai Test Engineer jobs? Cities with the most Ai Test Engineer job openings:
What states have the most Ai Test Engineer jobs? States with the most job openings for Ai Test Engineer jobs include:
What job categories do people searching Ai Test Engineer jobs look for? The top searched job categories for Ai Test Engineer jobs are:
Ai Test Engineer jobs near you
Agentic Test Engineer

Agentic Test Engineer

Lorven Technologies

Manhattan, NY • On-site

Contractor

Medical

Posted 15 days ago

Job description

Job Title: Agentic Test Engineer
Location: New York, NY
Duration: 6 Months Contract
Job Description:
  • This is a time-sensitive request for an AI-driven Agentic Test Engineer (Full stack) who can play an AI Builder role for MedicareIQ projects in AI.
  • Test engineering foundation 5+ years in QA/test engineering for web services and data-driven applications; strong understanding of test strategy, defect lifecycle, and quality gates.
  • Automation 3+ years building and maintaining automated test suites (UI and API) using common frameworks (e.g., Selenium/Cypress/Playwright; REST API testing), integrated into CI/CD pipelines.AI/ML & data testing 2+ years validating ML/GenAI features (prompt-driven flows, model outputs, regression risks); ability to design test cases for non-deterministic behavior, edge cases, and data quality.

Preferred skills and attributes for this role, including expected years of experience where applicable.
  • LLM/GenAI evaluation 1+ years with evaluation approaches for LLM apps (golden sets, rubric-based scoring, hallucination/grounding checks) and building repeatable automated evals.
  • Test data management Experience creating synthetic/de-identified test data, data contracts, and test fixtures for large datasets; familiarity with data pipelines and lineage concepts.
  • Performance & resiliency testing 1-2+ years with performance/load testing (e.g., JMeter/k6) and reliability testing (rate limits, timeouts, retries) for services that call model endpoints.
  • Design and execute AI test strategy Convert requirements and acceptance criteria into end-to-end test plans covering model behavior, application workflows, data quality, and integrations.
  • Drive defect prevention and RCA Triage issues using logs and traces, partner with engineers to isolate root cause, and ensure fixes include the right automated coverage.
  • Improve quality practices Establish standards for test data, test documentation, and release readiness; mentor peers and continuously reduce manual toil using approved AI tools.

What prior experience, industry background, or domain expertise are preferred for this role?
  • Healthcare / payer domain Prior experience in health insurance, claims, enrollment, benefits, utilization management, or related regulated healthcare workflows.
  • Enterprise-scale platforms Background testing distributed systems/data platforms with multiple upstream/downstream integrations, batch + real-time flows, and complex data dependencies
Lorven technologies logo

About Lorven technologies

Sourced by ZipRecruiter

Lorven Technologies, headquartered in Plainsboro, New Jersey, United States, is a reputable company in the technology industry, specializing in providing effective IT solutions and consulting services. The company's official website, lorventech.com, offers comprehensive insights into its offerings which include but are not limited to software development, IT consulting, project management, and business analysis. Since its inception, Lorven Technologies has been committed to ensuring efficiency and reliability in delivering IT services to its global clientele, establishing itself as a trusted name in the industry.

Industry

It services

Company size

51 - 200 Employees

Headquarters location

Plainsboro, NJ, US

Year founded

2001

Social media

FacebookTwitter

View All Lorven technologies Jobs

Apply