ZipRecruiter

Log In

1

Ai Test Engineer Jobs in California (NOW HIRING)

Fortinet

AI Test Engineer

Santa Clara, CA

$100K - $140K/yr

We're looking for an eager, early-career engineer to help build AI agents to improve work efficiency of network security product development. Responsibilities: * Design and implement resilient ...

Fortinet, Inc.

AI Test Engineer

Santa Clara, CA · On-site

$100K - $140K/yr

We're looking for an eager, early-career engineer to help build AI agents to improve work efficiency of network security product development. Responsibilities: * Design and implement resilient ...

Fortinet, Inc.

AI Test Engineer

Santa Clara, CA · On-site

$100K - $140K/yr

We're looking for an eager, early-career engineer to help build AI agents to improve work efficiency of network security product development. Responsibilities: * Design and implement resilient ...

Ranger

Forward-Deployed Test Engineer

San Francisco, CA · On-site

$80K - $120K/yr

Ranger, revolutionizing software testing Ranger is an AI-powered platform redefining QA. Our ... About the role As a Forward Deployed Test Engineer, you'll drive customer success by developing and ...

Ranger

Forward-Deployed Test Engineer

San Francisco, CA

$80K - $120K/yr

Ranger, revolutionizing software testing Ranger is an AI-powered platform redefining QA. Our ... About the role As a Forward Deployed Test Engineer, you'll drive customer success by developing and ...

Ranger

Forward-Deployed Test Engineer

San Francisco, CA

$80K - $120K/yr

Ranger, revolutionizing software testing Ranger is an AI-powered platform redefining QA. Our ... About the role As a Forward Deployed Test Engineer, you'll drive customer success by developing and ...

Danaher

Senior Software Test Engineer

Vista, CA

$130K - $140K/yr

Develop, execute, and automate testing strategies for AI-based systems, including test plans ... Collaborate with engineering and product teams throughout the development lifecycle to define ...

NextHop AI

Test Engineer

Santa Clara, CA · On-site

Nexthop AI is a team of industry-leading professionals with deep hardware and software expertise ... Engineering or a related field * Minimum 5 years of relevant industry experience in test, QA, ...

NextHop AI

Test Engineer

Santa Clara, CA · On-site

Nexthop AI is a team of industry-leading professionals with deep hardware and software expertise ... Engineering or a related field * Minimum 5 years of relevant industry experience in test, QA, ...

Efficient Computer

Test Engineer

San Jose, CA · On-site

This level of efficiency makes perpetual, pervasive intelligence possible: run AI/ML continuously ... Efficient Computer is looking for a Test Engineer with hands-on DFT and fabless semiconductor test ...

Actalent

Test Engineer

Vista, CA

$72K - $113K/yr

Test Engineer The Test Engineer will be responsible for translating product requirements into test ... AI tools.

Heartflow

Test Engineer III

San Francisco, CA

The Test Engineer is a hands-on individual contributor on the Test Engineering team, responsible ... Actively explore and apply AI-assisted test automation techniques AI-assisted authoring, self ...

Danaher

Senior Engineer, AI Systems Test

Vista, CA · On-site

$130K - $140K/yr

The Senior Engineer, AI Systems Test is responsible for ensuring the quality, reliability, and performance of AI-driven digital pathology solutions. You will collaborate with cross-functional teams ...

Heartflow

Test Engineer III

San Francisco, CA · On-site

The flagship product-an AI-driven, non-invasive cardiac test supported by the ACC/AHA Chest Pain ... The Test Engineer is a hands-on individual contributor on the Test Engineering team, responsible ...

next page

Showing results 1-20

All JobsAi Test Engineer JobsAi Test Engineer Jobs in California

Ai Test Engineer information

See California salary details

$17

$43

$73

How much do ai test engineer jobs pay per hour?

As of Aug 9, 2026, the average hourly pay for ai test engineer in California is $43.66, according to ZipRecruiter salary data. Most workers in this role earn between $32.98 and $51.73 per hour, depending on experience, location, and employer.

What is the difference between Ai Test Engineer vs Data Scientist?

AspectAi Test EngineerData Scientist
Required CredentialsBachelor's in CS, AI, or related field; knowledge of testing toolsBachelor's or higher in CS, Statistics, or related; proficiency in data analysis
Work EnvironmentSoftware testing teams, AI development projectsData analysis teams, AI research projects
Employer & Industry UsageTech companies, AI startups, software firmsTech companies, finance, healthcare, research institutions
Common Search & ComparisonOften compared for roles in AI testing and quality assuranceCompared for data analysis and AI model development roles

While both roles work within AI and tech environments, Ai Test Engineers focus on testing and validating AI systems, ensuring quality and performance. Data Scientists analyze data to develop models and insights. The roles are complementary but distinct in their core responsibilities.

What is an AI test engineer?

AI Test Engineers are professionals who design, develop, and execute tests to evaluate the performance, accuracy, and reliability of artificial intelligence systems and machine learning models. They work closely with data scientists and software developers to ensure AI solutions function as intended, identifying bugs, biases, and potential risks in algorithms. Their responsibilities often include creating test cases, automating test processes, and analyzing results to improve AI system quality and compliance.

What are some common challenges AI test engineers face when validating machine learning models?

AI Test Engineers often encounter challenges such as ensuring the quality and fairness of machine learning models, identifying edge cases that the model may not handle well, and working with limited labeled data for testing. Additionally, interpreting test results can be complex due to the probabilistic nature of AI outputs, requiring close collaboration with data scientists to understand model behaviors. Effective communication and a strong foundation in both software testing and AI concepts are essential to address these challenges and ensure reliable AI solutions.

What are the key skills and qualifications needed to thrive as an AI test engineer?

To thrive as an AI Test Engineer, you need a strong background in computer science, software testing methodologies, and a good understanding of machine learning concepts, often supported by a relevant degree. Familiarity with programming languages like Python, testing frameworks such as pytest, and tools like TensorFlow or PyTorch, along with certifications in software testing or AI, are typically required. Analytical thinking, attention to detail, and effective communication set top performers apart in this role. These skills and qualities are crucial for ensuring the reliability, accuracy, and ethical deployment of AI systems.
What are popular job titles related to Ai Test Engineer jobs in California? For Ai Test Engineer jobs in California, the most frequently searched job titles are:
What job categories do people searching Ai Test Engineer jobs in California look for? The top searched job categories for Ai Test Engineer jobs in California are:
What cities in California are hiring for Ai Test Engineer jobs? Cities in California with the most Ai Test Engineer job openings:
Ai Test Engineer jobs near you
Infographic showing various Ai Test Engineer job openings in California as of August 2026, with employment types broken down into 10% Internship, 70% Full Time, and 20% Contract. Highlights an 90% In-person, and 10% Remote job distribution, with an average salary of $90,822 per year, or $43.7 per hour.

AI Test Engineer

Fortinet

Santa Clara, CA

$100K - $140K/yr

Full-time

Medical, Dental, Vision, Life, Retirement, PTO

Re-posted 23 days ago

Job description

We're looking for an eager, early-career engineer to help build AI agents to improve work efficiency of network security product development.

Responsibilities:

  • Design and implement resilient, scalable multi-agent systems and agentic AI.
  • Support RAG pipelines, including vector databases and hybrid search
  • Integrate agents with external tools, APIs, and business systems
  • Run LLM/RAG evaluations to identify issues and improve reliability
  • Write prompts and support light model fine-tuning 

Requirements:

  • Bachelor's degree in CS, AI, ML, or a related technical field.
  • Strong project-based experience with generative AI is a plus.
  • Familiarity with AI agent frameworks.
  • Basic understanding of LLMs, prompt engineering, and generative AI concepts.
  • Some exposure to vector databases, retrieval systems, or RAG architectures.
  • Familiarity with major LLM models 
  • Basic familiarity with cloud platforms (AWS, GCP, Azure) and containers (Docker).
  • Solid Python skills and good understanding of software engineering fundamentals
  • Motivated, curious, and excited to learn

US Citizenship is required.

The US base salary range for this full-time position is $100,000-$140,000. Fortinet offers employees a variety of benefits, including medical, dental, vision, life and disability insurance, 401(k), 11 paid holidays, vacation time, and sick time as well as a comprehensive leave program.

Wage ranges are based on various factors including the labor market, job type, and job level. Exact salary offers will be determined by factors such as the candidate's subject knowledge, skill level, qualifications, experience, and geographic location.

All roles are eligible to participate in the Fortinet equity program, Bonus eligibility is reviewed at time of hire and annually at the Company's discretion.

Why Join Us:
We encourage candidates from all backgrounds and identities to apply. We offer a supportive work environment and a competitive Total Rewards package to support you with your overall health and financial well-being. Embark on a challenging, enjoyable, and rewarding career journey with Fortinet. Join us in bringing solutions that make a meaningful and lasting impact to our 660,000+ customers around the globe.

Fortinet (NASDAQ: FTNT) secures the largest enterprise, service provider, and government organizations around the world. Fortinet empowers its customers with intelligent, seamless protection across the expanding attack surface and the power to take on ever-increasing performance requirements of the borderless network - today and into the future. Only the Fortinet Security Fabric architecture can deliver security without compromise to address the most critical security challenges, whether in networked, application, cloud or mobile environments. Fortinet ranks number one in the most security appliances shipped worldwide and more than 500,000 customers trust Fortinet to protect their businesses.

We are committed to providing reasonable accommodations for all qualified individuals with disabilities. If you require assistance or accommodation due to a disability, please contact us at accommodations@fortinet.com.
 
Fortinet is an equal opportunity employer. We value diversity in our company, and all qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, age, military/veteran status or any other applicable legally protected characteristics in the location in which the candidate is applying.

Apply