ZipRecruiter

Log In

1

Ai Automation Testing Jobs in California (NOW HIRING)

Prologis, Inc.

AI Product Owner

San Francisco, CA · On-site

... AI Automation Engineers, AI/ML Engineers, platform teams, and delivery partners through discovery, prototyping, build, testing, launch, adoption, and continuous improvement. • Facilitate ...

Prologis

AI Product Owner

San Francisco, CA

Partner with AI Automation Engineers, AI/ML Engineers, platform teams, and delivery partners through discovery, prototyping, build, testing, launch, adoption, and continuous improvement. Facilitate ...

previous page

Showing results 41-60

All JobsAi Automation Testing JobsAi Automation Testing Jobs in California

Ai Automation Testing information

What are some common challenges faced by AI automation testing professionals when validating machine learning models?

AI Automation Testing professionals often encounter challenges such as ensuring that test cases comprehensively cover the unique behaviors of machine learning models, dealing with non-deterministic outputs, and handling large datasets efficiently. It's also common to face difficulties in setting up reliable test environments that simulate real-world data scenarios. Collaboration with data scientists and developers is crucial to define meaningful metrics and effectively interpret test results, ensuring the AI system meets both functional and ethical standards.

What is AI automation testing?

AI automation testing refers to the use of artificial intelligence technologies to automate the process of testing software applications. This approach enhances traditional automated testing by using machine learning and data analysis to identify test cases, detect defects, and optimize test coverage. AI-driven testing tools can adapt to changes in the application, reduce manual effort, and improve the accuracy and speed of testing processes. As a result, organizations can deliver higher-quality software more efficiently.

What are the key skills and qualifications needed to thrive as an AI automation testing professional?

To thrive as an AI Automation Testing professional, you need a solid understanding of software testing principles, programming languages (such as Python or Java), and AI/ML concepts, often supported by a degree in computer science or a related field. Familiarity with automation tools like Selenium, Appium, and AI-powered testing frameworks, as well as certifications like ISTQB, is highly valued. Strong analytical thinking, attention to detail, and effective communication skills help professionals excel in diagnosing issues and collaborating with development teams. These skills ensure the delivery of robust, efficient, and reliable AI-driven software products in a competitive technology landscape.

What is the difference between Ai Automation Testing vs Software Test Engineer?

AspectAi Automation TestingSoftware Test Engineer
Required CredentialsCertifications in AI, automation tools, programming languagesSoftware testing certifications (ISTQB, CSTE), programming skills
Work EnvironmentFocus on automation frameworks, AI integration, scriptingManual and automated testing, test case design, bug tracking
Employer & Industry UsageTech companies, AI-driven projects, software development firmsSoftware development companies, IT departments, QA teams

Ai Automation Testing and Software Test Engineer roles overlap in testing skills and programming knowledge. However, Ai Automation Testing emphasizes AI integration and automation frameworks, while Software Test Engineers focus more on manual testing, test case creation, and bug identification. Both roles are essential in software quality assurance but serve different aspects of the testing process.

What are popular job titles related to Ai Automation Testing jobs in California?

For Ai Automation Testing jobs in California, the most frequently searched job titles are:

What job categories do people searching Ai Automation Testing jobs in California look for?

The top searched job categories for Ai Automation Testing jobs in California are:

What cities in California are hiring for Ai Automation Testing jobs?

Cities in California with the most Ai Automation Testing job openings:

Ai Automation Testing jobs near you
Infographic showing various Ai Automation Testing job openings in California as of August 2026, with employment types broken down into 1% As Needed, 83% Full Time, 10% Part Time, 2% Temporary, 3% Contract, and 1% Nights. Highlights an 88% Physical, 3% Hybrid, and 9% Remote job distribution.

Senior Software Test and Automation Engineer (R4472)

Shield AI

San Diego, CA

$110K - $170K/yr

Full-time

Re-posted 17 days ago

Job description

Shield AI is a venture-backed defense-tech company with the mission of protecting service members and civilians with intelligent systems. Its products include Hivemind autonomy software, V-BAT and X-BAT aircraft, and Aechelon simulation and synthetic reality technologies. With offices and facilities across the U.S., Europe, the Middle East, and Asia-Pacific, Shield AI’s technology actively supports operations worldwide. For more information, visit www.shield.ai. Follow Shield AI on LinkedIn, X, Instagram, and YouTube. 

Job Description:
Shield AI's Software Test & Automation Team develops the verification, validation, and automation capabilities that enable rapid delivery of Hivemind autonomy across the Expeditionary and Emerging Operations portfolio. Our mission is to provide objective evidence of software quality, reliability, and mission readiness by building scalable automated test frameworks, repeatable validation environments, and data-driven readiness assessments spanning simulation, Software-in-the-Loop (SIL), Hardware-in-the-Loop (HIL), and Vehicle-in-the-Loop (VIL) environments. 

As a Senior Software Test & Automation Engineer, you will design and develop automated test infrastructure, execute system-level verification activities, analyze software performance, and build the tooling that enables continuous validation throughout the development lifecycle. Working closely with autonomy software, systems engineering, digital infrastructure, and flight test teams, you will help ensure autonomy capabilities are validated, repeatable, and ready for operational deployment. 

What you'll do:

  • Design, develop, and maintain automated test frameworks, validation tooling, and test infrastructure supporting autonomy software.  

  • Develop and execute verification and validation strategies across simulation, SIL, HIL, VIL, and representative system environments.  

  • Build automated regression, integration, functional, and performance test suites that improve software quality and deployment confidence.  

  • Develop Python-based automation, test harnesses, and analysis tools that reduce manual testing effort and improve repeatability.  

  • Analyze test results, identify software defects and integration issues, and support cross-functional root cause investigations.  

  • Develop software quality metrics, dashboards, and readiness assessments that provide objective evidence of software maturity.  

  • Integrate automated testing into CI/CD workflows to enable continuous validation and rapid developer feedback.  

  • Collaborate with autonomy software, systems engineering, flight test, and integration teams to define validation strategies and readiness criteria.  

  • Improve test infrastructure, automation coverage, and validation methodologies across the Expeditionary and Emerging Operations portfolio. 

Required qualifications:

  • BS in Computer Science, Aerospace, Electrical, Mechanical Engineering or related field.  

  • 4–7 years developing software test, verification, automation, or validation solutions for robotics, autonomy, aerospace, or other complex distributed systems.  

  • Strong proficiency in Python for automation, testing, and data analysis.  

  • Experience developing automated test frameworks, test harnesses, or validation infrastructure.  

  • Experience with Linux-based development environments.  

  • Experience validating software in simulation, SIL, HIL, and/or representative hardware environments.  

  • Experience debugging complex software and system integration issues.  

  • Experience with CI/CD pipelines and continuous validation practices.  

  • Strong understanding of software verification, regression testing, and quality assurance methodologies. 

Preferred qualifications:

  • Experience with flight control systems such as ArduPilot or PX4. 

  • Experience with unmanned aerial systems (fixed-wing, quadrotor, or both)  

  • Background in autonomy, robotics, or aerospace systems  

  • Familiarity with flight controllers, radios, and communications systems 

#LI-LD1
#LC

Full-time regular employee offer package:
Pay within range listed + Bonus + Benefits + Equity
 
Temporary employee offer package:
Pay within range listed above + temporary benefits package (applicable after 60 days of employment)
 
Salary compensation is influenced by a wide array of factors including but not limited to skill set, level of experience, licenses and certifications, and specific work location. All offers are contingent on a cleared background and possible reference check. Military fellows and part-time employees are not eligible for benefits. Please speak to your talent acquisition representative for more information.
 
###
 
Shield AI is proud to be an equal opportunity workplace and is an affirmative action employer. We are committed to equal employment opportunity regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, marital status, disability, gender identity or Veteran status. If you have a disability or special need that requires accommodation, please let us know. 

We may use artificial intelligence (AI) tools to support parts of the hiring process, such as reviewing applications, analyzing resumes, or assessing responses and identifying potential inconsistencies or verification signals in application materials based on available information. These tools assist our recruitment team but do not replace human judgment. Final hiring decisions are ultimately made by humans. If you would like more information about how your data is processed, please contact us.