1

Ai Automation Testing Jobs in California (NOW HIRING)

AI Lead (SAP Background Required)

Torrance, CA · On-site +1

$106K - $139K/yr

Apply AI for automation, testing, validation, and SDLC optimization * Analyze business requirements and translate them into AI-driven workflows and test strategies * Set up and manage AI/ML ...

Senior Automation & Middleware Engineer

Foster City, CA · On-site

$195K - $240K/yr

  • Medical

  • Life

  • PTO

Use AI-assisted development tools and workflows to accelerate engineering productivity and test ... Support scalable automated testing for connectivity, middleware, and system-level validation

QA Automation Manager

San Diego, CA

  • Medical

  • Dental

  • Vision

  • Life

  • Retirement

  • PTO

Define and execute the QA strategy to expand the use of AI, automation and manual testing frameworks, including security/vulnerability testing and code coverage measures and improvements. * Develop ...

QA Automation Manager

San Diego, CA · On-site

  • Medical

  • Dental

  • Vision

  • Life

  • Retirement

  • PTO

Define and execute the QA strategy to expand the use of AI, automation and manual testing frameworks, including security/vulnerability testing and code coverage measures and improvements. * Develop ...

AI Solutions Specialist

La Mirada, CA · On-site

$32 - $40/hr

  • Medical

  • Dental

  • Vision

  • Life

  • Retirement

First, the AI Solutions Specialist acts as the technical resource for AI automation and workflow improvement by designing, configuring, testing, implementing, and supporting automated workflows using ...

AI Solutions Specialist

La Mirada, CA · On-site

$32 - $40/hr

  • Medical

  • Dental

  • Vision

  • Life

  • Retirement

First, the AI Solutions Specialist acts as the technical resource for AI automation and workflow improvement by designing, configuring, testing, implementing, and supporting automated workflows using ...

Showing results 21-40

Ai Automation Testing information

What are some common challenges faced by AI automation testing professionals when validating machine learning models?

AI Automation Testing professionals often encounter challenges such as ensuring that test cases comprehensively cover the unique behaviors of machine learning models, dealing with non-deterministic outputs, and handling large datasets efficiently. It's also common to face difficulties in setting up reliable test environments that simulate real-world data scenarios. Collaboration with data scientists and developers is crucial to define meaningful metrics and effectively interpret test results, ensuring the AI system meets both functional and ethical standards.

What is AI automation testing?

AI automation testing refers to the use of artificial intelligence technologies to automate the process of testing software applications. This approach enhances traditional automated testing by using machine learning and data analysis to identify test cases, detect defects, and optimize test coverage. AI-driven testing tools can adapt to changes in the application, reduce manual effort, and improve the accuracy and speed of testing processes. As a result, organizations can deliver higher-quality software more efficiently.

What are the key skills and qualifications needed to thrive as an AI automation testing professional?

To thrive as an AI Automation Testing professional, you need a solid understanding of software testing principles, programming languages (such as Python or Java), and AI/ML concepts, often supported by a degree in computer science or a related field. Familiarity with automation tools like Selenium, Appium, and AI-powered testing frameworks, as well as certifications like ISTQB, is highly valued. Strong analytical thinking, attention to detail, and effective communication skills help professionals excel in diagnosing issues and collaborating with development teams. These skills ensure the delivery of robust, efficient, and reliable AI-driven software products in a competitive technology landscape.

What is the difference between Ai Automation Testing vs Software Test Engineer?

AspectAi Automation TestingSoftware Test Engineer
Required CredentialsCertifications in AI, automation tools, programming languagesSoftware testing certifications (ISTQB, CSTE), programming skills
Work EnvironmentFocus on automation frameworks, AI integration, scriptingManual and automated testing, test case design, bug tracking
Employer & Industry UsageTech companies, AI-driven projects, software development firmsSoftware development companies, IT departments, QA teams

Ai Automation Testing and Software Test Engineer roles overlap in testing skills and programming knowledge. However, Ai Automation Testing emphasizes AI integration and automation frameworks, while Software Test Engineers focus more on manual testing, test case creation, and bug identification. Both roles are essential in software quality assurance but serve different aspects of the testing process.

What cities in California are hiring for Ai Automation Testing jobs?

Cities in California with the most Ai Automation Testing job openings:

Infographic showing various Ai Automation Testing job openings in California as of August 2026, with employment types broken down into 1% As Needed, 83% Full Time, 10% Part Time, 2% Temporary, 3% Contract, and 1% Nights. Highlights an 88% Physical, 3% Hybrid, and 9% Remote job distribution.

Senior Automation & Middleware Engineer

Zoox

Foster City, CA

$195K - $240K/yr

Full-time

Medical, Life, PTO

Re-posted 26 days ago


Job description

We are looking for a software engineer to help scale development productivity, automation, observability, and system diagnostics for embedded and connected device platforms for Zoox's Telematics and Infotainment firmware team. This role sits at the intersection of embedded Linux development, middleware integration, automation infrastructure, developer tooling, and AI-assisted engineering workflows.

The ideal candidate is comfortable working across Linux user space, middleware, automation frameworks, CI/CD systems, telemetry pipelines, and system-level debugging to improve developer velocity and product quality.

This is not a traditional QA/SDET role. We are looking for engineers who combine strong software engineering fundamentals with practical automation, tooling, and systems debugging experience in embedded environments.

What Success Looks Like:

  • Improves engineering productivity through automation, tooling, and AI-assisted workflows

  • Reduces debugging and validation turnaround time through better diagnostics and observability

  • Enables scalable and reliable automation across multiple device platforms

  • Helps engineering teams move faster by simplifying development, testing, and troubleshooting workflows

  • Contributes both technically and operationally across middleware, tooling, automation, and system integration areas

In this role, you will:
  • Develop and maintain middleware, tooling, and automation solutions for embedded Linux and connected device platforms

  • Extend and improve existing automated validation frameworks and CI/CD workflows

  • Build tooling to improve developer productivity, diagnostics, observability, and troubleshooting efficiency

  • Develop and maintain telemetry, logging, and dashboarding solutions for system monitoring and issue triage

  • Collaborate with embedded, firmware, cloud, and infrastructure teams to improve development and validation workflows

  • Use AI-assisted development tools and workflows to accelerate engineering productivity and test development

  • Analyze system behavior across software, networking, middleware, and device layers to identify and debug complex issues

  • Support scalable automated testing for connectivity, middleware, and system-level validation

  • Contribute to automation strategies that improve scalability, reliability, and engineering efficiency across device programs

Qualifications
  • 7+ years of hands-on C/C++ and Python user-space and middleware development in Linux environments

  • BS/MS in CS, CE, or EE.

  • Proficient in designing Bash scripts, custom developer tooling, and automated workflows for Linux-based systems. 

  • Experienced in building, maintaining, and scaling CI/CD pipelines, automation testing frameworks, and infrastructure.

  • Competent in multi-layer software debugging, system logging implementation, and configuring telemetry or observability tooling.

  • Functional knowledge of integrating and troubleshooting communication protocols including Wi-Fi, Bluetooth, LTE, Ethernet, and CAN.[Qualification]

Bonus Qualifications
  • Embedded Linux & Infrastructure: Expert C/C++ developer in embedded Linux and middleware environments, utilizing Yocto, QEMU, virtualization, HIL/SIL, and device simulation.

  • Build Systems & Cloud DevOps: Experienced in developer tooling, build systems, platform infrastructure, Docker, and AWS-based cloud infrastructure.

  • Telemetry & Data Analytics: Skilled in building and managing telemetry pipelines, metrics systems, dashboards, and advanced analytics tooling.

  • Device Scaling & AI Automation: Proven track record scaling automation for connected device ecosystems, integrating device-cloud systems, and leveraging AI-assisted workflows.

$195,000 - $240,000 a year
Base Salary Range
 
There are three major components to compensation for this position: salary, Amazon Restricted Stock Units (RSUs), and Zoox Stock Appreciation Rights. A sign-on bonus may be offered as part of the compensation package. The listed range applies only to the base salary. Compensation will vary based on geographic location and level. Leveling, as well as positioning within a level, is determined by a range of factors, including, but not limited to, a candidate's relevant years of experience, domain knowledge, and interview performance. The salary range listed in this posting represents the range of levels Zoox is considering for this position.
 
Zoox also offers a comprehensive package of benefits, including paid time off (e.g., sick leave, vacation, bereavement), unpaid time off, Zoox Stock Appreciation Rights, Amazon RSUs, health insurance, long-term care insurance, long-term and short-term disability insurance, and life insurance.
About Zoox
Zoox is developing the first ground-up, fully autonomous vehicle fleet and the supporting ecosystem required to bring this technology to market. Sitting at the intersection of robotics, machine learning, and design, Zoox aims to provide the next generation of mobility-as-a-service in urban environments. We're looking for top talent that shares our passion and wants to be part of a fast-moving and highly execution-oriented team.

Follow us on LinkedIn

Accommodations
If you need an accommodation to participate in the application or interview process please reach out to [email protected] or your assigned recruiter.

A Final Note:
You do not need to match every listed expectation to apply for this position. Here at Zoox, we know that diverse perspectives foster the innovation we need to be successful, and we are committed to building a team that encompasses a variety of backgrounds, experiences, and skills.
We may use artificial intelligence (AI) tools to support parts of the hiring process, such as reviewing applications, analyzing resumes, or assessing responses and identifying potential inconsistencies or verification signals in application materials based on available information. These tools assist our recruitment team but do not replace human judgment. Final hiring decisions are ultimately made by humans. If you would like more information about how your data is processed, please contact us.
apply for this job