1

Generative Ai Testing Jobs in California (NOW HIRING)

As a software engineer, generative ai at WRITER, you'll be at the forefront of expanding human ... Early-detection cancer testing through Galleri * Flexible spending account and dependent FSA ...

next page

Showing results 1-20

Generative Ai Testing information

What is generative AI testing?

Generative AI Testing refers to the process of evaluating and validating AI systems, particularly those that generate content such as text, images, or code. This type of testing focuses on assessing the accuracy, reliability, fairness, and safety of generative models to ensure they function as intended and avoid producing harmful or biased outputs. Testers use various methods, including automated and manual techniques, to check for issues like hallucinations, inappropriate content, or security vulnerabilities. The goal is to build trust in generative AI systems and ensure they meet quality and ethical standards before deployment.

What are some common challenges faced when testing generative AI models, and how can I prepare to address them in this role?

Testing generative AI models often involves unique challenges such as evaluating the quality and relevance of generated content, detecting bias or inappropriate outputs, and ensuring model consistency across various prompts. You may work closely with data scientists and engineers to create robust evaluation frameworks and develop automated as well as manual testing strategies. Familiarity with prompt engineering, statistical evaluation techniques, and domain-specific knowledge will help you address these challenges effectively. Proactively staying updated on industry best practices and collaborating with cross-functional teams are key to success in this dynamic field.

What are the key skills and qualifications needed to thrive as a generative AI testing specialist, and why are they important?

To thrive as a Generative AI Testing Specialist, you need a robust understanding of machine learning principles, model evaluation techniques, and a background in computer science or a related field. Familiarity with tools such as Python, TensorFlow, PyTorch, and model evaluation frameworks, as well as experience with automated testing platforms, is typically required. Analytical thinking, attention to detail, and strong communication skills help you identify model weaknesses and collaborate effectively with development teams. These skills are crucial to ensure the reliability, safety, and ethical deployment of generative AI solutions.

What is the difference between Generative Ai Testing vs Data Scientist?

AspectGenerative Ai TestingData Scientist
Required CredentialsKnowledge of AI models, testing tools, programming skillsStatistics, programming, data analysis certifications
Work EnvironmentAI development teams, testing labs, tech companiesResearch labs, tech firms, finance, healthcare
Employer & Industry UsageAI product testing, quality assurance in techData analysis, predictive modeling across industries

Generative Ai Testing focuses on evaluating and validating AI-generated content and models, ensuring quality and accuracy. Data Scientists analyze data, build models, and derive insights. While both roles require programming and AI knowledge, Generative Ai Testing emphasizes testing processes, whereas Data Scientists focus on data analysis and model development.

How do I become a Generative AI Testing?

To become a Generative AI Tester, develop skills in machine learning, natural language processing, and programming languages like Python. Gain experience with AI frameworks such as TensorFlow or PyTorch and understand data quality and model evaluation techniques. Relevant certifications and hands-on projects can enhance your qualifications for roles in AI testing environments.

Is Generative AI Testing a good career?

Generative AI Testing is a growing field within AI development, focusing on evaluating the quality and safety of AI-generated content. It requires skills in machine learning, programming, and understanding AI models, often involving tools like Python and TensorFlow. The role offers opportunities in tech companies and research labs, with demand expected to increase as AI applications expand.

What are popular job titles related to Generative Ai Testing jobs in California?

For Generative Ai Testing jobs in California, the most frequently searched job titles are:

What job categories do people searching Generative Ai Testing jobs in California look for?

The top searched job categories for Generative Ai Testing jobs in California are:

What cities in California are hiring for Generative Ai Testing jobs?

Cities in California with the most Generative Ai Testing job openings:

Infographic showing various Generative Ai Testing job openings in California as of August 2026, with employment types broken down into 1% As Needed, 88% Full Time, 8% Part Time, 2% Contract, and 1% Nights. Highlights an 87% Physical, 3% Hybrid, and 10% Remote job distribution.

#Software Test Engineer - On-Device AI / Generative AI

Qualcomm

San Diego, CA • On-site

Full-time

Posted 18 days ago


Qualcomm rating

8.8

Company rating: 8.8 out of 10

Based on 11 frontline employees who took The Breakroom Quiz

49th of 246 rated software companies


Job description

Company:
Qualcomm Technologies, Inc.
Job Area:
Engineering Group, Engineering Group > Software Engineering
General Summary:
*** This position is not eligible for Qualcomm immigration sponsorship.***
About the Role
This role emphasizes on-device AI stability, system-level validation, and end-to-end AI pipeline verification across SoC (CPU, GPU, DSP, and NPU) execution environments, ensuring robust and scalable AI performance on real-world devices. This role targets engineers with a strong foundation in computer science (especially AI/ML) who are passionate about testing and validating cutting-edge generative AI technologies, including LLMs, LVMs, LoRA-based models, and agentic AI workflows. The candidate will play a critical role in driving AI test coverage, automation, and system-level quality, ensuring high reliability, performance, and scalability of on-device AI features in a fast-paced environment.
Minimum Qualifications:
• Bachelor's degree in Engineering, Information Systems, Computer Science, or related field.
Key Responsibilities
On-Device AI Testing & Validation
- Validate on-device AI solutions across mobile, PC, and automotive platforms, ensuring functionality, performance, and robustness.
- Design, develop, and execute end-to-end validation workflows, including model integration, test framework or test application development, device bring-up, and full system validation on target hardware.
- Validate Generative AI use cases across text, multimodal, and speech pipelines, leveraging techniques such as LoRA/adapters, RAG, and agentic AI workflows, ensuring correctness, robustness, and performance on-device
Test Coverage & Quality Ownership
- Define, expand, and track AI test coverage across features and platforms.
- Identify coverage gaps and develop new test scenarios.
- Monitor coverage metrics, pass rates, and regression trends.
Test Automation Development & Maintenance
- Develop new and maintain existing automation frameworks and scripts using Python, Java, and Shell.
- Build scalable pipelines for AI validation and regression testing.
- Improve efficiency through reusable tools and automation best practices.
Generative AI & Model Validation
- Validate Generative AI models including LLMs, LVMs (multimodal models), and LoRA-based adaptations
- Analyze model outputs for accuracy, consistency, robustness, and edge-case behavior
- Validate hybrid AI pipelines and RAG-based systems, including retrieval quality and response correctness
- Evaluate agentic AI workflows, including multi-step reasoning, tool invocation, and execution reliability
Debugging & Stability Engineering
- Perform log analysis and root cause investigation.
- Conduct stress, performance, and long-duration stability testing.
- Debug system, runtime, and model-level issues.
Qualifications & Skills
Required
- BS/MS in Computer Science or related field.
- Strong foundation in AI/ML, data structures, and algorithms.
- 1-3+ years of experience in software testing or AI validation (fresh graduates with strong AI/ML and programming fundamentals will also be considered)
Technical Skills
- Strong programming skills in Python, Java, and Shell.
- Experience with Linux environments and debugging tools.
AI Expertise
- Knowledge of LLMs, LVMs, LoRA, and agentic AI concepts.
- Understanding of AI inference workflows.
Soft Skills
- Fast learner and adaptable to fast-paced environments.
- Strong team player with excellent communication skills.
Preferred
- Experience with on-device AI frameworks and automation at scale.
- Familiarity with AI evaluation metrics and performance profiling
- Familiarity with Qualcomm's ML/AI Frameworks - QNN SDK or ML SW development kit is a plus
Qualcomm is an equal opportunity employer. If you are an individual with a disability and need an accommodation during the application/hiring process, rest assured that Qualcomm is committed to providing an accessible process. You may e-mail disability-accomodations@qualcomm.com or call Qualcomm's toll-free number found here. Upon request, Qualcomm will provide reasonable accommodations to support individuals with disabilities to be able participate in the hiring process. Qualcomm is also committed to making our workplace accessible for individuals with disabilities. (Keep in mind that this email address is used to provide reasonable accommodations for individuals with disabilities. We will not respond here to requests for updates on applications or resume inquiries).
To all Staffing and Recruiting Agencies: Our Careers Site is only for individuals seeking a job at Qualcomm. Staffing and recruiting agencies and individuals being represented by an agency are not authorized to use this site or to submit profiles, applications or resumes, and any such submissions will be considered unsolicited. Qualcomm does not accept unsolicited resumes or applications from agencies. Please do not forward resumes to our jobs alias, Qualcomm employees or any other company location. Qualcomm is not responsible for any fees related to unsolicited resumes/applications.
EEO Employer: Qualcomm is an equal opportunity employer; all qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, Veteran status, or any other protected classification.
Qualcomm expects its employees to abide by all applicable policies and procedures, including but not limited to security and other requirements regarding protection of Company confidential information and other confidential and/or proprietary information, to the extent those requirements are permissible under applicable law.
Pay range and Other Compensation & Benefits:
$94,200.00 - $141,200.00
The above pay scale reflects the broad, minimum to maximum, pay scale for this job code for the location for which it has been posted. Even more importantly, please note that salary is only one component of total compensation at Qualcomm. We also offer a competitive annual discretionary bonus program and opportunity for annual RSU grants (employees on sales-incentive plans are not eligible for our annual bonus). In addition, our highly competitive benefits package is designed to support your success at work, at home, and at play. Your recruiter will be happy to discuss all that Qualcomm has to offer - and you can review more details about our US benefits at this link.
If you would like more information about this role, please contact Qualcomm Careers.

What Qualcomm employees say

Pay

Benefits

Hours and flexibility

Workplace

Get the full story on Breakroom


Qualcomm logo

About Qualcomm

Sourced by ZipRecruiter

Qualcomm is enabling a world where everyone and everything can be intelligently connected. You interact with products and technologies made possible by Qualcomm every day, including 5G-enabled smartphones that double as pro-level cameras and gaming devices, smarter vehicles and cities, and the technology behind the smart, connected factories that manufactured your latest purchase. Our powerful connectivity solutions keep you connected—even in remote areas. Qualcomm 5G and AI innovations are the power behind the connected intelligent edge. You’ll find our technologies behind and inside the innovations that deliver significant value across multiple industries and to billions of people every day.

Industry

Technology, communication and media

Company size

10,000+ Employees

Headquarters location

San Diego, CA, US

Year founded

1985