Key Responsibilities On-Device AI Testing & Validation - Validate on-device AI solutions across ... Generative AI & Model Validation - Validate Generative AI models including LLMs, LVMs (multimodal ...
Key Responsibilities On-Device AI Testing & Validation - Validate on-device AI solutions across ... Generative AI & Model Validation - Validate Generative AI models including LLMs, LVMs (multimodal ...
#Software Test Engineer - On-Device AI / Generative AI
San Diego, CA · On-site
$94 - $141/hr
... generative AI technologies, including LLMs, LVMs, LoRA-based models, and agentic AI workflows. The ... Key ResponsibilitiesOn-Device AI Testing & Validation * Validate on-device AI solutions across ...
#Software Test Engineer - On-Device AI / Generative AI
San Diego, CA · On-site
$94 - $141/hr
... generative AI technologies, including LLMs, LVMs, LoRA-based models, and agentic AI workflows. The ... Key ResponsibilitiesOn-Device AI Testing & Validation * Validate on-device AI solutions across ...
#Software Test Engineer - On-Device AI / Generative AI
San Diego, CA · On-site
$94 - $141/hr
... generative AI technologies, including LLMs, LVMs, LoRA-based models, and agentic AI workflows. The ... Key ResponsibilitiesOn-Device AI Testing & Validation- Validate on-device AI solutions across ...
#Software Test Engineer - On-Device AI / Generative AI
San Diego, CA · On-site
$94 - $141/hr
... generative AI technologies, including LLMs, LVMs, LoRA-based models, and agentic AI workflows. The ... Key ResponsibilitiesOn-Device AI Testing & Validation- Validate on-device AI solutions across ...
Lead Software Engineer - Generative AI
Redwood City, CA · On-site
$175K - $219K/yr
As a member of C3 AI's Generative AI team, you will be tasked with developing the infrastructure ... and testing. * Manage individual project deliverables and mentor junior team members on industry ...
Lead Software Engineer - Generative AI
Redwood City, CA · On-site
$175K - $219K/yr
As a member of C3 AI's Generative AI team, you will be tasked with developing the infrastructure ... and testing. * Manage individual project deliverables and mentor junior team members on industry ...
Lead Software QA Engineer, AI Software/Platform Team
Milpitas, CA · On-site
$180 - $240/hr
Preferred: experience testing Generative AI, AI/ML platforms, AI agents, LLM-powered applications, or other AI-based products * Preferred: experience designing AI-agent-assisted QA workflows using ...
Lead Software QA Engineer, AI Software/Platform Team
Milpitas, CA · On-site
$180 - $240/hr
Preferred: experience testing Generative AI, AI/ML platforms, AI agents, LLM-powered applications, or other AI-based products * Preferred: experience designing AI-agent-assisted QA workflows using ...
As a member of C3 AI's Generative AI team, you will be tasked with developing the infrastructure ... and testing. * Manage individual project deliverables and mentor junior team members on industry ...
As a member of C3 AI's Generative AI team, you will be tasked with developing the infrastructure ... and testing. * Manage individual project deliverables and mentor junior team members on industry ...
We are looking for a Generative AI engineer to work on the full lifecycle of novel spatial ... testing models, deploying performant systems into our production architecture stack. Upcoming ...
We are looking for a Generative AI engineer to work on the full lifecycle of novel spatial ... testing models, deploying performant systems into our production architecture stack. Upcoming ...
Test Engineer-AI/LLM
Palo Alto, CA · On-site
Conduct end-to-end testing of integrated generative AI solutions, including APIs, data pipelines, and user interfaces. Optimization & Validation * Collaborate with ML engineers to validate fine-tuned ...
Test Engineer-AI/LLM
Palo Alto, CA · On-site
Conduct end-to-end testing of integrated generative AI solutions, including APIs, data pipelines, and user interfaces. Optimization & Validation * Collaborate with ML engineers to validate fine-tuned ...
Conduct end-to-end testing of integrated generative AI solutions, including APIs, data pipelines, and user interfaces. Optimization & Validation * Collaborate with ML engineers to validate fine-tuned ...
Conduct end-to-end testing of integrated generative AI solutions, including APIs, data pipelines, and user interfaces. Optimization & Validation * Collaborate with ML engineers to validate fine-tuned ...
Test Engineer-AI/LLM
Palo Alto, CA · On-site
Conduct end-to-end testing of integrated generative AI solutions, including APIs, data pipelines, and user interfaces. Optimization & Validation * Collaborate with ML engineers to validate fine-tuned ...
Quick apply
Test Engineer-AI/LLM
Palo Alto, CA · On-site
Conduct end-to-end testing of integrated generative AI solutions, including APIs, data pipelines, and user interfaces. Optimization & Validation * Collaborate with ML engineers to validate fine-tuned ...
Software engineer, generative AI
San Francisco, CA · On-site
$111K - $304K/yr
As a software engineer, generative ai at WRITER, you'll be at the forefront of expanding human ... Early-detection cancer testing through Galleri * Flexible spending account and dependent FSA ...
Software engineer, generative AI
San Francisco, CA · On-site
$111K - $304K/yr
As a software engineer, generative ai at WRITER, you'll be at the forefront of expanding human ... Early-detection cancer testing through Galleri * Flexible spending account and dependent FSA ...
Senior Generative AI Developer - Google Cloud
Irvine, CA · On-site
$140 - $210/hr
Apply automated testing, CI/CD, logging, monitoring, tracing, evaluation, and cost-management ... Hands-on experience building Generative AI or agentic applications. * Experience with Google Agent ...
Senior Generative AI Developer - Google Cloud
Irvine, CA · On-site
$140 - $210/hr
Apply automated testing, CI/CD, logging, monitoring, tracing, evaluation, and cost-management ... Hands-on experience building Generative AI or agentic applications. * Experience with Google Agent ...
Lead Engineer (Generative AI)
San Francisco, CA · On-site
$150 - $190/hr
Lead Engineer (Generative AI) Duration: 6-12 plus months Location * Minneapolis/St. Paul "Twin ... Build and manage CI/CD pipelines supporting automated testing, deployment, and release management
New
Lead Engineer (Generative AI)
San Francisco, CA · On-site
$150 - $190/hr
Lead Engineer (Generative AI) Duration: 6-12 plus months Location * Minneapolis/St. Paul "Twin ... Build and manage CI/CD pipelines supporting automated testing, deployment, and release management
New
Ensure code quality through testing (unit, integration, E2E) and documentation * Stay updated on generative AI and cloud technology trends Qualifications: * Bachelor's degree in Computer Science ...
Ensure code quality through testing (unit, integration, E2E) and documentation * Stay updated on generative AI and cloud technology trends Qualifications: * Bachelor's degree in Computer Science ...
Ensure code quality through testing (unit, integration, E2E) and documentation * Stay updated on generative AI and cloud technology trends Qualifications: * Bachelor's degree in Computer Science ...
Quick apply
Ensure code quality through testing (unit, integration, E2E) and documentation * Stay updated on generative AI and cloud technology trends Qualifications: * Bachelor's degree in Computer Science ...
Ensure code quality through testing (unit, integration, E2E) and documentation * Stay updated on generative AI and cloud technology trends Qualifications: * Bachelor's degree in Computer Science ...
Ensure code quality through testing (unit, integration, E2E) and documentation * Stay updated on generative AI and cloud technology trends Qualifications: * Bachelor's degree in Computer Science ...
AI/ML Engineer (Agentic & Generative AI)
Auburn, CA · On-site
$85 - $125/hr
Participate in code reviews, testing, debugging, and troubleshooting activities. * Research ... Strong interest in Generative AI, Large Language Models (LLMs), and intelligent agents.
AI/ML Engineer (Agentic & Generative AI)
Auburn, CA · On-site
$85 - $125/hr
Participate in code reviews, testing, debugging, and troubleshooting activities. * Research ... Strong interest in Generative AI, Large Language Models (LLMs), and intelligent agents.
Lead Data Engineer - Generative AI in Sacramento, CA
Sacramento, CA · On-site
$124K - $149K/yr
Develop testing and validation approaches for GenAI and Text-to-SQL solutions, including controls for hallucinations and inaccurate outputs. * Leverage technologies such as Snowflake Cortex and AWS ...
Lead Data Engineer - Generative AI in Sacramento, CA
Sacramento, CA · On-site
$124K - $149K/yr
Develop testing and validation approaches for GenAI and Text-to-SQL solutions, including controls for hallucinations and inaccurate outputs. * Leverage technologies such as Snowflake Cortex and AWS ...
Lead Generative AI Analyst
San Diego, CA · On-site
The Lead Generative AI Analyst plays a pivotal role in leading technical and writing teams to ... Experience in labeling and tagging frames/tasks/prompts for DNN preparation. * QA/testing ...
Lead Generative AI Analyst
San Diego, CA · On-site
The Lead Generative AI Analyst plays a pivotal role in leading technical and writing teams to ... Experience in labeling and tagging frames/tasks/prompts for DNN preparation. * QA/testing ...
Generative AI Engineer
San Francisco, CA · On-site
You will leverage AI-native engineering approaches, Agentic SDLC practices, and automation ... Automated Testing * Deployment Pipelines * Experience with test automation frameworks such as:
Generative AI Engineer
San Francisco, CA · On-site
You will leverage AI-native engineering approaches, Agentic SDLC practices, and automation ... Automated Testing * Deployment Pipelines * Experience with test automation frameworks such as:
Generative Ai Testing information
What is generative AI testing?
What are some common challenges faced when testing generative AI models, and how can I prepare to address them in this role?
What are the key skills and qualifications needed to thrive as a generative AI testing specialist, and why are they important?
What is the difference between Generative Ai Testing vs Data Scientist?
| Aspect | Generative Ai Testing | Data Scientist |
|---|---|---|
| Required Credentials | Knowledge of AI models, testing tools, programming skills | Statistics, programming, data analysis certifications |
| Work Environment | AI development teams, testing labs, tech companies | Research labs, tech firms, finance, healthcare |
| Employer & Industry Usage | AI product testing, quality assurance in tech | Data analysis, predictive modeling across industries |
Generative Ai Testing focuses on evaluating and validating AI-generated content and models, ensuring quality and accuracy. Data Scientists analyze data, build models, and derive insights. While both roles require programming and AI knowledge, Generative Ai Testing emphasizes testing processes, whereas Data Scientists focus on data analysis and model development.
How do I become a Generative AI Testing?
Is Generative AI Testing a good career?
What are popular job titles related to Generative Ai Testing jobs in California?
For Generative Ai Testing jobs in California, the most frequently searched job titles are:
What job categories do people searching Generative Ai Testing jobs in California look for?
The top searched job categories for Generative Ai Testing jobs in California are:
What cities in California are hiring for Generative Ai Testing jobs?
Cities in California with the most Generative Ai Testing job openings:

Full-time
Posted 18 days ago
Qualcomm rating
8.8
Based on 11 frontline employees who took The Breakroom Quiz
49th of 246 rated software companies
Job description
Qualcomm Technologies, Inc.
Job Area:
Engineering Group, Engineering Group > Software Engineering
General Summary:
*** This position is not eligible for Qualcomm immigration sponsorship.***
About the Role
This role emphasizes on-device AI stability, system-level validation, and end-to-end AI pipeline verification across SoC (CPU, GPU, DSP, and NPU) execution environments, ensuring robust and scalable AI performance on real-world devices. This role targets engineers with a strong foundation in computer science (especially AI/ML) who are passionate about testing and validating cutting-edge generative AI technologies, including LLMs, LVMs, LoRA-based models, and agentic AI workflows. The candidate will play a critical role in driving AI test coverage, automation, and system-level quality, ensuring high reliability, performance, and scalability of on-device AI features in a fast-paced environment.
Minimum Qualifications:
• Bachelor's degree in Engineering, Information Systems, Computer Science, or related field.
Key Responsibilities
On-Device AI Testing & Validation
- Validate on-device AI solutions across mobile, PC, and automotive platforms, ensuring functionality, performance, and robustness.
- Design, develop, and execute end-to-end validation workflows, including model integration, test framework or test application development, device bring-up, and full system validation on target hardware.
- Validate Generative AI use cases across text, multimodal, and speech pipelines, leveraging techniques such as LoRA/adapters, RAG, and agentic AI workflows, ensuring correctness, robustness, and performance on-device
Test Coverage & Quality Ownership
- Define, expand, and track AI test coverage across features and platforms.
- Identify coverage gaps and develop new test scenarios.
- Monitor coverage metrics, pass rates, and regression trends.
Test Automation Development & Maintenance
- Develop new and maintain existing automation frameworks and scripts using Python, Java, and Shell.
- Build scalable pipelines for AI validation and regression testing.
- Improve efficiency through reusable tools and automation best practices.
Generative AI & Model Validation
- Validate Generative AI models including LLMs, LVMs (multimodal models), and LoRA-based adaptations
- Analyze model outputs for accuracy, consistency, robustness, and edge-case behavior
- Validate hybrid AI pipelines and RAG-based systems, including retrieval quality and response correctness
- Evaluate agentic AI workflows, including multi-step reasoning, tool invocation, and execution reliability
Debugging & Stability Engineering
- Perform log analysis and root cause investigation.
- Conduct stress, performance, and long-duration stability testing.
- Debug system, runtime, and model-level issues.
Qualifications & Skills
Required
- BS/MS in Computer Science or related field.
- Strong foundation in AI/ML, data structures, and algorithms.
- 1-3+ years of experience in software testing or AI validation (fresh graduates with strong AI/ML and programming fundamentals will also be considered)
Technical Skills
- Strong programming skills in Python, Java, and Shell.
- Experience with Linux environments and debugging tools.
AI Expertise
- Knowledge of LLMs, LVMs, LoRA, and agentic AI concepts.
- Understanding of AI inference workflows.
Soft Skills
- Fast learner and adaptable to fast-paced environments.
- Strong team player with excellent communication skills.
Preferred
- Experience with on-device AI frameworks and automation at scale.
- Familiarity with AI evaluation metrics and performance profiling
- Familiarity with Qualcomm's ML/AI Frameworks - QNN SDK or ML SW development kit is a plus
Qualcomm is an equal opportunity employer. If you are an individual with a disability and need an accommodation during the application/hiring process, rest assured that Qualcomm is committed to providing an accessible process. You may e-mail disability-accomodations@qualcomm.com or call Qualcomm's toll-free number found here. Upon request, Qualcomm will provide reasonable accommodations to support individuals with disabilities to be able participate in the hiring process. Qualcomm is also committed to making our workplace accessible for individuals with disabilities. (Keep in mind that this email address is used to provide reasonable accommodations for individuals with disabilities. We will not respond here to requests for updates on applications or resume inquiries).
To all Staffing and Recruiting Agencies: Our Careers Site is only for individuals seeking a job at Qualcomm. Staffing and recruiting agencies and individuals being represented by an agency are not authorized to use this site or to submit profiles, applications or resumes, and any such submissions will be considered unsolicited. Qualcomm does not accept unsolicited resumes or applications from agencies. Please do not forward resumes to our jobs alias, Qualcomm employees or any other company location. Qualcomm is not responsible for any fees related to unsolicited resumes/applications.
EEO Employer: Qualcomm is an equal opportunity employer; all qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, Veteran status, or any other protected classification.
Qualcomm expects its employees to abide by all applicable policies and procedures, including but not limited to security and other requirements regarding protection of Company confidential information and other confidential and/or proprietary information, to the extent those requirements are permissible under applicable law.
Pay range and Other Compensation & Benefits:
$94,200.00 - $141,200.00
The above pay scale reflects the broad, minimum to maximum, pay scale for this job code for the location for which it has been posted. Even more importantly, please note that salary is only one component of total compensation at Qualcomm. We also offer a competitive annual discretionary bonus program and opportunity for annual RSU grants (employees on sales-incentive plans are not eligible for our annual bonus). In addition, our highly competitive benefits package is designed to support your success at work, at home, and at play. Your recruiter will be happy to discuss all that Qualcomm has to offer - and you can review more details about our US benefits at this link.
If you would like more information about this role, please contact Qualcomm Careers.
About Qualcomm
Sourced by ZipRecruiter
Qualcomm is enabling a world where everyone and everything can be intelligently connected. You interact with products and technologies made possible by Qualcomm every day, including 5G-enabled smartphones that double as pro-level cameras and gaming devices, smarter vehicles and cities, and the technology behind the smart, connected factories that manufactured your latest purchase. Our powerful connectivity solutions keep you connected—even in remote areas. Qualcomm 5G and AI innovations are the power behind the connected intelligent edge. You’ll find our technologies behind and inside the innovations that deliver significant value across multiple industries and to billions of people every day.
Industry
Technology, communication and media
Company size
10,000+ Employees
Headquarters location
San Diego, CA, US
Year founded
1985