ZipRecruiter

Log In

1

Generative Ai Testing Jobs in California (NOW HIRING)

Writer

Software engineer, generative AI

San Francisco, CA · On-site

$111K - $304K/yr

As a software engineer, generative ai at WRITER, you'll be at the forefront of expanding human ... Early-detection cancer testing through Galleri * Flexible spending account and dependent FSA ...

Apex Systems

AI Quality Engineer

Beverly Hills, CA · On-site

$82K - $106K/yr

Define and track AI quality metrics (e.g., hallucination rates, response accuracy, latency) LLM & Generative AI Testing * Develop test strategies for LLM-based applications, including: * Prompt ...

New

Icwgroup

Applied AI Engineer

San Diego, CA

Implement end-to-end generative AI solutions, including model fine-tuning, deployment, and testing in production environments. * Collaborate with cloud engineering, AI, and ML Ops teams to ...

Icwgroup

Applied AI Engineer

San Diego, CA

Implement end-to-end generative AI solutions, including model fine-tuning, deployment, and testing in production environments. * Collaborate with cloud engineering, AI, and ML Ops teams to ...

ICW Group

Applied AI Engineer

San Diego, CA · On-site

Implement end-to-end generative AI solutions, including model fine-tuning, deployment, and testing in production environments. * Collaborate with cloud engineering, AI, and ML Ops teams to ...

ICW Group

Applied AI Engineer

San Diego, CA · On-site

Implement end-to-end generative AI solutions, including model fine-tuning, deployment, and testing in production environments. * Collaborate with cloud engineering, AI, and ML Ops teams to ...

next page

Showing results 1-20

All JobsGenerative Ai Testing JobsGenerative Ai Testing Jobs in California

Generative Ai Testing information

What is the difference between Generative Ai Testing vs Data Scientist?

AspectGenerative Ai TestingData Scientist
Required CredentialsKnowledge of AI models, testing tools, programming skillsStatistics, programming, data analysis certifications
Work EnvironmentAI development teams, testing labs, tech companiesResearch labs, tech firms, finance, healthcare
Employer & Industry UsageAI product testing, quality assurance in techData analysis, predictive modeling across industries

Generative Ai Testing focuses on evaluating and validating AI-generated content and models, ensuring quality and accuracy. Data Scientists analyze data, build models, and derive insights. While both roles require programming and AI knowledge, Generative Ai Testing emphasizes testing processes, whereas Data Scientists focus on data analysis and model development.

How much do AI testers get paid?

AI testers, involved in evaluating and validating generative AI models, typically earn salaries ranging from $60,000 to $120,000 annually depending on experience, location, and company size. Entry-level positions may start lower, while experienced testers with specialized skills in machine learning and data analysis can earn higher wages.

Is AI testing a good career?

AI testing, including roles like Generative AI Testing, is a growing field with increasing demand for skills in machine learning, data analysis, and software quality assurance. It offers opportunities in tech companies, research labs, and startups, often requiring knowledge of AI frameworks and testing tools. The career can be stable and rewarding for those with technical expertise and an interest in AI development.

What are the key skills and qualifications needed to thrive as a Generative AI Testing Specialist, and why are they important?

To thrive as a Generative AI Testing Specialist, you need a robust understanding of machine learning principles, model evaluation techniques, and a background in computer science or a related field. Familiarity with tools such as Python, TensorFlow, PyTorch, and model evaluation frameworks, as well as experience with automated testing platforms, is typically required. Analytical thinking, attention to detail, and strong communication skills help you identify model weaknesses and collaborate effectively with development teams. These skills are crucial to ensure the reliability, safety, and ethical deployment of generative AI solutions.

What is the salary of generative AI tester?

The salary of a generative AI tester typically ranges from $70,000 to $120,000 annually, depending on experience, location, and company size. Entry-level positions may start lower, while experienced testers with specialized skills in AI and machine learning can earn higher salaries. Certifications in AI or related fields can also influence compensation.

What are some common challenges faced when testing generative AI models, and how can I prepare to address them in this role?

Testing generative AI models often involves unique challenges such as evaluating the quality and relevance of generated content, detecting bias or inappropriate outputs, and ensuring model consistency across various prompts. You may work closely with data scientists and engineers to create robust evaluation frameworks and develop automated as well as manual testing strategies. Familiarity with prompt engineering, statistical evaluation techniques, and domain-specific knowledge will help you address these challenges effectively. Proactively staying updated on industry best practices and collaborating with cross-functional teams are key to success in this dynamic field.

How do I become an AI tester?

To become an AI tester, you should have a strong understanding of machine learning concepts, programming skills in languages like Python, and experience with data annotation and model evaluation. Familiarity with AI tools, testing frameworks, and quality assurance processes is also important. Gaining relevant certifications or training in AI and software testing can enhance your qualifications.

What is Generative AI Testing?

Generative AI Testing refers to the process of evaluating and validating AI systems, particularly those that generate content such as text, images, or code. This type of testing focuses on assessing the accuracy, reliability, fairness, and safety of generative models to ensure they function as intended and avoid producing harmful or biased outputs. Testers use various methods, including automated and manual techniques, to check for issues like hallucinations, inappropriate content, or security vulnerabilities. The goal is to build trust in generative AI systems and ensure they meet quality and ethical standards before deployment.
What are popular job titles related to Generative Ai Testing jobs in California? For Generative Ai Testing jobs in California, the most frequently searched job titles are:
What job categories do people searching Generative Ai Testing jobs in California look for? The top searched job categories for Generative Ai Testing jobs in California are:
What cities in California are hiring for Generative Ai Testing jobs? Cities in California with the most Generative Ai Testing job openings:
Generative Ai Testing jobs near you
Infographic showing various Generative Ai Testing job openings in California as of July 2026, with employment types broken down into 100% Full Time. Highlights an 100% In-person job distribution.
Lead Software Engineer - Generative AI

Lead Software Engineer - Generative AI

C3 AI

Redwood City, CA • On-site

$175K - $219K/yr

Full-time

Posted 6 days ago

New

Job description

C3 AI (NYSE: AI), is the Enterprise AI application software company. C3 AI delivers a family of fully integrated products including the C3 Agentic AI Platform, an end-to-end platform for developing, deploying, and operating enterprise AI applications, C3 AI applications, a portfolio of industry-specific SaaS enterprise AI applications that enable the digital transformation of organizations globally, and C3 Generative AI, a suite of domain-specific generative AI offerings for the enterprise. Learn more at: C3 AI
We are looking for a highly skilled and experienced lead software engineer experienced in the field of machine learning and artificial intelligence, and passionate about Generative AI technology and building next-generation software platforms.
As a member of C3 AI's Generative AI team, you will be tasked with developing the infrastructure and tools to improve the state-of-the-art and enable the use of this game changing technology in our enterprise applications. You'll collaborate with product managers, data scientists and other engineers and will be responsible for the entire software engineering lifecycle. A successful candidate will thrive in a fast-paced, innovative, and highly collaborative environment, and demonstrate an ability to execute precisely and quickly. The ideal candidate will have in-depth experience with putting large scale machine learning models in production and a solid understanding of Large Language Models (LLMs).
Responsibilities:
  • Work across teams to architect robust software engineering solutions and frameworks with cross product impact.
  • Implement and enhance engineering best practices company wide.
  • Build systems and tools to enable and simplify the use of Generative AI technologies in our applications using the C3 AI Platform.
  • Enable scalable end-to-end machine learning pipelines in a distributed system with heterogeneous hardware (GPUs, TPUs, etc.).
  • Work with data scientists to research and implement latest approaches to efficiently train/fine-tune Generative Models.
  • Work with product owners to define and lead the long-term development the C3 Generative AI Suite.
  • Lead cross-team technical design discussions on application architecture, UI components, UX, back-end and third-party integration, and testing.
  • Manage individual project deliverables and mentor junior team members on industry coding standards and design techniques.

Qualifications:
  • Bachelor's degree in Computer Science, Computer Engineering, or related fields, MS preferred.
  • 8+ years of professional software development experience in Python; experience with Java and JavaScript preferred.
  • Proven track record of design and development of full stack web solutions for complex problems.
  • Strong hands-on experience and understanding of data structures, algorithms, profiling/optimization, DRY code, and Object-Oriented and Functional Programming.
  • In-depth understanding of machine learning including deep learning algorithms.
  • Proven track record of applying machine learning algorithms in a production system.
  • Demonstrated end-to-end ownership of projects.
  • Excellent verbal and written communication skills to collaborate multi-functionally and improve scalability.
  • Demonstrated interest for Generative AI technology (e.g., projects with technologies like LangChain, Semantic Kernel, ChatGPT Plugins, etc.).

Preferred Qualifications:
  • Advanced degree in computer science, math, or similar quantitative field.
  • Knowledge of Agile development methodology.
  • Experience in leading engineering teams and projects.

C3 AI provides excellent benefits, a competitive compensation package and generous equity plan.
California Base Pay Range
$175,000-$219,000 USD
C3 AI is proud to be an Equal Opportunity and Affirmative Action Employer. We do not discriminate on the basis of any legally protected characteristics, including disabled and veteran status.

Apply