1

Generative Ai Testing Jobs in San Rafael, CA (NOW HIRING)

Senior Quality Engineer

San Francisco, CA ยท On-site

$104K - $141K/yr

You will document AI-testing standards and formally mentor the team on integrating Generative AI into their daily engineering workflows. Scope, Complexity, and Impact * Scope: You will lead quality ...

Senior Tech Product Manager

San Francisco, CA ยท On-site

$149K - $196K/yr

Design A/B testing frameworks to evaluate ad performance and product impact * Use data to guide ... Exposure to AI/ML systems (especially LLMs or generative AI) * Experience building 0โ†’1 products ...

... LLMs, generative AI, and traditional ML with enterprise platforms * Manage AI projects including architecture design, model development, integration, and testing, and ensure projects follow best ...

New

Full Stack Engineer

San Francisco, CA ยท On-site

$120 - $200/hr

Knowledge of automated UI testing frameworks * Past experience or strong interest in generative AI * Highly collaborative mindset with strong communication and problem-solving skills. As a part of ...

Solid understanding of AI/ML concepts, including model evaluation metrics, data pipelines, and the unique challenges of testing generative AI outputs. * Experience with cloud platforms (AWS, Azure ...

Senior AI Product Associate, IT

San Francisco, CA ยท On-site +1

$104K - $160K/yr

Familiarity with generative-AI tools and platforms, including hands-on prompting and testing of AI APIs. * Ability to quickly learn new domains and translate complex workflows into product ...

Showing results 41-60

Generative Ai Testing information

See San Rafael, CA salary details

$35

$59

$85

How much do generative ai testing jobs pay per hour?

As of Aug 23, 2026, the average hourly pay for generative ai testing in San Rafael, CA is $59.89, according to ZipRecruiter salary data. Most workers in this role earn between $49.33 and $68.61 per hour, depending on experience, location, and employer.

What is generative AI testing?

Generative AI Testing refers to the process of evaluating and validating AI systems, particularly those that generate content such as text, images, or code. This type of testing focuses on assessing the accuracy, reliability, fairness, and safety of generative models to ensure they function as intended and avoid producing harmful or biased outputs. Testers use various methods, including automated and manual techniques, to check for issues like hallucinations, inappropriate content, or security vulnerabilities. The goal is to build trust in generative AI systems and ensure they meet quality and ethical standards before deployment.

What are some common challenges faced when testing generative AI models, and how can I prepare to address them in this role?

Testing generative AI models often involves unique challenges such as evaluating the quality and relevance of generated content, detecting bias or inappropriate outputs, and ensuring model consistency across various prompts. You may work closely with data scientists and engineers to create robust evaluation frameworks and develop automated as well as manual testing strategies. Familiarity with prompt engineering, statistical evaluation techniques, and domain-specific knowledge will help you address these challenges effectively. Proactively staying updated on industry best practices and collaborating with cross-functional teams are key to success in this dynamic field.

What are the key skills and qualifications needed to thrive as a generative AI testing specialist, and why are they important?

To thrive as a Generative AI Testing Specialist, you need a robust understanding of machine learning principles, model evaluation techniques, and a background in computer science or a related field. Familiarity with tools such as Python, TensorFlow, PyTorch, and model evaluation frameworks, as well as experience with automated testing platforms, is typically required. Analytical thinking, attention to detail, and strong communication skills help you identify model weaknesses and collaborate effectively with development teams. These skills are crucial to ensure the reliability, safety, and ethical deployment of generative AI solutions.

What is the difference between Generative Ai Testing vs Data Scientist?

AspectGenerative Ai TestingData Scientist
Required CredentialsKnowledge of AI models, testing tools, programming skillsStatistics, programming, data analysis certifications
Work EnvironmentAI development teams, testing labs, tech companiesResearch labs, tech firms, finance, healthcare
Employer & Industry UsageAI product testing, quality assurance in techData analysis, predictive modeling across industries

Generative Ai Testing focuses on evaluating and validating AI-generated content and models, ensuring quality and accuracy. Data Scientists analyze data, build models, and derive insights. While both roles require programming and AI knowledge, Generative Ai Testing emphasizes testing processes, whereas Data Scientists focus on data analysis and model development.

How do I become a Generative AI Testing?

To become a Generative AI Tester, develop skills in machine learning, natural language processing, and programming languages like Python. Gain experience with AI frameworks such as TensorFlow or PyTorch and understand data quality and model evaluation techniques. Relevant certifications and hands-on projects can enhance your qualifications for roles in AI testing environments.

Is Generative AI Testing a good career?

Generative AI Testing is a growing field within AI development, focusing on evaluating the quality and safety of AI-generated content. It requires skills in machine learning, programming, and understanding AI models, often involving tools like Python and TensorFlow. The role offers opportunities in tech companies and research labs, with demand expected to increase as AI applications expand.

What job categories do people searching Generative Ai Testing jobs in San Rafael, CA look for?

The top searched job categories for Generative Ai Testing jobs in San Rafael, CA are:

What cities near San Rafael, CA are hiring for Generative Ai Testing jobs?

Cities near San Rafael, CA with the most Generative Ai Testing job openings:

Infographic showing various Generative Ai Testing job openings in San Rafael, CA as of June 2026, with employment types broken down into 91% Full Time, 5% Part Time, and 4% Contract. Highlights an 66% Physical, 3% Hybrid, and 31% Remote job distribution, with an average salary of $124,569 per year, or $59.9 per hour.

Senior Quality Engineer

Outsystems

San Francisco, CA โ€ข On-site

$104K - $141K/yr

Full-time

Re-posted 6 days ago


Job description

There are NO limits to your career: come shape the future and be part of a truly unique global culture at OutSystems!

Role Overview

As a Senior AI Quality Engineer, you will be the strategic lead for quality within our AI-powered product ecosystem. This role extends beyond traditional QA responsibilities; you will be responsible for defining how we validate non-deterministic AI outputs and complex microservices. You will lead the integration of AI tools, utilizing applications like Claude Code, Cursor, and Gemini to evolve our SDLC toward high-velocity, AI-augmented delivery. You will guide the quality strategy for high-impact initiatives, ensuring that our AI products are functional, reliable, ethical, and scalable.

Core Responsibilities
  • AI-First Test Strategy & Planning: Define and implement the end-to-end test strategy for major AI product areas. You will align testing goals with broader engineering objectives.

  • AI-Augmented Automation: Provide technical leadership for complex automation challenges. You will support the adoption of Cursor and Claude Code to refactor frameworks, generate synthetic data, and automate the creation of sophisticated test suites.

  • Advanced Test Design: Lead the team in designing coverage for AI-based features, including prompt injection testing, model hallucination checks, and performance benchmarking. You will mentor junior engineers on using Gemini to generate use cases.

  • Defect Management & Root Cause Analysis: Lead triage for all defects. You will analyze trends in model behavior and system performance to implement systemic improvements to the development pipeline.

  • Intelligent CI/CD Quality Gates: Define and enforce "smart" quality gates within the CI/CD pipeline. You will hold responsibility for automated suites, ensuring they are reliable, efficient, and capable of catching regressions in both code and model output.

  • Strategic Reporting & Mentorship: Report on quality metrics and team velocity to stakeholders. You will document AI-testing standards and formally mentor the team on integrating Generative AI into their daily engineering workflows.

Scope, Complexity, and Impact
  • Scope: You will lead quality initiatives for an entire product module or end-to-end user workflows, establishing the quality framework for key components of our core AI engine.

  • Complexity: You will solve systemic quality issues, balancing the mitigation of technical debt with the rapid pace of AI innovation.

  • Impact: High. Your work directly influences team-wide velocity and ensures the long-term stability and trustworthiness of our AI products.

Required Qualifications
  • AI Toolchain Expertise: Advanced experience using AI coding assistants (Claude Code, Cursor) and LLMs (Gemini, GPT-4) to accelerate the SDLC.

  • SDLC Leadership: Proven track record of managing product delivery in an Agile environment with a focus on CI/CD and automated quality gates.

  • Technical Stack: Proficiency in C#, Python or JavaScript and experience with modern testing frameworks (e.g., Playwright, PyTest).

  • Autonomy: Ability to drive initiatives from ideation to completion with minimal oversight, requiring only strategic alignment with leadership.

  • Education/Experience: 5+ years in Quality Engineering or Software Development, with a significant focus on automated systems and AI-based applications.

Why Join Us?

We are evolving away from legacy testing mindsets. In this role, you have the autonomy to experiment with the latest AI tools to solve the most complex problems in software quality. If you want to build the blueprint for how AI-based products are delivered to millions of users, this is an ideal opportunity for you.

Salary Range (base): 204k - 235k

Salary Determination: Our salary range is based on industry standards, company performance, and market conditions. We offer competitive compensation packages to attract and retain top talent.

In determining salary ranges, we consider factors such as

  • Market Research: Industry reports, salary surveys, and online salary databases

  • Company Performance: Financial performance, revenue growth, and budget allocation

  • Job Requirements: Skills, experience, and qualifications necessary for the role

  • Geographic Location: Cost of living, market conditions, and industry standards in our region

More about OutSystems

OutSystems is a leading AI Development Platform built for the enterprise. Global organizations trust OutSystems to rapidly build mission-critical apps and agents, modernize legacy processes with agentic systems, and govern their entire AI portfolio across complex regulatory environments, all on one unified platform.


As the future becomes agentic, our customers need us now more than ever. While AI has opened the door to extraordinary possibilities, most large organizations find themselves stuck on one side of the "enterprise gap" because AI by itself doesn't solve their complex use cases and business challenges. OutSystems bridges the "enterprise gap" by combining the speed of generative AI with a deterministic, enterprise-grade framework. We provide the tools for teams of any size to deliver high-quality, reliable AI solutions that drive real business impact.


We are looking for passionate, talented, and motivated people to join us as we empower organizations to build, deploy, and scale the next generation of enterprise software. While we are leading the charge into the agentic era, our mission is broader: we are the platform enterprise leaders trust to evolve their entire business, accelerating innovation through secure, governed human-AI collaboration.


OutSystems is a global company, with more than 900k developer community members, 1,700 employees, more than 600 partners, and thousands of active customers in over 75 countries and across 21 industries. Founded in 2001, OutSystems now has offices in the United States, United Kingdom, the Netherlands, Portugal, Germany, the UAE, Japan, Hong Kong, Malaysia, Australia, India, and Singapore, and includes a thriving, worldwide community of remote employees.


Our customers are some of the world's most recognizable brands across diverse industries- such as Toyota, Heineken, Bosch, KeyBank, and UCLA-who trust OutSystems to deliver ROI and transformational impact.


Consistently recognized as a leader by top analyst firms Gartner, IDC and Forrester, OutSystems continues to shape the future of enterprise software development in the agentic era. We are proud to be named a leader in more than 100 categories on G2, including #1 in Customer Satisfaction in Enterprise Low Code Development, and most recently as a leader in AI Agent Building in the G2 Spring 2026 Reports.


Working at OutSystems

Our culture is built on our core values of Trust, Customer Success, Innovation, and Alignment. We operate as one global OutSystems team, taking ownership to pursue our vision of being the AI platform enterprise leaders trust to build, secure, and evolve their most critical applications and systems.


What do we have to offer you?

  • A company at the vanguard of the agentic revolution, where we don't just react to AI innovation-we architect it. Joining OutSystems means stepping onto a high-growth rocket ship that combines the fearless agility of a startup with the sophisticated, global foundation of an enterprise powerhouse.

  • Real growth opportunities. We don't just talk about development; we invest in it through structured programs designed to scale your expertise. Whether you are aiming for vertical progression, exploring lateral moves into new domains, or mastering specialized AI skills through our Professional Development Fund and Internal Mobility Program, we provide the resources to get you there.

  • A global collective of world-class talent, where you'll collaborate with enterprise software legends and sought-after thought leaders. At OutSystems, our industry experts aren't just visionaries-they are accessible, approachable mentors who are deeply invested in your growth as we architect the agentic future together.


OutSystems nurtures an inclusive culture where talented individuals from all backgrounds are empowered to learn, experiment and make an impact. . We believe that driving our next phase of growth requires the radical creativity that only comes from diverse perspectives. We are committed to building a team as global and diverse as the organizations we serve, ensuring every individual can perform to their full potential. As an equal opportunity employer, all qualified applicants receive equal consideration regardless of race, origin, religion, sex, sexual orientation, gender identity, disability, veteran status, or any other protected status.