ZipRecruiter

Log In

1

Generative Ai Testing Jobs (NOW HIRING)

Hearst

Senior Engineer, Generative AI

Manhattan, NY · On-site

$114K - $157K/yr

Design and develop Generative AI applications and features using modern LLM APIs and open-source ... A commitment to automated testing and software development best practices * Strong problem solving ...

Writer

Software engineer, generative AI

San Francisco, CA · On-site

$111K - $304K/yr

As a software engineer, generative ai at WRITER, you'll be at the forefront of expanding human ... Early-detection cancer testing through Galleri * Flexible spending account and dependent FSA ...

Hearst Newspapers

Senior Engineer, Generative AI

New York, NY · On-site

$114K - $157K/yr

Design and develop Generative AI applications and features using modern LLM APIs and open-source ... A commitment to automated testing and software development best practices * Strong problem solving ...

Hearst Corporate

Senior Engineer, Generative AI

Manhattan, NY · On-site

$114K - $157K/yr

Design and develop Generative AI applications and features using modern LLM APIs and open-source ... A commitment to automated testing and software development best practices * Strong problem solving ...

Hearst

Senior Engineer, Generative AI

Manhattan, NY · On-site

$114K - $157K/yr

Design and develop Generative AI applications and features using modern LLM APIs and open-source ... A commitment to automated testing and software development best practices * Strong problem solving ...

Hearst

Senior Engineer, Generative AI

New York, NY · On-site

$114K - $157K/yr

Design and develop Generative AI applications and features using modern LLM APIs and open-source ... A commitment to automated testing and software development best practices * Strong problem solving ...

next page

Showing results 1-20

People also search for

All JobsGenerative Ai Testing Jobs

Generative Ai Testing information

See salary details

$31

$53

$76

How much do generative ai testing jobs pay per hour?

As of Jun 5, 2026, the average hourly pay for generative ai testing in the United States is $53.73, according to ZipRecruiter salary data. Most workers in this role earn between $44.23 and $61.54 per hour, depending on experience, location, and employer.

What are the key skills and qualifications needed to thrive as a Generative AI Testing Specialist, and why are they important?

To thrive as a Generative AI Testing Specialist, you need a robust understanding of machine learning principles, model evaluation techniques, and a background in computer science or a related field. Familiarity with tools such as Python, TensorFlow, PyTorch, and model evaluation frameworks, as well as experience with automated testing platforms, is typically required. Analytical thinking, attention to detail, and strong communication skills help you identify model weaknesses and collaborate effectively with development teams. These skills are crucial to ensure the reliability, safety, and ethical deployment of generative AI solutions.

What are some common challenges faced when testing generative AI models, and how can I prepare to address them in this role?

Testing generative AI models often involves unique challenges such as evaluating the quality and relevance of generated content, detecting bias or inappropriate outputs, and ensuring model consistency across various prompts. You may work closely with data scientists and engineers to create robust evaluation frameworks and develop automated as well as manual testing strategies. Familiarity with prompt engineering, statistical evaluation techniques, and domain-specific knowledge will help you address these challenges effectively. Proactively staying updated on industry best practices and collaborating with cross-functional teams are key to success in this dynamic field.

What is Generative AI Testing?

Generative AI Testing refers to the process of evaluating and validating AI systems, particularly those that generate content such as text, images, or code. This type of testing focuses on assessing the accuracy, reliability, fairness, and safety of generative models to ensure they function as intended and avoid producing harmful or biased outputs. Testers use various methods, including automated and manual techniques, to check for issues like hallucinations, inappropriate content, or security vulnerabilities. The goal is to build trust in generative AI systems and ensure they meet quality and ethical standards before deployment.

What is the difference between Generative Ai Testing vs Data Scientist?

AspectGenerative Ai TestingData Scientist
Required CredentialsKnowledge of AI models, testing tools, programming skillsStatistics, programming, data analysis certifications
Work EnvironmentAI development teams, testing labs, tech companiesResearch labs, tech firms, finance, healthcare
Employer & Industry UsageAI product testing, quality assurance in techData analysis, predictive modeling across industries

Generative Ai Testing focuses on evaluating and validating AI-generated content and models, ensuring quality and accuracy. Data Scientists analyze data, build models, and derive insights. While both roles require programming and AI knowledge, Generative Ai Testing emphasizes testing processes, whereas Data Scientists focus on data analysis and model development.

More about Generative Ai Testing jobs
What cities are hiring for Generative Ai Testing jobs? Cities with the most Generative Ai Testing job openings:
What states have the most Generative Ai Testing jobs? States with the most job openings for Generative Ai Testing jobs include:
What job categories do people searching Generative Ai Testing jobs look for? The top searched job categories for Generative Ai Testing jobs are:
Generative Ai Testing jobs near you
Infographic showing various Generative Ai Testing job openings in the United States as of May 2026, with employment types broken down into 12% Internship, 76% Full Time, 6% Part Time, and 6% Contract. Highlights an 53% In-person, 12% Hybrid, and 35% Remote job distribution, with an average salary of $111,750 per year, or $53.7 per hour.
AI QA Test Lead

AI QA Test Lead

Truliant Federal Credit Union

Winston Salem, NC • On-site, Remote

Full-time

Medical, Dental, Vision, Life, Retirement, PTO

Posted 27 days ago

Job description

Truliant's mission is to improve lives by putting our members first, providing great service and straightforward financial solutions. Our core values of Member Focus, Service, Guidance, Relationships, and Community define how we interact with members to fulfill our mission of improving lives and providing a foundation on which we conduct ourselves.
Our Promise to Our Teammates: Truliant strives to provide all teammates with an enjoyable place to work where they feel valued, empowered and rewarded for all that they do.
Purpose of the Job
The AI QA Test Lead is a critical quality and risk-management leader responsible for ensuring the reliability, accuracy, and production readiness of the credit union's AI-driven member and staff experiences. This role owns the overall AI quality assurance strategy, directly safeguarding millions of AI-powered interactions each year by ensuring solutions meet defined standards for accuracy, compliance, brand alignment, and ethical use. Serving as the primary authority on AI testing and validation, the AI QA Test Lead designs and manages comprehensive testing plans across conversational AI, generative AI, and agentic AI workflows. The role partners closely with the AI Program team and Truliant's business stakeholders, and key vendors to validate new use cases, manage AI-related risk, and ensure all AI releases are thoroughly tested before deployment. The role manages the end-to-end correction loop with third-party vendors integral to the delivery of Truliant's AI use cases. Key responsibilities include defining QA plans, leading end-to-end UAT, validating ethical guardrails, and establishing scalable QA practices that enable safe and confident expansion of Truliant's AI capabilities.
Essential Functions and Responsibilities
  • Owns and leads the end-to-end quality assurance strategy for the credit union's AI self-service and internal support solutions, with a primary focus on conversational AI platforms such as Kore.ai.
  • Defines, documents, and maintains AI QA standards, test frameworks, methodologies, and acceptance criteria across all AI initiatives.
  • Designs and executes comprehensive AI test plans covering functional accuracy, conversational flows, edge cases, integrations, compliance, and regression scenarios.
  • Leads and governs all AI-related user acceptance testing (UAT), serving as the final quality gate for approving AI solutions prior to production release.
  • Validates AI-generated responses for accuracy, consistency, brand alignment, and adherence to member-first service standards.
  • Tests and monitors ethical AI guardrails, including bias prevention, hallucination detection, inappropriate response handling, and escalation logic.
  • Partners closely with the AI Solutions Architect and AI Optimization Analyst to review solution designs and ensure testability throughout the AI development lifecycle.
  • Establishes testing processes for prompt changes, workflow updates, model enhancements, and new AI capabilities to ensure safe iteration and deployment.
  • Analyzes defects, testing outcomes, and production issues to identify root causes and drive continuous improvement in AI quality.
  • Collaborates with business units and frontline teams to validate AI behavior against real-world use cases and operational expectations.
  • Tracks, documents, and reports on AI quality metrics such as defect trends, release readiness, risk severity, and post-release issues.
  • Stays current on AI QA best practices, regulatory considerations, and emerging testing techniques, proactively recommending improvements to strengthen AI reliability and governance.
  • Should possess a strong commitment to providing excellent service to Truliant's members.

Other Duties and Responsibilities
  • Assists with other tasks and projects as assigned.

Knowledge, Skills, and Abilities
  • Must have a strong understanding of conversational AI, generative AI, NLP, and intent-based bot frameworks.
  • Must have the ability to evaluate AI responses for tone, brand voice, compliance, and member experience impact.
  • Must have the ability to understand credit union business processes and assess AI solutions against operational and member needs.
  • Must have knowledge of ethical AI principles, including bias detection, guardrail validation, and hallucination mitigation.
  • Must have excellent collaboration and communication skills to work across technical teams, business stakeholders, and frontline staff.
  • Must have the ability to translate business and regulatory requirements into clear AI testing criteria and validation scenarios.
  • Must have familiarity with analytics, dashboards, automated QA tools, or conversation intelligence platforms used to support testing and monitoring.
  • Must have strong problem-solving skills with the ability to identify systemic quality issues and propose scalable solutions.
  • Must have attention to detail and high standards when reviewing AI outputs, workflows, and system changes.
  • Must have an understanding of UX and conversational design principles as they relate to testing and validation.
  • Must have the ability to manage multiple priorities in a fast-paced, innovation-driven environment.
  • Must have strong organizational skills and the ability to work independently with minimal supervision.
  • Must be able to work in a team environment with strong collaborative skills.
  • Must have superior interpersonal skills; ability to get along with diverse personalities; tactful, mature, flexible, respectful.
  • Must be flexible and able to shift resources and priorities as required.
  • Should possess a strong commitment to providing excellent service to Truliant's members.

Physical Requirements
  • Occasional standing, walking, bending, and stooping required
  • Must be able to sit at a desk for long periods of time and use a computer
  • Must be able to moderately lift or move up to 5 pounds and occasionally lift or move up to 10 pounds

Education and Background
  • Bachelor's degree required in a relevant field such as Information Systems, Computer Science, Business Administration, or a related discipline required.
  • Equivalent combination of education and directly applicable work experience may be considered, particularly in AI QA, software testing, or risk-focused roles.
  • 3-7 years of experience in quality assurance, testing, or validation roles involving complex systems, with at least 2 years focused on AI, conversational AI, or automation platforms required.
  • Demonstrated experience leading test planning, execution, defect management, and UAT for enterprise solutions required.
  • Expertise in quality assurance methodologies, test planning, test execution, defect tracking, release validation, and vendor correction loops required.
  • Experience testing AI systems for accuracy, edge cases, failure modes, and unintended behavior required.
  • Strong experience leading UAT efforts and serving as the final approval authority for production releases required.
  • Experience testing AI or automated decision systems, including generative AI or NLP-based solutions, strongly preferred.
  • Experience partnering with AI engineers, solutions architects, product owners, or business leaders to ensure quality and risk alignment preferred.
  • Background in financial services, credit unions, banking, or other regulated environments is a plus.

This position is remote within our NC, SC, VA footprint. Although this position is primarily remote, there are occasional events and meetings that may require you to work on-site at one of our Truliant locations.
If you have a passion for member service and would like to invest in a meaningful career with opportunity for growth, we encourage you to apply to Truliant!
As a member of the Truliant family, you will enjoy the following full time benefits:
  • No-cost employee Medical, dental, vision coverage
  • Prescription benefits (including mail order)
  • Paid holidays and Paid Time Off (PTO)
  • 401(k) plan with contribution matching
  • Paid community involvement volunteers hours
  • Paid group life Insurance
  • Teammate loan discounts
  • Tuition reimbursement
  • Short and long-term disability
  • Health & Wellness program
  • Teledoc (physician video conferencing)
  • Onsite fitness facilities or health club reimbursement
  • Employee Assistance Program (EAP)
  • Medical flexible spending account
  • Dependent care flexible spending account

Apply