ZipRecruiter

Log In

1

Generative Ai Testing Jobs (NOW HIRING)

Huntington

AI Senior Project Manager

Columbus, OH · On-site +1

This role leverages knowledge of AI and Generative AI technologies, prompt engineering and workflows, AI testing and validation, data quality, and process optimization to translate business needs ...

Huntington

AI Senior Project Manager

Columbus, OH · On-site +1

This role leverages knowledge of AI and Generative AI technologies, prompt engineering and workflows, AI testing and validation, data quality, and process optimization to translate business needs ...

Hearst

Senior Engineer, Generative AI

New York, NY · On-site

$114K - $157K/yr

Design and develop Generative AI applications and features using modern LLM APIs and open-source ... A commitment to automated testing and software development best practices * Strong problem solving ...

Writer

Software engineer, generative AI

San Francisco, CA · On-site

$111K - $304K/yr

As a software engineer, generative ai at WRITER, you'll be at the forefront of expanding human ... Early-detection cancer testing through Galleri * Flexible spending account and dependent FSA ...

CGI Inc.

Lead Generative AI Engineer

Reston, VA · On-site

$106K - $140K/yr

... automated testing, monitoring, and observability. • Evaluate AI solutions for quality ... Generative AI * Google Cloud Platform * Retrieval-Augmented Gen.(RAG) * LangGraph What you can ...

New

Peraton

Generative AI Specialist / AI & ML Developer

$135K - $216K/yr

Generative AI Specialist / AI & ML Developer Location: Remote About the Role * Peraton is seeking ... Knowledge of MLOps, A/B testing, and LLM evaluation frameworks (RAGAS, DeepEval). * Experience with ...

Huntington

AI Senior Project Manager

Columbus, OH · On-site +1

This role leverages knowledge of AI and Generative AI technologies, prompt engineering and workflows, AI testing and validation, data quality, and process optimization to translate business needs ...

eTeam

Generative AI Developer

Denver, CO · On-site

Job Summary : eTeam is a company looking for a Generative AI Developer. The role involves strong ... testing • Deployment patterns • batch real-time inference • Data APIs • SQL • REST • ...

next page

Showing results 1-20

All JobsGenerative Ai Testing Jobs

Generative Ai Testing information

See salary details

$31

$53

$76

How much do generative ai testing jobs pay per hour?

As of Jul 21, 2026, the average hourly pay for generative ai testing in the United States is $53.73, according to ZipRecruiter salary data. Most workers in this role earn between $44.23 and $61.54 per hour, depending on experience, location, and employer.

What is the difference between Generative Ai Testing vs Data Scientist?

AspectGenerative Ai TestingData Scientist
Required CredentialsKnowledge of AI models, testing tools, programming skillsStatistics, programming, data analysis certifications
Work EnvironmentAI development teams, testing labs, tech companiesResearch labs, tech firms, finance, healthcare
Employer & Industry UsageAI product testing, quality assurance in techData analysis, predictive modeling across industries

Generative Ai Testing focuses on evaluating and validating AI-generated content and models, ensuring quality and accuracy. Data Scientists analyze data, build models, and derive insights. While both roles require programming and AI knowledge, Generative Ai Testing emphasizes testing processes, whereas Data Scientists focus on data analysis and model development.

How much do AI testers get paid?

AI testers, involved in evaluating and validating generative AI models, typically earn salaries ranging from $60,000 to $120,000 annually depending on experience, location, and company size. Entry-level positions may start lower, while experienced testers with specialized skills in machine learning and data analysis can earn higher wages.

Is AI testing a good career?

AI testing, including roles like Generative AI Testing, is a growing field with increasing demand for skills in machine learning, data analysis, and software quality assurance. It offers opportunities in tech companies, research labs, and startups, often requiring knowledge of AI frameworks and testing tools. The career can be stable and rewarding for those with technical expertise and an interest in AI development.

What are the key skills and qualifications needed to thrive as a Generative AI Testing Specialist, and why are they important?

To thrive as a Generative AI Testing Specialist, you need a robust understanding of machine learning principles, model evaluation techniques, and a background in computer science or a related field. Familiarity with tools such as Python, TensorFlow, PyTorch, and model evaluation frameworks, as well as experience with automated testing platforms, is typically required. Analytical thinking, attention to detail, and strong communication skills help you identify model weaknesses and collaborate effectively with development teams. These skills are crucial to ensure the reliability, safety, and ethical deployment of generative AI solutions.

What is the salary of generative AI tester?

The salary of a generative AI tester typically ranges from $70,000 to $120,000 annually, depending on experience, location, and company size. Entry-level positions may start lower, while experienced testers with specialized skills in AI and machine learning can earn higher salaries. Certifications in AI or related fields can also influence compensation.

What are some common challenges faced when testing generative AI models, and how can I prepare to address them in this role?

Testing generative AI models often involves unique challenges such as evaluating the quality and relevance of generated content, detecting bias or inappropriate outputs, and ensuring model consistency across various prompts. You may work closely with data scientists and engineers to create robust evaluation frameworks and develop automated as well as manual testing strategies. Familiarity with prompt engineering, statistical evaluation techniques, and domain-specific knowledge will help you address these challenges effectively. Proactively staying updated on industry best practices and collaborating with cross-functional teams are key to success in this dynamic field.

How do I become an AI tester?

To become an AI tester, you should have a strong understanding of machine learning concepts, programming skills in languages like Python, and experience with data annotation and model evaluation. Familiarity with AI tools, testing frameworks, and quality assurance processes is also important. Gaining relevant certifications or training in AI and software testing can enhance your qualifications.

What is Generative AI Testing?

Generative AI Testing refers to the process of evaluating and validating AI systems, particularly those that generate content such as text, images, or code. This type of testing focuses on assessing the accuracy, reliability, fairness, and safety of generative models to ensure they function as intended and avoid producing harmful or biased outputs. Testers use various methods, including automated and manual techniques, to check for issues like hallucinations, inappropriate content, or security vulnerabilities. The goal is to build trust in generative AI systems and ensure they meet quality and ethical standards before deployment.
More about Generative Ai Testing jobs
What cities are hiring for Generative Ai Testing jobs? Cities with the most Generative Ai Testing job openings:
What states have the most Generative Ai Testing jobs? States with the most job openings for Generative Ai Testing jobs include:
What job categories do people searching Generative Ai Testing jobs look for? The top searched job categories for Generative Ai Testing jobs are:
Generative Ai Testing jobs near you
Infographic showing various Generative Ai Testing job openings in the United States as of July 2026, with employment types broken down into 100% Full Time. Highlights an 100% In-person job distribution, with an average salary of $111,750 per year, or $53.7 per hour.
Data Scientist - Responsible AI

Data Scientist - Responsible AI

Empower Annuity Insurance Company of America

Remote

Full-time

Medical, Dental, Vision, Life, Retirement, PTO

Posted 11 days ago

Empower rating

7.6

Company rating: 7.6 out of 10

Based on 45 frontline employees who took The Breakroom Quiz

109th of 148 rated financial services

Job description

Our vision for the future is based on the idea that transforming financial lives starts by giving our people the freedom to transform their own. We have a flexible work environment, and fluid career paths. We not only encourage but celebrate internal mobility. We also recognize the importance of purpose, well-being, and work-life balance. Within Empower and our communities, we work hard to create a welcoming and inclusive environment, and our associates dedicate thousands of hours to volunteering for causes that matter most to them.
Chart your own path and grow your career while helping more customers achieve financial freedom. Empower Yourself.
Applicants must be authorized to work for any employer in the U.S. We are unable to sponsor or take over sponsorship of an employment visa at this time, including CPT/OPT.
The Data Scientist will support Empower's Responsible AI strategy by developing, applying, and validating methods used to evaluate generative AI, agentic AI, and other AI-enabled business applications.
This role focuses on fairness, explainability, transparency, hallucination, safety, reliability, and related Responsible AI measures. The Data Scientist will work with AI/ML engineers, data engineers, security engineers, architects, governance partners, and business stakeholders to ensure evaluation methods are practical, repeatable, and aligned with business and regulatory needs.
What You Will Do:
  • Apply statistical analysis and experimentation to evaluate generative AI, agentic AI, and other AI-enabled applications.
  • Develop and maintain Responsible AI measures, benchmark datasets, test suites, and evaluation criteria.
  • Evaluate AI systems for fairness, bias, explainability, transparency, hallucination, safety, reliability, and robustness.
  • Use evaluation results to support the design, testing, selection, and ongoing assessment of AI-enabled business applications.
  • Establish performance baselines and help identify changes in model or application behavior over time.
  • Design and execute proofs of concept for new Responsible AI evaluation approaches.
  • Assess emerging Responsible AI tools, frameworks, and methodologies for validity, limitations, and business applicability.
  • Support the integration of Responsible AI testing into application development, quality assurance, and governance processes.
  • Partner with engineering, architecture, quality assurance, governance, and business teams to align evaluation methods with use case requirements.
  • Create and maintain model cards, evaluation reports, methodology documentation, and related guidance.
  • Communicate findings, limitations, risks, and recommendations to technical and nontechnical stakeholders.
  • Contribute to Responsible AI training, internal education, applied research, and industry engagement.
  • Monitor emerging technologies and evaluation methods related to generative AI, agentic AI, and Responsible AI.

What You Will Bring:
  • Bachelor's degree in Data Science, Computer Science, Statistics, Mathematics, Psychology, Economics, Operations Research, or another quantitative discipline.
  • 2 to 5 years of experience in data science, statistical analysis, AI evaluation, applied research, or analytics.
  • Strong Python programming skills and experience working with data analysis and AI evaluation tools.
  • Strong SQL skills and experience working with large, complex datasets.
  • Experience designing experiments, selecting appropriate measures, and interpreting statistical results.
  • Experience evaluating generative AI applications, large language models, agentic systems, or other AI-enabled solutions.
  • Knowledge of Responsible AI concepts, including fairness, bias, explainability, transparency, hallucination, safety, reliability, and robustness.
  • Experience developing evaluation datasets, benchmarks, test cases, scorecards, or performance measures.
  • Experience translating evaluation results into recommendations for business applications and technical teams.
  • Experience with source control, automated testing, technical documentation, and basic software engineering practices.
  • Ability to assess technical methodologies, identify limitations, and communicate findings clearly.
  • Strong written and verbal communication skills.
  • Ability to work independently and collaborate across technical, governance, and business teams.

What will set you apart:
  • Advanced degree in a quantitative, behavioral science, computer science, AI, or Responsible AI-related discipline.
  • Experience evaluating large language models, generative AI applications, retrieval-augmented generation systems, or agentic AI solutions.
  • Experience with model cards, system cards, AI evaluation frameworks, or AI assurance documentation.
  • Familiarity with Responsible AI standards and frameworks, including NIST or ISO guidance.
  • Experience with fairness metrics, explainability techniques, hallucination and grounding evaluation, human evaluation, LLM-as-judge methods, or adversarial testing.
  • Experience applying Responsible AI evaluation methods within production or business-facing applications.
  • Experience in financial services or another regulated industry.
  • Experience contributing to technical publications, conferences, research collaborations, or industry working groups.

This job operates in a professional office environment.
This job description is not intended to be an exhaustive list of all duties, responsibilities and qualifications of the job. The employer has the right to revise this job description at any time. You will be evaluated in part based on your performance of the responsibilities and/or tasks listed in this job description. You may be required to perform other duties that are not included on this job description. The job description is not a contract for employment, and either you or the employer may terminate employment at any time, for any reason, as per terms and conditions of your employment contract.
What we offer you
We offer an array of diverse and inclusive benefits regardless of where you are in your career. We believe that providing our employees with the means to lead healthy balanced lives results in the best possible work performance.
  • Medical, dental, vision and life insurance
  • Retirement savings - 401(k) plan with generous company matching contributions (up to 6%), financial advisory services, potential company discretionary contribution, and a broad investment lineup
  • Tuition reimbursement up to $5,250/year
  • Business-casual environment that includes the option to wear jeans
  • Generous paid time off upon hire - including a paid time off program plus ten paid company holidays and three floating holidays each calendar year
  • Paid volunteer time - 16 hours per calendar year
  • Leave of absence programs - including paid parental leave, paid short- and long-term disability, and Family and Medical Leave (FMLA)
  • Business Resource Groups (BRGs) - BRGs facilitate inclusion and collaboration across our business internally and throughout the communities where we live, work and play. BRGs are open to all.

Base Salary Range
$87,400.00 - $123,400.00
The salary range above shows the typical minimum to maximum base salary range for this position in the location listed. Non-sales positions have the opportunity to participate in a bonus program. Sales positions are eligible for sales incentives, and in some instances a bonus plan, whereby total compensation may far exceed base salary depending on individual performance. Actual compensation offered may vary from posted hiring range based upon geographic location, work experience, education, licensure requirements and/or skill level and will be finalized at the time of offer.
Equal opportunity employer • Drug-free workplace
We are an equal opportunity employer with a commitment to diversity. All individuals, regardless of personal characteristics, are encouraged to apply. All qualified applicants will receive consideration for employment without regard to age (40 and over), race, color, national origin, ancestry, sex, sexual orientation, gender, gender identity, gender expression, marital status, pregnancy, religion, physical or mental disability, military or veteran status, genetic information, or any other status protected by applicable state or local law.
***For remote and hybrid positions you will be required to provide reliable high-speed internet with a wired connection as well as a place in your home to work with limited disruption. You must have reliable connectivity from an internet service provider that is fiber, cable or DSL internet. Other necessary computer equipment, will be provided. You may be required to work in the office if you do not have an adequate home work environment and the required internet connection.***
Job Posting End Date at 12:01 am on:
07-31-2026
Want the latest money news and views shaping how we live, work and play? Stay in the know with The Currency and sign up for Empower's free newsletter.

What Empower employees say

Pay

Benefits

Hours and flexibility

Workplace

Get the full story on Breakroom

Apply