ZipRecruiter

Log In

1

Generative Ai Testing Jobs (NOW HIRING)

Delan Associates, Inc

AI Agentic Tester

Denver, MO · Remote

... Testing Functional Testing Generative AI Testing Large Language Models (LLMs) AI Agents & Agentic AI Retrieval-Augmented Generation (RAG) Prompt Engineering Validation AI Model Validation ...

Delan Associates, Inc.

AI Agentic Tester

Denver, MO · On-site +1

Functional Testing * Generative AI Testing * Large Language Models (LLMs) * AI Agents & Agentic AI * Retrieval-Augmented Generation (RAG) * Prompt Engineering Validation * AI Model Validation ...

PB consulting

Generative AI Engineer

Irving, TX

Participate in model testing, deployment, monitoring, and continuous improvement. * Contribute to ... Experience with Generative AI techniques including text generation, text-to-image generation, and ...

New

PB consulting

Generative AI Engineer

Grapevine, TX

Participate in model testing, deployment, monitoring, and continuous improvement. * Contribute to ... Experience with Generative AI techniques including text generation, text-to-image generation, and ...

New

Digipulse Technologies, Inc

AI Engineer

Atlanta, GA · On-site

$69K - $89K/yr

Generative AI and Large Language Models * Prompt engineering and prompt optimization * LLM testing and AI quality assurance * RAG, vector databases, semantic search, and embeddings * AI evaluation ...

LOGC2

EOIR Program Manager - AI TESTING

Springfield, VA · On-site

$121K - $121K/yr

Lead and guide the work of technical staff executing complex AI Testing, Evaluation, Verification, and Validation (TEVV) activities, including generative AI performance assessments and adversarial ...

Prosum Inc.

Generative AI Engineer

Fort Worth, TX · On-site

$120K - $165K/yr

Generative AI Engineer Location: Remote (U.S.) Salary Range: $120k to $165k About the Role We are ... Develop evaluation pipelines for LLM outputs, including regression testing and failure analysis

Lares IT Solutions Inc

Generative AI Engineer

Plano, TX · On-site

Generative AI Developer Plano, TX We are seeking a seasoned Generative AI Developer with expertise ... Testing & Tools: Cucumber (BDD), SonarQube, Postman, JIRA, Maven, Gradle, Apache Spark * Operating ...

next page

Showing results 1-20

All JobsGenerative Ai Testing Jobs

Generative Ai Testing information

See salary details

$31

$53

$76

How much do generative ai testing jobs pay per hour?

As of Aug 10, 2026, the average hourly pay for generative ai testing in the United States is $53.73, according to ZipRecruiter salary data. Most workers in this role earn between $44.23 and $61.54 per hour, depending on experience, location, and employer.

What is the difference between Generative Ai Testing vs Data Scientist?

AspectGenerative Ai TestingData Scientist
Required CredentialsKnowledge of AI models, testing tools, programming skillsStatistics, programming, data analysis certifications
Work EnvironmentAI development teams, testing labs, tech companiesResearch labs, tech firms, finance, healthcare
Employer & Industry UsageAI product testing, quality assurance in techData analysis, predictive modeling across industries

Generative Ai Testing focuses on evaluating and validating AI-generated content and models, ensuring quality and accuracy. Data Scientists analyze data, build models, and derive insights. While both roles require programming and AI knowledge, Generative Ai Testing emphasizes testing processes, whereas Data Scientists focus on data analysis and model development.

How do I become a Generative AI Testing?

To become a Generative AI Tester, develop skills in machine learning, natural language processing, and programming languages like Python. Gain experience with AI frameworks such as TensorFlow or PyTorch and understand data quality and model evaluation techniques. Certifications in AI or data science can enhance your qualifications and improve job prospects.

Is Generative AI Testing a good career?

Generative AI Testing is a growing field within AI development that involves evaluating the quality and safety of AI-generated content. It requires skills in machine learning, programming, and understanding AI models, making it a promising career path with increasing demand as AI technologies expand. Professionals in this area can find opportunities in tech companies, research labs, and startups focused on AI innovation.

What are the key skills and qualifications needed to thrive as a generative AI testing specialist, and why are they important?

To thrive as a Generative AI Testing Specialist, you need a robust understanding of machine learning principles, model evaluation techniques, and a background in computer science or a related field. Familiarity with tools such as Python, TensorFlow, PyTorch, and model evaluation frameworks, as well as experience with automated testing platforms, is typically required. Analytical thinking, attention to detail, and strong communication skills help you identify model weaknesses and collaborate effectively with development teams. These skills are crucial to ensure the reliability, safety, and ethical deployment of generative AI solutions.

What are some common challenges faced when testing generative AI models, and how can I prepare to address them in this role?

Testing generative AI models often involves unique challenges such as evaluating the quality and relevance of generated content, detecting bias or inappropriate outputs, and ensuring model consistency across various prompts. You may work closely with data scientists and engineers to create robust evaluation frameworks and develop automated as well as manual testing strategies. Familiarity with prompt engineering, statistical evaluation techniques, and domain-specific knowledge will help you address these challenges effectively. Proactively staying updated on industry best practices and collaborating with cross-functional teams are key to success in this dynamic field.

What is generative AI testing?

Generative AI Testing refers to the process of evaluating and validating AI systems, particularly those that generate content such as text, images, or code. This type of testing focuses on assessing the accuracy, reliability, fairness, and safety of generative models to ensure they function as intended and avoid producing harmful or biased outputs. Testers use various methods, including automated and manual techniques, to check for issues like hallucinations, inappropriate content, or security vulnerabilities. The goal is to build trust in generative AI systems and ensure they meet quality and ethical standards before deployment.
More about Generative Ai Testing jobs
What cities are hiring for Generative Ai Testing jobs? Cities with the most Generative Ai Testing job openings:
What states have the most Generative Ai Testing jobs? States with the most job openings for Generative Ai Testing jobs include:
What job categories do people searching Generative Ai Testing jobs look for? The top searched job categories for Generative Ai Testing jobs are:
Generative Ai Testing jobs near you
Infographic showing various Generative Ai Testing job openings in the United States as of August 2026, with employment types broken down into 1% As Needed, 85% Full Time, 9% Part Time, 4% Contract, and 1% Nights. Highlights an 89% Physical, 2% Hybrid, and 9% Remote job distribution, with an average salary of $111,750 per year, or $53.7 per hour.

AI Agentic Tester

Delan Associates, Inc

Denver, MO • Remote

Contractor

Posted 5 days ago

Job description

AI Agentic Tester

Denver, MO (Remote)


Must-Have Skills

AI Agentic Testing

Functional Testing

Generative AI Testing

Large Language Models (LLMs)

AI Agents & Agentic AI

Retrieval-Augmented Generation (RAG)

Prompt Engineering Validation

AI Model Validation & Evaluation

API Testing (Postman, REST APIs, Swagger)

Python

Test Automation (Selenium / Playwright / PyTest)

AI Evaluation Metrics (Accuracy, Hallucination, Relevance, Consistency)

End-to-End Workflow Testing

Multi-Agent Testing

Azure OpenAI / AWS Bedrock / Gemini

Core Responsibilities

Perform functional testing of AI agent workflows and end-to-end AI applications.

Validate LLM responses for accuracy, relevance, consistency, and hallucination rates.

Test RAG pipelines, prompt engineering, and AI agent orchestration.

Execute API testing using Postman, Swagger, and REST APIs.

Develop and maintain automation scripts using Python, Selenium, Playwright, or PyTest.

Validate multi-agent interactions, tool calling, and workflow execution.

Apply AI testing methodologies and evaluation metrics to ensure response quality.

  • W
    • ork with Azure OpenAI, AWS Bedrock, Gemini, or similar AI platforms to validate AI solutions.

    Employment Type: CONTRACTOR

    Apply