ZipRecruiter

Log In

1

Generative Ai Testing Jobs (NOW HIRING)

Peraton

Generative AI Engineering Intern (Graduate)

$17.25 - $22.25/hr

Support prompt engineering efforts including designing, testing, and refining prompts to improve ... Conduct research on emerging generative AI techniques, foundation models, and best practices ...

Johnson & Johnson

Data and Generative AI Engineer

Raritan, NJ · On-site

$117K - $140K/yr

Design, develop and deliver Generative/Agentic AI solutions that accelerate End-to-End Data ... Ensure data quality and integrity through meticulous testing and validation, applying Intelligent ...

Cotiviti

$32 - $40/hr

Conduct research on Agentic AI models and their potential impact on healthcare workflows and decision-making. * Assist in designing, developing, and testing autonomous AI agents and generative AI ...

Cotiviti

Intern - Generative AI/Agentic AI/Research

$32 - $40/hr

Conduct research on Agentic AI models and their potential impact on healthcare workflows and decision-making. * Assist in designing, developing, and testing autonomous AI agents and generative AI ...

Jj

Data and Generative AI Engineer

New Brunswick, NJ

$118K - $141K/yr

Design, develop and deliver Generative/Agentic AI solutions that accelerate End-to-End Data ... Ensure data quality and integrity through meticulous testing and validation, applying Intelligent ...

Jj

Data and Generative AI Engineer

Raritan, NJ

$117K - $140K/yr

Design, develop and deliver Generative/Agentic AI solutions that accelerate End-to-End Data ... Ensure data quality and integrity through meticulous testing and validation, applying Intelligent ...

next page

Showing results 1-20

All JobsGenerative Ai Testing Jobs

Generative Ai Testing information

See salary details

$31

$53

$76

How much do generative ai testing jobs pay per hour?

As of Jul 21, 2026, the average hourly pay for generative ai testing in the United States is $53.73, according to ZipRecruiter salary data. Most workers in this role earn between $44.23 and $61.54 per hour, depending on experience, location, and employer.

What is the difference between Generative Ai Testing vs Data Scientist?

AspectGenerative Ai TestingData Scientist
Required CredentialsKnowledge of AI models, testing tools, programming skillsStatistics, programming, data analysis certifications
Work EnvironmentAI development teams, testing labs, tech companiesResearch labs, tech firms, finance, healthcare
Employer & Industry UsageAI product testing, quality assurance in techData analysis, predictive modeling across industries

Generative Ai Testing focuses on evaluating and validating AI-generated content and models, ensuring quality and accuracy. Data Scientists analyze data, build models, and derive insights. While both roles require programming and AI knowledge, Generative Ai Testing emphasizes testing processes, whereas Data Scientists focus on data analysis and model development.

How much do AI testers get paid?

AI testers, involved in evaluating and validating generative AI models, typically earn salaries ranging from $60,000 to $120,000 annually depending on experience, location, and company size. Entry-level positions may start lower, while experienced testers with specialized skills in machine learning and data analysis can earn higher wages.

Is AI testing a good career?

AI testing, including roles like Generative AI Testing, is a growing field with increasing demand for skills in machine learning, data analysis, and software quality assurance. It offers opportunities in tech companies, research labs, and startups, often requiring knowledge of AI frameworks and testing tools. The career can be stable and rewarding for those with technical expertise and an interest in AI development.

What are the key skills and qualifications needed to thrive as a Generative AI Testing Specialist, and why are they important?

To thrive as a Generative AI Testing Specialist, you need a robust understanding of machine learning principles, model evaluation techniques, and a background in computer science or a related field. Familiarity with tools such as Python, TensorFlow, PyTorch, and model evaluation frameworks, as well as experience with automated testing platforms, is typically required. Analytical thinking, attention to detail, and strong communication skills help you identify model weaknesses and collaborate effectively with development teams. These skills are crucial to ensure the reliability, safety, and ethical deployment of generative AI solutions.

What is the salary of generative AI tester?

The salary of a generative AI tester typically ranges from $70,000 to $120,000 annually, depending on experience, location, and company size. Entry-level positions may start lower, while experienced testers with specialized skills in AI and machine learning can earn higher salaries. Certifications in AI or related fields can also influence compensation.

What are some common challenges faced when testing generative AI models, and how can I prepare to address them in this role?

Testing generative AI models often involves unique challenges such as evaluating the quality and relevance of generated content, detecting bias or inappropriate outputs, and ensuring model consistency across various prompts. You may work closely with data scientists and engineers to create robust evaluation frameworks and develop automated as well as manual testing strategies. Familiarity with prompt engineering, statistical evaluation techniques, and domain-specific knowledge will help you address these challenges effectively. Proactively staying updated on industry best practices and collaborating with cross-functional teams are key to success in this dynamic field.

How do I become an AI tester?

To become an AI tester, you should have a strong understanding of machine learning concepts, programming skills in languages like Python, and experience with data annotation and model evaluation. Familiarity with AI tools, testing frameworks, and quality assurance processes is also important. Gaining relevant certifications or training in AI and software testing can enhance your qualifications.

What is Generative AI Testing?

Generative AI Testing refers to the process of evaluating and validating AI systems, particularly those that generate content such as text, images, or code. This type of testing focuses on assessing the accuracy, reliability, fairness, and safety of generative models to ensure they function as intended and avoid producing harmful or biased outputs. Testers use various methods, including automated and manual techniques, to check for issues like hallucinations, inappropriate content, or security vulnerabilities. The goal is to build trust in generative AI systems and ensure they meet quality and ethical standards before deployment.
More about Generative Ai Testing jobs
What cities are hiring for Generative Ai Testing jobs? Cities with the most Generative Ai Testing job openings:
What states have the most Generative Ai Testing jobs? States with the most job openings for Generative Ai Testing jobs include:
What job categories do people searching Generative Ai Testing jobs look for? The top searched job categories for Generative Ai Testing jobs are:
Generative Ai Testing jobs near you
Infographic showing various Generative Ai Testing job openings in the United States as of July 2026, with employment types broken down into 100% Full Time. Highlights an 100% In-person job distribution, with an average salary of $111,750 per year, or $53.7 per hour.
Generative AI Engineering Intern (Graduate)

Generative AI Engineering Intern (Graduate)

Peraton

Remote

$17.25 - $22.25/hr

Full-time

Re-posted 14 days ago

Peraton rating

8.3

Company rating: 8.3 out of 10

Based on 56 frontline employees who took The Breakroom Quiz

41st of 210 rated it services

Job description

Responsibilities
Peraton is seeking motivated Generative AI Engineering Interns (Graduate) supporting Internal Research and Development (IRAD) initiatives focused on AI/ML-driven platforms for Operations in the Information Environment (OIE). Interns can support 100% remotely.
This open-ended graduate internship is designed to provide sustained, meaningful work experience throughout your academic program. Interns will work 40 hours per week during the summer and 20 hours per week during the academic year, with the flexibility to increase to 40 hours per week as schedules allow. In this role, you will gain hands-on experience developing and applying cutting-edge generative AI solutions, including large language models (LLMs), prompt engineering, retrieval-augmented generation (RAG), and agentic AI architectures within a defense technology environment. Working alongside senior engineers and data scientists, you will support mission-critical information operations for Combatant Commands (COCOMs) by translating operational requirements into secure, production-grade AI solutions. The role offers exposure to enterprise software development practices such as Agile, DevSecOps, and CI/CD, as well as work with classified and sensitive data in FedRAMP-compliant cloud environments using technologies including Azure OpenAI Service, AWS, Python, LangChain, LlamaIndex, Hugging Face, vector databases, Docker, and Git. This internship provides competitive hourly compensation, flexible and remote-friendly scheduling, dedicated mentorship, networking opportunities across Peraton's technical leadership, and a potential pathway to full-time employment upon graduation.
Roles and responsibilities for this position include:
  • Assist in the development and optimization of generative AI solutions using GPT-4, Claude, Gemini, and Azure OpenAI Service under the guidance of senior team members.
  • Support prompt engineering efforts including designing, testing, and refining prompts to improve LLM output quality, accuracy, and consistency.
  • Contribute to the implementation of retrieval-augmented generation (RAG) systems, including working with vector databases, embedding models, and semantic search pipelines.
  • Conduct research on emerging generative AI techniques, foundation models, and best practices, summarizing findings for the development team.
  • Assist in building evaluation frameworks and quality assurance pipelines to measure and improve AI-generated content quality.
  • Support documentation efforts including creating technical guides, API documentation, and prompt libraries.
  • Participate in code reviews, team meetings, and Agile/Scrum ceremonies to gain exposure to professional software development practices.
  • Collaborate with cross-functional teams to understand operational requirements and translate them into technical solutions.
  • Take on progressively complex responsibilities as skills develop throughout the internship tenure.

#PeratonIntern
Qualifications
Required Qualifications:
  • Currently enrolled in a Master's or Ph.D. program in Computer Science, Data Science, Artificial Intelligence, Machine Learning, Computational Linguistics, Natural Language Processing, or related technical field.
  • Completion of at least one semester of graduate coursework prior to internship start date.
  • Strong programming skills in Python, including familiarity with common data science libraries (NumPy, Pandas, scikit-learn).
  • Foundational understanding of machine learning concepts, neural networks, and natural language processing principles.
  • Exposure to large language models (LLMs) through coursework, research projects, or personal projects (e.g., using OpenAI API, Hugging Face, or similar).
  • Strong analytical and problem-solving skills with attention to detail.
  • Excellent written and verbal communication skills.
  • Ability to work both independently and collaboratively in a team environment.
  • US. Citizenship required (must be able to obtain Secret clearance).

Desired Qualifications:
  • Hands-on experience with LLM frameworks such as LangChain, LlamaIndex, or Hugging Face Transformers.
  • Experience with prompt engineering techniques including few-shot learning, chain-of-thought prompting, or structured output generation.
  • Familiarity with vector databases (Pinecone, ChromaDB, Weaviate) or embedding models for semantic search applications.
  • Experience with cloud platforms (AWS, Microsoft Azure, Google Cloud) for AI/ML development or deployment.
  • Research experience in NLP, generative AI, or related fields, including publications or conference presentations.
  • Familiarity with responsible AI principles, AI safety, and techniques for mitigating bias and hallucinations in LLM outputs.
  • Experience with version control (Git/GitHub) and collaborative development workflows.
  • Interest in defense, national security, or government technology applications.
  • Prior internship experience in software development, data science, or AI/ML roles.
  • Coursework or projects involving multimodal AI, computer vision, or reinforcement learning.

Peraton Overview
Peraton is a next-generation national security company that drives missions of consequence spanning the globe and extending to the farthest reaches of the galaxy. As the world's leading mission capability integrator and transformative enterprise IT provider, we deliver trusted, highly differentiated solutions and technologies to protect our nation and allies. Peraton operates at the critical nexus between traditional and nontraditional threats across all domains: land, sea, space, air, and cyberspace. The company serves as a valued partner to essential government agencies and supports every branch of the U.S. armed forces. Each day, our employees do the can't be done by solving the most daunting challenges facing our customers. Visit peraton.com to learn how we're keeping people around the world safe and secure.
Target Salary Range
The rate / range per hour below represents the typical salary range for this position. Salary is determined by various factors, including but not limited to, the scope and responsibilities of the position, the individual's experience, education, knowledge, skills, and competencies, as well as geographic location and business and contract considerations. Depending on the position, employees may be eligible for overtime, shift differential, and a discretionary bonus in addition to base pay.
SCA / Union / Intern Rate or Range
$35.00/hour
EEO
EEO: Equal opportunity employer, including disability and protected veterans, or other characteristics protected by law.

What Peraton employees say

Pay

Benefits

Hours and flexibility

Workplace

Get the full story on Breakroom

Peraton logo

About Peraton

Sourced by ZipRecruiter

At Peraton, we re at the forefront of delivering the next big thing every day. We re the partner of choice to help solve some of the world s most daunting challenges, delivering bold, new solutions to keep people around the world safer and more secure.

Industry

It services

Company size

10,000+ Employees

Headquarters location

Herndon, VA, US

Year founded

2017

View All Peraton Jobs

Apply