1

Generative Ai Testing Jobs in Raleigh, NC (NOW HIRING)

... code, testing techniques, and support activities to enrich the knowledge base and assist other ... and generative AI. • Experience in Optimizing and adapting prompt engineering strategies to ...

Senior AI Scientist

Durham, NC · Remote

$88K - $120K/yr

... Generative AI systems, with a primary focus on Large Language Models (LLMs) and agentic AI ... A/B testing and canary releases * Production monitoring and model drift detection * Enable ...

Senior AI Scientist

Durham, NC · On-site

$88K - $120K/yr

... Generative AI systems, with a primary focus on Large Language Models (LLMs) and agentic AI ... A/B testing and canary releases * Production monitoring and model drift detection * Enable ...

Senior AI Scientist

Durham, NC · Remote

$88K - $120K/yr

... Generative AI systems, with a primary focus on Large Language Models (LLMs) and agentic AI ... A/B testing and canary releases * Production monitoring and model drift detection * Enable ...

AI ML Engineer with LLM & AWS Integration

Raleigh, NC · On-site

$101K - $136K/yr

... code, testing techniques, and support activities to enrich the knowledge base and assist other ... LLMs and generative AI. • Experience with developing and deploying AI Agents for business ...

... model testing and validation, selecting the best-performing algorithms based on statistical and ... TensorFlow, PyTorch, LangChain • Expertise in Generative AI, including: RAG (Retrieval-Augmented ...

Product Manager

Chapel Hill, NC · On-site +1

$115K - $140K/yr

Identify and evaluate opportunities to apply generative AI, large language models, and other ... Experience with experimentation frameworks (A/B testing, feature flagging) and data pipelines.

Support pilots, user testing, training, deployment, and adoption in partnership with functional ... Working knowledge of generative AI, large language models, copilots, agents, prompt/agent design ...

next page

Showing results 1-20

Generative Ai Testing information

See Raleigh, NC salary details

$31

$52

$74

How much do generative ai testing jobs pay per hour?

As of Jun 9, 2026, the average hourly pay for generative ai testing in Raleigh, NC is $52.23, according to ZipRecruiter salary data. Most workers in this role earn between $42.98 and $59.81 per hour, depending on experience, location, and employer.

What is the difference between Generative Ai Testing vs Data Scientist?

AspectGenerative Ai TestingData Scientist
Required CredentialsKnowledge of AI models, testing tools, programming skillsStatistics, programming, data analysis certifications
Work EnvironmentAI development teams, testing labs, tech companiesResearch labs, tech firms, finance, healthcare
Employer & Industry UsageAI product testing, quality assurance in techData analysis, predictive modeling across industries

Generative Ai Testing focuses on evaluating and validating AI-generated content and models, ensuring quality and accuracy. Data Scientists analyze data, build models, and derive insights. While both roles require programming and AI knowledge, Generative Ai Testing emphasizes testing processes, whereas Data Scientists focus on data analysis and model development.

What are the key skills and qualifications needed to thrive as a Generative AI Testing Specialist, and why are they important?

To thrive as a Generative AI Testing Specialist, you need a robust understanding of machine learning principles, model evaluation techniques, and a background in computer science or a related field. Familiarity with tools such as Python, TensorFlow, PyTorch, and model evaluation frameworks, as well as experience with automated testing platforms, is typically required. Analytical thinking, attention to detail, and strong communication skills help you identify model weaknesses and collaborate effectively with development teams. These skills are crucial to ensure the reliability, safety, and ethical deployment of generative AI solutions.

What are some common challenges faced when testing generative AI models, and how can I prepare to address them in this role?

Testing generative AI models often involves unique challenges such as evaluating the quality and relevance of generated content, detecting bias or inappropriate outputs, and ensuring model consistency across various prompts. You may work closely with data scientists and engineers to create robust evaluation frameworks and develop automated as well as manual testing strategies. Familiarity with prompt engineering, statistical evaluation techniques, and domain-specific knowledge will help you address these challenges effectively. Proactively staying updated on industry best practices and collaborating with cross-functional teams are key to success in this dynamic field.

What is Generative AI Testing?

Generative AI Testing refers to the process of evaluating and validating AI systems, particularly those that generate content such as text, images, or code. This type of testing focuses on assessing the accuracy, reliability, fairness, and safety of generative models to ensure they function as intended and avoid producing harmful or biased outputs. Testers use various methods, including automated and manual techniques, to check for issues like hallucinations, inappropriate content, or security vulnerabilities. The goal is to build trust in generative AI systems and ensure they meet quality and ethical standards before deployment.
What are popular job titles related to Generative Ai Testing jobs in Raleigh, NC? For Generative Ai Testing jobs in Raleigh, NC, the most frequently searched job titles are:
What job categories do people searching Generative Ai Testing jobs in Raleigh, NC look for? The top searched job categories for Generative Ai Testing jobs in Raleigh, NC are:
AI/ML Engineer with Generative AI

AI/ML Engineer with Generative AI

Infosys

Raleigh, NC • On-site

Full-time

Posted 6 days ago


Infosys rating

7.5

Company rating: 7.5 out of 10

Based on 58 frontline employees who took The Breakroom Quiz

96th of 203 rated it services


Job description

Job Summary:
Infosys is a global leader in next-generation digital services and consulting. The AI/ML Engineer role focuses on leveraging advanced technologies such as generative AI to drive digital transformation for financial institutions, contributing to software solutions and maintaining system stability.
Responsibilities:
• Contribute to the requirements elicitation process by documenting assigned parts of business requirements, in line with guidance provided
• Facilitate software application design discussions, and document design decisions to guide the technical team towards building software solutions
• Participate in coding and integrate new features or updates into existing applications, with a focus on maintaining system stability
• Conduct code reviews, do changes to the codebase and maintain code repositories
• Implement test strategies, analyse results, and coordinate bug fixes to uphold the software quality standards
• Develop user training programs, documentation, and support frameworks to ensure a smooth transition to new software applications
• Actively participate in resolving production issues and recommend preventive strategies to enhance system reliability
• Maintain detailed records of code, testing techniques, and support activities to enrich the knowledge base and assist other similar projects
Qualifications:
Required:
• Experience in design, develop, and fine-tune machine learning models, particularly those involving LLMs and generative AI.
• Experience in Optimizing and adapting prompt engineering strategies to improve model performance and relevance.
• Experience in Integrate and deploy models using AWS services including Bedrock, S3, ECS, EC2, Lambda and other AI/ML related services.
• Experience in build and maintain scalable data pipelines and APIs to support ML workflows.
• Experience in monitoring model performance and iterate based on feedback and metrics.
• Experience with LLMs (e.g., OpenAI, Anthropic, Cohere) and prompt engineering.
• Experience with AWS services, especially Bedrock, S3, EC2, and Lambda Familiarity with MLOps practices and tools for model deployment and monitoring.
• Experience with AWS SageMaker for model development and model deployment.
• Experience in Understanding of quantitative/statistical/ML/AI modeling methodologies.
• Experience in ML engineering, including hands-on experience with Generative AI/LLMs.
• Experience with developing and deploying AI Agents for business problems.
• Bachelor’s degree or foreign equivalent required from an accredited institution. Will also consider three years of progressive experience in the specialty in lieu of every year of education.
• This position may require relocation and/or travel to work/project location.
• Candidates authorized to work for any employer in the United States without employer-based visa sponsorship are welcome to apply. Infosys is unable to provide immigration sponsorship for this role now or in the future.
Preferred:
• Experience in Python and ML libraries (e.g., TensorFlow, Py Torch, scikit-learn).
• Experience with Programming skills in data analytics related languages and libraries, such as Python, R, Pandas, or JavaScript.
Company:
Infosys is a technology company that offers consulting, outsourcing, cloud infrastructure, program management, and software services. Founded in 1981, the company is headquartered in Bangalore, IND, with a team of 10001+ employees. The company is currently Late Stage.

What Infosys employees say

Pay

Benefits

Hours and flexibility

Workplace

Get the full story on Breakroom