ZipRecruiter

Log In

1

Ai Prompt Tester Jobs in Raleigh, NC (NOW HIRING)

Sproutai

AI Builder - Product Analyst

Raleigh, NC · On-site

$70 - $95/hr

Design and manage prompt testing systems with comprehensive performance tracking * Craft and ... Stay current with AI product best practices and evaluation methodologies while documenting insights ...

Envestnet

Lead AI Quality Assurance Engineer

Raleigh, NC · Hybrid

$125K/yr

Experience with automated testing frameworks, API testing, model evaluation, prompt testing, hallucination testing, data quality validation, AI governance controls, and regulatory, security, privacy ...

Envestnet

Lead AI Quality Assurance Engineer

Raleigh, NC · Hybrid

$125K/yr

Experience with automated testing frameworks, API testing, model evaluation, prompt testing, hallucination testing, data quality validation, AI governance controls, and regulatory, security, privacy ...

Envestnet

Lead AI Quality Assurance Engineer

Raleigh, NC · Hybrid

$125K/yr

Experience with automated testing frameworks, API testing, model evaluation, prompt testing, hallucination testing, data quality validation, AI governance controls, and regulatory, security, privacy ...

Itron, Inc

AI Developer

Raleigh, NC · On-site

Build and maintain AI solutions leveraging Azure AI Foundry, including model selection, prompt ... Build CI/CD pipelines that support automated testing, security scanning, and deployments to Azure.

Northern Base

AI Solution Lead

Cary, NC · On-site

... prompt engineering, and context engineering ✔ Experience packaging, deploying, serving, and ... automated testing, observability, monitoring, and Service Level Objectives (SLOs) ✔ Strong ...

Verizon

Principal AI Red Team Operator

Cary, NC · On-site

You will lead the development of testing frameworks, playbooks, toolsets, and metrics that scale ... Experience using other than prompt strategies to compromise AI systems (data poisoning, embedding ...

next page

Showing results 1-20

All JobsAi Prompt Tester JobsAi Prompt Tester Jobs in Raleigh, NC

Ai Prompt Tester information

See Raleigh, NC salary details

$13

$17

$21

How much do ai prompt tester jobs pay per hour?

As of Sep 5, 2026, the average hourly pay for ai prompt tester in Raleigh, NC is $17.78, according to ZipRecruiter salary data. Most workers in this role earn between $15.87 and $19.38 per hour, depending on experience, location, and employer.

What is an AI prompt tester?

An AI Prompt Tester evaluates and refines AI-generated responses by testing different prompts to ensure accuracy, relevance, and coherence. They analyze outputs, identify inconsistencies, and provide feedback to improve AI models. This role requires critical thinking, attention to detail, and a strong understanding of AI behavior. It is commonly used in AI development, chatbots, and content generation systems.

What are the key skills and qualifications needed to thrive as an AI prompt tester?

To thrive as an AI Prompt Tester, you need a strong grasp of language comprehension, analytical thinking, and familiarity with AI-driven content generation platforms. Experience using tools like GPT-based interfaces, prompt management systems, and possibly certifications in machine learning or natural language processing can be advantageous. Attention to detail, problem-solving, and effective communication are valuable soft skills in this role. These skills are crucial for ensuring high-quality, relevant AI outputs and facilitating continuous improvements in AI prompt performance.

What are some typical challenges an AI prompt tester faces on the job?

AI Prompt Testers often encounter challenges such as ensuring prompt accuracy across diverse contexts, identifying subtle biases or inconsistencies in AI-generated outputs, and adapting to frequent software updates or changes in model behavior. They may need to balance thorough testing with efficiency under tight deadlines, and clearly communicate feedback to developers or product teams. Tackling these challenges requires strong analytical skills, adaptability, and close collaboration with cross-functional teams to help improve product quality and user experience.

How do I become an AI prompt tester?

To become an AI prompt tester, you should have strong language skills, an understanding of AI and machine learning concepts, and experience with writing or editing prompts. Familiarity with AI tools and platforms, along with attention to detail, is essential for evaluating and improving AI responses. Gaining relevant experience through online courses or freelance projects can also help establish credibility in this role.

How do you become an AI prompt tester?

To become an AI prompt tester, you typically need strong language skills, familiarity with AI language models, and attention to detail. Gaining experience through online courses, practicing prompt creation, and understanding AI behavior can improve your chances. Some roles may require basic knowledge of programming or specific tools used in AI development.

What are popular job titles related to Ai Prompt Tester jobs in Raleigh, NC?

For Ai Prompt Tester jobs in Raleigh, NC, the most frequently searched job titles are:

What job categories do people searching Ai Prompt Tester jobs in Raleigh, NC look for?

The top searched job categories for Ai Prompt Tester jobs in Raleigh, NC are:

What cities near Raleigh, NC are hiring for Ai Prompt Tester jobs?

Cities near Raleigh, NC with the most Ai Prompt Tester job openings:

Ai Prompt Tester jobs near you
Infographic showing various Ai Prompt Tester job openings in Raleigh, NC as of August 2026, with employment types broken down into 4% Internship, 48% Full Time, 7% Part Time, and 41% Contract. Highlights an 67% In-person, 10% Hybrid, and 23% Remote job distribution, with an average salary of $36,977 per year, or $17.8 per hour.

AI Prompt Engineer - Raleigh, Nc

Motion Recruitment Partners, LLC

Raleigh, NC • On-site

Other

Medical, Dental, Vision, Retirement, PTO

Posted 24 days ago

Job description


An enterprise cybersecurity group in Raleigh is seeking an AI Prompt Engineer to help expand an emerging security program centered around generative AI. The organization is evaluating advanced AI models from a security perspective and developing new ways to use generative models as part of automated security assessment, application testing, and vulnerability research.
This engineer will create sophisticated prompt-based testing workflows designed to make AI models perform targeted cyber analysis. Rather than focusing on basic chatbot prompting, the position involves developing reusable AI harnesses capable of providing the model with the proper context, instructions, and testing logic for activities including static and dynamic security testing, network exposure analysis, penetration-testing scenarios, port discovery, and certificate abuse detection.
Required Skills & Experience
  • Hands-on background designing sophisticated prompt strategies for generative AI
  • Practical cybersecurity knowledge, including attack surfaces, vulnerabilities, malicious behavior, and network traffic concepts
  • Software engineering or application development experience in languages such as Python, Go, C#, .NET, or similar
  • Ability to construct multi-step or context-rich LLM workflows rather than simple single prompts
  • Familiarity with one or more modern generative AI/model platforms
  • Experience storing, querying, or manipulating data using PostgreSQL, Elasticsearch, Cloud SQL, or related databases
  • Strong ability to explain previous AI projects, experimentation methods, and technical design decisions

Desired Skills & Experience
  • Exposure to application security and automated code-security testing
  • Background in offensive security, penetration testing, or vulnerability research
  • Familiarity with containerized or cloud-hosted applications
  • Experience with GKE or Kubernetes
  • Previous work evaluating the behavior or security of large language models
  • Experience operating in a research-oriented engineering environment

What You Will Be Doing
Daily Responsibilities
  • Engineer reusable prompt workflows that support AI-assisted security assessments
  • Create testing scenarios that push models to investigate applications, infrastructure, and potential attack surfaces
  • Develop prompting approaches for static and dynamic application-security analysis
  • Evaluate network, port, perimeter, and certificate-related security scenarios through GenAI workflows
  • Run experiments against different model providers and compare model behavior and effectiveness
  • Continuously adjust instructions, context, and harness logic based on testing results
  • Coordinate with data engineers so security output can be normalized, persisted, and analyzed downstream
  • Share actionable AI-discovered issues with threat-hunting and security-response teams

The Offer
  • Contract opportunity
  • Competitive hourly compensation

You will receive the following benefits:
  • Medical Insurance
  • Dental Benefits
  • Vision Benefits
  • Paid Time Off (PTO)
  • 401(k)

Applicants must be currently authorized to work in the US on a full-time basis now and in the future.

Apply