ZipRecruiter

Log In

1

Ai Prompt Tester Jobs in Raleigh, NC (NOW HIRING)

Cherry Bekaert

AI Prompt and Skills Engineer

Raleigh, NC · On-site

$70K - $90K/yr

The Prompt + Skills Engineer is the hands-on builder in Cherry Bekaert's AI Center of Excellence ... Conducts quality assurance testing on AI outputs, including accuracy validation, edge case testing ...

Cherry Bekaert

AI Prompt and Skills Engineer

Raleigh, NC · On-site +1

$70K - $90K/yr

The Prompt + Skills Engineer is the hands-on builder in Cherry Bekaert's AI Center of Excellence ... Conducts quality assurance testing on AI outputs, including accuracy validation, edge case testing ...

Itron, Inc

AI Developer

Raleigh, NC · On-site

Build and maintain AI solutions leveraging Azure AI Foundry, including model selection, prompt ... Build CI/CD pipelines that support automated testing, security scanning, and deployments to Azure.

Itron, Inc.

AI Developer

Raleigh, NC · On-site

Build and maintain AI solutions leveraging Azure AI Foundry, including model selection, prompt ... Build CI/CD pipelines that support automated testing, security scanning, and deployments to Azure.

Northern Base

AI Solution Lead

Cary, NC · On-site

... prompt engineering, and context engineering ✔ Experience packaging, deploying, serving, and ... automated testing, observability, monitoring, and Service Level Objectives (SLOs) ✔ Strong ...

Amphenol TCS

AI Lead

Raleigh, NC · On-site

Define reusable AI solution patterns, prompt/agent design standards, solution templates ... Support pilots, user testing, training, deployment, and adoption in partnership with functional ...

Lindsay & Brownell

AI Engineer

Raleigh, NC · On-site

Optimize performance and cost through testing, profiling, and tuning of inference infrastructure ... Prompt flow, automation pipelines, and human-in-the-loop systems * Post-Training Techniques: Fine ...

next page

Showing results 1-20

All JobsAi Prompt Tester JobsAi Prompt Tester Jobs in Raleigh, NC

Ai Prompt Tester information

See Raleigh, NC salary details

$13

$17

$21

How much do ai prompt tester jobs pay per hour?

As of Aug 10, 2026, the average hourly pay for ai prompt tester in Raleigh, NC is $17.78, according to ZipRecruiter salary data. Most workers in this role earn between $15.87 and $19.38 per hour, depending on experience, location, and employer.

What are some typical challenges an AI prompt tester faces on the job?

AI Prompt Testers often encounter challenges such as ensuring prompt accuracy across diverse contexts, identifying subtle biases or inconsistencies in AI-generated outputs, and adapting to frequent software updates or changes in model behavior. They may need to balance thorough testing with efficiency under tight deadlines, and clearly communicate feedback to developers or product teams. Tackling these challenges requires strong analytical skills, adaptability, and close collaboration with cross-functional teams to help improve product quality and user experience.

What are the key skills and qualifications needed to thrive as an AI prompt tester?

To thrive as an AI Prompt Tester, you need a strong grasp of language comprehension, analytical thinking, and familiarity with AI-driven content generation platforms. Experience using tools like GPT-based interfaces, prompt management systems, and possibly certifications in machine learning or natural language processing can be advantageous. Attention to detail, problem-solving, and effective communication are valuable soft skills in this role. These skills are crucial for ensuring high-quality, relevant AI outputs and facilitating continuous improvements in AI prompt performance.

How do I become an AI Prompt Tester?

To become an AI Prompt Tester, you should develop strong language and communication skills, understand how AI language models work, and gain experience with prompt creation and evaluation. Familiarity with AI tools, attention to detail, and the ability to provide clear feedback are essential. Some roles may require a background in computer science, linguistics, or related fields, and testing often involves working with specific platforms or software environments.

How do you become an AI Prompt Tester?

To become an AI Prompt Tester, candidates typically need strong language skills, creativity, and familiarity with AI language models. Gaining experience with prompt engineering, understanding AI behavior, and working with relevant tools or platforms can improve chances. Some roles may require a background in computer science or related fields, along with attention to detail and problem-solving skills.

What is an AI prompt tester?

An AI Prompt Tester evaluates and refines AI-generated responses by testing different prompts to ensure accuracy, relevance, and coherence. They analyze outputs, identify inconsistencies, and provide feedback to improve AI models. This role requires critical thinking, attention to detail, and a strong understanding of AI behavior. It is commonly used in AI development, chatbots, and content generation systems.

What are popular job titles related to Ai Prompt Tester jobs in Raleigh, NC? For Ai Prompt Tester jobs in Raleigh, NC, the most frequently searched job titles are:
What job categories do people searching Ai Prompt Tester jobs in Raleigh, NC look for? The top searched job categories for Ai Prompt Tester jobs in Raleigh, NC are:
What cities near Raleigh, NC are hiring for Ai Prompt Tester jobs? Cities near Raleigh, NC with the most Ai Prompt Tester job openings:
Ai Prompt Tester jobs near you
Infographic showing various Ai Prompt Tester job openings in Raleigh, NC as of August 2026, with employment types broken down into 5% Internship, 83% Full Time, and 12% Contract. Highlights an 77% In-person, 5% Hybrid, and 18% Remote job distribution, with an average salary of $36,977 per year, or $17.8 per hour.

AI Prompt Engineer - Raleigh, Nc

Motion Recruitment

Raleigh, NC • On-site

Other

Medical, Dental, Vision, Retirement, PTO

Posted 3 days ago

New

Job description

Job Description

An enterprise cybersecurity group in Raleigh is seeking an AI Prompt Engineer to help expand an emerging security program centered around generative AI. The organization is evaluating advanced AI models from a security perspective and developing new ways to use generative models as part of automated security assessment, application testing, and vulnerability research.

This engineer will create sophisticated prompt-based testing workflows designed to make AI models perform targeted cyber analysis. Rather than focusing on basic chatbot prompting, the position involves developing reusable AI harnesses capable of providing the model with the proper context, instructions, and testing logic for activities including static and dynamic security testing, network exposure analysis, penetration-testing scenarios, port discovery, and certificate abuse detection.

Required Skills & Experience

  • Hands-on background designing sophisticated prompt strategies for generative AI

  • Practical cybersecurity knowledge, including attack surfaces, vulnerabilities, malicious behavior, and network traffic concepts

  • Software engineering or application development experience in languages such as Python, Go, C#, .NET, or similar

  • Ability to construct multi-step or context-rich LLM workflows rather than simple single prompts

  • Familiarity with one or more modern generative AI/model platforms

  • Experience storing, querying, or manipulating data using PostgreSQL, Elasticsearch, Cloud SQL, or related databases

  • Strong ability to explain previous AI projects, experimentation methods, and technical design decisions

Desired Skills & Experience

  • Exposure to application security and automated code-security testing

  • Background in offensive security, penetration testing, or vulnerability research

  • Familiarity with containerized or cloud-hosted applications

  • Experience with GKE or Kubernetes

  • Previous work evaluating the behavior or security of large language models

  • Experience operating in a research-oriented engineering environment

What You Will Be Doing

Daily Responsibilities

  • Engineer reusable prompt workflows that support AI-assisted security assessments

  • Create testing scenarios that push models to investigate applications, infrastructure, and potential attack surfaces

  • Develop prompting approaches for static and dynamic application-security analysis

  • Evaluate network, port, perimeter, and certificate-related security scenarios through GenAI workflows

  • Run experiments against different model providers and compare model behavior and effectiveness

  • Continuously adjust instructions, context, and harness logic based on testing results

  • Coordinate with data engineers so security output can be normalized, persisted, and analyzed downstream

  • Share actionable AI-discovered issues with threat-hunting and security-response teams

The Offer

  • Contract opportunity

  • Competitive hourly compensation

You will receive the following benefits:

  • Medical Insurance

  • Dental Benefits

  • Vision Benefits

  • Paid Time Off (PTO)

  • 401(k)

Applicants must be currently authorized to work in the US on a full-time basis now and in the future.

Apply