Hartford, CT · On-site
AI Testing Jira Java Selenium Top skills required for this role: 1. Agent AI - Prompt Generation 2. Selenium Automation 3. AI tools for testing / Responsibilities/ Years of experience * Minimum of 5+ ...
Quick apply
Hartford, CT · On-site
AI Testing Jira Java Selenium Top skills required for this role: 1. Agent AI - Prompt Generation 2. Selenium Automation 3. AI tools for testing / Responsibilities/ Years of experience * Minimum of 5+ ...
... AI Prompt Engineer in Minneapolis ... The group is exploring how frontier language models can be incorporated into cybersecurity testing ...
... AI Prompt Engineer in Minneapolis ... The group is exploring how frontier language models can be incorporated into cybersecurity testing ...
Projects may involve application scanning, simulated offensive testing, external attack-surface ... Experience creating AI-driven workflows, orchestration logic, or prompt-based tooling * Database ...
Projects may involve application scanning, simulated offensive testing, external attack-surface ... Experience creating AI-driven workflows, orchestration logic, or prompt-based tooling * Database ...
Projects may involve application scanning, simulated offensive testing, external attack-surface ... Experience creating AI-driven workflows, orchestration logic, or prompt-based tooling * Database ...
Projects may involve application scanning, simulated offensive testing, external attack-surface ... Experience creating AI-driven workflows, orchestration logic, or prompt-based tooling * Database ...
Chandler, AZ · On-site
$76.14 - $85.80/hr
Hands-on experience developing AI frameworks, prompt orchestration solutions, or AI testing harnesses * Strong knowledge of Generative AI technologies and frontier LLM platforms * Background in ...
Chandler, AZ · On-site
$76.14 - $85.80/hr
Hands-on experience developing AI frameworks, prompt orchestration solutions, or AI testing harnesses * Strong knowledge of Generative AI technologies and frontier LLM platforms * Background in ...
A large enterprise organization is hiring an AI Prompt Engineer to join a GenAI security research ... You will apply advanced prompting techniques to areas such as penetration-style testing, perimeter ...
A large enterprise organization is hiring an AI Prompt Engineer to join a GenAI security research ... You will apply advanced prompting techniques to areas such as penetration-style testing, perimeter ...
A large enterprise organization is hiring an AI Prompt Engineer to join a GenAI security research ... You will apply advanced prompting techniques to areas such as penetration-style testing, perimeter ...
A large enterprise organization is hiring an AI Prompt Engineer to join a GenAI security research ... You will apply advanced prompting techniques to areas such as penetration-style testing, perimeter ...
Miami, FL · On-site
$110 - $170/hr
... of AI by protecting GenAI and agentic systems at the prompt and tool‑invocation layer. This ... testing, and CI/CD. Working knowledge of GenAI/LLM and agentic design patterns and protocols ...
Miami, FL · On-site
$110 - $170/hr
... of AI by protecting GenAI and agentic systems at the prompt and tool‑invocation layer. This ... testing, and CI/CD. Working knowledge of GenAI/LLM and agentic design patterns and protocols ...
Oversee structured A/B testing initiatives and data analysis to iteratively optimize agent ... AI, Large Language Models (LLMs), and deep prompt engineering strategies within an enterprise AWS ...
Quick apply
Oversee structured A/B testing initiatives and data analysis to iteratively optimize agent ... AI, Large Language Models (LLMs), and deep prompt engineering strategies within an enterprise AWS ...
Austin, TX · On-site +1
... testing. * Share insights and learnings with the broader product and AI teams. Requirements ... Strong skills in prompt engineering techniques (e.g., few-shot, chain-of-thought, RAG pipelines)
Austin, TX · On-site +1
... testing. * Share insights and learnings with the broader product and AI teams. Requirements ... Strong skills in prompt engineering techniques (e.g., few-shot, chain-of-thought, RAG pipelines)
Austin, TX · On-site
... testing. * Share insights and learnings with the broader product and AI teams. Requirements ... Strong skills in prompt engineering techniques (e.g., few-shot, chain-of-thought, RAG pipelines)
Quick apply
Austin, TX · On-site
... testing. * Share insights and learnings with the broader product and AI teams. Requirements ... Strong skills in prompt engineering techniques (e.g., few-shot, chain-of-thought, RAG pipelines)
Prompt design & iteration for generative AI systems -- 2+ years (or equivalent hands-on experience ... Analytical problem solving (testing outputs, identifying failure patterns, improving systems) -- 2+ ...
Quick apply
Prompt design & iteration for generative AI systems -- 2+ years (or equivalent hands-on experience ... Analytical problem solving (testing outputs, identifying failure patterns, improving systems) -- 2+ ...
OR · On-site +1
We are seeking three WEM AQM Prompt Engineers to join this new capability team. These roles sit at ... and applied AI - designing, testing, and optimizing the LLM prompts that power Five9 AQM ...
OR · On-site +1
We are seeking three WEM AQM Prompt Engineers to join this new capability team. These roles sit at ... and applied AI - designing, testing, and optimizing the LLM prompts that power Five9 AQM ...
Familiarity with AI security testing tools, red team prompt testing suites, agent behavior analyzers, and LLM evaluation frameworks. * Ability to evaluate AI system behavior for hallucinations ...
Familiarity with AI security testing tools, red team prompt testing suites, agent behavior analyzers, and LLM evaluation frameworks. * Ability to evaluate AI system behavior for hallucinations ...
Austin, TX · On-site
$110 - $170/hr
... testing. * Share insights and learnings with the broader product and AI teams. Requirements ... Strong skills in prompt engineering techniques (e.g., few-shot, chain-of-thought, RAG pipelines)
Austin, TX · On-site
$110 - $170/hr
... testing. * Share insights and learnings with the broader product and AI teams. Requirements ... Strong skills in prompt engineering techniques (e.g., few-shot, chain-of-thought, RAG pipelines)
$110 - $170/hr
... testing. * Share insights and learnings with the broader product and AI teams. Requirements ... Strong skills in prompt engineering techniques (e.g., few-shot, chain-of-thought, RAG pipelines)
$110 - $170/hr
... testing. * Share insights and learnings with the broader product and AI teams. Requirements ... Strong skills in prompt engineering techniques (e.g., few-shot, chain-of-thought, RAG pipelines)
Experience with LLM observability and eval tooling - Confident AI, LangFuse, LangSmith, or similar ... Experience with red teaming or adversarial prompt testing * Understanding of prompt injection risks ...
Experience with LLM observability and eval tooling - Confident AI, LangFuse, LangSmith, or similar ... Experience with red teaming or adversarial prompt testing * Understanding of prompt injection risks ...
Familiarity with AI security testing tools, red team prompt testing suites, agent behavior analyzers, and LLM evaluation frameworks. * Ability to evaluate AI system behavior for hallucinations ...
Familiarity with AI security testing tools, red team prompt testing suites, agent behavior analyzers, and LLM evaluation frameworks. * Ability to evaluate AI system behavior for hallucinations ...
Arlington, VA · On-site
$82K - $184K/yr
Familiarity with AI security testing tools, red team prompt testing suites, agent behavior analyzers, and LLM evaluation frameworks. * Ability to evaluate AI system behavior for hallucinations ...
Arlington, VA · On-site
$82K - $184K/yr
Familiarity with AI security testing tools, red team prompt testing suites, agent behavior analyzers, and LLM evaluation frameworks. * Ability to evaluate AI system behavior for hallucinations ...
Denver, MO · On-site +1
Test RAG pipelines, prompt engineering, and AI agent orchestration. Execute API testing using Postman, Swagger, and REST APIs. Develop and maintain automation scripts using Python, Selenium ...
Denver, MO · On-site +1
Test RAG pipelines, prompt engineering, and AI agent orchestration. Execute API testing using Postman, Swagger, and REST APIs. Develop and maintain automation scripts using Python, Selenium ...
$14.18 - $14.90
4% of jobs
$14.90 - $15.63
13% of jobs
$16.18 is the 25th percentile. Wages below this are outliers.
$15.63 - $16.35
11% of jobs
$16.35 - $17.07
7% of jobs
$17.07 - $17.79
7% of jobs
The median wage is $18.24 / hr.
$17.79 - $18.51
13% of jobs
$18.51 - $19.23
13% of jobs
$19.75 is the 75th percentile. Wages above this are outliers.
$19.23 - $19.95
11% of jobs
$19.95 - $20.67
8% of jobs
$20.67 - $21.39
7% of jobs
$21.39 - $22.12
6% of jobs
$14
$18
$22
An AI Prompt Tester evaluates and refines AI-generated responses by testing different prompts to ensure accuracy, relevance, and coherence. They analyze outputs, identify inconsistencies, and provide feedback to improve AI models. This role requires critical thinking, attention to detail, and a strong understanding of AI behavior. It is commonly used in AI development, chatbots, and content generation systems.
To thrive as an AI Prompt Tester, you need a strong grasp of language comprehension, analytical thinking, and familiarity with AI-driven content generation platforms. Experience using tools like GPT-based interfaces, prompt management systems, and possibly certifications in machine learning or natural language processing can be advantageous. Attention to detail, problem-solving, and effective communication are valuable soft skills in this role. These skills are crucial for ensuring high-quality, relevant AI outputs and facilitating continuous improvements in AI prompt performance.
AI Prompt Testers often encounter challenges such as ensuring prompt accuracy across diverse contexts, identifying subtle biases or inconsistencies in AI-generated outputs, and adapting to frequent software updates or changes in model behavior. They may need to balance thorough testing with efficiency under tight deadlines, and clearly communicate feedback to developers or product teams. Tackling these challenges requires strong analytical skills, adaptability, and close collaboration with cross-functional teams to help improve product quality and user experience.
Cities with the most Ai Prompt Tester job openings:
States with the most job openings for Ai Prompt Tester jobs include:
The top searched job categories for Ai Prompt Tester jobs are:
Sourced by ZipRecruiter
It services
51 - 200 Employees
Princeton, NJ, US
