ZipRecruiter

Log In

1

Ai Prompt Tester Jobs (NOW HIRING)

1872 Consulting

AI Prompt Engineering Lead

Chicago, IL · Hybrid

$105K - $139K/yr

AI Prompt Engineering Lead Chicago, IL: Hybrid work from home: 2 days WFH, 3 days onsite in the ... Run structured prompt testing and evaluation cycles - comparing outputs across model versions ...

Team Red Dog

AI Prompt Engineer

Redmond, WA · On-site

Testing, QA & Optimization - Ability to perform unit testing, root cause analysis, quality assurance reviews, and prompt optimization to improve conversational accuracy, usability, and overall AI ...

1872 Consulting

AI Prompt Engineering Lead

Chicago, IL · Hybrid

$105K - $139K/yr

AI Prompt Engineering Lead Chicago, IL: Hybrid work from home: 2 days WFH, 3 days onsite in the ... Run structured prompt testing and evaluation cycles - comparing outputs across model versions ...

Moonfire

AI Prompt Engineer

Ashburn, VA · On-site

$61 - $122/hr

AI Prompt Engineer Job Category: Information Technology Time Type: Full time Minimum Clearance ... Conduct testing to compare prompt variations, analyze results drive continuous improvement.

CACI

AI Prompt Engineer

Ashburn, VA · Hybrid

AI Prompt Engineer Job Category: Information Technology Time Type: Full time Minimum Clearance ... Conduct testing to compare prompt variations, analyze results drive continuous improvement.

OVA.Work

AI prompt analyst

... B testing and performance evaluation of prompts • Identify edge cases, bias, hallucinations, and inconsistencies in AI responses • Document prompt strategies, learnings, and optimization ...

CACI

AI Prompt Engineer

Ashburn, VA · Hybrid

AI Prompt Engineer Job Category: Engineering Time Type: Full time Minimum Clearance Required to ... Conduct testing to compare prompt variations, analyze results drive continuous improvement.

CACI

AI Prompt Engineer

Ashburn, VA · Hybrid

AI Prompt Engineer Job Category: Information Technology Time Type: Full time Minimum Clearance ... Conduct testing to compare prompt variations, analyze results drive continuous improvement.

Ignite IT, LLC

$60 - $90/hr

Support rapid prototyping, testing, implementation, and continuous improvement of AI solutions ... Familiarity with prompt evaluation, output validation, and responsible AI practices. * 401(k) with ...

next page

Showing results 1-20

All JobsTechnology JobsSoftware JobsAi Prompt Tester Jobs

Ai Prompt Tester information

See salary details

$14

$18

$22

How much do ai prompt tester jobs pay per hour?

As of Sep 5, 2026, the average hourly pay for ai prompt tester in the United States is $18.29, according to ZipRecruiter salary data. Most workers in this role earn between $16.35 and $19.95 per hour, depending on experience, location, and employer.

What is an AI prompt tester?

An AI Prompt Tester evaluates and refines AI-generated responses by testing different prompts to ensure accuracy, relevance, and coherence. They analyze outputs, identify inconsistencies, and provide feedback to improve AI models. This role requires critical thinking, attention to detail, and a strong understanding of AI behavior. It is commonly used in AI development, chatbots, and content generation systems.

What are the key skills and qualifications needed to thrive as an AI prompt tester?

To thrive as an AI Prompt Tester, you need a strong grasp of language comprehension, analytical thinking, and familiarity with AI-driven content generation platforms. Experience using tools like GPT-based interfaces, prompt management systems, and possibly certifications in machine learning or natural language processing can be advantageous. Attention to detail, problem-solving, and effective communication are valuable soft skills in this role. These skills are crucial for ensuring high-quality, relevant AI outputs and facilitating continuous improvements in AI prompt performance.

What are some typical challenges an AI prompt tester faces on the job?

AI Prompt Testers often encounter challenges such as ensuring prompt accuracy across diverse contexts, identifying subtle biases or inconsistencies in AI-generated outputs, and adapting to frequent software updates or changes in model behavior. They may need to balance thorough testing with efficiency under tight deadlines, and clearly communicate feedback to developers or product teams. Tackling these challenges requires strong analytical skills, adaptability, and close collaboration with cross-functional teams to help improve product quality and user experience.

How do I become an AI prompt tester?

To become an AI prompt tester, you should have strong language skills, an understanding of AI and machine learning concepts, and experience with writing or editing prompts. Familiarity with AI tools and platforms, along with attention to detail, is essential for evaluating and improving AI responses. Gaining relevant experience through online courses or freelance projects can also help establish credibility in this role.

How do you become an AI prompt tester?

To become an AI prompt tester, you typically need strong language skills, familiarity with AI language models, and attention to detail. Gaining experience through online courses, practicing prompt creation, and understanding AI behavior can improve your chances. Some roles may require basic knowledge of programming or specific tools used in AI development.
More about Ai Prompt Tester jobs

What cities are hiring for Ai Prompt Tester jobs?

Cities with the most Ai Prompt Tester job openings:

What states have the most Ai Prompt Tester jobs?

States with the most job openings for Ai Prompt Tester jobs include:

What job categories do people searching Ai Prompt Tester jobs look for?

The top searched job categories for Ai Prompt Tester jobs are:

Ai Prompt Tester jobs near you
Infographic showing various Ai Prompt Tester job openings in the United States as of August 2026, with employment types broken down into 5% Internship, 41% Full Time, 5% Part Time, and 49% Contract. Highlights an 68% In-person, 9% Hybrid, and 23% Remote job distribution, with an average salary of $38,039 per year, or $18.3 per hour.

AI Prompt Engineering Lead

1872 Consulting

Chicago, IL • Hybrid

$105K - $139K/yr

Full-time

This job post has expired today. Applications are no longer accepted.

Job description

AI Prompt Engineering Lead
Chicago, IL: Hybrid work from home: 2 days WFH, 3 days onsite in the loop

Summary:

The AI Prompt Engineering Lead will drive end-to-end AI solutions, for stakeholders throughout the professional services organization, working in departments across business departments with an initial focus on legal.

You'll partner with key business stakeholders to understand existing processes, workflows, etc., recommend AI solutions to automate existing business processes, and then deliver the solutions using tools like Claude Cowork and ChatGPT Custom GPTs.

Once the tools are delivered, you'll train the business users, and drive continuous optimization based on feedback from the business users.

What you'll be doing

  • Design and maintain a library of complex, production-grade system prompts for Claude Cowork and ChatGPT Custom GPTs tailored to legal tasks: contract review, clause extraction, due diligence checklists, legal research summaries, and matter intake.
  • Build multi-step prompt workflows that chain instructions, handle conditional logic, and produce structured outputs (tables, memos, checklists) formatted for attorney consumption.
  • Configure and maintain Custom GPTs with specific instructions, knowledge file uploads (precedent packs, playbooks, style guides), and actions that connect to internal document stores and matter management systems.
  • Set up and optimise Claude Cowork automations that route tasks, process uploaded documents, and deliver AI-assisted outputs within existing team workflows.
  • Conduct deep-dive discovery sessions with practice groups to map current workflows, identify friction points, and translate attorney needs into precise AI task specifications.
  • Run structured prompt testing and evaluation cycles - comparing outputs across model versions, prompt variants, and edge cases - to maintain quality and consistency standards.
  • Deliver hands-on training sessions and workshops for attorneys and staff; build self-serve guides, prompt templates, and a prompt library they can adapt independently.
  • ct as internal expert and escalation point for AI tool questions; troubleshoot underperforming prompts and continuously refine based on user feedback.
  • Stay current on new capabilities in Claude, GPT-4o, and emerging models; proactively identify and prototype features (deep research, file analysis, voice, computer use) that add value for legal users.
  • Maintain responsible AI usage guidelines; flag prompt patterns that risk hallucination, data leakage, or outputs unsuitable for client-facing use.

Skills we're seeking

  • Bachelor's Degree, ideally in an IT, Data or Business related field
  • 5+ years of professional experience in AI, IT or Product related roles
  • 3+ years of experience in AI focused roles
  • Must have strong experience with Prompt Engineering
  • Must have strong experience with either Claude and/or ChatGPT
  • Must have strong experience partnering with business stakeholders to understand business processes, workflows, etc. and subsequently recommending solutions, documenting specific requirements and managing the delivery of AI solutions
  • Experience with Jira, Confluence or similar product management tools

Nice to haves

  • Experience with Claude Cowork
  • Experience building custom GPTs in ChatGPT
  • Experience with Jira, Confluence or similar product management tools
  • Experience building AI solutions for legal departments
1872 Consulting logo

About 1872 Consulting

Sourced by ZipRecruiter

1872 Consulting, based in Chicago, IL, USA, operates within the IT consulting industry. Armed with a diverse team of experts, the company offers specialized IT consulting services, focusing on modernizing business technologies and driving innovative business strategies. Established in 1872, the company has a rich history marked by its commitment to bridging the gap between businesses and technology. Its mission is to empower organizations to surpass their business goals by providing state-of-the-art IT solutions and service. The company prides itself on its core values of integrity, excellence, and innovation, instilling these principles in every project they undertake.

Industry

It services

Company size

11 - 50 Employees

Headquarters location

Chicago, IL, US

Year founded

2014

View All 1872 Consulting Jobs

Apply