ZipRecruiter

Log In

1

Ai Prompt Tester Jobs in Virginia (NOW HIRING)

SwiftCruit

AI Prompt Engineer

Ashburn, VA · On-site

$66.70 - $133.30/hr

Job Title: AI Prompt EngineerJob Category: EngineeringTime Type: Full timeMinimum Clearance ... Conduct testing to compare prompt variations, analyze results drive continuous improvement.

Ignite IT

Jr. AI Prompt Engineer

Ashburn, VA

Support rapid prototyping, testing, implementation, and continuous improvement of AI solutions ... Familiarity with prompt evaluation, output validation, and responsible AI practices. Benefits ...

Ignite IT

Jr. AI Prompt Engineer

Ashburn, VA · On-site +1

Support rapid prototyping, testing, implementation, and continuous improvement of AI solutions ... Familiarity with prompt evaluation, output validation, and responsible AI practices. Benefits ...

Cherry Bekaert

AI Prompt and Skills Engineer

Richmond, VA · On-site

$71K - $92K/yr

The Prompt + Skills Engineer is the hands-on builder in Cherry Bekaert's AI Center of Excellence ... Conducts quality assurance testing on AI outputs, including accuracy validation, edge case testing ...

Moonfire

AI Prompt and Skills Engineer

Richmond, VA · On-site

$116 - $175/hr

As AI Prompt And Skills Engineer, You Will * Writes, tests and refines prompts across Tax ... Conducts quality assurance testing on AI outputs, including accuracy validation, edge case testing ...

Cherry Bekaert

AI Prompt and Skills Engineer

Tysons Corner, VA · On-site

$72K - $93K/yr

The Prompt + Skills Engineer is the hands-on builder in Cherry Bekaert's AI Center of Excellence ... Conducts quality assurance testing on AI outputs, including accuracy validation, edge case testing ...

Socket.dev

AI Security Specialist

Arlington, VA · On-site

$83 - $185/hr

Ability to review AI prompt inputs, configuration settings, guardrails, and simple testing outputs with guidance from senior staff. * Basic scripting ability (Python, JS, or similar) to help build or ...

Interon IT Solutions

Senior Salesforce Developer

Reston, VA · On-site

$130K - $159K/yr

Implement custom objects, versioning models, and secure role‑based access AI & Prompt Engineering ... Perform unit and integration testing across flows, integrations, prompts, and DocGen * Support UAT ...

next page

Showing results 1-20

All JobsAi Prompt Tester JobsAi Prompt Tester Jobs in Virginia

Ai Prompt Tester information

What is an AI prompt tester?

An AI Prompt Tester evaluates and refines AI-generated responses by testing different prompts to ensure accuracy, relevance, and coherence. They analyze outputs, identify inconsistencies, and provide feedback to improve AI models. This role requires critical thinking, attention to detail, and a strong understanding of AI behavior. It is commonly used in AI development, chatbots, and content generation systems.

What are the key skills and qualifications needed to thrive as an AI prompt tester?

To thrive as an AI Prompt Tester, you need a strong grasp of language comprehension, analytical thinking, and familiarity with AI-driven content generation platforms. Experience using tools like GPT-based interfaces, prompt management systems, and possibly certifications in machine learning or natural language processing can be advantageous. Attention to detail, problem-solving, and effective communication are valuable soft skills in this role. These skills are crucial for ensuring high-quality, relevant AI outputs and facilitating continuous improvements in AI prompt performance.

What are some typical challenges an AI prompt tester faces on the job?

AI Prompt Testers often encounter challenges such as ensuring prompt accuracy across diverse contexts, identifying subtle biases or inconsistencies in AI-generated outputs, and adapting to frequent software updates or changes in model behavior. They may need to balance thorough testing with efficiency under tight deadlines, and clearly communicate feedback to developers or product teams. Tackling these challenges requires strong analytical skills, adaptability, and close collaboration with cross-functional teams to help improve product quality and user experience.

How do I become an AI prompt tester?

To become an AI prompt tester, you should have strong language skills, an understanding of AI and machine learning concepts, and experience with writing or editing prompts. Familiarity with AI tools and platforms, along with attention to detail, is essential for evaluating and improving AI responses. Gaining relevant experience through online courses or freelance projects can also help establish credibility in this role.

How do you become an AI prompt tester?

To become an AI prompt tester, you typically need strong language skills, familiarity with AI language models, and attention to detail. Gaining experience through online courses, practicing prompt creation, and understanding AI behavior can improve your chances. Some roles may require basic knowledge of programming or specific tools used in AI development.

What are popular job titles related to Ai Prompt Tester jobs in Virginia?

For Ai Prompt Tester jobs in Virginia, the most frequently searched job titles are:

What job categories do people searching Ai Prompt Tester jobs in Virginia look for?

The top searched job categories for Ai Prompt Tester jobs in Virginia are:

What cities in Virginia are hiring for Ai Prompt Tester jobs?

Cities in Virginia with the most Ai Prompt Tester job openings:

Ai Prompt Tester jobs near you
Infographic showing various Ai Prompt Tester job openings in Virginia as of August 2026, with employment types broken down into 2% Internship, 69% Full Time, 10% Part Time, and 19% Contract. Highlights an 66% In-person, 4% Hybrid, and 30% Remote job distribution.

AI Prompt Engineer

CACI International, Inc.

Ashburn, VA • On-site

Full-time

Medical, Retirement, PTO

Re-posted 27 days ago

Job description

Job Title: AI Prompt Engineer
Job Category: Information Technology
Time Type: Full time
Minimum Clearance Required to Start: None
Employee Type: Regular
Percentage of Travel Required: Up to 10%
Type of Travel: Local
* * *
CACI is currently looking for a AI Prompt Engineer to join our BEAGLE (Border Enforcement Applications for Government Leading-Edge Information Technology) Agile Solution Factory (ASF) Team supporting Customs and Border Control (CBP) client located in Northern Virginia! Join this passionate team of industry-leading individuals supporting the best practices in Agile Software Development for the Department of Homeland Security (DHS).
As a member of the BEAGLE ASF Team, you will support the men and women charged with safeguarding the American people and enhancing the Nation's safety, security, and prosperity. CBP agents and officers are on the front lines, every day, protecting our national security by combining customs, immigration, border security, and agricultural protection into one coordinated and supportive activity.
ASF programs thrive in a culture of innovation and are constantly seeking individuals who can bring creative ideas to solve complex problems, both technical and procedural at the team and portfolio levels.
The Opportunity:
We are seeking a highly creative, technically proficient, and detail-oriented Prompt Engineer to join our growing AI team. This pivotal role will be responsible for designing, testing, and optimizing prompts for Large Language Models (LLMs) to achieve high-quality, and reliable outputs for various use cases. You will be instrumental in translating complex requirements into effective AI interactions.
This role is ideal for someone who thrives on experimentation, understands how LLMs interpret language, and is passionate about unlocking the full potential of generative AI.
You will excel at developing innovative software solutions as part of a technically diverse and geographically disbursed team. A strong passion for AI technologies and experience with agile delivery and deploying software in short sprints.
Responsibilities:
  • Prompt Design & Optimization: Develop, refine, and iterate on prompts for various generative AI models (LLMs) to elicit desired behaviors, responses, and creative outputs.
  • Iterative Testing & Analysis: Conduct testing to compare prompt variations, analyze results drive continuous improvement.
  • Collaboration: Work closely with multiple groups to integrate prompts to streamline manual processes.
  • Research & Development: Stay abreast of the latest advancements in LLMs, generative AI, and prompt engineering techniques.
  • Fine-tuning & RAG Support: Provide input and collaborate on strategies for model fine-tuning and Retrieval Augmented Generation (RAG) to further improve accuracy.
  • Problem Solving: Debug unexpected model behaviors, identifying root causes within prompt structure, model limitations, or data context.

Qualifications:
Required:
  • Must be a U.S. Citizen with the ability to pass CBP background investigation, criteria include, but not limited to:
  • 3-year check for felony convictions
  • 1 year check for illegal drug use
  • 1 year check for misconduct such as theft or fraud
  • Bachelor's degree in Computer Science, Software Engineering, Information Technology, or related field (equivalent experience may be considered in lieu of degree).
  • 0-3 years of professional software development experience, internships, or relevant academic project work.
  • 1+ year of hands-on experience working with Large Language Models (e.g., OpenAI GPT series, Llama, Gemini) or other generative AI models.
  • Experience with at least one programming language (Python, JavaScript/TypeScript)
  • Familiarity with prompt engineering techniques (few-shot, chain-of-thought, structured outputs, function calling)
  • Willing to work a hybrid schedule with onsite requirements in Ashburn, VA

Desired:
  • Problem-solving skills, with a data-driven approach to experimentation and optimization.
  • Witten and verbal communication skills, with an ability to articulate complex technical concepts clearly.
  • Ability to work independently and collaboratively in a fast-paced, evolving environment.
  • Exposure to RAG concepts, including embeddings and vector databases
  • Understanding of AI safety considerations (e.g., prompt injection, bias, data privacy)
  • Exposure to Agile/Scrum development environments

What You Can Expect:
A culture of integrity.
At CACI, we place character and innovation at the center of everything we do. As a valued team member, you'll be part of a high-performing group dedicated to our customer's missions and driven by a higher purpose - to ensure the safety of our nation.
An environment of trust.
CACI values the unique contributions that every employee brings to our company and our customers - every day. You'll have the autonomy to take the time you need through a unique flexible time off benefit and have access to robust learning resources to make your ambitions a reality.
A focus on continuous growth.
Together, we will advance our nation's most critical missions, build on our lengthy track record of business success, and find opportunities to break new ground - in your career and in our legacy.
Pay Range:
There are a host of factors that can influence final salary including, but not limited to, geographic location, Federal Government contract labor categories and contract wage rates, relevant prior work experience, specific skills and competencies, education, and certifications. Our employees value the flexibility at CACI that allows them to balance quality work and their personal lives. We offer competitive compensation, benefits and learning and development opportunities. Our broad and competitive mix of benefits options is designed to support and protect employees and their families. At CACI, you will receive comprehensive benefits such as; healthcare, wellness, financial, retirement, family support, continuing education, and time off benefits.
The proposed salary range for this position is:
$61,100 - $122,200
CACI is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, pregnancy, sexual orientation, age, national origin, disability, status as a protected veteran, or any other protected characteristic.

Apply