1

Generative Ai Testing Jobs in Virginia (NOW HIRING)

AI Prompt Engineer

Ashburn, VA · On-site

$66.70 - $133.30/hr

Develop, refine, and iterate on prompts for various generative AI models (LLMs) to elicit desired behaviors, responses, and creative outputs. * Iterative Testing & Analysis: Conduct testing to ...

AI Evaluation Scientist

Mclean, VA · On-site

$105 - $145/hr

... generative AI models (LLMs preferred). * Familiarity with evaluation metrics, statistical testing, dataset creation, and experimental design for AI systems. * Proficiency in Python and relevant ...

Integrate Generative AI capabilities into existing platforms and user experiences * Evaluate and ... Strong experience developing Python applications from scratch, including testing and deployment

Integrate Generative AI capabilities into existing platforms and user experiences * Evaluate and ... Strong experience developing Python applications from scratch, including testing and deployment

Integrate Generative AI capabilities into existing platforms and user experiences * Evaluate and ... Strong experience developing Python applications from scratch, including testing and deployment

Integrate Generative AI capabilities into existing platforms and user experiences * Evaluate and ... Strong experience developing Python applications from scratch, including testing and deployment

Showing results 41-60

Generative Ai Testing information

What is generative AI testing?

Generative AI Testing refers to the process of evaluating and validating AI systems, particularly those that generate content such as text, images, or code. This type of testing focuses on assessing the accuracy, reliability, fairness, and safety of generative models to ensure they function as intended and avoid producing harmful or biased outputs. Testers use various methods, including automated and manual techniques, to check for issues like hallucinations, inappropriate content, or security vulnerabilities. The goal is to build trust in generative AI systems and ensure they meet quality and ethical standards before deployment.

What are some common challenges faced when testing generative AI models, and how can I prepare to address them in this role?

Testing generative AI models often involves unique challenges such as evaluating the quality and relevance of generated content, detecting bias or inappropriate outputs, and ensuring model consistency across various prompts. You may work closely with data scientists and engineers to create robust evaluation frameworks and develop automated as well as manual testing strategies. Familiarity with prompt engineering, statistical evaluation techniques, and domain-specific knowledge will help you address these challenges effectively. Proactively staying updated on industry best practices and collaborating with cross-functional teams are key to success in this dynamic field.

What are the key skills and qualifications needed to thrive as a generative AI testing specialist, and why are they important?

To thrive as a Generative AI Testing Specialist, you need a robust understanding of machine learning principles, model evaluation techniques, and a background in computer science or a related field. Familiarity with tools such as Python, TensorFlow, PyTorch, and model evaluation frameworks, as well as experience with automated testing platforms, is typically required. Analytical thinking, attention to detail, and strong communication skills help you identify model weaknesses and collaborate effectively with development teams. These skills are crucial to ensure the reliability, safety, and ethical deployment of generative AI solutions.

What is the difference between Generative Ai Testing vs Data Scientist?

AspectGenerative Ai TestingData Scientist
Required CredentialsKnowledge of AI models, testing tools, programming skillsStatistics, programming, data analysis certifications
Work EnvironmentAI development teams, testing labs, tech companiesResearch labs, tech firms, finance, healthcare
Employer & Industry UsageAI product testing, quality assurance in techData analysis, predictive modeling across industries

Generative Ai Testing focuses on evaluating and validating AI-generated content and models, ensuring quality and accuracy. Data Scientists analyze data, build models, and derive insights. While both roles require programming and AI knowledge, Generative Ai Testing emphasizes testing processes, whereas Data Scientists focus on data analysis and model development.

How do I become a Generative AI Testing?

To become a Generative AI Tester, develop skills in machine learning, natural language processing, and programming languages like Python. Gain experience with AI frameworks such as TensorFlow or PyTorch and understand data quality and model evaluation techniques. Relevant certifications and hands-on projects can enhance your qualifications for roles in AI testing environments.

Is Generative AI Testing a good career?

Generative AI Testing is a growing field within AI development, focusing on evaluating the quality and safety of AI-generated content. It requires skills in machine learning, programming, and understanding AI models, often involving tools like Python and TensorFlow. The role offers opportunities in tech companies and research labs, with demand expected to increase as AI applications expand.

What job categories do people searching Generative Ai Testing jobs in Virginia look for?

The top searched job categories for Generative Ai Testing jobs in Virginia are:

What cities in Virginia are hiring for Generative Ai Testing jobs?

Cities in Virginia with the most Generative Ai Testing job openings:

Infographic showing various Generative Ai Testing job openings in Virginia as of August 2026, with employment types broken down into 1% As Needed, 78% Full Time, 18% Part Time, 2% Contract, and 1% Nights. Highlights an 87% Physical, 3% Hybrid, and 10% Remote job distribution.

AI Prompt Engineer

SwiftCruit

Ashburn, VA • On-site

$66.70 - $133.30/hr

Other

Medical, Retirement, PTO

Posted 5 days ago


Job description

Job Title: AI Prompt EngineerJob Category: EngineeringTime Type: Full timeMinimum Clearance Required to Start: NoneEmployee Type: RegularPercentage of Travel Required: Up to 10%Type of Travel: Local* * *

The Opportunity:

CACI is currently looking for a AI Prompt Engineer to join our BEAGLE (Border Enforcement Applications for Government Leading-Edge Information Technology) Agile Solution Factory (ASF) Team supporting Customs and Border Control (CBP) client located in Northern Virginia! Join this passionate team of industry-leading individuals supporting the best practices in Agile Software Development for the Department of Homeland Security (DHS).

As a member of the BEAGLE ASF Team, you will support the men and women charged with safeguarding the American people and enhancing the Nation’s safety, security, and prosperity. CBP agents and officers are on the front lines, every day, protecting our national security by combining customs, immigration, border security, and agricultural protection into one coordinated and supportive activity.

ASF programs thrive in a culture of innovation and are constantly seeking individuals who can bring creative ideas to solve complex problems, both technical and procedural at the team and portfolio levels.

More about this role:

We are seeking a highly creative, technically proficient, and detail-oriented Prompt Engineer to join our growing AI team. This pivotal role will be responsible for designing, testing, and optimizing prompts for Large Language Models (LLMs) to achieve high-quality, and reliable outputs for various use cases. You will be instrumental in translating complex requirements into effective AI interactions.

This role is ideal for someone who thrives on experimentation, understands how LLMs interpret language, and is passionate about unlocking the full potential of generative AI.

You will excel at developing innovative software solutions as part of a technically diverse and geographically disbursed team. A strong passion for AI technologies and experience with agile delivery and deploying software in short sprints.

Responsibilities:
  • Prompt Design & Optimization: Develop, refine, and iterate on prompts for various generative AI models (LLMs) to elicit desired behaviors, responses, and creative outputs.
  • Iterative Testing & Analysis: Conduct testing to compare prompt variations, analyze results drive continuous improvement.
  • Collaboration: Work closely with multiple groups to integrate prompts to streamline manual processes.
  • Research & Development: Stay abreast of the latest advancements in LLMs, generative AI, and prompt engineering techniques.
  • Fine-tuning & RAG Support: Provide input and collaborate on strategies for model fine-tuning and Retrieval Augmented Generation (RAG) to further improve accuracy.
  • Problem Solving: Debug unexpected model behaviors, identifying root causes within prompt structure, model limitations, or data context.
Qualifications:Required
  • Must be a U.S. Citizen with the ability to pass CBP background investigation, criteria include, but not limited to:
    • 3-year check for felony convictions
    • 1 year check for illegal drug use
    • 1 year check for misconduct such as theft or fraud
  • Bachelor’s degree in Computer Science, Software Engineering, Information Technology, or related field (equivalent experience may be considered in lieu of degree).
  • Must be available to work a hybrid schedule with onsite requirements in Ashburn, VA
  • 0–3 years of professional software development experience, internships, or relevant academic project work.
  • 1+ year of hands-on experience working with Large Language Models (e.g., OpenAI GPT series, Llama, Gemini) or other generative AI models.
  • Experience with at least one programming language (Python, JavaScript/TypeScript)
  • Familiarity with prompt engineering techniques (few-shot, chain-of-thought, structured outputs, function calling)
Desired:
  • Problem-solving skills, with a data-driven approach to experimentation and optimization.
  • Witten and verbal communication skills, with an ability to articulate complex technical concepts clearly.
  • Ability to work independently and collaboratively in a fast-paced, evolving environment.
  • Exposure to RAG concepts, including embeddings and vector databases
  • Understanding of AI safety considerations (e.g., prompt injection, bias, data privacy)
  • Exposure to Agile/Scrum development environments
What You Can Expect:

A culture of integrity.

At CACI, we place character and innovation at the center of everything we do. As a valued team member, you’ll be part of a high-performing group dedicated to our customer’s missions and driven by a higher purpose – to ensure the safety of our nation.

An environment of trust.

CACI values the unique contributions that every employee brings to our company and our customers - every day. You’ll have the autonomy to take the time you need through a unique flexible time off benefit and have access to robust learning resources to make your ambitions a reality.

A focus on continuous growth.

Together, we will advance our nation’s most critical missions, build on our longitudinal track record of business success, and find opportunities to break new ground — in your career and in our legacy.

Pay Range

There are a host of factors that can influence final salary including, but not limited to, geographic location, Federal Government contract labor categories and contract wage rates, relevant prior work experience, specific skills and competencies, education, and certifications. Our employees value the flexibility at CACI that allows them to balance quality work and their personal lives. We offer competitive compensation, benefits and learning and development opportunities. Our broad and competitive mix of benefits options is designed to support and protect employees and their families. At CACI, you will receive comprehensive benefits such as; healthcare, wellness, financial, retirement, family support, continuing education, and time off benefits.

The proposed salary range for this position is:

$66,700 - $133,300

CACI is anEqualOpportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, pregnancy, sexual orientation, age, national origin, disability, status as

#J-18808-Ljbffr