ZipRecruiter

Log In

1

Generative Ai Testing Jobs in Washington (NOW HIRING)

Deloitte

Lead Generative AI Data Engineer III

Washington, DC · On-site

$115K - $152K/yr

The Lead Generative AI Data Engineer III will be responsible for designing, developing, and ... Responsibilities : • Lead the design, development, testing, and deployment of machine learning ...

NPR

Lead AI Solutions Engineer, AI Labs

Washington, DC · Hybrid

$187K - $208K/yr

Design, develop, and deploy scalable Generative AI (GAI) solutions, focusing on enhancing content ... Implement data-driven methods, A/B testing, and performance monitoring to optimize the efficiency ...

NPR

Lead AI Solutions Engineer, AI Labs

Washington, DC · On-site

$113K - $149K/yr

Design, develop, and deploy scalable Generative AI (GAI) solutions, focusing on enhancing content ... Implement data-driven methods, A/B testing, and performance monitoring to optimize the efficiency ...

NPR

Lead AI Solutions Engineer, AI Labs

Washington, DC · On-site

$116K - $152K/yr

Design, develop, and deploy scalable Generative AI (GAI) solutions, focusing on enhancing content ... Implement data-driven methods, A/B testing, and performance monitoring to optimize the efficiency ...

MITRE

Intermediate AI and Decision Engineer

Mclean, VA · Hybrid

$121K - $152K/yr

... generative and agentic AI, decision science, human machine teaming, cognitive science, AI testing and evaluation, multi-agent systems, knowledge-based reasoning, automated planning, semantics, and ...

MITRE

Senior AI and Decision Engineer

Mclean, VA · Hybrid

$143K - $179K/yr

... generative and agentic AI, decision science, human machine teaming, cognitive science, AI testing and evaluation, multi-agent systems, knowledge-based reasoning, automated planning, semantics, and ...

next page

Showing results 1-20

All JobsGenerative Ai Testing JobsGenerative Ai Testing Jobs in Washington

Generative Ai Testing information

What is the difference between Generative Ai Testing vs Data Scientist?

AspectGenerative Ai TestingData Scientist
Required CredentialsKnowledge of AI models, testing tools, programming skillsStatistics, programming, data analysis certifications
Work EnvironmentAI development teams, testing labs, tech companiesResearch labs, tech firms, finance, healthcare
Employer & Industry UsageAI product testing, quality assurance in techData analysis, predictive modeling across industries

Generative Ai Testing focuses on evaluating and validating AI-generated content and models, ensuring quality and accuracy. Data Scientists analyze data, build models, and derive insights. While both roles require programming and AI knowledge, Generative Ai Testing emphasizes testing processes, whereas Data Scientists focus on data analysis and model development.

How much do AI testers get paid?

AI testers, involved in evaluating and validating generative AI models, typically earn salaries ranging from $60,000 to $120,000 annually depending on experience, location, and company size. Entry-level positions may start lower, while experienced testers with specialized skills in machine learning and data analysis can earn higher wages.

Is AI testing a good career?

AI testing, including roles like Generative AI Testing, is a growing field with increasing demand for skills in machine learning, data analysis, and programming. It offers opportunities in tech companies, research labs, and startups, often requiring knowledge of AI frameworks and testing tools. The career can be stable and rewarding for those with technical expertise and an interest in AI development and quality assurance.

What are the key skills and qualifications needed to thrive as a Generative AI Testing Specialist, and why are they important?

To thrive as a Generative AI Testing Specialist, you need a robust understanding of machine learning principles, model evaluation techniques, and a background in computer science or a related field. Familiarity with tools such as Python, TensorFlow, PyTorch, and model evaluation frameworks, as well as experience with automated testing platforms, is typically required. Analytical thinking, attention to detail, and strong communication skills help you identify model weaknesses and collaborate effectively with development teams. These skills are crucial to ensure the reliability, safety, and ethical deployment of generative AI solutions.

What are some common challenges faced when testing generative AI models, and how can I prepare to address them in this role?

Testing generative AI models often involves unique challenges such as evaluating the quality and relevance of generated content, detecting bias or inappropriate outputs, and ensuring model consistency across various prompts. You may work closely with data scientists and engineers to create robust evaluation frameworks and develop automated as well as manual testing strategies. Familiarity with prompt engineering, statistical evaluation techniques, and domain-specific knowledge will help you address these challenges effectively. Proactively staying updated on industry best practices and collaborating with cross-functional teams are key to success in this dynamic field.

What is a $900,000 AI job?

A $900,000 AI job typically refers to high-level roles in artificial intelligence, such as senior machine learning engineers, AI research directors, or executive positions, often requiring advanced skills, extensive experience, and sometimes specialized certifications. These roles usually involve leading AI development projects, strategic planning, and overseeing AI teams in large organizations or tech companies.

How do I become an AI tester?

To become an AI tester, you should have a strong understanding of machine learning concepts, programming skills in languages like Python, and experience with data annotation and model evaluation. Familiarity with AI development tools and testing frameworks, along with attention to detail, is essential for identifying issues in AI systems.

What is Generative AI Testing?

Generative AI Testing refers to the process of evaluating and validating AI systems, particularly those that generate content such as text, images, or code. This type of testing focuses on assessing the accuracy, reliability, fairness, and safety of generative models to ensure they function as intended and avoid producing harmful or biased outputs. Testers use various methods, including automated and manual techniques, to check for issues like hallucinations, inappropriate content, or security vulnerabilities. The goal is to build trust in generative AI systems and ensure they meet quality and ethical standards before deployment.
What are popular job titles related to Generative Ai Testing jobs in Washington? For Generative Ai Testing jobs in Washington, the most frequently searched job titles are:
What job categories do people searching Generative Ai Testing jobs in Washington look for? The top searched job categories for Generative Ai Testing jobs in Washington are:
Generative Ai Testing jobs near you
Infographic showing various Generative Ai Testing job openings in Washington as of June 2026, with employment types broken down into 10% Internship, 75% Full Time, 10% Part Time, and 5% Temporary. Highlights an 75% In-person, 5% Hybrid, and 20% Remote job distribution.
Senior Developer - Generative AI Platform and Mission Support

Senior Developer - Generative AI Platform and Mission Support

Peraton

Herndon, VA • On-site

$146K - $234K/yr

Full-time

Posted 9 days ago

Peraton rating

8.2

Company rating: 8.2 out of 10

Based on 53 frontline employees who took The Breakroom Quiz

45th of 204 rated it services

Job description

Responsibilities
Peraton Labs is seeking a Senior Developer to provide customer development support while also contributing to a broader Generative AI Platform and AI Program Management Office (PMO) initiatives. This role combines hands-on software engineering with mission-oriented delivery, requiring someone who can independently drive feature development, resolve complex technical issues, and help mature a production platform serving critical customer mission needs.
This individual will serve as a senior technical contributor on the deployed customer platform - owning significant development responsibilities, mentoring junior team members, and helping ensure that engineering decisions align with both immediate mission requirements and longer-term platform evolution. Additionally, this role will support cross-cutting Generative AI Platform and AI PMO development needs, contributing to shared capabilities, integration efforts, and technical initiatives that benefit the broader AI-enabled product portfolio.
The ideal candidate brings strong full-stack or backend development experience, comfort working in cloud-native environments, and the ability to operate effectively across both dedicated product support and broader organizational engineering priorities.
Key Responsibilities
  • Serve as a senior developer on a generative AI platform, owning feature development, bug resolution, performance optimization, and technical debt reduction
  • Design, build, test, and maintain production-quality software components supporting IRIS platform capabilities and mission requirements
  • Develop and maintain backend services, APIs, data processing pipelines, and integration points that support operational workflows
  • Contribute to front-end development as needed to deliver cohesive, user-facing platform features
  • Provide technical mentorship and code review support to junior and mid-level developers on the team
  • Support broader Generative AI Platform and AI PMO development initiatives, contributing to shared services, reusable components, and cross-platform integration efforts
  • Collaborate with product owners, analysts, and mission stakeholders to translate requirements into well-engineered technical solutions
  • Participate in architecture discussions, technical planning, and engineering tradeoff decisions for both the customer deployment and broader platform needs
  • Help establish and maintain engineering best practices including code quality standards, testing strategies, CI/CD workflows, and documentation
  • Troubleshoot and resolve complex technical issues across the application stack in development and production environments
  • Support deployment, release management, and operational readiness activities for the customer deployment and related platform capabilities
  • Document technical designs, implementation decisions, and system behaviors for engineering and stakeholder audiences

Qualifications
Required:
  • Minimum of 12 years of experience with BS/BA; Minimum of 10 years with MS/MA; Minimum of 7 years with PhD
  • Relevant experience should be in software development, application engineering, platform development, or related technical roles
  • Degree in Computer Science, Software Engineering, Computer Engineering, Information Systems, or a related technical field
  • Strong proficiency in Python with production development experience; additional experience with JavaScript/TypeScript preferred
  • Demonstrated experience building and maintaining production software systems, including backend services, APIs, and data-driven applications
  • Experience with cloud platforms (AWS preferred), containerization (Docker, Kubernetes), and modern deployment practices
  • Strong understanding of relational databases (PostgreSQL preferred), SQL, and data modeling
  • Experience with CI/CD pipelines, automated testing, version control (Git), and software delivery best practices
  • Ability to work independently, manage competing priorities, and deliver high-quality work in a fast-paced environment
  • Strong written and verbal communication skills with the ability to collaborate effectively across technical and non-technical stakeholders
  • US Citizenship with the ability to obtain and maintain Public Trust suitability

Desired:
  • Prior experience supporting FAA systems, aviation-related platforms, or government mission applications
  • Hands-on experience with Rust is a plus
  • Experience with AI/ML integration, LLM-enabled applications, or agentic AI platform development
  • Familiarity with FastAPI, async Python frameworks, or modern API development patterns
  • Experience with front-end frameworks (React preferred) and full-stack development
  • Experience with infrastructure-as-code (Terraform), monitoring/observability tooling, or platform engineering practices
  • Background in supporting multiple concurrent projects or product lines with shared engineering resources
  • Experience with data pipelines, ETL processes, or analytical data processing
  • Familiarity with security best practices, RBAC implementation, and compliance-aware development in regulated environments
  • Experience mentoring developers and contributing to engineering team growth
  • Exposure to Agile delivery practices, sprint-based development, and cross-functional team collaboration

Peraton Overview
Peraton is a next-generation national security company that drives missions of consequence spanning the globe and extending to the farthest reaches of the galaxy. As the world's leading mission capability integrator and transformative enterprise IT provider, we deliver trusted, highly differentiated solutions and technologies to protect our nation and allies. Peraton operates at the critical nexus between traditional and nontraditional threats across all domains: land, sea, space, air, and cyberspace. The company serves as a valued partner to essential government agencies and supports every branch of the U.S. armed forces. Each day, our employees do the can't be done by solving the most daunting challenges facing our customers. Visit peraton.com to learn how we're keeping people around the world safe and secure.
Target Salary Range
$146,000 - $234,000. This represents the typical salary range for this position. Salary is determined by various factors, including but not limited to, the scope and responsibilities of the position, the individual's experience, education, knowledge, skills, and competencies, as well as geographic location and business and contract considerations. Depending on the position, employees may be eligible for overtime, shift differential, and a discretionary bonus in addition to base pay.
EEO
EEO: Equal opportunity employer, including disability and protected veterans, or other characteristics protected by law.

What Peraton employees say

Pay

Benefits

Hours and flexibility

Workplace

Get the full story on Breakroom

Peraton logo

About Peraton

Sourced by ZipRecruiter

At Peraton, we re at the forefront of delivering the next big thing every day. We re the partner of choice to help solve some of the world s most daunting challenges, delivering bold, new solutions to keep people around the world safer and more secure.

Industry

It services

Company size

10,000+ Employees

Headquarters location

Herndon, VA, US

Year founded

2017

View All Peraton Jobs

Apply