ZipRecruiter

Log In

1

Senior Artificial Intelligence Testing Jobs in Virginia

previous pagenext page

Showing results 21-40

All JobsArtificial Intelligence Testing JobsSenior Artificial Intelligence Testing JobsSenior Artificial Intelligence Testing Jobs in Virginia

Senior Artificial Intelligence Testing information

What is a senior artificial intelligence testing professional?

Senior Artificial Intelligence Testing professionals are experienced specialists responsible for designing, executing, and overseeing tests to ensure the quality, reliability, and ethical standards of AI systems. They develop test plans, create testing frameworks, and analyze AI model behaviors to identify errors, biases, or security vulnerabilities. They often collaborate with data scientists, engineers, and product managers to refine AI algorithms and ensure they perform as intended in real-world scenarios. Their role is critical in maintaining trust and safety in AI-driven products and services.

What skills and qualifications are needed to thrive as a senior artificial intelligence testing professional?

To thrive as a Senior Artificial Intelligence Testing professional, you need expertise in software testing methodologies, machine learning concepts, and proficiency in programming languages like Python, along with a degree in computer science or a related field. Familiarity with AI testing frameworks, automated testing tools (such as TensorFlow, PyTorch, Selenium), and relevant certifications (like ISTQB) is often required. Strong analytical thinking, attention to detail, and effective communication skills distinguish top performers in this role. These competencies are critical to ensuring the quality, reliability, and ethical integrity of AI systems in complex, real-world applications.

What are common challenges faced by senior artificial intelligence testing professionals, and how can they be addressed?

Senior Artificial Intelligence Testing professionals often encounter challenges such as ensuring the reliability of complex AI models, dealing with insufficient or biased data, and validating unpredictable outputs. Addressing these issues typically involves developing comprehensive test plans, employing advanced testing frameworks, and collaborating closely with data scientists and engineers. Regular communication with cross-functional teams and staying updated on the latest AI testing methodologies are also essential for overcoming these challenges and ensuring robust, ethical AI systems.

What is the difference between Senior Artificial Intelligence Testing vs Machine Learning Engineer?

AspectSenior Artificial Intelligence TestingMachine Learning Engineer
Required CredentialsBachelor's or Master's in CS, experience in AI testing toolsBachelor's or Master's in CS, strong programming skills, knowledge of ML frameworks
Work EnvironmentAI development teams, quality assurance, testing labsData science teams, software development environments, cloud platforms
Employer & Industry UsageTech companies, AI-focused firms, research institutionsTech companies, startups, research labs, AI product companies
Common Search & Comparison IntentUnderstanding testing roles in AI projectsDeveloping and deploying machine learning models

While Senior Artificial Intelligence Testing focuses on evaluating and validating AI systems for accuracy and reliability, Machine Learning Engineers design, build, and optimize machine learning models. Both roles require a strong background in computer science and AI, but their core responsibilities differ: testing emphasizes quality assurance, whereas engineering emphasizes model development and deployment.

How do I become a senior artificial intelligence testing?

To become a senior artificial intelligence testing professional, candidates typically need a strong background in computer science, machine learning, or related fields, along with experience in AI development and testing. Proficiency in programming languages like Python, knowledge of AI frameworks, and familiarity with testing tools are essential, often complemented by advanced degrees or certifications in AI or software testing. Progression usually involves gaining experience in AI projects, demonstrating leadership skills, and staying updated with emerging AI technologies and testing methodologies.

Is senior artificial intelligence testing a good career?

Senior artificial intelligence testing is a specialized role that involves evaluating AI systems for accuracy, reliability, and safety, often requiring skills in programming, data analysis, and understanding of machine learning models. It is a growing field with increasing demand as AI technologies expand across industries, offering opportunities for career advancement and specialization. The role typically requires experience, technical certifications, and knowledge of testing tools and frameworks.

What are the most commonly searched types of Artificial Intelligence Testing jobs in Virginia?

The most popular types of Artificial Intelligence Testing jobs in Virginia are:

What are popular job titles related to Senior Artificial Intelligence Testing jobs in Virginia?

For Senior Artificial Intelligence Testing jobs in Virginia, the most frequently searched job titles are:

What job categories do people searching Senior Artificial Intelligence Testing jobs in Virginia look for?

The top searched job categories for Senior Artificial Intelligence Testing jobs in Virginia are:

What cities in Virginia are hiring for Senior Artificial Intelligence Testing jobs?

Cities in Virginia with the most Senior Artificial Intelligence Testing job openings:

Senior Artificial Intelligence Testing jobs near you

Artificial Intelligence Subject Matter Expert (SME)

Agile Defense

Reston, VA • On-site

$120 - $160/hr

Other

Re-posted 24 days ago

Job description

At Agile Defense we know that action defines the outcome and new challenges require new solutions. That’s why we always look to the future and embrace change with an unmovable spirit and the courage to build for what comes next.

Our vision is to bring adaptive innovation to support our nation's most important missions through the seamless integration of advanced technologies, elite minds, and unparalleled agility—leveraging a foundation of speed, flexibility, and ingenuity to strengthen and protect our nation’s vital interests.

Requisition #: 1504

Job Title: Artificial Intelligence Subject Matter Expert (SME)

Job Title for Careers Page: Artificial Intelligence Subject Matter Expert (SME)

Location: Reston, VA

Clearance Level: Top Secret

SUMMARY

The AI SME serves as the organization’s lead expert in applying Artificial Intelligence within the Security Operations Center (SOC), transforming emerging AI technologies into operational capabilities that enhance threat detection, response, and overall cyber defense.

JOB DUTIES AND RESPONSIBILITIES
  • Deliver support services related to testing, reporting, and assessing a range of AI applications.
  • Conduct operational testing and evaluation of AI to determine capability gaps and uncover vulnerabilities in deployed AI solutions.
  • Review current cyber defense posture, identify vulnerabilities to AI‑driven threats and assist in developing and implementing protective measures.
  • Provide SOPs, testing plans, and methodologies used, as well as reports outlining findings and actionable recommendations for remediation. This reporting shall include SOP development, identification of the methods employed, and findings accompanied by actionable corrective measures.
QUALIFICATIONS
  • Bachelor’s of Science, Mathematics, or equivalent experience
ADDITIONAL SKILLS & QUALIFICATIONS REQUIRED SKILLS
  • Top Secret Clearance
  • 5+ years in ML, Data Science, or AI engineering; 2+ years focused on Generative AI and LLMs
  • Deep expertise in machine learning, deep learning, and statistical modeling
  • Hands‑on experience with LLM frameworks, vector databases, and prompt engineering
  • Advanced Python proficiency; production‑grade software development experience
  • MLOps and cloud AI platform experience (Azure AI, AWS Bedrock, Google Vertex AI)
  • Proven track record taking AI solutions from PoC to production
  • Experience in assessing cyber risk and functionality of AI solutions
  • Experience in incorporating automation and artificial intelligence into cyber programs
  • Experience with data analytic software such as Splunk, Cribl, Elastic and Sentinel
PREFERRED SKILLS
  • Open‑source contributions or published AI research
  • Experience with edge/low‑latency model optimization
  • Certifications in AI Ethics, Responsible AI, or Cloud AI Architecture
  • Familiarity with adversarial AI testing and red‑teaming
WORKING CONDITIONS

Hybrid schedule in Reston, VA

Employees of Agile Defense are our number one priority, and the importance we place on our culture here is fundamental. Our culture is alive and evolving, but it always stays true to its roots. Here, you are valued as a family member, and we believe that we can accomplish great things together. Agile Defense has been highly successful in the past few years due to our employees and the culture we create together.

What makes us Agile? We call it the 6Hs, the values that define our culture and guide everything we do. Together, these values infuse vibrancy, integrity, and a tireless work ethic into advancing the most important national security and critical civilian missions. It's how we show up every day. It's who we are.

We also believe in supporting our employees by offering a competitive and comprehensive benefits package. To explore the benefits we offer, please visit our website under the Careers section.

Happy - Be Infectious.

Happiness multiplies and creates a positive and connected environment where motivation and satisfaction have an outsized effect on everything we do.

Helpful - Be Supportive.

Being helpful is the foundation of teamwork, resulting in a supportive atmosphere where collaboration flourishes, and collective success is celebrated.

Honest - Be Trustworthy.

Honesty serves as our compass, ensuring transparent communication and ethical conduct, essential to who we are and the complex domains we support.

Humble - Be Grounded.

Success is not achieved alone, humility ensures a culture of mutual respect, encouraging open communication, and a willingness to learn from one another and take on any task.

Hungry - Be Eager.

Our hunger for excellence drives an insatiable appetite for innovation and continuous improvement, propelling us forward in the face of new and unprecedented challenges.

Hustle - Be Driven.

Hustle is reflected in our relentless work ethic, where we are each committed to going above and beyond to advance the mission and achieve success.

Equal Opportunity Employer/Protected Veterans/Individuals with Disabilities

#J-18808-Ljbffr

Apply