ZipRecruiter

Log In

1

Ai Tester Jobs (NOW HIRING)

VTG

AI Architect

Chantilly, VA

AI testing and evaluation * Model deployment and monitoring * Operational sustainment and optimization Develop and mature AI evaluation and testing methodologies, including: * Traditional ML ...

Astra North Infoteck Inc.

Gen AI Testing: Integrate Gen AI into all phases of testing, including automated test case generation, synthetic data creation, and intelligent bug analysis * Full-Stack Validation: Own quality ...

DataAnnotation

Penetration Tester - AI Trainer

Downey, CA · Remote

$50 - $100/hr

Provide feedback that directly shapes the next generation of AI security models. Qualifications: * 2+ years of hands-on experience in a cybersecurity role -- such as penetration testing, red teaming ...

Apply Early

DataAnnotation

Penetration Tester - AI Trainer

Syracuse, NY · Remote

$50 - $100/hr

Provide feedback that directly shapes the next generation of AI security models. Qualifications: * 2+ years of hands-on experience in a cybersecurity role -- such as penetration testing, red teaming ...

Apply Early

DataAnnotation

Penetration Tester - AI Trainer

Naperville, IL · Remote

$50 - $100/hr

Provide feedback that directly shapes the next generation of AI security models. Qualifications: * 2+ years of hands-on experience in a cybersecurity role -- such as penetration testing, red teaming ...

Apply Early

DataAnnotation

Penetration Tester - AI Trainer

Bend, OR · Remote

$50 - $100/hr

Provide feedback that directly shapes the next generation of AI security models. Qualifications: * 2+ years of hands-on experience in a cybersecurity role -- such as penetration testing, red teaming ...

Apply Early

DataAnnotation

Penetration Tester - AI Trainer

Burbank, CA · Remote

$50 - $100/hr

Provide feedback that directly shapes the next generation of AI security models. Qualifications: * 2+ years of hands-on experience in a cybersecurity role -- such as penetration testing, red teaming ...

Apply Early

DataAnnotation

Penetration Tester - AI Trainer

Norfolk, VA · Remote

$50 - $100/hr

Provide feedback that directly shapes the next generation of AI security models. Qualifications: * 2+ years of hands-on experience in a cybersecurity role -- such as penetration testing, red teaming ...

Apply Early

DataAnnotation

Penetration Tester - AI Trainer

Birmingham, AL · Remote

$50 - $100/hr

Provide feedback that directly shapes the next generation of AI security models. Qualifications: * 2+ years of hands-on experience in a cybersecurity role -- such as penetration testing, red teaming ...

Apply Early

DataAnnotation

Penetration Tester - AI Trainer

Lubbock, TX · Remote

$50 - $100/hr

Provide feedback that directly shapes the next generation of AI security models. Qualifications: * 2+ years of hands-on experience in a cybersecurity role -- such as penetration testing, red teaming ...

Apply Early

DataAnnotation

Penetration Tester - AI Trainer

Tuscaloosa, AL · Remote

$50 - $100/hr

Provide feedback that directly shapes the next generation of AI security models. Qualifications: * 2+ years of hands-on experience in a cybersecurity role -- such as penetration testing, red teaming ...

Apply Early

next page

Showing results 1-20

All JobsAi Tester Jobs

Ai Tester information

See salary details

$10

$38

$62

How much do ai tester jobs pay per hour?

As of Jul 4, 2026, the average hourly pay for ai tester in the United States is $38.36, according to ZipRecruiter salary data. Most workers in this role earn between $21.39 and $50.72 per hour, depending on experience, location, and employer.

Is AI testing a good career?

AI testing is a growing field within software quality assurance that involves evaluating artificial intelligence systems for accuracy, reliability, and performance. It requires skills in programming, understanding AI algorithms, and familiarity with testing tools. The demand for AI testers is increasing as AI applications expand across industries, making it a promising career option for those interested in technology and quality assurance.

What are the key skills and qualifications needed to thrive in the Ai Tester position, and why are they important?

To thrive as an AI Tester, you need a background in computer science, experience with software testing methodologies, and a solid understanding of artificial intelligence technologies. Familiarity with testing tools (such as Selenium, Jupyter notebooks, or TensorFlow testing frameworks), programming languages like Python, and relevant certifications (e.g., ISTQB) are highly advantageous. Attention to detail, problem-solving abilities, and strong communication skills help AI Testers identify and articulate issues effectively. These skills ensure AI systems are reliable, accurate, and deliver expected outcomes in real-world applications.

What is an AI Tester job?

An AI Tester is responsible for evaluating artificial intelligence systems to ensure they function correctly, efficiently, and ethically. They design and execute test cases, identify flaws or biases, and verify that AI models meet performance standards. AI Testers work with developers and data scientists to improve AI reliability and user experience. Their role is crucial in preventing errors, reducing risks, and ensuring AI models make accurate and fair decisions.

How do I become an AI tester?

To become an AI tester, you should have a strong understanding of machine learning concepts, programming skills in languages like Python, and experience with data annotation and testing AI models. Familiarity with testing tools, data management, and quality assurance processes is also important. Gaining relevant certifications or training in AI and software testing can improve job prospects.

How much do AI testers make?

AI testers typically earn between $50,000 and $100,000 annually, depending on experience, location, and the complexity of the projects. Entry-level positions may start lower, while experienced testers with specialized skills can earn higher salaries, especially in tech hubs or with certifications in testing tools.

What are some typical challenges faced by AI Testers in their daily work?

AI Testers often encounter challenges such as managing and testing large, complex datasets, handling rapidly evolving algorithms, and ensuring consistent test coverage across various real-world scenarios. They must also validate that AI models are free from bias and produce accurate, reproducible results under different conditions. Overcoming these challenges requires both technical proficiency and adaptability. Collaboration with data scientists, developers, and product managers is common, and testers frequently update their testing approaches to keep pace with the fast changes in AI technology.

What is a $900000 AI job?

A $900,000 AI job typically refers to a high-level position in artificial intelligence, such as senior AI researcher, machine learning director, or AI executive, often requiring advanced skills, extensive experience, and sometimes ownership of projects or teams. These roles usually involve leadership, strategic planning, and expertise in AI tools, programming, and data analysis, with compensation reflecting the seniority and impact of the position.
More about Ai Tester jobs
What cities are hiring for Ai Tester jobs? Cities with the most Ai Tester job openings:
What are the most commonly searched types of Ai Tester jobs? The most popular types of Ai Tester jobs are:
What states have the most Ai Tester jobs? States with the most job openings for Ai Tester jobs include:
What job categories do people searching Ai Tester jobs look for? The top searched job categories for Ai Tester jobs are:
Ai Tester jobs near you
AI Architect

AI Architect

VTG

Chantilly, VA

Full-time

Posted 20 days ago

Job description

Overview

VTG is seeking a highly experienced and innovative AI Architect to lead the design, development, evaluation, and deployment of advanced artificial intelligence solutions in support of mission-critical and enterprise initiatives. This role requires deep expertise in modern AI/ML architectures, including agentic AI systems, large language models (LLMs), autonomous workflows, AI evaluation frameworks, and production-grade machine learning operations (MLOps). This position is located in Chantilly, VA. 

The ideal candidate is both technically exceptional and customer-facing — capable of advising senior leadership, engaging directly with government and commercial stakeholders, and serving as a trusted authority on emerging AI technologies and best practices. This individual must have hands-on experience building and operationalizing AI systems at scale and possess a strong understanding of modern AI governance, responsible AI principles, and evaluation methodologies.


What will you do?

Architect, design, and implement advanced AI/ML solutions, including:

  • Agentic AI systems
  • Retrieval-Augmented Generation (RAG)
  • Large Language Model (LLM) integrations
  • Autonomous and semi-autonomous workflows
  • AI orchestration frameworks
  • Predictive analytics and traditional ML models

Lead the end-to-end AI lifecycle, including:

  • Data ingestion and preparation
  • Model development and fine-tuning
  • AI testing and evaluation
  • Model deployment and monitoring
  • Operational sustainment and optimization

Develop and mature AI evaluation and testing methodologies, including:

  • Traditional ML evaluation metrics
  • LLM benchmarking
  • Red teaming and adversarial testing
  • Hallucination detection
  • Bias and fairness assessments
  • Performance and reliability testing
  • Human-in-the-loop evaluation strategies
  • Design scalable MLOps and AIOps pipelines to support secure and repeatable deployment of AI capabilities in enterprise and cloud environments

Establish and implement AI governance frameworks, including:

  • Responsible AI practices
  • Security and compliance controls
  • Model transparency and explainability
  • Risk management
  • Data governance standards
  • Serve as a senior technical advisor to customers, executives, and program leadership on AI strategy, architecture, modernization, and emerging capabilities.
  • Lead technical discussions, architecture reviews, demonstrations, and customer briefings with confidence and authority.
  • Stay current with emerging AI research, industry trends, open-source technologies, and commercial AI platforms; continuously assess applicability to organizational and customer needs.
  • Mentor engineers, data scientists, and software developers on AI best practices, architectures, and implementation strategies.
  • Collaborate across engineering, cybersecurity, cloud, data, and product teams to deliver integrated AI solutions.

Do you have what it takes?

Required Qualifications:

  • Bachelor’s degree in Computer Science, Artificial Intelligence, Data Science, Software Engineering, Mathematics, or related technical field.
    • Master’s degree or PhD preferred.
  • 10–15+ years of experience in artificial intelligence, machine learning, software engineering, data engineering, or related technical disciplines.
  • Demonstrated experience architecting and deploying enterprise-scale AI/ML solutions in production environments.
  • Hands-on experience building and operationalizing:
    • Agentic AI systems
    • LLM-powered applications
    • AI orchestration frameworks
    • Autonomous decision-support systems
  • Strong understanding of:
    • Machine learning algorithms
    • Deep learning techniques
    • Natural language processing (NLP)
    • Reinforcement learning concepts
    • Statistical modeling and AI evaluation methodologies
  • Experience with AI testing, validation, benchmarking, and evaluation frameworks for both traditional ML and generative AI systems.
  • Experience implementing practical MLOps pipelines and AI operationalization frameworks.
  • Strong programming experience with:
    • Python
    • Jupyter Notebooks or equivalent notebook environments
  • Experience with big data and distributed processing technologies such as:
    • Apache Spark
    • Databricks (preferred)
  • Experience with one or more major cloud platforms:
    • Microsoft Azure
    • Amazon Web Services (AWS)
    • Google Cloud Platform (GCP)
  • Familiarity with:
    • Vector databases
    • AI orchestration frameworks (LangChain, Semantic Kernel, CrewAI, AutoGen, etc.)
    • Containerization and orchestration technologies
    • CI/CD pipelines for AI deployments
  • Strong communication and presentation skills with demonstrated customer-facing experience.
  • Ability to translate complex technical concepts into actionable business and mission solutions.

Preferred Qualifications:

  • Experience supporting Federal Government, DoD, Intelligence Community, or highly regulated environments.
  • Experience implementing secure AI architectures in classified or sensitive environments.
  • Familiarity with AI security, adversarial AI, and zero trust principles.
  • Experience with GPU infrastructure, model optimization, and scalable inference architectures.
  • Published research, conference presentations, patents, or contributions to the AI community preferred.
  • Active participation in AI research communities, industry working groups, or open-source AI initiatives.

Clearance Requirement

  • Active Secret security clearance required, or ability to obtain and maintain a Secret clearance.

Desired Characteristics

  • Strategic thinker with strong technical depth and hands-on engineering capability.
  • Passion for continuous learning and staying ahead of rapidly evolving AI technologies.
  • Comfortable operating in ambiguous and fast-paced technical environments.
  • Strong leadership, collaboration, and mentoring abilities.
  • Customer-focused with executive presence and consultative communication skills.

Technologies & Tools

Experience with several of the following is desired:

  • Python
  • Jupyter Notebook
  • Apache Spark
  • Databricks
  • TensorFlow
  • PyTorch
  • Hugging Face
  • LangChain
  • Semantic Kernel
  • CrewAI
  • AutoGen
  • Kubernetes
  • Docker
  • Azure AI Services
  • AWS SageMaker
  • Google Vertex AI
  • Vector databases
  • MLflow
  • GitLab/GitHub CI/CD pipelines

Work Environment

This role may support hybrid, on-site, or customer-location work environments depending on program requirements. Occasional travel may be required for customer engagement, technical workshops, or industry events.

Qualifications:

Required Qualifications:

  • Bachelor’s degree in Computer Science, Artificial Intelligence, Data Science, Software Engineering, Mathematics, or related technical field.
    • Master’s degree or PhD preferred.
  • 10–15+ years of experience in artificial intelligence, machine learning, software engineering, data engineering, or related technical disciplines.
  • Demonstrated experience architecting and deploying enterprise-scale AI/ML solutions in production environments.
  • Hands-on experience building and operationalizing:
    • Agentic AI systems
    • LLM-powered applications
    • AI orchestration frameworks
    • Autonomous decision-support systems
  • Strong understanding of:
    • Machine learning algorithms
    • Deep learning techniques
    • Natural language processing (NLP)
    • Reinforcement learning concepts
    • Statistical modeling and AI evaluation methodologies
  • Experience with AI testing, validation, benchmarking, and evaluation frameworks for both traditional ML and generative AI systems.
  • Experience implementing practical MLOps pipelines and AI operationalization frameworks.
  • Strong programming experience with:
    • Python
    • Jupyter Notebooks or equivalent notebook environments
  • Experience with big data and distributed processing technologies such as:
    • Apache Spark
    • Databricks (preferred)
  • Experience with one or more major cloud platforms:
    • Microsoft Azure
    • Amazon Web Services (AWS)
    • Google Cloud Platform (GCP)
  • Familiarity with:
    • Vector databases
    • AI orchestration frameworks (LangChain, Semantic Kernel, CrewAI, AutoGen, etc.)
    • Containerization and orchestration technologies
    • CI/CD pipelines for AI deployments
  • Strong communication and presentation skills with demonstrated customer-facing experience.
  • Ability to translate complex technical concepts into actionable business and mission solutions.

Preferred Qualifications:

  • Experience supporting Federal Government, DoD, Intelligence Community, or highly regulated environments.
  • Experience implementing secure AI architectures in classified or sensitive environments.
  • Familiarity with AI security, adversarial AI, and zero trust principles.
  • Experience with GPU infrastructure, model optimization, and scalable inference architectures.
  • Published research, conference presentations, patents, or contributions to the AI community preferred.
  • Active participation in AI research communities, industry working groups, or open-source AI initiatives.

Clearance Requirement

  • Active Secret security clearance required, or ability to obtain and maintain a Secret clearance.

Desired Characteristics

  • Strategic thinker with strong technical depth and hands-on engineering capability.
  • Passion for continuous learning and staying ahead of rapidly evolving AI technologies.
  • Comfortable operating in ambiguous and fast-paced technical environments.
  • Strong leadership, collaboration, and mentoring abilities.
  • Customer-focused with executive presence and consultative communication skills.

Technologies & Tools

Experience with several of the following is desired:

  • Python
  • Jupyter Notebook
  • Apache Spark
  • Databricks
  • TensorFlow
  • PyTorch
  • Hugging Face
  • LangChain
  • Semantic Kernel
  • CrewAI
  • AutoGen
  • Kubernetes
  • Docker
  • Azure AI Services
  • AWS SageMaker
  • Google Vertex AI
  • Vector databases
  • MLflow
  • GitLab/GitHub CI/CD pipelines

Work Environment

This role may support hybrid, on-site, or customer-location work environments depending on program requirements. Occasional travel may be required for customer engagement, technical workshops, or industry events.

Education:UNAVAILABLEEmployment Type: FULL_TIME

Apply