$50.50 - $69.25/hr
Technical Design Agents Configuration (Config) Agent AI Testing and Quality focused agents Support ongoing refinement of agent logic, prompts, and behaviors to improve accuracy, reliability, and ...
Quick apply
$50.50 - $69.25/hr
Technical Design Agents Configuration (Config) Agent AI Testing and Quality focused agents Support ongoing refinement of agent logic, prompts, and behaviors to improve accuracy, reliability, and ...
Your responsibilities will center on supporting the testing, evaluation, verification, and validation of AI systems, with a strong emphasis on adversarial and responsible AI testing. Key ...
Your responsibilities will center on supporting the testing, evaluation, verification, and validation of AI systems, with a strong emphasis on adversarial and responsible AI testing. Key ...
Montville Township, NJ · On-site
AI Red Tester/Pen Tester/Ethical Hacker- Long Term Contract - Remote For our direct client, a prestigious global firm, we seek an experienced hands-on AI Red Team tester to join their team, for a ...
Quick apply
Montville Township, NJ · On-site
AI Red Tester/Pen Tester/Ethical Hacker- Long Term Contract - Remote For our direct client, a prestigious global firm, we seek an experienced hands-on AI Red Team tester to join their team, for a ...
$90K - $122K/yr
In this role, you will also help design and own an AI testing platform that operates natively within our Databricks Medallion architecture-leveraging tools like MLflow to enable evaluation, lineage ...
$90K - $122K/yr
In this role, you will also help design and own an AI testing platform that operates natively within our Databricks Medallion architecture-leveraging tools like MLflow to enable evaluation, lineage ...
Dallas, TX · On-site
$53.50 - $73.50/hr
Technical Design Agents Configuration (Config) Agent AI Testing and Quality focused agents Support ongoing refinement of agent logic, prompts, and behaviors to improve accuracy, reliability, and ...
Dallas, TX · On-site
$53.50 - $73.50/hr
Technical Design Agents Configuration (Config) Agent AI Testing and Quality focused agents Support ongoing refinement of agent logic, prompts, and behaviors to improve accuracy, reliability, and ...
We are seeking a Senior AI Penetration Tester to join our Information Security department. The ideal candidate will bring 2-4 years of hands-on penetration testing experience, deep technical ...
We are seeking a Senior AI Penetration Tester to join our Information Security department. The ideal candidate will bring 2-4 years of hands-on penetration testing experience, deep technical ...
We are seeking a Senior AI Penetration Tester to join our Information Security department. The ideal candidate will bring 2-4 years of hands-on penetration testing experience, deep technical ...
We are seeking a Senior AI Penetration Tester to join our Information Security department. The ideal candidate will bring 2-4 years of hands-on penetration testing experience, deep technical ...
Summary of This Role The Lead, AI Testing & Monitoring is a senior technical and governance role responsible for independently validating and continuously monitoring AI/ML models to ensure they meet ...
Summary of This Role The Lead, AI Testing & Monitoring is a senior technical and governance role responsible for independently validating and continuously monitoring AI/ML models to ensure they meet ...
Atlanta, GA · On-site
Summary of This Role The Lead, AI Testing & Monitoring is a senior technical and governance role responsible for independently validating and continuously monitoring AI/ML models to ensure they meet ...
Atlanta, GA · On-site
Summary of This Role The Lead, AI Testing & Monitoring is a senior technical and governance role responsible for independently validating and continuously monitoring AI/ML models to ensure they meet ...
Summary of This Role The Lead, AI Testing & Monitoring is a senior technical and governance role responsible for independently validating and continuously monitoring AI/ML models to ensure they meet ...
Summary of This Role The Lead, AI Testing & Monitoring is a senior technical and governance role responsible for independently validating and continuously monitoring AI/ML models to ensure they meet ...
Partner with engineering and QA teams to embed AI/ML solutions into development, testing, and CI/CD workflows * Drive AI adoption across quality engineering, including test generation, test ...
Partner with engineering and QA teams to embed AI/ML solutions into development, testing, and CI/CD workflows * Drive AI adoption across quality engineering, including test generation, test ...
AI Evaluation / Testing (Evaluation Engineer) Fort Worth, TX (Remote) Long Term Contract Job Summary: We are seeking a skilled AI Evaluation Engineer to validate AI models and agent workflows built ...
AI Evaluation / Testing (Evaluation Engineer) Fort Worth, TX (Remote) Long Term Contract Job Summary: We are seeking a skilled AI Evaluation Engineer to validate AI models and agent workflows built ...
Dallas, TX · On-site
$53.50 - $73.50/hr
AI enabled delivery, configuration, testing, and quality practices * Comfortable performing peer reviews, smoke testing, and troubleshooting technical issues * Ability to collaborate across EMEA ...
Dallas, TX · On-site
$53.50 - $73.50/hr
AI enabled delivery, configuration, testing, and quality practices * Comfortable performing peer reviews, smoke testing, and troubleshooting technical issues * Ability to collaborate across EMEA ...
Penetration Tester For AI/ML Systems 7+ years of experience in penetration testing with a focus on AI/ML systems, including hands-on exploitation of vulnerabilities like adversarial attacks, model ...
Penetration Tester For AI/ML Systems 7+ years of experience in penetration testing with a focus on AI/ML systems, including hands-on exploitation of vulnerabilities like adversarial attacks, model ...
Charlotte, NC · On-site
$45 - $59.25/hr
GEN AI Testing Insurance Test Automation Requirements: • 15+ yrs. QA experience candidate with 10+ yrs. of management exposure • Test Director will oversee and manage complex projects within a ...
Quick apply
Charlotte, NC · On-site
$45 - $59.25/hr
GEN AI Testing Insurance Test Automation Requirements: • 15+ yrs. QA experience candidate with 10+ yrs. of management exposure • Test Director will oversee and manage complex projects within a ...
$45 - $59.25/hr
The ideal candidate will have strong expertise in AI-driven testing and engineering platforms combined with hands-on proficiency in Tricentis Tosca for test automation. This role requires working ...
New
$45 - $59.25/hr
The ideal candidate will have strong expertise in AI-driven testing and engineering platforms combined with hands-on proficiency in Tricentis Tosca for test automation. This role requires working ...
New
You will define and lead the discipline of testing AI agents, evaluating LLM behavior, and ensuring the reliability of agentic systems operating in production. It requires deep engineering rigor ...
You will define and lead the discipline of testing AI agents, evaluating LLM behavior, and ensuring the reliability of agentic systems operating in production. It requires deep engineering rigor ...
Data ingestion and preparation Model development and fine-tuning AI testing and evaluation Model deployment and monitoring Operational sustainment and optimization Develop and mature AI evaluation ...
Data ingestion and preparation Model development and fine-tuning AI testing and evaluation Model deployment and monitoring Operational sustainment and optimization Develop and mature AI evaluation ...
Winston Salem, NC · On-site
Serving as the primary authority on AI testing and validation, the AI QA Test Lead designs and manages comprehensive testing plans across conversational AI, generative AI, and agentic AI workflows.
Winston Salem, NC · On-site
Serving as the primary authority on AI testing and validation, the AI QA Test Lead designs and manages comprehensive testing plans across conversational AI, generative AI, and agentic AI workflows.
The Adversarial AI & Research Engineer will lead adversarial testing and innovate in AI attack techniques, while building security tooling and serving as a strategic partner across the company.
The Adversarial AI & Research Engineer will lead adversarial testing and innovate in AI attack techniques, while building security tooling and serving as a strategic partner across the company.
$10.82 - $15.54
7% of jobs
$15.54 - $20.26
16% of jobs
$21.31 is the 25th percentile. Wages below this are outliers.
$20.26 - $24.98
9% of jobs
$24.98 - $29.70
3% of jobs
$29.70 - $34.42
10% of jobs
The median wage is $36.31 / hr.
$34.42 - $39.14
10% of jobs
$39.14 - $43.86
7% of jobs
$43.86 - $48.58
9% of jobs
$49.21 is the 75th percentile. Wages above this are outliers.
$48.58 - $53.30
16% of jobs
$53.30 - $58.02
6% of jobs
$58.02 - $62.74
5% of jobs
$10
$38
$62
To thrive as an AI Tester, you need a background in computer science, experience with software testing methodologies, and a solid understanding of artificial intelligence technologies. Familiarity with testing tools (such as Selenium, Jupyter notebooks, or TensorFlow testing frameworks), programming languages like Python, and relevant certifications (e.g., ISTQB) are highly advantageous. Attention to detail, problem-solving abilities, and strong communication skills help AI Testers identify and articulate issues effectively. These skills ensure AI systems are reliable, accurate, and deliver expected outcomes in real-world applications.
An AI Tester is responsible for evaluating artificial intelligence systems to ensure they function correctly, efficiently, and ethically. They design and execute test cases, identify flaws or biases, and verify that AI models meet performance standards. AI Testers work with developers and data scientists to improve AI reliability and user experience. Their role is crucial in preventing errors, reducing risks, and ensuring AI models make accurate and fair decisions.
AI Testers often encounter challenges such as managing and testing large, complex datasets, handling rapidly evolving algorithms, and ensuring consistent test coverage across various real-world scenarios. They must also validate that AI models are free from bias and produce accurate, reproducible results under different conditions. Overcoming these challenges requires both technical proficiency and adaptability. Collaboration with data scientists, developers, and product managers is common, and testers frequently update their testing approaches to keep pace with the fast changes in AI technology.
$50.50 - $69.25/hr
Contractor
Posted 13 days ago
Must Have Technical/Functional Skills:
ServiceNow Developer, Test support, Strong documentation and problem-solving skills
Exposure in building ServiceNow agents, ServiceNow platform configuration, or technical design concepts
AI enabled delivery, configuration, testing, and quality practices
Comfortable performing peer reviews, smoke testing, and troubleshooting technical issues
Ability to collaborate across EMEA, APAC, and AMS teams in a fast paced, pilot driven environment
Strong documentation and problem solving skills
Development & Enhancement of AI Agent Products
Contribute to the development and enhancement of AI Agent products, including:
Technical Design Agents
Configuration (Config) Agent
AI Testing and Quality focused agents
Support ongoing refinement of agent logic, prompts, and behaviors to improve accuracy, reliability, and usability.
Ability to collaborate across EMEA, APAC, and AMS teams in a fast paced, pilot driven environment
Strong documentation and problem solving skills
