Denver, MO · Remote
AI Agentic Tester Denver, MO (Remote) Must-Have Skills * AI Agentic Testing * Functional Testing * Generative AI Testing * Large Language Models (LLMs) * AI Agents & Agentic AI * Retrieval-Augmented ...
Quick apply
Denver, MO · Remote
AI Agentic Tester Denver, MO (Remote) Must-Have Skills * AI Agentic Testing * Functional Testing * Generative AI Testing * Large Language Models (LLMs) * AI Agents & Agentic AI * Retrieval-Augmented ...
Denver, MO · On-site +1
AI Agentic Tester Denver, MO (Remote) Must-Have Skills AI Agentic Testing Functional Testing Generative AI Testing Large Language Models (LLMs) AI Agents & Agentic AI Retrieval-Augmented Generation ...
Denver, MO · On-site +1
AI Agentic Tester Denver, MO (Remote) Must-Have Skills AI Agentic Testing Functional Testing Generative AI Testing Large Language Models (LLMs) AI Agents & Agentic AI Retrieval-Augmented Generation ...
Denver, MO · On-site +1
AI Agentic Tester Denver, MO (Remote) Must-Have Skills * AI Agentic Testing * Functional Testing * Generative AI Testing * Large Language Models (LLMs) * AI Agents & Agentic AI * Retrieval-Augmented ...
Denver, MO · On-site +1
AI Agentic Tester Denver, MO (Remote) Must-Have Skills * AI Agentic Testing * Functional Testing * Generative AI Testing * Large Language Models (LLMs) * AI Agents & Agentic AI * Retrieval-Augmented ...
Flexible remote work: Work remotely within EST or CST time zones. This role offers a rare ... Develop repeatable AI security testing methodologies, tools, and automation. * Partner with ...
Flexible remote work: Work remotely within EST or CST time zones. This role offers a rare ... Develop repeatable AI security testing methodologies, tools, and automation. * Partner with ...
Flexible remote work: Work remotely within EST or CST time zones. This role offers a rare ... Develop repeatable AI security testing methodologies, tools, and automation. * Partner with ...
Flexible remote work: Work remotely within EST or CST time zones. This role offers a rare ... Develop repeatable AI security testing methodologies, tools, and automation. * Partner with ...
Sterling, VA · On-site +1
$50 - $80/hr
OWASP AI Testing Guide, NIST AI Risk Management Framework (AI RMF), NIST Cybersecurity Framework (CSF) Cyber AI Profile, AI Bills of Materials (AI-BOMs), NSA AI Security Guidelines. Location: Remote ...
Sterling, VA · On-site +1
$50 - $80/hr
OWASP AI Testing Guide, NIST AI Risk Management Framework (AI RMF), NIST Cybersecurity Framework (CSF) Cyber AI Profile, AI Bills of Materials (AI-BOMs), NSA AI Security Guidelines. Location: Remote ...
OWASP AI Testing Guide, NIST AI Risk Management Framework (AI RMF), NIST Cybersecurity Framework (CSF) Cyber AI Profile, AI Bills of Materials (AI-BOMs), NSA AI Security Guidelines. Location: Remote ...
Quick apply
OWASP AI Testing Guide, NIST AI Risk Management Framework (AI RMF), NIST Cybersecurity Framework (CSF) Cyber AI Profile, AI Bills of Materials (AI-BOMs), NSA AI Security Guidelines. Location: Remote ...
Cincinnati, OH · Remote
$55.25 - $76/hr
Cincinnati, OH (Remote) Employment Type: Full-Time Experience Required: 4-6 Years Visa Type: USC ... AI Testing & Quality Practices * AI Agent Design & Enhancement * Technical Design Agents
Quick apply
Cincinnati, OH · Remote
$55.25 - $76/hr
Cincinnati, OH (Remote) Employment Type: Full-Time Experience Required: 4-6 Years Visa Type: USC ... AI Testing & Quality Practices * AI Agent Design & Enhancement * Technical Design Agents
Remote Role Responsibilities * Red team conversational AI models and agents. Conduct jailbreaks ... Apply structure using taxonomies, benchmarks, and playbooks to maintain consistent testing.
Quick apply
Remote Role Responsibilities * Red team conversational AI models and agents. Conduct jailbreaks ... Apply structure using taxonomies, benchmarks, and playbooks to maintain consistent testing.
Washington, DC · Remote
$141K - $236K/yr
Support AI testing, evaluation, verification, and validation (TEVV) activities for operational AI ... For Remote Opportunities), education and certifications as well as Federal Government Contract ...
Washington, DC · Remote
$141K - $236K/yr
Support AI testing, evaluation, verification, and validation (TEVV) activities for operational AI ... For Remote Opportunities), education and certifications as well as Federal Government Contract ...
Remote Role Responsibilities * Red team conversational AI models and agents. Focus on jailbreaks ... Apply structure using taxonomies, benchmarks, and playbooks to maintain consistent testing.
Quick apply
Remote Role Responsibilities * Red team conversational AI models and agents. Focus on jailbreaks ... Apply structure using taxonomies, benchmarks, and playbooks to maintain consistent testing.
AI Safety Experts -- English & Malay Type: Contract Compensation: $17-$25/hour Location: Remote ... Apply structure by following taxonomies, benchmarks, and playbooks to ensure consistent testing.
Quick apply
AI Safety Experts -- English & Malay Type: Contract Compensation: $17-$25/hour Location: Remote ... Apply structure by following taxonomies, benchmarks, and playbooks to ensure consistent testing.
AI Safety Experts -- English & Malay Type: Contract Compensation: $17-$25/hour Location: Remote ... Apply structure by following taxonomies, benchmarks, and playbooks to maintain testing consistency.
Quick apply
AI Safety Experts -- English & Malay Type: Contract Compensation: $17-$25/hour Location: Remote ... Apply structure by following taxonomies, benchmarks, and playbooks to maintain testing consistency.
Remote * 5-6 years of experience in Core Application Engineering * Minimum 2 years of hands-on ... Strong experience in Prompt Engineering, RAG Architecture, AI Observability, AI Testing ...
Remote * 5-6 years of experience in Core Application Engineering * Minimum 2 years of hands-on ... Strong experience in Prompt Engineering, RAG Architecture, AI Observability, AI Testing ...
AI Safety Experts -- English & Malay Type: Contract Compensation: $17-$25/hour Location: Remote ... Apply structure by following taxonomies, benchmarks, and playbooks to maintain testing consistency.
Quick apply
AI Safety Experts -- English & Malay Type: Contract Compensation: $17-$25/hour Location: Remote ... Apply structure by following taxonomies, benchmarks, and playbooks to maintain testing consistency.
Remote Role Responsibilities * Red team conversational AI models and agents by performing ... Apply structure by following taxonomies, benchmarks, and playbooks to maintain consistent testing.
Quick apply
Remote Role Responsibilities * Red team conversational AI models and agents by performing ... Apply structure by following taxonomies, benchmarks, and playbooks to maintain consistent testing.
$100K - $130K/yr
We offer a collaborative culture, growth opportunities, and flexibility with remote work options ... Evaluate and apply emerging AI-powered testing tools to automate and accelerate QA operations
$100K - $130K/yr
We offer a collaborative culture, growth opportunities, and flexibility with remote work options ... Evaluate and apply emerging AI-powered testing tools to automate and accelerate QA operations
Remote Role Responsibilities * Red team conversational AI models and agents to identify jailbreaks ... Apply structure by following taxonomies, benchmarks, and playbooks to maintain consistent testing.
Quick apply
Remote Role Responsibilities * Red team conversational AI models and agents to identify jailbreaks ... Apply structure by following taxonomies, benchmarks, and playbooks to maintain consistent testing.
Remote Role Responsibilities * Red team conversational AI models and agents by performing ... Apply structure by following taxonomies, benchmarks, and playbooks to maintain consistent testing.
Quick apply
Remote Role Responsibilities * Red team conversational AI models and agents by performing ... Apply structure by following taxonomies, benchmarks, and playbooks to maintain consistent testing.
AI Safety Experts -- English & Danish Type: Contract Compensation: $48-$62/hour Location: Remote ... Apply structure by following taxonomies, benchmarks, and playbooks to maintain consistent testing.
Quick apply
AI Safety Experts -- English & Danish Type: Contract Compensation: $48-$62/hour Location: Remote ... Apply structure by following taxonomies, benchmarks, and playbooks to maintain consistent testing.
$11.06 - $16.37
4% of jobs
$16.37 - $21.68
2% of jobs
$21.68 - $26.99
4% of jobs
$26.99 - $32.30
5% of jobs
$32.30 - $37.61
8% of jobs
$38.35 is the 25th percentile. Wages below this are outliers.
$37.61 - $42.92
10% of jobs
$42.92 - $48.23
13% of jobs
The median wage is $49.04 / hr.
$48.23 - $53.54
25% of jobs
$54.87 is the 75th percentile. Wages above this are outliers.
$53.54 - $58.85
16% of jobs
$58.85 - $64.16
9% of jobs
$64.16 - $69.47
4% of jobs
$11
$47
$69
| Aspect | Remote Ai Tester | Remote Data Annotator |
|---|---|---|
| Required Credentials | Basic understanding of AI/ML concepts, sometimes certifications in testing or QA | Attention to detail, training in annotation tools, no formal certifications required |
| Work Environment | Remote, often collaborative with AI development teams | Remote, focused on data labeling and annotation tasks |
| Industry Usage | AI development, machine learning projects | Data preparation for AI models, machine learning datasets |
| Common Search/Comparison | Yes | Yes |
Remote Ai Testers and Remote Data Annotators both work remotely in AI-related fields. While Ai Testers focus on evaluating AI models' performance and accuracy, Data Annotators prepare and label data for training AI systems. Both roles require attention to detail and familiarity with AI workflows, but Ai Testers often need a basic understanding of AI concepts, whereas Data Annotators primarily focus on data labeling tasks.
Cities with the most Remote Ai Tester job openings:
The most popular types of Ai Tester jobs are:
States with the most job openings for Remote Ai Tester jobs include:
The top searched job categories for Remote Ai Tester jobs are:
Denver, MO • Remote
Full-time
Posted 26 days ago
AI Agentic Tester
Denver, MO (Remote)
Must-Have Skills
* AI Agentic Testing
* Functional Testing
* Generative AI Testing
* Large Language Models (LLMs)
* AI Agents & Agentic AI
* Retrieval-Augmented Generation (RAG)
* Prompt Engineering Validation
* AI Model Validation & Evaluation
* API Testing (Postman, REST APIs, Swagger)
* Python
* Test Automation (Selenium / Playwright / PyTest)
* AI Evaluation Metrics (Accuracy, Hallucination, Relevance, Consistency)
* End-to-End Workflow Testing
* Multi-Agent Testing
* Azure OpenAI / AWS Bedrock / Gemini
Core Responsibilities
* Perform functional testing of AI agent workflows and end-to-end AI applications.
* Validate LLM responses for accuracy, relevance, consistency, and hallucination rates.
* Test RAG pipelines, prompt engineering, and AI agent orchestration.
* Execute API testing using Postman, Swagger, and REST APIs.
* Develop and maintain automation scripts using Python, Selenium, Playwright, or PyTest.
* Validate multi-agent interactions, tool calling, and workflow execution.
* Apply AI testing methodologies and evaluation metrics to ensure response quality.
* Work with Azure OpenAI, AWS Bedrock, Gemini, or similar AI platforms to validate AI solutions.
Sourced by ZipRecruiter
Engineering professional services and facilities support services
51 - 200 Employees
Freeport, NY, US
