ZipRecruiter

Log In

2

Remote Ai Tester Jobs in California (NOW HIRING)

Mercor

AI Safety Expert - Bilingual

San Francisco, CA · Remote

$17 - $25/hr

Remote Role Responsibilities * Red team conversational AI models and agents. Focus on jailbreaks ... Apply structure using taxonomies, benchmarks, and playbooks to maintain consistent testing.

Mercor

AI Safety Expert - Red Team

San Francisco, CA · Remote

$29 - $45/hr

Remote Role Responsibilities * Red team conversational AI models and agents by performing ... Apply structure by following taxonomies, benchmarks, and playbooks to maintain consistent testing.

Mercor

AI Safety Expert - Red Team

San Francisco, CA · Remote

$17 - $25/hr

Remote Role Responsibilities * Red team conversational AI models and agents to identify jailbreaks ... Apply structure by following taxonomies, benchmarks, and playbooks to ensure consistent testing.

Mercor

AI Safety Expert - Red Team

San Francisco, CA · Remote

$29 - $45/hr

Remote Role Responsibilities * Red team conversational AI models and agents by performing ... Apply structure by following taxonomies, benchmarks, and playbooks to maintain consistent testing.

Mercor

AI Safety Expert - Red Team

San Francisco, CA · Remote

$48 - $62/hr

Remote Role Responsibilities * Red team conversational AI models and agents to identify jailbreaks ... Apply structure by following taxonomies, benchmarks, and playbooks to maintain consistent testing.

YO AI Labs

Travel Operations Expert - Remote

Palo Alto, CA · Remote

$50 - $70/hr

Remote Job Overview We are seeking experienced Travel Operations Experts to support an AI training ... The role involves testing real-world travel scenarios, evaluating AI-supported tools, and providing ...

New

YO AI Labs

Travel Operations Expert - Remote

San Jose, CA · Remote

$50 - $70/hr

Remote Job Overview We are seeking experienced Travel Operations Experts to support an AI training ... The role involves testing real-world travel scenarios, evaluating AI-supported tools, and providing ...

New

Productive Playhouse

Thai AI Product Tester

Glendale, CA · On-site +1

$250/day

Thai AI Product Tester Location: 100% Remote, located in the U.S. Device: Applicants must have a qualifying Google Pixel device for the duration of the project Compensation: USD $250.00 upon ...

next page

Showing results 1-20

All JobsAi Tester JobsRemote Ai Tester JobsRemote Ai Tester Jobs in California

Remote Ai Tester information

What is a remote AI tester?

Remote AI Testers are professionals who evaluate and validate artificial intelligence systems, algorithms, or applications from a remote location. Their primary role is to ensure that AI models work as intended by testing for accuracy, reliability, and potential biases. They may create test cases, report bugs, and provide feedback to development teams to help improve AI products. This job often requires technical knowledge of AI, attention to detail, and strong communication skills. Working remotely allows AI testers to collaborate with teams globally and test software in various real-world environments.

What are the key skills and qualifications needed to thrive as a remote AI tester, and why are they important?

To thrive as a Remote AI Tester, you need a strong understanding of software testing principles, programming basics (such as Python), and familiarity with AI/ML concepts, often supported by a degree in computer science or related field. Experience with testing frameworks, version control systems like Git, and bug tracking tools such as Jira is typically required. Attention to detail, analytical thinking, and effective remote communication are essential soft skills for this role. These skills ensure accurate evaluation of AI systems, reliable test coverage, and seamless collaboration with distributed teams.

What are some common challenges faced by remote AI testers, and how can they be addressed?

Remote AI Testers often encounter challenges such as limited direct communication with development teams and difficulties in understanding complex AI models without in-person support. To address these, it’s important to proactively schedule regular virtual meetings, document testing procedures thoroughly, and leverage collaboration tools to share findings efficiently. Staying updated with the latest testing frameworks and maintaining a strong self-management routine can also help ensure productivity and quality while working remotely.

What is the difference between Remote Ai Tester vs Remote Data Annotator?

AspectRemote Ai TesterRemote Data Annotator
Required CredentialsBasic understanding of AI/ML concepts, sometimes certifications in testing or QAAttention to detail, training in annotation tools, no formal certifications required
Work EnvironmentRemote, often collaborative with AI development teamsRemote, focused on data labeling and annotation tasks
Industry UsageAI development, machine learning projectsData preparation for AI models, machine learning datasets
Common Search/ComparisonYesYes

Remote Ai Testers and Remote Data Annotators both work remotely in AI-related fields. While Ai Testers focus on evaluating AI models' performance and accuracy, Data Annotators prepare and label data for training AI systems. Both roles require attention to detail and familiarity with AI workflows, but Ai Testers often need a basic understanding of AI concepts, whereas Data Annotators primarily focus on data labeling tasks.

What are the most commonly searched types of Ai Tester jobs in California?

The most popular types of Ai Tester jobs in California are:

What are popular job titles related to Remote Ai Tester jobs in California?

For Remote Ai Tester jobs in California, the most frequently searched job titles are:

What job categories do people searching Remote Ai Tester jobs in California look for?

The top searched job categories for Remote Ai Tester jobs in California are:

What cities in California are hiring for Remote Ai Tester jobs?

Cities in California with the most Remote Ai Tester job openings:

Remote Ai Tester jobs near you
Infographic showing various Remote Ai Tester job openings in California as of August 2026, with employment types broken down into 80% Full Time, and 20% Part Time. Highlights an 100% Remote job distribution.

AI Red Team Specialist - Remote | Upto $25/hr

San Francisco, CA • Remote

Mercor
See more jobs at Mercorexternal

$25/hr

Full-time

Posted 2 days ago

New

Job description

About the job

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey.

Position: AI Safety Experts — English & Indonesian
Type: Contract
Compensation: $17–$25/hour
Location: Remote

Role Responsibilities

  • Red team conversational AI models and agents. Focus on jailbreaks, prompt injections, misuse cases, and bias exploitation.
  • Generate high-quality human data. Annotate failures, classify vulnerabilities, and flag systemic risks.
  • Apply structure using taxonomies, benchmarks, and playbooks to maintain consistent testing.
  • Document reproducibly. Produce reports, datasets, and attack cases that customers can act on.

Qualifications

Must-Have

  • Fluent in English and Indonesian.
  • Prior red teaming experience in AI adversarial work, cybersecurity, or socio-technical probing.
  • Ability to explain risks clearly to technical and non-technical stakeholders.

Preferred

  • Experience in Adversarial ML: jailbreak datasets, prompt injection, RLHF/DPO attacks, model extraction.
  • Background in Cybersecurity: penetration testing, exploit development, reverse engineering.
  • Knowledge of socio-technical risk: harassment/disinfo probing, abuse analysis, conversational AI testing.

Application Process (Takes 20–30 mins to complete)

  • Upload resume
  • AI interview based on your resume
  • Submit form

Resources & Support

  • For details about the interview process and platform information, please check: https://talent.docs.mercor.com/welcome
  • For any help or support, reach out to: support@mercor.com

PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.