2

Remote Ai Tester Jobs in San Ramon, CA (NOW HIRING)

Remote Role Responsibilities * Red team conversational AI models and agents to identify jailbreaks ... Apply structure by following taxonomies, benchmarks, and playbooks to ensure consistent testing.

Remote Role Responsibilities * Red team conversational AI models and agents. Conduct jailbreaks ... Apply structure using taxonomies, benchmarks, and playbooks to maintain consistent testing.

Remote Role Responsibilities * Red team conversational AI models and agents to identify jailbreaks ... Apply structure by following taxonomies, benchmarks, and playbooks to ensure consistent testing.

Software AI Engineer2 Experience: 6 - 8 yrs Location: 1 - US Bay Area 1 - US Remote Key ... Participate in the full software development lifecycle, including testing, deployment, and ...

next page

Showing results 1-20

Remote Ai Tester information

See San Ramon, CA salary details

$12

$53

$77

How much do remote ai tester jobs pay per hour?

As of Aug 7, 2026, the average hourly pay for remote ai tester in San Ramon, CA is $53.13, according to ZipRecruiter salary data. Most workers in this role earn between $41.92 and $62.60 per hour, depending on experience, location, and employer.

How do I become a remote AI tester?

To become a remote AI tester, you should have a strong understanding of AI and machine learning concepts, along with skills in programming, data analysis, and testing tools. Gaining experience through online courses, certifications, or internships can improve your prospects, and familiarity with platforms like Python, TensorFlow, or similar is often beneficial. Strong communication skills and the ability to work independently are also important for remote roles.

What are the key skills and qualifications needed to thrive as a remote AI tester, and why are they important?

To thrive as a Remote AI Tester, you need a strong understanding of software testing principles, programming basics (such as Python), and familiarity with AI/ML concepts, often supported by a degree in computer science or related field. Experience with testing frameworks, version control systems like Git, and bug tracking tools such as Jira is typically required. Attention to detail, analytical thinking, and effective remote communication are essential soft skills for this role. These skills ensure accurate evaluation of AI systems, reliable test coverage, and seamless collaboration with distributed teams.

What is the difference between Remote Ai Tester vs Remote Data Annotator?

AspectRemote Ai TesterRemote Data Annotator
Required CredentialsBasic understanding of AI/ML concepts, sometimes certifications in testing or QAAttention to detail, training in annotation tools, no formal certifications required
Work EnvironmentRemote, often collaborative with AI development teamsRemote, focused on data labeling and annotation tasks
Industry UsageAI development, machine learning projectsData preparation for AI models, machine learning datasets
Common Search/ComparisonYesYes

Remote Ai Testers and Remote Data Annotators both work remotely in AI-related fields. While Ai Testers focus on evaluating AI models' performance and accuracy, Data Annotators prepare and label data for training AI systems. Both roles require attention to detail and familiarity with AI workflows, but Ai Testers often need a basic understanding of AI concepts, whereas Data Annotators primarily focus on data labeling tasks.

What is a remote AI tester?

Remote AI Testers are professionals who evaluate and validate artificial intelligence systems, algorithms, or applications from a remote location. Their primary role is to ensure that AI models work as intended by testing for accuracy, reliability, and potential biases. They may create test cases, report bugs, and provide feedback to development teams to help improve AI products. This job often requires technical knowledge of AI, attention to detail, and strong communication skills. Working remotely allows AI testers to collaborate with teams globally and test software in various real-world environments.

What are some common challenges faced by remote AI testers, and how can they be addressed?

Remote AI Testers often encounter challenges such as limited direct communication with development teams and difficulties in understanding complex AI models without in-person support. To address these, it’s important to proactively schedule regular virtual meetings, document testing procedures thoroughly, and leverage collaboration tools to share findings efficiently. Staying updated with the latest testing frameworks and maintaining a strong self-management routine can also help ensure productivity and quality while working remotely.
What are popular job titles related to Remote Ai Tester jobs in San Ramon, CA? For Remote Ai Tester jobs in San Ramon, CA, the most frequently searched job titles are:
What cities near San Ramon, CA are hiring for Remote Ai Tester jobs? Cities near San Ramon, CA with the most Remote Ai Tester job openings:
Infographic showing various Remote Ai Tester job openings in San Ramon, CA as of July 2026, with employment types broken down into 78% Full Time, 9% Part Time, and 13% Contract. Highlights an 100% Remote job distribution, with an average salary of $110,511 per year, or $53.1 per hour.

AI Safety Specialist - Fully Remote | Upto $22/hr

Mercor

San Francisco, CA • Remote

$22/hr

Full-time

Re-posted 28 days ago


Job description

About the job

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey.

Position: AI Safety Experts — English & Gujarati
Type: Contract
Compensation: $20–$22/hour
Location: Remote

Role Responsibilities

  • Red team conversational AI models and agents to identify jailbreaks, prompt injections, and misuse cases.
  • Generate high-quality human data by annotating failures, classifying vulnerabilities, and flagging systemic risks.
  • Apply structure by following taxonomies, benchmarks, and playbooks to ensure consistent testing.
  • Document reproducibly by producing reports, datasets, and attack cases for customer action.
  • Work independently and asynchronously to meet deadlines while improving AI model performance.

Qualifications

Must-Have

  • Fluent in English and Gujarati.
  • Prior experience in red teaming (AI adversarial work, cybersecurity, socio-technical probing).
  • Ability to explain risks clearly to technical and non-technical stakeholders.

Preferred

  • Experience with Adversarial ML: jailbreak datasets, prompt injection, RLHF/DPO attacks, model extraction.
  • Background in Cybersecurity: penetration testing, exploit development, reverse engineering.
  • Knowledge of Socio-technical risk: harassment/disinfo probing, abuse analysis, conversational AI testing.

Application Process (Takes 20–30 mins to complete)

  • Upload resume
  • AI interview based on your resume
  • Submit form

Resources & Support

  • For details about the interview process and platform information, please check: https://talent.docs.mercor.com/welcome
  • For any help or support, reach out to: support@mercor.com

PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.