2

Remote Ai Tester Jobs in San Ramon, CA (NOW HIRING)

... Remote-first, technically rigorous team that takes production quality seriously WHAT YOU'LL DO: Own thefull QA lifecyclefor AI-powered solutions - from unit and integration testing through system ...

Remote Role Responsibilities * Red team conversational AI models and agents. Perform jailbreaks ... Apply structure using taxonomies, benchmarks, and playbooks to maintain consistent testing.

Remote Role Responsibilities * Red team conversational AI models and agents. Focus on jailbreaks ... Apply structure using taxonomies, benchmarks, and playbooks to maintain consistent testing.

Remote Role Responsibilities * Red team conversational AI models and agents to identify jailbreaks ... Apply structure by following taxonomies, benchmarks, and playbooks to ensure consistent testing.

Remote Role Responsibilities * Red team conversational AI models and agents to identify jailbreaks ... Apply structure by following taxonomies, benchmarks, and playbooks to ensure consistent testing.

Remote Role Responsibilities * Red team conversational AI models and agents to identify jailbreaks ... Apply structure by following taxonomies, benchmarks, and playbooks to maintain consistent testing.

About the job Mercor connects elite creative and technical talent with leading AI research labs ... Background in areas such as SOC analysis, incident response (DFIR), penetration testing, threat ...

Design, develop, and implement robust performance testing frameworks and automation tools to ... Experience with RDMA (Remote Direct Memory Access) and RoCEv2 (RDMA over Converged Ethernet)

AI System Engineer

San Francisco, CA · On-site +1

$175K - $250K/yr

Comfort with automated testing, metrics, and observability as part of core development practice ... San Francisco preferred, open to remote (U.S.) Employment Type: Full-time [Please note that all ...

Founding AI Engineer

Palo Alto, CA · Remote

$180K - $240K/yr

... testing for comparing models and orchestration stacks. * Strong foundation in CS, ML, or ... This is not a remote or hybrid role.

New

Software Engineer, AI SDK

San Francisco, CA · On-site +1

$196K - $294K/yr

You will collaborate closely with a remote and distributed team of talented engineers to create a ... Conduct comprehensive testing to ensure the reliability and stability of the SDK. * Collaborate ...

Showing results 21-40

Remote Ai Tester information

See San Ramon, CA salary details

$12

$53

$77

How much do remote ai tester jobs pay per hour?

As of Aug 8, 2026, the average hourly pay for remote ai tester in San Ramon, CA is $53.13, according to ZipRecruiter salary data. Most workers in this role earn between $41.92 and $62.60 per hour, depending on experience, location, and employer.

How do I become a remote AI tester?

To become a remote AI tester, you should have a strong understanding of AI and machine learning concepts, along with skills in programming, data analysis, and testing tools. Gaining experience through online courses, certifications, or internships can improve your prospects, and familiarity with platforms like Python, TensorFlow, or similar is often beneficial. Strong communication skills and the ability to work independently are also important for remote roles.

What are the key skills and qualifications needed to thrive as a remote AI tester, and why are they important?

To thrive as a Remote AI Tester, you need a strong understanding of software testing principles, programming basics (such as Python), and familiarity with AI/ML concepts, often supported by a degree in computer science or related field. Experience with testing frameworks, version control systems like Git, and bug tracking tools such as Jira is typically required. Attention to detail, analytical thinking, and effective remote communication are essential soft skills for this role. These skills ensure accurate evaluation of AI systems, reliable test coverage, and seamless collaboration with distributed teams.

What is the difference between Remote Ai Tester vs Remote Data Annotator?

AspectRemote Ai TesterRemote Data Annotator
Required CredentialsBasic understanding of AI/ML concepts, sometimes certifications in testing or QAAttention to detail, training in annotation tools, no formal certifications required
Work EnvironmentRemote, often collaborative with AI development teamsRemote, focused on data labeling and annotation tasks
Industry UsageAI development, machine learning projectsData preparation for AI models, machine learning datasets
Common Search/ComparisonYesYes

Remote Ai Testers and Remote Data Annotators both work remotely in AI-related fields. While Ai Testers focus on evaluating AI models' performance and accuracy, Data Annotators prepare and label data for training AI systems. Both roles require attention to detail and familiarity with AI workflows, but Ai Testers often need a basic understanding of AI concepts, whereas Data Annotators primarily focus on data labeling tasks.

What is a remote AI tester?

Remote AI Testers are professionals who evaluate and validate artificial intelligence systems, algorithms, or applications from a remote location. Their primary role is to ensure that AI models work as intended by testing for accuracy, reliability, and potential biases. They may create test cases, report bugs, and provide feedback to development teams to help improve AI products. This job often requires technical knowledge of AI, attention to detail, and strong communication skills. Working remotely allows AI testers to collaborate with teams globally and test software in various real-world environments.

What are some common challenges faced by remote AI testers, and how can they be addressed?

Remote AI Testers often encounter challenges such as limited direct communication with development teams and difficulties in understanding complex AI models without in-person support. To address these, it’s important to proactively schedule regular virtual meetings, document testing procedures thoroughly, and leverage collaboration tools to share findings efficiently. Staying updated with the latest testing frameworks and maintaining a strong self-management routine can also help ensure productivity and quality while working remotely.
What are popular job titles related to Remote Ai Tester jobs in San Ramon, CA? For Remote Ai Tester jobs in San Ramon, CA, the most frequently searched job titles are:
What cities near San Ramon, CA are hiring for Remote Ai Tester jobs? Cities near San Ramon, CA with the most Remote Ai Tester job openings:
Infographic showing various Remote Ai Tester job openings in San Ramon, CA as of July 2026, with employment types broken down into 78% Full Time, 9% Part Time, and 13% Contract. Highlights an 100% Remote job distribution, with an average salary of $110,511 per year, or $53.1 per hour.

AI Safety Specialist - Fully Remote | Upto $22/hr

Mercor

San Francisco, CA • Remote

$22/hr

Full-time

Re-posted 28 days ago


Job description

About the job

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey.

Position: AI Safety Experts — English & Assamese
Type: Contract
Compensation: $20–$22/hour
Location: Remote

Role Responsibilities

  • Red team conversational AI models and agents to identify jailbreaks, prompt injections, misuse cases, and bias exploitation.
  • Generate high-quality human data by annotating failures, classifying vulnerabilities, and flagging systemic risks.
  • Apply structure by following taxonomies, benchmarks, and playbooks to maintain consistent testing.
  • Document reproducibly by producing reports, datasets, and attack cases that customers can act on.
  • Review AI outputs on sensitive topics like bias, misinformation, or harmful behaviors, with optional participation in higher-sensitivity projects.

Qualifications

Must-Have

  • Fluent Language Skills Required: English & Assamese
  • Prior red teaming experience in AI adversarial work, cybersecurity, or socio-technical probing.
  • Ability to push systems to breaking points with a curious and adversarial mindset.
  • Structured approach using frameworks or benchmarks.
  • Strong communication skills to explain risks to technical and non-technical stakeholders.
  • Adaptability to move across projects and customers.

Preferred

  • Experience with Adversarial ML, Cybersecurity, and socio-technical risk.
  • Skills in creative probing, such as psychology, acting, or writing for unconventional adversarial thinking.

Application Process (Takes 20–30 mins to complete)

  • Upload resume
  • AI interview based on your resume
  • Submit form

Resources & Support

  • For details about the interview process and platform information, please check: https://talent.docs.mercor.com/welcome
  • For any help or support, reach out to: support@mercor.com

PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.