ZipRecruiter

Log In

1

Ai Task Reviewer Jobs in California (NOW HIRING)

Mercor

Fraud Engineer - AI Specialist

San Francisco, CA · Remote

$80/hr

Use frontier AI coding agents to complete and evaluate complex fraud and risk engineering tasks. * Review model-generated implementations involving fraud detection systems, risk scoring models, abuse ...

Eloquent AI

AI Engineer, Platform

San Francisco, CA · On-site

From automating compliance reviews to handling customer operations, our Operators are quietly ... tasks with intelligent, end-to-end execution. Headquartered in San Francisco with a global ...

Eloquent AI

AI Engineer, Agent

San Francisco, CA · On-site

From automating compliance reviews to handling customer operations, our Operators are quietly ... tasks with intelligent, end-to-end execution. Headquartered in San Francisco with a global ...

Sycamore

Software Engineer, AI Evaluation

Palo Alto, CA · On-site

$180 - $240/hr

... tasks, reviewed when risk requires it, and deployable with clear rollback paths. The goal is a ... Core AI engineers are expected to own coherent end-to-end slices across backend services, APIs ...

New

Eloquent AI

AI Engineer, Multimodal LLMs

San Francisco, CA · On-site

$93K - $124K/yr

From automating compliance reviews to handling customer operations, our Operators are quietly ... tasks with intelligent, end-to-end execution. Headquartered in San Francisco with a global ...

next page

Showing results 1-20

All JobsAi Task Reviewer JobsAi Task Reviewer Jobs in California

Ai Task Reviewer information

How to become an AI task reviewer?

To become an AI task reviewer, candidates typically need strong attention to detail, good understanding of AI and machine learning concepts, and experience with data annotation or content moderation. Relevant skills include familiarity with review tools and platforms, and some roles may require a background in linguistics, computer science, or related fields. Gaining experience through online courses or certifications can also improve prospects in this role.

Are remote AI task reviewer jobs legit?

Remote AI task reviewer jobs are legitimate positions where individuals evaluate and annotate data to improve AI systems. These roles often require attention to detail, basic computer skills, and sometimes specific training or guidelines, and they are commonly offered by reputable companies in the tech industry.

What is the difference between Ai Task Reviewer vs Data Annotator?

AspectAi Task ReviewerData Annotator
Required CredentialsBasic computer skills, training in review guidelinesBasic computer skills, training in annotation tools
Work EnvironmentRemote or office-based, reviewing AI outputsRemote or office-based, labeling and annotating data
Industry UsageAI development, machine learning projectsData preparation, machine learning datasets
Search & Comparison IntentUnderstanding review roles in AI projectsUnderstanding data labeling roles in AI

The main difference between an Ai Task Reviewer and a Data Annotator lies in their roles within AI development. Ai Task Reviewers focus on evaluating and validating AI outputs, ensuring quality and accuracy, while Data Annotators are responsible for labeling and preparing data used to train AI models. Both roles are essential in the AI industry, often requiring similar skills but serving different functions in the data pipeline.

What are popular job titles related to Ai Task Reviewer jobs in California?

For Ai Task Reviewer jobs in California, the most frequently searched job titles are:

What job categories do people searching Ai Task Reviewer jobs in California look for?

The top searched job categories for Ai Task Reviewer jobs in California are:

What cities in California are hiring for Ai Task Reviewer jobs?

Cities in California with the most Ai Task Reviewer job openings:

Ai Task Reviewer jobs near you
Infographic showing various Ai Task Reviewer job openings in California as of August 2026, with employment types broken down into 85% Full Time, 9% Part Time, and 6% Contract. Highlights an 83% In-person, and 17% Remote job distribution.

DevOps Engineer - AI Model Evaluator - AI Trainer

Mercor

San Francisco, CA • Remote

$85/hr

Full-time

Re-posted 29 days ago

Job description

About the job

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey.

Position: DevOps / SRE / Cloud Engineer (Coding Agent Experience)
Type: Contract
Compensation: $85/hour
Location: Remote

Role Responsibilities

  • Use frontier AI coding agents to complete and evaluate complex infrastructure engineering tasks.
  • Review model-generated implementations involving cloud platforms, Kubernetes, CI/CD systems, and infrastructure automation.
  • Identify bugs, edge cases, reliability issues, and failure modes in model outputs.
  • Compare outputs from multiple frontier models to assess strengths and weaknesses.
  • Apply professional engineering judgment to realistic infrastructure engineering scenarios.

Qualifications

Must-Have

  • 2+ years of professional DevOps, SRE, or Cloud Engineering experience.
  • Experience with AWS, Azure, GCP, Kubernetes, Terraform, CI/CD pipelines, or observability tooling.
  • Regular use of AI coding agents like Cursor, Claude Code, Codex, Windsurf, Gemini CLI, or similar tools.
  • Ability to evaluate model-generated infrastructure and reliability engineering solutions.

Preferred

  • Experience supporting production-scale systems.

Compensation & Legal

  • $400 per accepted task.
  • Compensation is tied to accepted work.

Application Process (Takes 20–30 mins to complete)

  • Upload resume
  • AI interview based on your resume
  • Submit form

Resources & Support

  • For details about the interview process and platform information, please check: https://talent.docs.mercor.com/welcome
  • For any help or support, reach out to: support@mercor.com

PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.


#hiringmercor