ZipRecruiter

Log In

1

Ai Rater Jobs in California (NOW HIRING)

Highlight AI

Head of AI

San Francisco, CA · On-site

$180 - $220/hr

  • Medical

  • Dental

  • Vision

  • PTO

Own output quality across Highlight chat, actions, and workflows; drive toward industry leading acceptance rates. * Build and lead a world‑class ML Engineering team; Establish AI/ML best practices ...

Highlight AI

Head of AI

San Francisco, CA · On-site

$250K - $350K/yr

  • Medical

  • Dental

  • Vision

  • PTO

Own output quality across Highlight chat, actions, and workflows; drive toward industry leading acceptance rates. * Build and lead a world-class ML Engineering team; Establish AI/ML best practices ...

Arcade AI, Inc

AI Engineer - Tools

San Francisco, CA · On-site

Experience building and consuming APIs - REST, auth flows, pagination, rate limits, and the messy ... Ready to make AI actually useful? Apply Now Compensation and Benefits This role offers a ...

next page

Showing results 1-20

All JobsAi Rater JobsAi Rater Jobs in California

Ai Rater information

What is an AI Rater?

An AI Rater evaluates and provides feedback on artificial intelligence models, typically improving search engines, chatbots, or recommendation systems. They assess the relevance, accuracy, and quality of AI-generated content based on specific guidelines. This role requires strong analytical skills, attention to detail, and familiarity with the subject matter being reviewed. AI Raters often work remotely and on a flexible schedule.

What skills and qualifications are needed to thrive as an AI Rater?

To thrive as an AI Rater, you generally need strong attention to detail, analytical thinking, and proficiency in English, often supported by formal education such as a high school diploma or higher. Familiarity with web browsers, online research, and company-specific rating platforms or guidelines is essential. Excellent time management, adaptability, and effective written communication help individuals excel in this position. These skills and qualities ensure accurate and consistent evaluations of AI-generated content, directly impacting the improvement of artificial intelligence systems.

What does an AI Rater do?

A typical day for an AI Rater involves reviewing and evaluating various types of content, such as search engine results, social media posts, advertisements, or chatbot responses, to ensure they meet quality and relevancy standards. You may follow detailed guidelines to rate or annotate content, complete assigned tasks in a web-based platform, and provide feedback to help improve AI performance. Most positions are remote and offer flexible schedules, allowing you to plan your workload around personal commitments. Collaboration is generally limited, as most work is performed independently, but periodic communication with team leads for training or updates is common.

What are the most commonly searched types of Ai Rater jobs in California?

The most popular types of Ai Rater jobs in California are:

What are popular job titles related to Ai Rater jobs in California?

For Ai Rater jobs in California, the most frequently searched job titles are:

What job categories do people searching Ai Rater jobs in California look for?

The top searched job categories for Ai Rater jobs in California are:

What cities in California are hiring for Ai Rater jobs?

Cities in California with the most Ai Rater job openings:

Ai Rater jobs near you
Infographic showing various Ai Rater job openings in California as of August 2026, with employment types broken down into 62% Full Time, 22% Part Time, 3% Temporary, and 13% Contract. Highlights an 82% In-person, and 18% Remote job distribution.

Linguist - Rater Guidelines Specialist

Mercor

San Francisco, CA • Remote

$45 - $65/hr

Full-time

Posted 2 days ago

New

Job description

About the job

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey.

Position: AI Rater Guidelines Writer (Linguist / Instructional Designer)
Type: Contract
Compensation: $45–$65/hour
Location: Remote

Role Responsibilities

  • Guide research and program teams to close the gap between ambiguous program requirements and rater-ready instructions across various domains.
  • Design clear, non-contradictory rating guidelines and rubrics for consistent application by raters, including in edge cases.
  • Evaluate draft guidelines for ambiguity, contradictions, and coverage gaps, revising until raters can apply them without escalation.
  • Translate program specifications from domains such as finance, retail, insurance, legal, and sports into precise rater instructions.
  • Collaborate with subject matter experts and program leads to ensure consistency and accuracy across guideline sets.

Qualifications

Must-Have

  • 3+ years of professional experience in linguistics, instructional design, technical writing, or a related field.
  • Experience writing or refining guidelines/rubrics for human raters in a GenAI/RLHF context.
  • Ability to work across multiple domains (e.g., finance, retail, insurance, legal, sports) and translate domain-specific nuances.
  • Strong track record of resolving ambiguity and contradiction in written specifications.
  • Ability to engage reliably for at least 35 hours/week during weekdays.
  • Strong written communication skills for explaining complex guidance clearly.

Application Process (Takes 20–30 mins to complete)

  • Upload resume
  • AI interview based on your resume
  • Submit form

Resources & Support

  • For details about the interview process and platform information, please check: https://talent.docs.mercor.com/welcome
  • For any help or support, reach out to: support@mercor.com

PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.