ZipRecruiter

Log In

2

Remote Reader Evaluator Jobs in California (NOW HIRING)

YO AI Labs

Accountant (CPA/CA) Remote

Palo Alto, CA · Remote

$20 - $30/hr

Remote Job Overview We are seeking experienced Tax Professionals and US Tax Law Experts to apply ... evaluations is what matters most. Key Responsibilities * Read and interpret US sales and use tax ...

YO AI Labs

Accountant (CPA/CA) Remote

Los Angeles, CA · Remote

$20 - $30/hr

Remote Job Overview We are seeking experienced Tax Professionals and US Tax Law Experts to apply ... evaluations is what matters most. Key Responsibilities * Read and interpret US sales and use tax ...

YO AI Labs

Accountant (CPA/CA) Remote

San Francisco, CA · Remote

$20 - $30/hr

Remote Job Overview We are seeking experienced Tax Professionals and US Tax Law Experts to apply ... evaluations is what matters most. Key Responsibilities * Read and interpret US sales and use tax ...

YO AI Labs

Accountant (CPA/CA) Remote

San Jose, CA · Remote

$20 - $30/hr

Remote Job Overview We are seeking experienced Tax Professionals and US Tax Law Experts to apply ... evaluations is what matters most. Key Responsibilities * Read and interpret US sales and use tax ...

Mercor

JSON Specialist - Rubric Expert

San Francisco, CA · Remote

$50 - $175/hr

Remote Commitment: 20-40 hours/week Role Responsibilities * Evaluate JSON-formatted AI model ... Read and understand written task descriptions and rubrics. * Parse, read, and assess JSON-based ...

next page

Showing results 1-20

All JobsReader Evaluator JobsRemote Reader Evaluator JobsRemote Reader Evaluator Jobs in California

Remote Reader Evaluator information

What is a remote reader evaluator?

Remote Reader Evaluators are professionals who assess and score standardized tests, essays, or other written materials from a remote location, often using online platforms. They are typically hired by educational testing companies or organizations to ensure consistent and fair evaluation of student responses. These evaluators follow specific scoring guidelines and rubrics to maintain objectivity and accuracy. The role usually requires strong analytical skills, attention to detail, and, in some cases, a background in education or a related field.

What are the key skills and qualifications needed to thrive as a remote reader evaluator?

To thrive as a Remote Reader Evaluator, you need strong analytical skills, attention to detail, and a relevant educational background—often a bachelor’s degree in education or a related field. Familiarity with online assessment platforms and secure document management systems, as well as training in scoring rubrics, is typically required. Excellent written communication, time management, and the ability to work independently are crucial soft skills for this role. These skills ensure accurate, consistent, and unbiased evaluation of student work in a remote environment.

What are some common challenges faced by remote reader evaluators, and how can they be overcome?

Remote Reader Evaluators often encounter challenges such as maintaining consistency in scoring, managing time effectively during peak grading periods, and staying focused while working independently. To overcome these, it helps to follow the provided scoring rubrics closely, participate actively in calibration sessions, and establish a structured daily routine to minimize distractions. Regular communication with team leads and peers can also provide support and clarify any uncertainties about evaluation criteria.

What is the difference between Remote Reader Evaluator vs Remote Content Moderator?

AspectRemote Reader Evaluator
Required CredentialsHigh school diploma or equivalent; some roles may require a degree or experience in language or education
Work EnvironmentRemote, flexible hours, often independent work
Employer & Industry UsageUsed by educational companies, content platforms, and testing organizations
Common Search & ComparisonCompared for evaluating reading comprehension, language skills, or content accuracy

Remote Reader Evaluators focus on assessing reading materials, comprehension, and language accuracy, often in educational or testing contexts. Remote Content Moderators review user-generated content for appropriateness. While both roles are remote and require attention to detail, the Reader Evaluator emphasizes evaluation of reading and language, whereas Content Moderators focus on content compliance and community standards.

How to become a remote reader evaluator?

To become a remote reader evaluator, typically you need strong reading comprehension skills, attention to detail, and the ability to evaluate content objectively. Many employers require a high school diploma or equivalent, and some may ask for prior experience in content review or related fields. Familiarity with online tools and a reliable internet connection are also important for remote work.

What are the most commonly searched types of Reader Evaluator jobs in California?

The most popular types of Reader Evaluator jobs in California are:

What are popular job titles related to Remote Reader Evaluator jobs in California?

For Remote Reader Evaluator jobs in California, the most frequently searched job titles are:

What job categories do people searching Remote Reader Evaluator jobs in California look for?

The top searched job categories for Remote Reader Evaluator jobs in California are:

What cities in California are hiring for Remote Reader Evaluator jobs?

Cities in California with the most Remote Reader Evaluator job openings:

Remote Reader Evaluator jobs near you
Infographic showing various Remote Reader Evaluator job openings in California as of August 2026, with employment types broken down into 100% Part Time. Highlights an 100% Remote job distribution.

JSON Evaluator - Fully Remote | Upto $175/hr

Mercor

San Francisco, CA • Remote

$175/hr

Full-time

Posted 16 days ago

Job description

About the job

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey.

Position: JSON-fluent & Rubrics Expert
Type: Contract
Compensation: $50–$175/hour
Location: Remote
Commitment: 20–40 hours/week

Role Responsibilities

  • Evaluate JSON-formatted AI model outputs against defined grading rubrics.
  • Read and understand written task descriptions and rubrics.
  • Parse, read, and assess JSON-based outputs, grading them against provided rubrics.
  • Ensure attention to detail and consistency in applying rubric criteria.
  • Work independently to meet tight deadlines within 12-24 hours.

Qualifications

Must-Have

  • Available to start today, July 24, running to July 27-28.
  • Comfortable reading and interpreting JSON files.
  • Based in the US.
  • Access to a desktop or laptop computer (no Chromebooks).

Preferred

  • Prior Mercor experience, especially in applying detailed rubrics and evaluation criteria consistently.

Start Date

  • Today, July 24

Application Process (Takes 20–30 mins to complete)

  • Upload resume
  • AI interview based on your resume
  • Submit form

Resources & Support

  • For details about the interview process and platform information, please check: https://talent.docs.mercor.com/welcome
  • For any help or support, reach out to: support@mercor.com

PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.