ZipRecruiter

Log In

1

Live In Ai Evaluator Jobs (NOW HIRING)

Innodata Inc.

AI Evaluator - Flexible Hours

$15/hr

This is more than just a gig-it's a rare chance to help shape the future of AI from anywhere in the ... Evaluating the perceived quality and/or appropriateness of content * Generating labels to advance ...

Mercor

AI Evaluator - Software Expert

New York, NY · Remote

$80 - $120/hr

Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Software / AI / IT / data Evaluator Type:

Mercor

Compliance AI Evaluator - Finance

New York, NY · Remote

$80 - $120/hr

Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel ... Position: Compliance / regulatory response with financial-services AI Evaluator Type: Contract ...

Mercor

Financial Compliance AI Evaluator

New York, NY · Remote

$80 - $120/hr

Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel ... Position: Compliance / regulatory response with financial-services AI Evaluator Type: Contract ...

Mercor

Compliance AI Evaluator - Finance

New York, NY · Remote

$80 - $120/hr

Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel ... Position: Compliance / regulatory response with financial-services AI Evaluator Type: Contract ...

Right at Home

Live-In's

Skokie, IL · On-site

$180 - $200/day

Must be able to successfully complete a written Competency Evaluation * You must have a high school ... Paid travel time in between clients & mileage * Medical Benefits - Including Vision & Dental

next page

Showing results 1-20

All JobsEducation JobsHigher Education JobsAdmissions Evaluator JobsLive In Ai Evaluator Jobs

Live In Ai Evaluator information

See salary details

$29.5K

$65.5K

$106.5K

How much do live in ai evaluator jobs pay per year?

As of Aug 19, 2026, the average yearly pay for live in ai evaluator in the United States is $65,471.00, according to ZipRecruiter salary data. Most workers in this role earn between $44,500.00 and $79,500.00 per year, depending on experience, location, and employer.
More about Live In Ai Evaluator jobs

What cities are hiring for Live In Ai Evaluator jobs?

Cities with the most Live In Ai Evaluator job openings:

What are the most commonly searched types of Ai Evaluator jobs?

The most popular types of Ai Evaluator jobs are:

What states have the most Live In Ai Evaluator jobs?

States with the most job openings for Live In Ai Evaluator jobs include:

What job categories do people searching Live In Ai Evaluator jobs look for?

The top searched job categories for Live In Ai Evaluator jobs are:

Live In Ai Evaluator jobs near you
Infographic showing various Live In Ai Evaluator job openings in the United States as of August 2026, with employment types broken down into 1% As Needed, 67% Full Time, 29% Part Time, and 3% Contract. Highlights an 83% Physical, 2% Hybrid, and 15% Remote job distribution, with an average salary of $65,471 per year, or $31.5 per hour.

AI Evaluator - Flexible Hours

Innodata Inc.

Remote

$15/hr

Full-time, Part-time

Re-posted 24 days ago

Innodata rating

7.5

Company rating: 7.5 out of 10

Based on 6 frontline employees who took The Breakroom Quiz

163rd of 245 rated software companies

Job description

Scope of the Role: 

At Innodata, we're partnering with the world's leading technology companies to build the future of generative AI and large language models (LLMs). We're on the lookout for smart, savvy, and curious Generative AI Specialist to join our global contributor community as part of our Subject Matter Expert (SME) on Demand program.

This is not a traditional full-time role. It's a part-time, remote, flexible, project-specific opportunity designed for those who want to make a real impact-on their schedule. Whether you're a writer, linguist, educator, researcher, or just deeply passionate about language and logic, this role lets you contribute to cutting-edge AI development while maintaining control over your time. 

You'll be helping LLMs learn the intricacies of language and reasoning-not just how to write, but how to think. If you've ever dreamed of shaping the intelligence behind tomorrow's technology, this is your chance. 

This is more than just a gig-it's a rare chance to help shape the future of AI from anywhere in the world, on your own terms. 

What You'll Own:

  • Rating/assessing the performance of AI models or algorithms based on their output or behavior through a set of evaluative questions.  
  • Labeling elements of a piece of content rather than the content as a whole.  
  • Assigning predefined categories or labels to items.  
  • Evaluating the perceived quality and/or appropriateness of content  
  • Generating labels to advance understanding of a concept, trend etc.  
  • Creation of additional training data for machine learning models by applying transformations to the original data, such as modifying images (rotation, flipping, cropping), generating new text (paraphrasing, summarization), or altering audio/video signals (speed modification, pitch shifting) to reduce overfitting and increase dataset diversity.  
  • Reviewing data and identifying whether or not a product feature works as intended based on the project's guidelines.  
  • Labeling model outputs to identify if a piece of content is or isn't something. Examples: identify clickbait; identifying gaming videos; identifying branded content. 
  • Ordering or ranking items based on a set of preferences or criteria.  
  • Creating prompts or questions that will be used to generate responses from a language model or other AI system.  
  • Projects that evaluate the relevance of content based on a relevancy scale (1-3, 1-5, etc.).  
  • Generating responses to prompts or questions using a language model or other AI system.  
  • Rewriting existing text while preserving the original meaning, often to improve clarity or style and adherence to guidelines.  
  • Producing concise summaries of longer pieces of text or data.  
  • Converting spoken language or audio content into written text.  
  • Converting text or spoken language from one language to another.  
  • Gathering and compiling various forms of data to be used for training, evaluating, or fine-tuning the AI models. This may include text, images, videos, audio files, or other types of digital content.

You'll Thrive in This Role If You Have:

  • A Bachelor's degree or higher in a humanities specialization is required. Advanced degrees are strongly preferred (Master's or PhD)
  • Professional or Expert level proficiency (C1/C2) in English 

The expected hourly salary range for this position is $15 p/hour, based on experience, skills, and qualifications.

What Innodata employees say

Hours and flexibility

Workplace

Get the full story on Breakroom

Apply