ZipRecruiter

Log In

2

Remote Language Evaluator Jobs (NOW HIRING)

Mercor

Bilingual Evaluator - Telugu Expert

New York, NY · Remote

$15 - $20/hr

Remote Role Responsibilities * Conduct fact-checking using trusted public sources and external ... Significant experience using large language models . * Excellent writing skills in English

Mercor

Bilingual Evaluator - LLM Specialist

New York, NY · Remote

$15 - $20/hr

Remote Role Responsibilities * Conduct fact-checking using trusted public sources and external ... Significant experience using large language models (LLMs) * Excellent writing skills in English

next page

Showing results 1-20

All JobsRemote Language Evaluator Jobs

Remote Language Evaluator information

See salary details

$29.5K

$65.5K

$106.5K

How much do remote language evaluator jobs pay per year?

As of Jun 29, 2026, the average yearly pay for remote language evaluator in the United States is $65,471.00, according to ZipRecruiter salary data. Most workers in this role earn between $44,500.00 and $79,500.00 per year, depending on experience, location, and employer.

What are some common challenges faced by Remote Language Evaluators, and how can they be managed effectively?

Remote Language Evaluators often encounter challenges such as managing time across multiple projects, adapting to various language proficiency standards, and ensuring consistency in their evaluations. Working independently can also mean limited immediate feedback from colleagues, so staying organized and maintaining clear communication with the team is essential. Utilizing structured evaluation rubrics, participating in regular team check-ins, and leveraging online collaboration tools can help overcome these challenges and ensure high-quality, consistent assessments.

What is the difference between Remote Language Evaluator vs Remote Language Tester?

AspectRemote Language EvaluatorRemote Language Tester
CredentialsLanguage proficiency certifications, linguistic degreesLanguage proficiency certifications, linguistic degrees
Work EnvironmentRemote, flexible hours, home-basedRemote, flexible hours, home-based
Industry UsageUsed in localization, translation quality assessmentUsed in software testing, language comprehension validation
Job FocusAssessing language quality, evaluating translationsTesting language features in software, verifying language accuracy

Remote Language Evaluators and Remote Language Testers both work remotely and require language proficiency certifications. However, evaluators focus on assessing translation quality and linguistic accuracy, while testers concentrate on verifying language features within software applications. Both roles are essential in language-related industries but serve different purposes.

What is a Remote Language Evaluator?

A Remote Language Evaluator is a professional who assesses language proficiency, fluency, and comprehension abilities of individuals, typically through online platforms. They may conduct oral or written tests, rate language samples, and provide feedback to help organizations or educational institutions determine language skill levels. These evaluators work from remote locations, making use of technology to communicate with test-takers and submit evaluations. This role is essential for language learning programs, corporate training, and certification processes.

What are the key skills and qualifications needed to thrive as a Remote Language Evaluator, and why are they important?

To thrive as a Remote Language Evaluator, you need advanced proficiency in one or more languages, a strong understanding of grammar and linguistics, and often a relevant degree or language certification. Familiarity with digital assessment platforms, language testing software, and secure communication tools is typically required. Exceptional attention to detail, analytical thinking, and effective written communication are crucial soft skills for providing accurate evaluations. These capabilities ensure reliable language assessments and uphold the quality standards expected by educational institutions and language service providers.
More about Remote Language Evaluator jobs
What cities are hiring for Remote Language Evaluator jobs? Cities with the most Remote Language Evaluator job openings:
What are the most commonly searched types of Language Evaluator jobs? The most popular types of Language Evaluator jobs are:
What states have the most Remote Language Evaluator jobs? States with the most job openings for Remote Language Evaluator jobs include:
What job categories do people searching Remote Language Evaluator jobs look for? The top searched job categories for Remote Language Evaluator jobs are:
Remote Language Evaluator jobs near you
Infographic showing various Remote Language Evaluator job openings in the United States as of June 2026, with employment types broken down into 67% Part Time, and 33% Contract. Highlights an 37% Physical, 3% Hybrid, and 60% Remote job distribution, with an average salary of $65,471 per year, or $31.5 per hour.

Language Model Evaluator - Fully Remote | Upto $20/hr Part-time

Mercor

San Francisco, CA • Remote

$20/hr

Part-time

Posted 29 days ago

Job description

About the job

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey.

Position: Generalist - English & Bengali
Type: Contract
Compensation: $15–$20/hour
Location: Remote

Role Responsibilities

  • Conduct fact-checking using trusted public sources and external tools.
  • Generate high-quality human evaluation data by identifying response strengths, areas for improvement, and factual inaccuracies.
  • Assess reasoning quality, clarity, tone, and completeness of responses.
  • Ensure model responses align with expected conversational behavior and system guidelines.
  • Work independently and asynchronously to meet deadlines while improving AI model performance.

Qualifications

Must-Have

  • Bachelor's degree
  • Native speaker in Bengali
  • Significant experience using large language models (LLMs)
  • Excellent writing skills in English
  • Strong attention to detail
  • Background or experience in domains requiring structured analytical thinking (e.g., research, policy, analytics, linguistics, engineering)

Preferred

  • Prior experience with RLHF, model evaluation, or data annotation work
  • Experience writing or editing high-quality written content
  • Experience comparing multiple outputs and making fine-grained qualitative judgments

Application Process (Takes 20–30 mins to complete)

  • Upload resume
  • AI interview based on your resume
  • Submit form

Resources & Support

  • For details about the interview process and platform information, please check: https://talent.docs.mercor.com/welcome
  • For any help or support, reach out to: support@mercor.com

PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.