New York, NY · Remote
$90/hr
Remote Commitment: 35 hours/week Role Responsibilities * Design test cases to confirm task ... Monitor AI agent runs for shortcuts and grading gaps to ensure trustworthy benchmark scores.
Quick apply
New York, NY · Remote
$90/hr
Remote Commitment: 35 hours/week Role Responsibilities * Design test cases to confirm task ... Monitor AI agent runs for shortcuts and grading gaps to ensure trustworthy benchmark scores.
New York, NY · Remote
$90/hr
Remote Commitment: 35 hours/week Role Responsibilities * Design test cases to confirm each task ... Protect benchmark scores by identifying shortcuts and grading gaps in AI agent runs. Qualifications ...
Quick apply
New York, NY · Remote
$90/hr
Remote Commitment: 35 hours/week Role Responsibilities * Design test cases to confirm each task ... Protect benchmark scores by identifying shortcuts and grading gaps in AI agent runs. Qualifications ...
New York, NY · Remote
$60 - $90/hr
Remote Commitment: 35 hours/week Role Responsibilities * Design test cases to confirm each task ... Protect benchmark scores by identifying shortcuts and grading gaps in AI agent runs. Qualifications ...
Quick apply
New York, NY · Remote
$60 - $90/hr
Remote Commitment: 35 hours/week Role Responsibilities * Design test cases to confirm each task ... Protect benchmark scores by identifying shortcuts and grading gaps in AI agent runs. Qualifications ...
Manhattan, NY · On-site +1
$75/hr
Analyze, score, and compare AI model outputs to support ongoing AI development and performance ... Test AI performance against custom-built scenarios and refine tasks based on quality reviews ...
New
Manhattan, NY · On-site +1
$75/hr
Analyze, score, and compare AI model outputs to support ongoing AI development and performance ... Test AI performance against custom-built scenarios and refine tasks based on quality reviews ...
New
New York, NY · On-site +1
$50 - $60/hr
Remote About TPAPT: TPAPT is a national nonprofit consortium of 17,000 local tutors and independent ... Proven success with high scores on both SAT and ACT. * 3-6 hours per week of availability * A ...
New York, NY · On-site +1
$50 - $60/hr
Remote About TPAPT: TPAPT is a national nonprofit consortium of 17,000 local tutors and independent ... Proven success with high scores on both SAT and ACT. * 3-6 hours per week of availability * A ...
New York, NY · Remote
$50 - $60/hr
Remote About TPAPT: TPAPT is a national nonprofit consortium of 17,000 local tutors and independent ... Proven success with high scores on both SAT and ACT. * 3-6 hours per week of availability * A ...
New York, NY · Remote
$50 - $60/hr
Remote About TPAPT: TPAPT is a national nonprofit consortium of 17,000 local tutors and independent ... Proven success with high scores on both SAT and ACT. * 3-6 hours per week of availability * A ...
Remote and in-person Salary: Industry leading hourly rates, plus performance bonuses and hourly ... Excellent GPA and test scores (98th to 99th percentile) * Ability to conceptualize and teach ...
Remote and in-person Salary: Industry leading hourly rates, plus performance bonuses and hourly ... Excellent GPA and test scores (98th to 99th percentile) * Ability to conceptualize and teach ...
Manhattan, NY · On-site +1
Remote and in-person Salary: Industry leading hourly rates, plus performance bonuses and hourly ... Excellent GPA and test scores (98th to 99th percentile) * Ability to conceptualize and teach ...
Manhattan, NY · On-site +1
Remote and in-person Salary: Industry leading hourly rates, plus performance bonuses and hourly ... Excellent GPA and test scores (98th to 99th percentile) * Ability to conceptualize and teach ...
Rye, NY · Remote
$67.50/hr
... test scores, and helps them prepare to be considered for admission into and succeed at the best ... This is a remote position.
Quick apply
Rye, NY · Remote
$67.50/hr
... test scores, and helps them prepare to be considered for admission into and succeed at the best ... This is a remote position.
Manhattan, NY · On-site +1
$125/hr
In this role, you will review and score AI model responses, develop expert-level financial ... Test AI performance against custom finance scenarios, analyze results, and refine tasks based on ...
New
Manhattan, NY · On-site +1
$125/hr
In this role, you will review and score AI model responses, develop expert-level financial ... Test AI performance against custom finance scenarios, analyze results, and refine tasks based on ...
New
New York, NY · Remote
This is a part-time, remote, 1099 contract role that can be based anywhere in the United States or ... Have previously taken the Medical College Admission Test (MCAT) (copy of official score report ...
New York, NY · Remote
This is a part-time, remote, 1099 contract role that can be based anywhere in the United States or ... Have previously taken the Medical College Admission Test (MCAT) (copy of official score report ...
Stamford, CT · Remote
$20 - $30/hr
Review the AI's formal translation of a statute and score it pass/fail against your rubric ... Write clear, self-contained test scenarios (including edge cases) for failed criteria, with ...
Stamford, CT · Remote
$20 - $30/hr
Review the AI's formal translation of a statute and score it pass/fail against your rubric ... Write clear, self-contained test scenarios (including edge cases) for failed criteria, with ...
Jersey City, NJ · Remote
$20 - $30/hr
Review the AI's formal translation of a statute and score it pass/fail against your rubric ... Write clear, self-contained test scenarios (including edge cases) for failed criteria, with ...
Jersey City, NJ · Remote
$20 - $30/hr
Review the AI's formal translation of a statute and score it pass/fail against your rubric ... Write clear, self-contained test scenarios (including edge cases) for failed criteria, with ...
Paterson, NJ · Remote
$20 - $30/hr
Review the AI's formal translation of a statute and score it pass/fail against your rubric ... Write clear, self-contained test scenarios (including edge cases) for failed criteria, with ...
Paterson, NJ · Remote
$20 - $30/hr
Review the AI's formal translation of a statute and score it pass/fail against your rubric ... Write clear, self-contained test scenarios (including edge cases) for failed criteria, with ...
Elizabeth, NJ · Remote
$20 - $30/hr
Review the AI's formal translation of a statute and score it pass/fail against your rubric ... Write clear, self-contained test scenarios (including edge cases) for failed criteria, with ...
Elizabeth, NJ · Remote
$20 - $30/hr
Review the AI's formal translation of a statute and score it pass/fail against your rubric ... Write clear, self-contained test scenarios (including edge cases) for failed criteria, with ...
Newark, NJ · Remote
$20 - $30/hr
Review the AI's formal translation of a statute and score it pass/fail against your rubric ... Write clear, self-contained test scenarios (including edge cases) for failed criteria, with ...
Newark, NJ · Remote
$20 - $30/hr
Review the AI's formal translation of a statute and score it pass/fail against your rubric ... Write clear, self-contained test scenarios (including edge cases) for failed criteria, with ...
New York, NY · Remote
$20 - $30/hr
Review the AI's formal translation of a statute and score it pass/fail against your rubric ... Write clear, self-contained test scenarios (including edge cases) for failed criteria, with ...
New York, NY · Remote
$20 - $30/hr
Review the AI's formal translation of a statute and score it pass/fail against your rubric ... Write clear, self-contained test scenarios (including edge cases) for failed criteria, with ...
Yonkers, NY · Remote
$20 - $30/hr
Review the AI's formal translation of a statute and score it pass/fail against your rubric ... Write clear, self-contained test scenarios (including edge cases) for failed criteria, with ...
Yonkers, NY · Remote
$20 - $30/hr
Review the AI's formal translation of a statute and score it pass/fail against your rubric ... Write clear, self-contained test scenarios (including edge cases) for failed criteria, with ...
Remote Role Responsibilities * Review multi-step enterprise sales workflows. Judge if the AI ... to score AI outputs. Capture what separates great selling from average. * Operate in test ...
Quick apply
Remote Role Responsibilities * Review multi-step enterprise sales workflows. Judge if the AI ... to score AI outputs. Capture what separates great selling from average. * Operate in test ...
New York, NY · Remote
This is a full-time, remote role that can be based anywhere in the United States or Canada. Your ... Have previously taken the Medical College Admission Test (MCAT) (copy of official score report ...
New York, NY · Remote
This is a full-time, remote role that can be based anywhere in the United States or Canada. Your ... Have previously taken the Medical College Admission Test (MCAT) (copy of official score report ...
A Remote Test Scoring job involves evaluating and grading standardized test responses, essays, or assessments from students, typically based on a set of guidelines or a scoring rubric. These jobs are usually seasonal and may require a background in education or a specific subject. Scorers work from home using a computer and internet connection, following strict accuracy and consistency standards. Training is often provided before scoring begins.
To thrive as a Remote Test Scorer, you need strong analytical skills, attention to detail, and a solid understanding of assessment rubrics, often supported by a bachelor’s degree or relevant teaching experience. Familiarity with online scoring platforms and secure data management systems is commonly required. Excellent time management, self-motivation, and clear written communication help candidates excel in this independent, deadline-driven role. These skills ensure fair, accurate, and efficient evaluation of student assessments from a remote environment.
A typical workday as a Remote Test Scorer involves logging onto a secure online scoring platform, reading and evaluating student assessments according to specific rubrics and guidelines, and entering scores and feedback electronically. Most positions offer flexible scheduling, but scorers are generally expected to meet daily or weekly quotas. It’s common to work independently, but you may have access to support from team leaders or participate in virtual training and calibration sessions. Attention to detail and maintaining focus for extended periods are crucial, as the accuracy and consistency of scoring directly impact students’ results.
The most popular types of Test Scoring jobs in New York are:
For Remote Test Scoring jobs in New York, the most frequently searched job titles are:
The top searched job categories for Remote Test Scoring jobs in New York are:
Cities in New York with the most Remote Test Scoring job openings:
$90/hr
Full-time
Posted 4 days ago
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey.
Position: QA/Test Engineer
Type: Contract
Compensation: $60–$90/hour
Location: Remote
Commitment: 35 hours/week
Role Responsibilities
Qualifications
Must-Have
Preferred
Application Process (Takes 20–30 mins to complete)
Resources & Support
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
