Maintain consistent judgment across a high volume of short action segments. * Complete assigned ... Preferred * Experience with video annotation, data labeling, computer vision datasets, or ...
Quick apply
Maintain consistent judgment across a high volume of short action segments. * Complete assigned ... Preferred * Experience with video annotation, data labeling, computer vision datasets, or ...
Quick apply
Maintain consistent judgment across a high volume of short action segments. * Complete assigned ... Preferred * Experience with video annotation, data labeling, computer vision datasets, or ...
This role leads two tightly coupled but distinct capabilities: (1) governing canonical annotation standards and judgment frameworks, and (2) applying those standards at scale through operational ...
This role leads two tightly coupled but distinct capabilities: (1) governing canonical annotation standards and judgment frameworks, and (2) applying those standards at scale through operational ...
Demonstrated technical judgment in designing or operating annotation systems that support machine learning training, evaluation, or model assessment * Good understanding of annotation systems and ...
Demonstrated technical judgment in designing or operating annotation systems that support machine learning training, evaluation, or model assessment * Good understanding of annotation systems and ...
Maintain consistent judgment across a high volume of short action segments. * Complete assigned ... Preferred * Experience with video annotation, data labeling, computer vision datasets, or ...
Quick apply
Maintain consistent judgment across a high volume of short action segments. * Complete assigned ... Preferred * Experience with video annotation, data labeling, computer vision datasets, or ...
New York, NY · Remote
$20 - $25/hr
Maintain consistent judgment across a high volume of short action segments. * Complete assigned ... Preferred * Experience with video annotation, data labeling, computer vision datasets, or ...
Quick apply
New York, NY · Remote
$20 - $25/hr
Maintain consistent judgment across a high volume of short action segments. * Complete assigned ... Preferred * Experience with video annotation, data labeling, computer vision datasets, or ...
Perform AI/ML-related tasks such as data labeling, annotation, and content evaluation * Participate ... These tools assist our recruitment team but do not replace human judgment. Final hiring decisions ...
Perform AI/ML-related tasks such as data labeling, annotation, and content evaluation * Participate ... These tools assist our recruitment team but do not replace human judgment. Final hiring decisions ...
Perform AI/ML-related tasks such as data labeling, annotation, and content evaluation * Participate ... These tools assist our recruitment team but do not replace human judgment. Final hiring decisions ...
Quick apply
Perform AI/ML-related tasks such as data labeling, annotation, and content evaluation * Participate ... These tools assist our recruitment team but do not replace human judgment. Final hiring decisions ...
New York, NY · Remote
Perform AI/ML-related tasks such as data labeling, annotation, and content evaluation * Participate ... These tools assist our recruitment team but do not replace human judgment. Final hiring decisions ...
Quick apply
New York, NY · Remote
Perform AI/ML-related tasks such as data labeling, annotation, and content evaluation * Participate ... These tools assist our recruitment team but do not replace human judgment. Final hiring decisions ...
Perform AI/ML-related tasks such as data labeling, annotation, and content evaluation * Participate ... These tools assist our recruitment team but do not replace human judgment. Final hiring decisions ...
Perform AI/ML-related tasks such as data labeling, annotation, and content evaluation * Participate ... These tools assist our recruitment team but do not replace human judgment. Final hiring decisions ...
Perform AI/ML-related tasks such as data labeling, annotation, and content evaluation * Participate ... These tools assist our recruitment team but do not replace human judgment. Final hiring decisions ...
Perform AI/ML-related tasks such as data labeling, annotation, and content evaluation * Participate ... These tools assist our recruitment team but do not replace human judgment. Final hiring decisions ...
New York, NY · Remote
Perform AI/ML-related tasks such as data labeling, annotation, and content evaluation * Participate ... These tools assist our recruitment team but do not replace human judgment. Final hiring decisions ...
Quick apply
New York, NY · Remote
Perform AI/ML-related tasks such as data labeling, annotation, and content evaluation * Participate ... These tools assist our recruitment team but do not replace human judgment. Final hiring decisions ...
New York, NY · Remote
$93K - $116K/yr
... judgment are what matter most. Key Responsibilities * Analyze, review, and edit AI-generated ... Data Annotation * Problem-Solving * Independent Research * Attention to Detail Preferred ...
Quick apply
New York, NY · Remote
$93K - $116K/yr
... judgment are what matter most. Key Responsibilities * Analyze, review, and edit AI-generated ... Data Annotation * Problem-Solving * Independent Research * Attention to Detail Preferred ...
New York, NY · On-site
$94K - $118K/yr
We provide evaluation and annotation frameworks connecting natural language processing and human judgment in order to elevate the quality, intelligence, and usability of the data that drives our ...
New York, NY · On-site
$94K - $118K/yr
We provide evaluation and annotation frameworks connecting natural language processing and human judgment in order to elevate the quality, intelligence, and usability of the data that drives our ...
New York, NY · On-site
$75 - $110/hr
Comfort judging whether a correct nursing finding was properly escalated and documented Preferred * Prior data annotation, labeling, or AI evaluation experience is a plus Application Process (Takes ...
Quick apply
New York, NY · On-site
$75 - $110/hr
Comfort judging whether a correct nursing finding was properly escalated and documented Preferred * Prior data annotation, labeling, or AI evaluation experience is a plus Application Process (Takes ...
New York, NY · On-site
$75K - $100K/yr
The Clinical Specialist will play a critical role in data generation, annotation, and evaluation to ... Strong clinical judgment and attention to detail, with the ability to evaluate medication-related ...
New York, NY · On-site
$75K - $100K/yr
The Clinical Specialist will play a critical role in data generation, annotation, and evaluation to ... Strong clinical judgment and attention to detail, with the ability to evaluate medication-related ...
New York, NY · Hybrid
$87K - $119K/yr
... rigorous clinical judgment. This role requires a leader who can hold the clinical line with ... Oversee clinical operations of the AI arm, including annotation strategy, safety protocols ...
New York, NY · Hybrid
$87K - $119K/yr
... rigorous clinical judgment. This role requires a leader who can hold the clinical line with ... Oversee clinical operations of the AI arm, including annotation strategy, safety protocols ...
New York, NY · On-site +1
$162K/yr
... judgment to content quality decisions, we encourage you to apply. Product Content Engineer ... Experience designing and implementing evaluation frameworks, annotation guidelines, or quality ...
New York, NY · On-site +1
$162K/yr
... judgment to content quality decisions, we encourage you to apply. Product Content Engineer ... Experience designing and implementing evaluation frameworks, annotation guidelines, or quality ...
New York, NY · Remote
$120/hr
Judge completeness of the clinical picture, ensuring all active meds, labs, and comorbidities are ... Prior data annotation, labeling, or AI evaluation experience Application Process (Takes 20-30 mins ...
Quick apply
New York, NY · Remote
$120/hr
Judge completeness of the clinical picture, ensuring all active meds, labs, and comorbidities are ... Prior data annotation, labeling, or AI evaluation experience Application Process (Takes 20-30 mins ...
New York, NY · On-site
$87K - $119K/yr
... judgment behind it. Pelago has scaled to helping hundreds of employers and health plans and has ... Oversee clinical operations of the AI arm, including annotation strategy, safety protocols ...
New York, NY · On-site
$87K - $119K/yr
... judgment behind it. Pelago has scaled to helping hundreds of employers and health plans and has ... Oversee clinical operations of the AI arm, including annotation strategy, safety protocols ...
New York, NY · On-site
It requires disciplined evaluation, high-quality data, modeling judgment, experimentation, and ... Create and maintain representative datasets from simulations, human annotation, production feedback ...
Quick apply
New York, NY · On-site
It requires disciplined evaluation, high-quality data, modeling judgment, experimentation, and ... Create and maintain representative datasets from simulations, human annotation, production feedback ...
| Aspect | Annotation Judge | Data Annotator |
|---|---|---|
| Credentials | Typically requires basic education, sometimes certification in data labeling | Usually requires similar or less formal education, often on-the-job training |
| Work Environment | Office or remote, working with data labeling platforms | Office or remote, performing data labeling tasks |
| Industry Usage | Used across AI, machine learning, and data science projects | Common in AI, machine learning, and data preparation workflows |
| Search & Comparison Intent | Often compared for roles involving data review and quality control | Compared for entry-level data labeling roles |
The main difference between an Annotation Judge and a Data Annotator lies in their roles. Annotation Judges typically review and validate annotations made by Data Annotators, ensuring quality and accuracy. Data Annotators perform the initial labeling of data. Both roles are essential in AI data pipelines, with Annotation Judges focusing on quality control and Data Annotators on data preparation.
The top searched job categories for Annotation Judge jobs in Norwalk, CT are:

New York, NY • Remote
$25/hr
Full-time
Posted 10 days ago
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey.
Position: AI Data Generalist — Egocentric Video Review
Type: Contract
Compensation: $20–$25/hour
Location: Remote
Duration: Approximately 2 weeks
Role Responsibilities
Qualifications
Must-Have
Preferred
Start Date
Application Process (Takes 20–30 mins to complete)
Resources & Support
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.