Annotation Judge Jobs in New York (NOW HIRING)

Maintain consistent judgment across a high volume of short action segments. * Complete assigned ... Preferred * Experience with video annotation, data labeling, computer vision datasets, or ...

This role leads two tightly coupled but distinct capabilities: (1) governing canonical annotation standards and judgment frameworks, and (2) applying those standards at scale through operational ...

Demonstrated technical judgment in designing or operating annotation systems that support machine learning training, evaluation, or model assessment * Good understanding of annotation systems and ...

Demonstrated technical judgment in designing or operating annotation systems that support machine learning training, evaluation, or model assessment * Good understanding of annotation systems and ...

Maintain consistent judgment across a high volume of short action segments. * Complete assigned ... Preferred * Experience with video annotation, data labeling, computer vision datasets, or ...

Maintain consistent judgment across a high volume of short action segments. * Complete assigned ... Preferred * Experience with video annotation, data labeling, computer vision datasets, or ...

About Rise Data Labs Rise Data Labs is a leading AI training and data annotation company that ... professional judgment * Participate in calibration sessions with other experts to align scoring ...

Perform AI/ML-related tasks such as data labeling, annotation, and content evaluation * Participate ... These tools assist our recruitment team but do not replace human judgment. Final hiring decisions ...

Perform AI/ML-related tasks such as data labeling, annotation, and content evaluation * Participate ... These tools assist our recruitment team but do not replace human judgment. Final hiring decisions ...

Perform AI/ML-related tasks such as data labeling, annotation, and content evaluation * Participate ... These tools assist our recruitment team but do not replace human judgment. Final hiring decisions ...

Perform AI/ML-related tasks such as data labeling, annotation, and content evaluation * Participate ... These tools assist our recruitment team but do not replace human judgment. Final hiring decisions ...

Perform AI/ML-related tasks such as data labeling, annotation, and content evaluation * Participate ... These tools assist our recruitment team but do not replace human judgment. Final hiring decisions ...

Perform AI/ML-related tasks such as data labeling, annotation, and content evaluation * Participate ... These tools assist our recruitment team but do not replace human judgment. Final hiring decisions ...

... judgment are what matter most. Key Responsibilities * Analyze, review, and edit AI-generated ... Data Annotation * Problem-Solving * Independent Research * Attention to Detail Preferred ...

Annotation protocols, rubrics, and evaluation designs for creative and multimodal outputs ... You understand how humans judge creative work and design systems around that. * You turn messy work ...

Experience translating expert judgment into criteria, rubrics, datasets, protocols, or measurable outcomes. * Experience designing or applying evaluation methods, benchmark datasets, annotation ...

We provide evaluation and annotation frameworks connecting natural language processing and human judgment in order to elevate the quality, intelligence, and usability of the data that drives our ...

Comfort judging whether a correct nursing finding was properly escalated and documented Preferred * Prior data annotation, labeling, or AI evaluation experience is a plus Application Process (Takes ...

Together, we turn human judgment into the training and evaluation layer that enables AI models and ... Design human-data collection strategies, evaluation protocols, rubrics, annotation schemes, and ...

The Clinical Specialist will play a critical role in data generation, annotation, and evaluation to ... Strong clinical judgment and attention to detail, with the ability to evaluate medication‑related ...