ZipRecruiter

Log In

1

Annotation Judge Jobs in Missouri (NOW HIRING)

next page

Showing results 1-20

All JobsAnnotation Judge JobsAnnotation Judge Jobs in Missouri

Annotation Judge information

What is an annotation judge?

An Annotation Judge is a professional who evaluates the quality and accuracy of labeled data, such as text, images, or audio, which has been annotated for use in machine learning and artificial intelligence projects. Their main responsibility is to review, verify, and ensure that the data annotations meet specific guidelines and standards. Annotation Judges play a critical role in improving the reliability of training datasets, which directly impacts the performance of AI systems. They often work closely with data annotators, quality assurance teams, and project managers to maintain high data quality.

What are the key skills and qualifications needed to thrive as an annotation judge, and why are they important?

To thrive as an Annotation Judge, you need strong analytical skills, attention to detail, and subject matter expertise relevant to the data being evaluated, usually supported by a degree in a related field. Familiarity with annotation platforms, data labeling tools, and quality assurance systems is typically required. Excellent communication, impartiality, and critical thinking help you provide clear feedback and maintain high annotation standards. These skills are crucial to ensure data accuracy and consistency, which directly impact the performance of machine learning models.

What are some common challenges faced by annotation judges, and how can they effectively overcome them?

Annotation Judges often face challenges such as maintaining impartiality, handling ambiguous or subjective data, and ensuring high consistency across large volumes of work. To overcome these, it’s essential to follow established guidelines closely, communicate regularly with team members for clarification, and participate in calibration sessions. Staying detail-oriented and seeking feedback can also help maintain accuracy and fairness in their assessments.

What is the difference between Annotation Judge vs Data Annotator?

AspectAnnotation JudgeData Annotator
CredentialsTypically requires basic education, sometimes certification in data labelingUsually requires similar or less formal education, often on-the-job training
Work EnvironmentOffice or remote, working with data labeling platformsOffice or remote, performing data labeling tasks
Industry UsageUsed across AI, machine learning, and data science projectsCommon in AI, machine learning, and data preparation workflows
Search & Comparison IntentOften compared for roles involving data review and quality controlCompared for entry-level data labeling roles

The main difference between an Annotation Judge and a Data Annotator lies in their roles. Annotation Judges typically review and validate annotations made by Data Annotators, ensuring quality and accuracy. Data Annotators perform the initial labeling of data. Both roles are essential in AI data pipelines, with Annotation Judges focusing on quality control and Data Annotators on data preparation.

What are popular job titles related to Annotation Judge jobs in Missouri?

For Annotation Judge jobs in Missouri, the most frequently searched job titles are:

What job categories do people searching Annotation Judge jobs in Missouri look for?

The top searched job categories for Annotation Judge jobs in Missouri are:

What cities in Missouri are hiring for Annotation Judge jobs?

Cities in Missouri with the most Annotation Judge job openings:

Annotation Judge jobs near you

Multilingual Data Annotation Specialist

Zefr

California, MO • On-site

$63 - $78/hr

Other

Medical, Dental, Vision, Life, Retirement, PTO

Posted yesterday

New

Job description

What we do:

Zefr is the leading global technology company enabling responsible marketing in walled garden social environments. Zefr’s solutions empower brands to manage their content adjacency on scaled platforms such as YouTube, Meta, TikTok, and Snap, in accordance with industry standard frameworks. Through its patented AI technology, Zefr offers brands and agencies more accurate and transparent solutions for social walled gardens. The company is headquartered in Los Angeles, California, with additional locations across the globe.

What you’ll do:

We are hiring a Multilingual Data Annotation Specialist to support the training and performance of Zefr’s advanced AI systems. In this role, you will annotate videos, images, and metadata across platforms such as YouTube, TikTok, Meta, and Snap.

High quality human annotation is foundational to how our machine learning systems interpret, classify, and evaluate content at scale. Your work will directly shape the accuracy and integrity of our AI solutions.

We are looking for someone curious about machine learning and computer vision, energized by nuanced decision making, and committed to delivering precise, thoughtful work. The ideal candidate is self-directed, analytical, proactive, and comfortable navigating ambiguity. Candidates should value clarity, ask smart questions, and continuously seek opportunities to improve processes.

Here’s what you’ll get to do:

  • Use internal tools to label social media content according to Zefr’s contextual category guidelines.

  • Conduct daily annotation and quality evaluation across video, image, and metadata formats.

  • Apply cognitive and cultural nuance when making judgment calls on complex or sensitive content.

  • Interpret, apply, and help refine labeling frameworks and documentation.

  • Identify emerging trends or edge cases and surface potential issues to stakeholders.

  • Conduct root cause analyses to identify opportunities for improving content quality.

  • Provide insights on content patterns and contribute to enhancements of the labeling interface.

  • Generate weekly reports with findings and quality recommendations.

  • Perform quality assurance across multiple project pipelines.

  • Maintain up-to-date knowledge of Zefr policies and proactively suggest optimization opportunities.

  • Gain foundational exposure to machine learning concepts and develop an understanding of how high quality annotation data powers AI systems.

Here’s what we’re looking for: Language Requirements:

  • Fluency in English and Hindi is required.

  • Fluency in Spanish, Mandarin, Turkish, Tagalog, or others are a plus.

Qualifications and Experience:

  • Professional experience in annotation, content moderation, labeling, quality assurance, or policy enforcement.

  • Strong cultural fluency and ability to interpret contextual nuance across varied content types.

  • Familiarity with major social media platforms including TikTok, YouTube, Facebook, Instagram, and Snapchat.

  • Exceptional attention to detail with the ability to perform repetitive tasks with consistency and accuracy.

  • Strong written communication skills, particularly in explaining ambiguity, inconsistencies, or definitional drift.

  • Ability to apply style guides and enforce consistency across diverse content formats.

  • Experience using AI tools such as Claude, Gemini, ChatGPT, or similar technologies.

  • Proficiency in Google Workspace applications.

  • Familiarity with SQL is a plus.

Working Style and Mindset:

  • Reliable, self motivated, and capable of delivering high quality work independently.

  • Strong analytical thinking and structured problem solving skills.

  • Comfortable working in a fast-paced environment with shifting priorities.

  • Work with sensitive content, including political topics, religious perspectives, violence, and adult material.

  • Effective collaborator who can also operate autonomously.

  • Willing to work a hybrid schedule with 2 to 3 days per week in our Marina del Rey office.

  • Ability to appropriately handle confidential and proprietary information with sound judgment.

Benefits (for US based employees):

  • Flexible PTO

  • Medical, dental, and vision insurance with FSA options

  • Company-paid life insurance

  • Paid parental leave

  • 401(k) with company match

  • Professional development opportunities

  • 13 paid holidays off

  • Flexible hybrid work schedules

  • “Summer Fridays” (shorter work days on select Fridays during the summertime)

  • In-office lunches and lots of free food

  • Optional in-person and virtual events (we like to celebrate!)

Compensation (for US based employees):

The anticipated salary for this position is 70,500. Individual pay is determined by factors such as job-related skills, experience, and relevant education or training. If your compensation expectations fall outside of this range, it may still be worth having a conversation.

Zefr is an equal opportunity employer that embraces diversity and inclusion in the workplace. We are committed to building a team that represents a variety of backgrounds, skills, and perspectives because we know this only makes us better. We strongly encourage women, persons of color, LGBTQIA+ individuals, persons with disabilities, members of ethnic minorities, foreign-born residents, and veterans to apply even if you do not meet 100% of the qualifications.

#J-18808-Ljbffr

Apply