... independent judgment in ambiguous audio scenarios and make consistent, defensible annotation decisions. • Portfolio (strongly preferred for advanced candidates): Voice samples, annotated ...
... independent judgment in ambiguous audio scenarios and make consistent, defensible annotation decisions. • Portfolio (strongly preferred for advanced candidates): Voice samples, annotated ...
Conduct detailed data annotation and quality assurance of natural language datasets following ... These tools assist our recruitment team but do not replace human judgment. Final hiring decisions ...
Quick apply
Conduct detailed data annotation and quality assurance of natural language datasets following ... These tools assist our recruitment team but do not replace human judgment. Final hiring decisions ...
Demonstrated technical judgment in designing or operating annotation systems that support machine learning training, evaluation, or model assessment * Good understanding of annotation systems and ...
Demonstrated technical judgment in designing or operating annotation systems that support machine learning training, evaluation, or model assessment * Good understanding of annotation systems and ...
Team Leader - Document Research
Manhattan, NY · On-site
$135 - $230/hr
Demonstrated technical judgment in designing or operating annotation systems that support machine learning training, evaluation, or model assessment * Good understanding of annotation systems and ...
Team Leader - Document Research
Manhattan, NY · On-site
$135 - $230/hr
Demonstrated technical judgment in designing or operating annotation systems that support machine learning training, evaluation, or model assessment * Good understanding of annotation systems and ...
LLM-as-a-judge) to support the humans-in-the-loop (HITL) work of the broader Editorial team. They will lead and drive the requirements behind data annotation tasks and tooling, writing intuitive ...
LLM-as-a-judge) to support the humans-in-the-loop (HITL) work of the broader Editorial team. They will lead and drive the requirements behind data annotation tasks and tooling, writing intuitive ...
LLM-as-a-judge) to support the humans-in-the-loop (HITL) work of the broader Editorial team. They will lead and drive the requirements behind data annotation tasks and tooling, writing intuitive ...
LLM-as-a-judge) to support the humans-in-the-loop (HITL) work of the broader Editorial team. They will lead and drive the requirements behind data annotation tasks and tooling, writing intuitive ...
Survey Watch Stander / Video Annotator - Level I (Mesophotic Deep Benthic Communities Survey)
Panama City, FL · On-site
Position TitleSurvey Watch Stander and Video Annotation (Level I)Labor CategoryTechnical Support ... participating as judges for local science fairs, conducting and participating in outreach and ...
Quick apply
Survey Watch Stander / Video Annotator - Level I (Mesophotic Deep Benthic Communities Survey)
Panama City, FL · On-site
Position TitleSurvey Watch Stander and Video Annotation (Level I)Labor CategoryTechnical Support ... participating as judges for local science fairs, conducting and participating in outreach and ...
Position Title Survey Watch Stander and Video Annotation (Level I) Labor Category Technical Support ... participating as judges for local science fairs, conducting and participating in outreach and ...
Position Title Survey Watch Stander and Video Annotation (Level I) Labor Category Technical Support ... participating as judges for local science fairs, conducting and participating in outreach and ...
LLM-as-a-judge) to support the humans-in-the-loop (HITL) work of the broader Editorial team. They will lead and drive the requirements behind data annotation tasks and tooling, writing intuitive ...
LLM-as-a-judge) to support the humans-in-the-loop (HITL) work of the broader Editorial team. They will lead and drive the requirements behind data annotation tasks and tooling, writing intuitive ...
Survey Watch Stander / Video Annotator - Level I (Mesophotic Deep Benthic Communities Survey)
Panama City Beach, FL · On-site
Position Title Survey Watch Stander and Video Annotation (Level I) Labor Category Technical Support ... participating as judges for local science fairs, conducting and participating in outreach and ...
Survey Watch Stander / Video Annotator - Level I (Mesophotic Deep Benthic Communities Survey)
Panama City Beach, FL · On-site
Position Title Survey Watch Stander and Video Annotation (Level I) Labor Category Technical Support ... participating as judges for local science fairs, conducting and participating in outreach and ...
Conduct detailed data annotation and quality assurance of natural language datasets following ... These tools assist our recruitment team but do not replace human judgment. Final hiring decisions ...
Quick apply
Conduct detailed data annotation and quality assurance of natural language datasets following ... These tools assist our recruitment team but do not replace human judgment. Final hiring decisions ...
Demonstrated ability to exercise independent judgment in ambiguous audio scenarios and make consistent, defensible annotation decisions. * Portfolio (strongly preferred for advanced candidates)
Quick apply
Demonstrated ability to exercise independent judgment in ambiguous audio scenarios and make consistent, defensible annotation decisions. * Portfolio (strongly preferred for advanced candidates)
Demonstrated ability to exercise independent judgment in ambiguous audio scenarios and make consistent, defensible annotation decisions. * Portfolio (strongly preferred for advanced candidates)
Quick apply
Demonstrated ability to exercise independent judgment in ambiguous audio scenarios and make consistent, defensible annotation decisions. * Portfolio (strongly preferred for advanced candidates)
Lead Generative AI Analyst - English (US)
Santa Clara, CA · Remote
$50/hr
Rather than focusing on individual annotation work, you'll lead the day-to-day execution of AI data ... These tools assist our recruitment team but do not replace human judgment. Final hiring decisions ...
Quick apply
Lead Generative AI Analyst - English (US)
Santa Clara, CA · Remote
$50/hr
Rather than focusing on individual annotation work, you'll lead the day-to-day execution of AI data ... These tools assist our recruitment team but do not replace human judgment. Final hiring decisions ...
Conduct detailed data annotation and quality assurance of natural language datasets following ... These tools assist our recruitment team but do not replace human judgment. Final hiring decisions ...
Conduct detailed data annotation and quality assurance of natural language datasets following ... These tools assist our recruitment team but do not replace human judgment. Final hiring decisions ...
Demonstrated ability to exercise independent judgment in ambiguous audio scenarios and make consistent, defensible annotation decisions. * Portfolio (strongly preferred for advanced candidates)
Quick apply
Demonstrated ability to exercise independent judgment in ambiguous audio scenarios and make consistent, defensible annotation decisions. * Portfolio (strongly preferred for advanced candidates)
Demonstrated ability to exercise independent judgment in ambiguous audio scenarios and make consistent, defensible annotation decisions. * Portfolio (strongly preferred for advanced candidates)
Quick apply
Demonstrated ability to exercise independent judgment in ambiguous audio scenarios and make consistent, defensible annotation decisions. * Portfolio (strongly preferred for advanced candidates)
Demonstrated ability to exercise independent judgment in ambiguous audio scenarios and make consistent, defensible annotation decisions. * Portfolio (strongly preferred for advanced candidates)
Quick apply
Demonstrated ability to exercise independent judgment in ambiguous audio scenarios and make consistent, defensible annotation decisions. * Portfolio (strongly preferred for advanced candidates)
Demonstrated ability to exercise independent judgment in ambiguous audio scenarios and make consistent, defensible annotation decisions. * Portfolio (strongly preferred for advanced candidates)
Quick apply
Demonstrated ability to exercise independent judgment in ambiguous audio scenarios and make consistent, defensible annotation decisions. * Portfolio (strongly preferred for advanced candidates)
Demonstrated ability to exercise independent judgment in ambiguous audio scenarios and make consistent, defensible annotation decisions. * Portfolio (strongly preferred for advanced candidates)
Quick apply
Demonstrated ability to exercise independent judgment in ambiguous audio scenarios and make consistent, defensible annotation decisions. * Portfolio (strongly preferred for advanced candidates)
Annotation Judge information
What is an annotation judge?
What are the key skills and qualifications needed to thrive as an annotation judge, and why are they important?
What is the difference between Annotation Judge vs Data Annotator?
| Aspect | Annotation Judge | Data Annotator |
|---|---|---|
| Credentials | Typically requires basic education, sometimes certification in data labeling | Usually requires similar or less formal education, often on-the-job training |
| Work Environment | Office or remote, working with data labeling platforms | Office or remote, performing data labeling tasks |
| Industry Usage | Used across AI, machine learning, and data science projects | Common in AI, machine learning, and data preparation workflows |
| Search & Comparison Intent | Often compared for roles involving data review and quality control | Compared for entry-level data labeling roles |
The main difference between an Annotation Judge and a Data Annotator lies in their roles. Annotation Judges typically review and validate annotations made by Data Annotators, ensuring quality and accuracy. Data Annotators perform the initial labeling of data. Both roles are essential in AI data pipelines, with Annotation Judges focusing on quality control and Data Annotators on data preparation.
What are some common challenges faced by annotation judges, and how can they effectively overcome them?
- Volunteer Bird Dog Real Estate
- Senior Specialist Picerne Real Estate Group
- Flex Schedule Virtual Real Estate Assistant
- Assistant Parcel Post
- We Buy Ugly Houses
- Property Acquisition Specialist
- Head Of Global Real Estate
- Remote Drone Pilot Military
- Entry Level Real Estate Development
- Volunteer Real Estate Staging

SpaceX rating
8.8
Based on 147 frontline employees who took The Breakroom Quiz
15th of 72 rated aerospace companies
Job description
xAI is focused on creating AI systems that enhance human understanding and knowledge. They are seeking an AI Tutor specialized in multilingual audio capabilities to train and refine their AI model, Grok, in voice interactions and speech recognition across various languages and cultural contexts.
Responsibilities:
• Use proprietary software to provide labels, annotations, recordings, and inputs on projects involving multilingual audio clips, voice recordings, speech samples, and auditory elements in various languages.
• Support the delivery of high-quality curated audio data that ensures clear, natural spoken output, accurate representation of linguistic and prosodic details (such as intonation, rhythm, and accent), and professional audio standards.
• Collaborate with technical staff to develop tasks that improve AI's ability to handle speech modulation, accent variation, noise in real-world recordings, and multilingual audio processing.
• Work with technical staff to improve annotation tools for efficient audio workflows.
Qualifications:
Required:
• Native proficiency in Arabic with exposure to diverse accents, dialects, or regional variations.
• Proficiency in English (minimum B2 level) with clear, natural vocal delivery and pronunciation suitable for audio recording purposes.
• Strong auditory perception to identify nuances in speech, accents, pronunciation, intonation, and audio quality across languages.
• Demonstrated ability to handle multilingual audio content, including evaluating speech accuracy, cultural vocal expressions, and contextual interpretation in spoken form.
• Demonstrated ability to transcribe audio with high accuracy across accents and varying audio quality.
• Comfort providing high-quality voice recordings and feedback on audio samples in multiple languages.
• Strong comprehension skills and the ability to make independent judgments on ambiguous or varied audio material, including noisy or accented speech.
• Strong communication, interpersonal, analytical, detail-oriented, and organizational skills, with the ability to articulate audio-related feedback effectively.
• Commitment to developing AI that masters sophisticated multilingual audio capabilities.
Preferred:
• Demonstration of exceptional attention to linguistic nuance, auditory detail, and data quality beyond standard transcription work.
• Deep understanding and taste of what good/useful Audio data is.
• Strong command of advanced transcription and annotation practices, including handling disfluencies, accents, and prosodic features (intonation, stress, rhythm, emotion, etc) with high consistency and accuracy.
• Background in linguistics (e.g., phonetics, phonology, sociolinguistics), speech sciences, cognitive science, or a related field, or equivalent practical experience, with demonstrated ability to analyze accent variation, pronunciation differences, and multilingual speech patterns.
• Experience working with speech/audio datasets, annotation workflows, or AI training data, including knowledge/experience with training voice models, and an understanding of how data quality impacts model performance.
• Professional experience in voice work, including voice acting, voice recording, podcasting with a measurable audience (e.g., X following), or similar audio production demonstrating attention to clarity and recording quality.
• Demonstrated ability to exercise independent judgment in ambiguous audio scenarios and make consistent, defensible annotation decisions.
• Portfolio (strongly preferred for advanced candidates): Voice samples, annotated transcripts, or audio-related work demonstrating quality, methodology, and attention to detail.
• Candidates with professional experience in voice, linguistics, speech data, or speech evaluation and research are especially encouraged to apply.
Company:
SpaceXAI develops AI software and computational infrastructure designed for scientific discovery, automated reasoning, and data processing. It is a sub-organization of SpaceX. Founded in 2023, the company is headquartered in Palo Alto, USA, with a team of 1001-5000 employees. The company is currently Late Stage.
About SpaceX
Sourced by ZipRecruiter
Industry
Aerospace product and parts manufacturing, data services, guided missile and space vehicle manufacturing and satellite telecommunications
Company size
1,001 - 5,000 Employees
Headquarters location
Hawthorne, CA, US