Experience in AI data annotation, evaluation, or QA. What Success Looks Like: * High consistency in ... Feedback that improves annotator performance and overall output quality. * Contribution to a ...
Experience in AI data annotation, evaluation, or QA. What Success Looks Like: * High consistency in ... Feedback that improves annotator performance and overall output quality. * Contribution to a ...
Client Director, Frontier Data - US
Palo Alto, CA · On-site
$255K - $325K/yr
... rate, inter-annotator agreement, and pairwise preference scoring) Client Partnership ... Experience evaluating large language model performance and/or improving model performance via fine ...
Client Director, Frontier Data - US
Palo Alto, CA · On-site
$255K - $325K/yr
... rate, inter-annotator agreement, and pairwise preference scoring) Client Partnership ... Experience evaluating large language model performance and/or improving model performance via fine ...
Client Director, Frontier Data - US
Palo Alto, CA · On-site
$255K - $325K/yr
... rate, inter-annotator agreement, and pairwise preference scoring) Client Partnership ... Experience evaluating large language model performance and/or improving model performance via ...
Client Director, Frontier Data - US
Palo Alto, CA · On-site
$255K - $325K/yr
... rate, inter-annotator agreement, and pairwise preference scoring) Client Partnership ... Experience evaluating large language model performance and/or improving model performance via ...
Quality Manager, Applied AI
Boston, MA · On-site
$125K - $160K/yr
... the language they speak. We use cutting-edge AI, machine translation, and human-in-the-loop ... S. in a quantitative field (CS, Statistics, Data Science, Engineering, Linguistics, HCI) or ...
Quality Manager, Applied AI
Boston, MA · On-site
$125K - $160K/yr
... the language they speak. We use cutting-edge AI, machine translation, and human-in-the-loop ... S. in a quantitative field (CS, Statistics, Data Science, Engineering, Linguistics, HCI) or ...
This project focuses on using Large Language Models (LLMs) to provide annotations of evaluation data (a.k.a., LLM as judge), and the design of an Inter-Annotator Agreement study to assess the ...
This project focuses on using Large Language Models (LLMs) to provide annotations of evaluation data (a.k.a., LLM as judge), and the design of an Inter-Annotator Agreement study to assess the ...
Quality Manager, Applied AI
Boston, MA · On-site
... the language they speak. We use cutting-edge AI, machine translation, and human-in-the-loop ... S. in a quantitative field (CS, Statistics, Data Science, Engineering, Linguistics, HCI) or ...
Quality Manager, Applied AI
Boston, MA · On-site
... the language they speak. We use cutting-edge AI, machine translation, and human-in-the-loop ... S. in a quantitative field (CS, Statistics, Data Science, Engineering, Linguistics, HCI) or ...
AI/ML Engineer - NLP Scientist
South San Francisco, CA · On-site
$80 - $85/hr
Implement claim decomposition, natural language inference (NLI), entailment, and contradiction ... Build evaluation datasets with expert annotation guidelines and measure inter-annotator agreement
AI/ML Engineer - NLP Scientist
South San Francisco, CA · On-site
$80 - $85/hr
Implement claim decomposition, natural language inference (NLI), entailment, and contradiction ... Build evaluation datasets with expert annotation guidelines and measure inter-annotator agreement
Strong Python production engineering with modern natural language processing frameworks ... annotator agreement * Reports error rates by direction, not only aggregate accuracy -- false ...
Strong Python production engineering with modern natural language processing frameworks ... annotator agreement * Reports error rates by direction, not only aggregate accuracy -- false ...
NLP Scientist
San Jose, CA · On-site
Minimum capabilities Strong Python production engineering with modern natural language processing ... and inter-annotator agreement Reports error rates by direction, not only aggregate accuracy ...
NLP Scientist
San Jose, CA · On-site
Minimum capabilities Strong Python production engineering with modern natural language processing ... and inter-annotator agreement Reports error rates by direction, not only aggregate accuracy ...
Production Manager, Applied AI
Boston, MA · On-site
... the language they speak. We use cutting-edge AI, machine translation, and human-in-the-loop ... Repeated misses by a PM or annotator pool lead to documented remediation or replacement. Issues are ...
Production Manager, Applied AI
Boston, MA · On-site
... the language they speak. We use cutting-edge AI, machine translation, and human-in-the-loop ... Repeated misses by a PM or annotator pool lead to documented remediation or replacement. Issues are ...
Senior Product Manager
$129K - $170K/yr
By incorporating robust clinical narrative data, artificial intelligence technology, and measured ... Working knowledge of natural language processing (NLP), machine learning (ML), and the concepts ...
Senior Product Manager
$129K - $170K/yr
By incorporating robust clinical narrative data, artificial intelligence technology, and measured ... Working knowledge of natural language processing (NLP), machine learning (ML), and the concepts ...
Senior Product Manager
$129K - $170K/yr
By incorporating robust clinical narrative data, artificial intelligence technology, and measured ... Working knowledge of natural language processing (NLP), machine learning (ML), and the concepts ...
Senior Product Manager
$129K - $170K/yr
By incorporating robust clinical narrative data, artificial intelligence technology, and measured ... Working knowledge of natural language processing (NLP), machine learning (ML), and the concepts ...
Production Manager, Applied AI
Boston, MA · On-site
$110K - $145K/yr
... the language they speak. We use cutting-edge AI, machine translation, and human-in-the-loop ... Repeated misses by a PM or annotator pool lead to documented remediation or replacement. Issues are ...
Production Manager, Applied AI
Boston, MA · On-site
$110K - $145K/yr
... the language they speak. We use cutting-edge AI, machine translation, and human-in-the-loop ... Repeated misses by a PM or annotator pool lead to documented remediation or replacement. Issues are ...
AI/ML Engineer - NLP Scientist
South San Francisco, CA · On-site
$80 - $85/hr
Implement claim decomposition, natural language inference (NLI), entailment, and contradiction ... Build evaluation datasets with expert annotation guidelines and measure inter-annotator agreement
AI/ML Engineer - NLP Scientist
South San Francisco, CA · On-site
$80 - $85/hr
Implement claim decomposition, natural language inference (NLI), entailment, and contradiction ... Build evaluation datasets with expert annotation guidelines and measure inter-annotator agreement
Content Engineer, Meta Superintelligence Labs
Menlo Park, CA · On-site
$162K - $227K/yr
Sitting at the intersection of user experience and large-language model behavior, content engineers ... annotator teams, build calibration processes, and deliver data analysis on results. Partner with ...
Content Engineer, Meta Superintelligence Labs
Menlo Park, CA · On-site
$162K - $227K/yr
Sitting at the intersection of user experience and large-language model behavior, content engineers ... annotator teams, build calibration processes, and deliver data analysis on results. Partner with ...
Content Engineer, Meta Superintelligence Labs
Menlo Park, CA · On-site
$162K/yr
Sitting at the intersection of user experience and large-language model behavior, content engineers ... annotator teams, build calibration processes, and deliver data analysis on results. Partner with ...
Content Engineer, Meta Superintelligence Labs
Menlo Park, CA · On-site
$162K/yr
Sitting at the intersection of user experience and large-language model behavior, content engineers ... annotator teams, build calibration processes, and deliver data analysis on results. Partner with ...
Product & Research Operations Manager, Human Data
San Francisco, CA · On-site
$160K - $225K/yr
Define and track inter-rater reliability, error rates by category, and annotator-level performance ... Background in audio, speech, or language-related workflows * Familiarity with QA systems and ...
Product & Research Operations Manager, Human Data
San Francisco, CA · On-site
$160K - $225K/yr
Define and track inter-rater reliability, error rates by category, and annotator-level performance ... Background in audio, speech, or language-related workflows * Familiarity with QA systems and ...
... language model post-training and evaluation, to produce the expert reasoning and evaluation data ... annotator would apply them the same way Why join Cobalt AI: * Advance frontier AI where it counts.
... language model post-training and evaluation, to produce the expert reasoning and evaluation data ... annotator would apply them the same way Why join Cobalt AI: * Advance frontier AI where it counts.
... language model post-training and evaluation, to produce the expert reasoning and evaluation data ... annotator would apply them the same way Why join Cobalt AI: * Advance frontier AI where it counts.
... language model post-training and evaluation, to produce the expert reasoning and evaluation data ... annotator would apply them the same way Why join Cobalt AI: * Advance frontier AI where it counts.
... language model post-training and evaluation, to produce the expert reasoning and evaluation data ... annotator would apply them the same way Why join Cobalt AI: * Advance frontier AI where it counts.
... language model post-training and evaluation, to produce the expert reasoning and evaluation data ... annotator would apply them the same way Why join Cobalt AI: * Advance frontier AI where it counts.
Language Data Annotator information
What is the difference between Language Data Annotator vs Transcription Specialist?
| Aspect | Language Data Annotator | Transcription Specialist |
|---|---|---|
| Credentials | Basic computer skills, attention to detail | Typing proficiency, language skills |
| Work Environment | Data labeling platforms, remote or office | Audio/video transcription, remote or office |
| Industry Usage | AI training, machine learning datasets | Media, legal, medical transcription |
| Search Intent | Compare roles in data annotation | Compare roles in transcription |
The main difference is that Language Data Annotators focus on labeling and categorizing language data for AI models, while Transcription Specialists convert audio or video content into written text. Both roles require language skills and attention to detail but serve different purposes within the language processing industry.
What cities are hiring for Language Data Annotator jobs?
Cities with the most Language Data Annotator job openings:
What states have the most Language Data Annotator jobs?
States with the most job openings for Language Data Annotator jobs include:
What are popular job titles related to Language Data Annotator jobs?
For Language Data Annotator jobs, the most frequently searched job titles are:
AI Quality Control Specialist - Dutch Language (NL)
e2f, inc.
 • Translation Services • 51 - 200 employees51 - 200 employees
Full-time
Re-posted 24 days ago
Job description
About the Role:
TrustScale is building scalable, high-quality human-in-the-loop systems to power AI. We are looking for an AI Quality Control Specialist - Dutch Language (NL) who can analyze, validate, and challenge AI-generated outputs with precision and consistency. This is not a proofreading role. You will act as a quality gatekeeper, ensuring outputs meet standards for accuracy, utility, and linguistic quality across large-scale workflows.
What You Will Do:
- Evaluate AI-generated content in Dutch across multiple task types (annotation, review, validation).
- Apply structured quality frameworks to assess:
- Accuracy and factual correctness.
- Utility (alignment with user intent).
- Language quality (fluency, tone, clarity).
- Train vendors
- Participate Clients Calls
Identify and flag:
- Hallucinations and misinformation.
- Logical inconsistencies.
- Cultural or linguistic mismatches.
- Provide clear, structured feedback to improve upstream quality.
- Detect patterns of errors across batches and contribute to quality insights.
- Support calibration efforts to ensure consistent scoring across teams.
- Contribute to guideline refinement and evaluation standards.
Who You Are:
- Professional proficiency in Dutch and strong command of English are required.
- Highly analytical with strong critical thinking skills.
- Comfortable working with ambiguous and evolving guidelines.
- Detail-oriented with the ability to maintain consistency at scale.
- Clear communicator, able to justify decisions and provide actionable feedback.
- Naturally skepticalable to question outputs and validate information.
Preferred Background:
- Journalism, editorial, or investigative research.
- Linguistics, translation, or localization QA.
- Content moderation / Trust & Safety.
- Experience in AI data annotation, evaluation, or QA.
What Success Looks Like:
- High consistency in quality scoring across tasks.
- Strong alignment with QA benchmarks.
- Ability to detect non-obvious quality issues.
- Feedback that improves annotator performance and overall output quality.
- Contribution to a scalable, predictable quality system.
Why TrustScale:
At TrustScale, we operate AI talent as a supply chainstructured, measurable, and optimized. You will be part of a system where quality is not subjective, but defined, measured, and continuously improved.
About e2f
Sourced by ZipRecruiter
Industry
Translation services
Company size
51 - 200 Employees
Headquarters location
San Jose, CA, US
Year founded
2004