This role sits at the intersection of data science, human annotation engineering, and evaluation methodology, and is instrumental in turning human judgment into a rigorous, reproducible signal that ...
This role sits at the intersection of data science, human annotation engineering, and evaluation methodology, and is instrumental in turning human judgment into a rigorous, reproducible signal that ...
Data Operations Engineer
Mountain View, CA · On-site
$136.30K - $163.60K/yr
The Data Operations Engineer will manage the internal dataset library and collaborate with various ... with data annotation, labeling workflows, or dataset preparation for machine learning. • ...
Data Operations Engineer
Mountain View, CA · On-site
$136.30K - $163.60K/yr
The Data Operations Engineer will manage the internal dataset library and collaborate with various ... with data annotation, labeling workflows, or dataset preparation for machine learning. • ...
You will collaborate with product managers and ML engineers to define ontology requirements, design annotation workflows, and manage internal and external annotation teams. From sampling data and ...
You will collaborate with product managers and ML engineers to define ontology requirements, design annotation workflows, and manage internal and external annotation teams. From sampling data and ...
Software Engineer, ML Data Infrastructure
Mountain View, CA · On-site
$136.30K - $163.60K/yr
... data annotation tools to support first-party and third-party labeling workforce to provide high ... Engineering, or a closely related field Preferred : • Strong proficiency in C++ or other high ...
Software Engineer, ML Data Infrastructure
Mountain View, CA · On-site
$136.30K - $163.60K/yr
... data annotation tools to support first-party and third-party labeling workforce to provide high ... Engineering, or a closely related field Preferred : • Strong proficiency in C++ or other high ...
Annotation Data Scientist, Evaluation Integrity (Siri)
$154.60K - $274.90K/yr
This role sits at the intersection of data science, human annotation engineering, and evaluation methodology, and is instrumental in turning human judgment into a rigorous, reproducible signal that ...
Annotation Data Scientist, Evaluation Integrity (Siri)
$154.60K - $274.90K/yr
This role sits at the intersection of data science, human annotation engineering, and evaluation methodology, and is instrumental in turning human judgment into a rigorous, reproducible signal that ...
Helix AI Engineer, Tooling
San Jose, CA · Hybrid
$150K - $250K/yr
Design and build intuitive web interfaces for robot data annotation, datasets visualization, and ... Strong software engineering fundamentals * Bachelor's or Master's degree in Computer Science ...
Helix AI Engineer, Tooling
San Jose, CA · Hybrid
$150K - $250K/yr
Design and build intuitive web interfaces for robot data annotation, datasets visualization, and ... Strong software engineering fundamentals * Bachelor's or Master's degree in Computer Science ...
Human Data Solutions Engineer
San Francisco, CA · On-site
$134.90K - $162K/yr
The role As a Human Data Operations & Solutions Engineer at Encord, you will sit at the ... You'll own the full arc: leading technical discovery on demo calls, designing the annotation ...
Quick apply
Human Data Solutions Engineer
San Francisco, CA · On-site
$134.90K - $162K/yr
The role As a Human Data Operations & Solutions Engineer at Encord, you will sit at the ... You'll own the full arc: leading technical discovery on demo calls, designing the annotation ...
Data Quality Specialist
Sunnyvale, CA · On-site
... annotation and labeling to support machine learning model training • Document quality standards and create comprehensive reports on data quality metrics • Collaborate with engineering teams to ...
Data Quality Specialist
Sunnyvale, CA · On-site
... annotation and labeling to support machine learning model training • Document quality standards and create comprehensive reports on data quality metrics • Collaborate with engineering teams to ...
Senior Robotics Data Collection Engineer - Only W2
Warren, MI · On-site
$99.60K - $135.20K/yr
Senior Robotics Data Collection Engineer Location: Warren, MI (Onsite from Day 1) Job Type: W2 ... established annotation guidelines and quality standards. · Perform manual annotation and ...
Quick apply
Senior Robotics Data Collection Engineer - Only W2
Warren, MI · On-site
$99.60K - $135.20K/yr
Senior Robotics Data Collection Engineer Location: Warren, MI (Onsite from Day 1) Job Type: W2 ... established annotation guidelines and quality standards. · Perform manual annotation and ...
Human Factors Research Engineer, AIML Data Operations
$171.60K - $258.10K/yr
This global data annotation and collection initiative enables Apple to create amazing new ... engineers to develop highly-usable and performant interfaces Published research in human-in-the ...
Human Factors Research Engineer, AIML Data Operations
$171.60K - $258.10K/yr
This global data annotation and collection initiative enables Apple to create amazing new ... engineers to develop highly-usable and performant interfaces Published research in human-in-the ...
Robotics Data Collection Engineer Location: Warren, Michigan (Onsite) Duration: 12+Months with ... Perform manual annotation and verification when necessary to generate high-quality ground truth ...
Quick apply
Robotics Data Collection Engineer Location: Warren, Michigan (Onsite) Duration: 12+Months with ... Perform manual annotation and verification when necessary to generate high-quality ground truth ...
You will collaborate with product managers and ML engineers to define ontology requirements, design annotation workflows, and manage internal and external annotation teams. From sampling data and ...
You will collaborate with product managers and ML engineers to define ontology requirements, design annotation workflows, and manage internal and external annotation teams. From sampling data and ...
Python Developer _ MRM & Data Annotation (AI/ML)
Charlotte, NC · On-site
$110K - $125K/yr
... for annotation workflow automation (task assignment, QA sampling, and label consistency checks). • Collaborate with risk, compliance, and data science teams to align model development with ...
Python Developer _ MRM & Data Annotation (AI/ML)
Charlotte, NC · On-site
$110K - $125K/yr
... for annotation workflow automation (task assignment, QA sampling, and label consistency checks). • Collaborate with risk, compliance, and data science teams to align model development with ...
Senior Manager of Quality Assurance, AIML Data Operations
$214K - $356.60K/yr
Cross-Functional & Stakeholder Collaboration Partner with Data Science and ML Engineering teams to understand model requirements, translate them into annotation quality standards, and close feedback ...
Senior Manager of Quality Assurance, AIML Data Operations
$214K - $356.60K/yr
Cross-Functional & Stakeholder Collaboration Partner with Data Science and ML Engineering teams to understand model requirements, translate them into annotation quality standards, and close feedback ...
... annotation pipelines that feed directly into Apple's AI and machine learning models. You will partner closely with Data Science, Engineering, and Operations leadership to ensure that data quality is ...
... annotation pipelines that feed directly into Apple's AI and machine learning models. You will partner closely with Data Science, Engineering, and Operations leadership to ensure that data quality is ...
CA · On-site
$26 - $29/wk
Programming: Program parts using 2D and/or 3D toolpaths with Surfcam or Mastercam on mills and lathes. * Blueprint Reading: Read and interpret prints, specification sheets, and 3D files to determine ...
Quick apply
Software Engineer, ML Infrastructure
Vancouver, WA · On-site +1
$155K - $190K/yr
As a Software Engineer on the Machine Learning (ML) Infrastructure team, you will help design ... You will build and improve our data discovery capabilities and integrate with 3rd party annotation ...
Software Engineer, ML Infrastructure
Vancouver, WA · On-site +1
$155K - $190K/yr
As a Software Engineer on the Machine Learning (ML) Infrastructure team, you will help design ... You will build and improve our data discovery capabilities and integrate with 3rd party annotation ...
Software Engineer, Labeling Infrastructure
Mountain View, CA · Hybrid
$204.10K - $241.80K/yr
Experience developing data annotation/review tools. EG: Labeling for ML, Content Reviews for Trust ... Experiencing programming using C++, Python. * Hands-on experience with LLM/GenAI-based products ...
Software Engineer, Labeling Infrastructure
Mountain View, CA · Hybrid
$204.10K - $241.80K/yr
Experience developing data annotation/review tools. EG: Labeling for ML, Content Reviews for Trust ... Experiencing programming using C++, Python. * Hands-on experience with LLM/GenAI-based products ...
Data Annotator / Data Labeling Specialist
Charlotte, NC · On-site
$110K - $125K/yr
... annotation taxonomy and definitions consistently across tasks and datasets. • Perform quality ... ML engineers and linguists/domain experts to improve labeling frameworks. • Support dataset ...
Data Annotator / Data Labeling Specialist
Charlotte, NC · On-site
$110K - $125K/yr
... annotation taxonomy and definitions consistently across tasks and datasets. • Perform quality ... ML engineers and linguists/domain experts to improve labeling frameworks. • Support dataset ...
Software Engineer, ML Infrastructure
Los Angeles, CA · Remote
$155K - $190K/yr
As a Software Engineer on the Machine Learning (ML) Infrastructure team, you will help design ... You will build and improve our data discovery capabilities and integrate with 3rd party annotation ...
Quick apply
Software Engineer, ML Infrastructure
Los Angeles, CA · Remote
$155K - $190K/yr
As a Software Engineer on the Machine Learning (ML) Infrastructure team, you will help design ... You will build and improve our data discovery capabilities and integrate with 3rd party annotation ...
Data Annotation Engineer information
See salary details
$51.5K - $64.7K
2% of jobs
$64.7K - $78K
9% of jobs
$87.2K is the 25th percentile. Wages below this are outliers.
$78K - $91.2K
20% of jobs
$91.2K - $104.4K
4% of jobs
$104.4K - $117.6K
4% of jobs
$117.6K - $130.9K
1% of jobs
$130.9K - $144.1K
0% of jobs
$144.1K - $157.3K
0% of jobs
The median wage is $163.9K / yr.
$157.3K - $170.5K
18% of jobs
$170.5K - $183.8K
0% of jobs
$188.9K is the 75th percentile. Wages above this are outliers.
$183.8K - $197K
41% of jobs
$51.5K
$147.5K
$197K
How much do data annotation engineer jobs pay per year?
What is a Data Annotation Engineer job?
What are the key skills and qualifications needed to thrive in the Data Annotation Engineer position, and why are they important?
What are the main challenges faced by Data Annotation Engineers in their daily work?
- What are the key skills and qualifications needed to thrive in the Data Annotation Engineer position and why are they important?
- What are the main challenges faced by Data Annotation Engineers in their daily work?
- What is a Data Annotation Engineer job?
- The 10 Top Types Of Data Annotation Engineer Jobs

Full-time
Posted 11 days ago
Apple rating
8.1
Based on 661 frontline employees who took The Breakroom Quiz
6th of 30 rated technology retailers
Job description
As an Annotation Data Scientist on the Evaluation Integrity team, you will design and run HITL annotation projects that evaluate the quality and authenticity of agentic user personae, the validity of agent-to-agent conversations, and the reliability of LLM-as-judge and rule-based evaluators against Siri's product specifications. You will own annotation initiatives end-to-end; from rubric design and tooling, through annotator calibration, to data science analysis that turns annotator judgments into actionable signal for modeling, planning, and product teams.
Bachelor's or Master's degree in a quantitative or related field such as Data Science, Computer Science, Linguistics, Statistics, or Cognitive Science, or equivalent job-related experience.5+ years of hands-on experience working with human-annotated datasets or human-in-the-loop evaluation methodologies for machine learning, natural language processing, or large language model systems.5+ years of experience using Python for data processing, analysis, and prototyping, including experience with libraries such as pandas, Jupyter, and at least one data visualization library.Experience designing, implementing, and communicating annotation schemas, rubrics, or ontologies for machine learning training or evaluation data.Experience managing multiple concurrent dataset curation efforts, including scoping work, iterating on guidelines, coordinating with in-house or vendor annotators, and monitoring annotator performance metrics such as accuracy, throughput, and inter-annotator agreement.Experience specifying or designing custom annotation tooling in collaboration with software engineers.
Experience evaluating LLM-powered or agentic systems, including familiarity with LLM-as-judge methodologies, rubric-based grading, or trajectory and tool-call evaluation.Familiarity with statistical methods that address accuracy and variability in human annotation data, such as inter-annotator agreement, Cohen's or Fleiss' kappa, Krippendorff's alpha, or bootstrapping.Data-querying experience with SQL, Spark, or similar, and comfort working with large, complex, real-world datasets.Experience building pre-ship evaluation pipelines for conversational or assistant products.Experience with prompt engineering, or with designing simulated user personae for agent evaluation.Experience running annotation programs across multiple locales or at large scale.Excellent written and verbal communication skills, with the ability to explain technical topics clearly to data scientists, engineers, annotators, and cross-functional partners.Proven ability to collaborate effectively across functions and drive projects of varying sizes and scopes - knowing when to dive deep and when to delegate.
About Apple
Sourced by ZipRecruiter
Imagine what you could do here! At Apple, new ideas have a way of becoming extraordinary products, services, and customer experiences very quickly. Bring passion and dedication to your job and there's no telling what you could accomplish. Dynamic, intelligent people and inspiring, innovative technologies are the norm here. The people who work here have reinvented entire industries with all Apple Hardware products. The same real passion for innovation that goes into our products also applies to our practices strengthening our dedication to leave the world better than we found it.
Industry
Computer and electronic product manufacturing
Company size
10,000+ Employees
Headquarters location
Cupertino, CA, US
Year founded
1976