Product Manager, Evals & Improvement Responsibilities: * Own the end-to-end feedback and ... Experience building annotation, labeling, or crowd-sourcing systems * Experience with reinforcement ...
Product Manager, Evals & Improvement Responsibilities: * Own the end-to-end feedback and ... Experience building annotation, labeling, or crowd-sourcing systems * Experience with reinforcement ...
Data Engine & Annotation Systems Engineer
San Francisco, CA · On-site
$120K - $155K/yr
You will improve the quality, speed, and reliability of data used to train and evaluate production ... Experience managing external annotation vendors or distributed annotation teams. $120,000 - $155 ...
Data Engine & Annotation Systems Engineer
San Francisco, CA · On-site
$120K - $155K/yr
You will improve the quality, speed, and reliability of data used to train and evaluate production ... Experience managing external annotation vendors or distributed annotation teams. $120,000 - $155 ...
Experience building data collection tools, annotation platforms, or human-in-the-loop pipelines ... Have 5+ years in product management, with experience launching new products and scaling existing ...
Experience building data collection tools, annotation platforms, or human-in-the-loop pipelines ... Have 5+ years in product management, with experience launching new products and scaling existing ...
Data Engine & Annotation Systems Engineer
San Francisco, CA · On-site
$120K - $155K/yr
You will improve the quality, speed, and reliability of data used to train and evaluate production ... Experience managing external annotation vendors or distributed annotation teams. $120,000 - $155 ...
Data Engine & Annotation Systems Engineer
San Francisco, CA · On-site
$120K - $155K/yr
You will improve the quality, speed, and reliability of data used to train and evaluate production ... Experience managing external annotation vendors or distributed annotation teams. $120,000 - $155 ...
Data Engine & Annotation Systems Engineer
San Francisco, CA · On-site
$120K - $155K/yr
You will improve the quality, speed, and reliability of data used to train and evaluate production ... Experience managing external annotation vendors or distributed annotation teams. $120,000 - $155 ...
Data Engine & Annotation Systems Engineer
San Francisco, CA · On-site
$120K - $155K/yr
You will improve the quality, speed, and reliability of data used to train and evaluate production ... Experience managing external annotation vendors or distributed annotation teams. $120,000 - $155 ...
Staff Product Manager, Applied AI
Sunnyvale, CA · On-site
$215K - $245K/yr
Experience with data collection operation (teleoperation fleets, annotation and curation pipelines ... At least 10 years of experience in product management or engineering, including 5+ years leading ...
Staff Product Manager, Applied AI
Sunnyvale, CA · On-site
$215K - $245K/yr
Experience with data collection operation (teleoperation fleets, annotation and curation pipelines ... At least 10 years of experience in product management or engineering, including 5+ years leading ...
Applied AI Product Manager
Austin, TX · On-site
Marsh is seeking an Applied AI Product Manager to help translate advances in AI into useful ... Experience with observability, quality dashboards, annotation workflows, or human-in-the-loop ...
Applied AI Product Manager
Austin, TX · On-site
Marsh is seeking an Applied AI Product Manager to help translate advances in AI into useful ... Experience with observability, quality dashboards, annotation workflows, or human-in-the-loop ...
Technical Program Manager, Human Data Annotation (Code)
Palo Alto, CA · On-site
$152K - $196K/yr
This role is a critical link between research, product, engineering, and annotation teams, and will ... Manage a data quality assurance team that designs and implements rigorous and scalable quality ...
Technical Program Manager, Human Data Annotation (Code)
Palo Alto, CA · On-site
$152K - $196K/yr
This role is a critical link between research, product, engineering, and annotation teams, and will ... Manage a data quality assurance team that designs and implements rigorous and scalable quality ...
Applied AI Product Manager
Austin, TX · On-site
Marsh is seeking an Applied AI Product Manager to help translate advances in AI into useful ... Experience with observability, quality dashboards, annotation workflows, or human-in-the-loop ...
Applied AI Product Manager
Austin, TX · On-site
Marsh is seeking an Applied AI Product Manager to help translate advances in AI into useful ... Experience with observability, quality dashboards, annotation workflows, or human-in-the-loop ...
Lead Product Manager
San Ramon, CA · On-site
Products like our voice agents and agentic runtime are joint efforts with product engineering ... Where data investment goes: acquisition, annotation, and labeling priorities. * The quality bar ...
Quick apply
Lead Product Manager
San Ramon, CA · On-site
Products like our voice agents and agentic runtime are joint efforts with product engineering ... Where data investment goes: acquisition, annotation, and labeling priorities. * The quality bar ...
... annotation, evaluation, and data-generation tasks that fuel AI progress. Product Managers at Scale ... sit at the intersection of these two sides, shaping the systems, tooling, and experiences that make ...
... annotation, evaluation, and data-generation tasks that fuel AI progress. Product Managers at Scale ... sit at the intersection of these two sides, shaping the systems, tooling, and experiences that make ...
... annotation, evaluation, and data-generation tasks that fuel AI progress. Product Managers at Scale ... sit at the intersection of these two sides, shaping the systems, tooling, and experiences that make ...
... annotation, evaluation, and data-generation tasks that fuel AI progress. Product Managers at Scale ... sit at the intersection of these two sides, shaping the systems, tooling, and experiences that make ...
Data Annotator / Geospatial Annotation Specialist
South San Francisco, CA · On-site
$82K - $92K/yr
... production-ready. The Specialist performs detailed vector annotation, image segmentation, and ... Reporting Expectations The Specialist reports jointly to managers in the Advanced Model Development ...
Data Annotator / Geospatial Annotation Specialist
South San Francisco, CA · On-site
$82K - $92K/yr
... production-ready. The Specialist performs detailed vector annotation, image segmentation, and ... Reporting Expectations The Specialist reports jointly to managers in the Advanced Model Development ...
Define and track annotation quality, productivity, and certification metrics; continuously refine ... Support vendor management by analyzing performance, cost, and quality metrics across multiple ...
Define and track annotation quality, productivity, and certification metrics; continuously refine ... Support vendor management by analyzing performance, cost, and quality metrics across multiple ...
Senior Product Manager - Omniverse Rendering
Santa Clara, CA · On-site
$148K - $196K/yr
... realism, annotation outputs, and simulation pipeline architecture. * Work with AI, robotics ... product management, engineering, solution architecture, or related experience. * Strong ...
Senior Product Manager - Omniverse Rendering
Santa Clara, CA · On-site
$148K - $196K/yr
... realism, annotation outputs, and simulation pipeline architecture. * Work with AI, robotics ... product management, engineering, solution architecture, or related experience. * Strong ...
Senior Product Manager - Omniverse Rendering
Santa Clara, CA · On-site
$148K - $196K/yr
... annotation outputs, and simulation pipeline architecture. Work with AI, robotics, computer vision ... product management, technical product management, engineering, solution architecture, or related ...
Senior Product Manager - Omniverse Rendering
Santa Clara, CA · On-site
$148K - $196K/yr
... annotation outputs, and simulation pipeline architecture. Work with AI, robotics, computer vision ... product management, technical product management, engineering, solution architecture, or related ...
Senior Product Manager - Omniverse Rendering
Santa Clara, CA · On-site
$148K - $196K/yr
... realism, annotation outputs, and simulation pipeline architecture. * Work with AI, robotics ... product management, engineering, solution architecture, or related experience. * Strong ...
Senior Product Manager - Omniverse Rendering
Santa Clara, CA · On-site
$148K - $196K/yr
... realism, annotation outputs, and simulation pipeline architecture. * Work with AI, robotics ... product management, engineering, solution architecture, or related experience. * Strong ...
Product Management, Human Data Platform
San Francisco, CA · On-site
$305K - $385K/yr
Own the product direction for our human data tooling, with clear prioritization across labeling ... Experience building data collection tools, annotation platforms, or human-in-the-loop pipelines
Product Management, Human Data Platform
San Francisco, CA · On-site
$305K - $385K/yr
Own the product direction for our human data tooling, with clear prioritization across labeling ... Experience building data collection tools, annotation platforms, or human-in-the-loop pipelines
Senior Product Manager - Omniverse Rendering
Santa Clara, CA · On-site
$147K - $194K/yr
... realism, annotation outputs, and simulation pipeline architecture. * Work with AI, robotics ... product management, engineering, solution architecture, or related experience. * Strong ...
Senior Product Manager - Omniverse Rendering
Santa Clara, CA · On-site
$147K - $194K/yr
... realism, annotation outputs, and simulation pipeline architecture. * Work with AI, robotics ... product management, engineering, solution architecture, or related experience. * Strong ...
Data Annotator / Geospatial Annotation Specialist
South San Francisco, CA · On-site
$82K - $92K/yr
... production-ready. The Specialist performs detailed vector annotation, image segmentation, and ... Reporting Expectations The Specialist reports jointly to managers in the Advanced Model Development ...
Data Annotator / Geospatial Annotation Specialist
South San Francisco, CA · On-site
$82K - $92K/yr
... production-ready. The Specialist performs detailed vector annotation, image segmentation, and ... Reporting Expectations The Specialist reports jointly to managers in the Advanced Model Development ...
Annotation Product Manager information
See salary details
$51.5K - $64.7K
0% of jobs
$64.7K - $78K
1% of jobs
$78K - $91.2K
3% of jobs
$91.2K - $104.4K
4% of jobs
$104.4K - $117.6K
5% of jobs
$117.6K - $130.9K
5% of jobs
$136.5K is the 25th percentile. Wages below this are outliers.
$130.9K - $144.1K
14% of jobs
$144.1K - $157.3K
5% of jobs
The median wage is $165.9K / yr.
$157.3K - $170.5K
18% of jobs
$180.6K is the 75th percentile. Wages above this are outliers.
$170.5K - $183.8K
24% of jobs
$183.8K - $197K
19% of jobs
$51.5K
$159.4K
$197K
How much do annotation product manager jobs pay per year?
What is an annotation product manager?
What are the key skills and qualifications needed to thrive as an annotation product manager?
How does an annotation product manager typically collaborate with engineering and data science teams?
What is the difference between Annotation Product Manager vs Data Scientist?
| Aspect | Annotation Product Manager | Data Scientist |
|---|---|---|
| Required Credentials | Bachelor's in CS, Business, or related; experience in product management | Bachelor's or higher in CS, Statistics, or related; advanced analytics skills |
| Work Environment | Collaborates with engineering, data teams, and stakeholders on annotation tools and processes | Analyzes data, builds models, and interprets complex datasets |
| Industry Usage | Used in AI, machine learning, and data labeling projects | Applied across tech, finance, healthcare for data analysis and modeling |
The Annotation Product Manager focuses on managing annotation tools and workflows to support AI projects, while the Data Scientist analyzes data and develops models. Both roles require technical knowledge, but differ in their primary responsibilities and focus areas within data projects.
What are popular job titles related to Annotation Product Manager jobs?
For Annotation Product Manager jobs, the most frequently searched job titles are:

Product Manager, Evals & Improvement
Menlo Park, CA
$146K/yr
Full-time
Posted 23 days ago
Key responsibilities
Own the end-to-end feedback and improvement system, including collection, analysis, prioritization, and resolution.
Define how to measure agent quality across dimensions such as accuracy, helpfulness, reliability, and safety.
Partner with ML and data science teams to turn feedback into model improvements, eval frameworks, and training data.
Meta rating
7.8
Based on 45 frontline employees who took The Breakroom Quiz
Job description
Product Manager, Evals & Improvement Responsibilities:
- Own the end-to-end feedback and improvement system: collection, analysis, prioritization, and resolution.
- Define how we measure agent quality across dimensions (accuracy, helpfulness, reliability, safety).
- Build product mechanisms that capture implicit and explicit user signal at scale.
- Partner with ML and data science to turn feedback into model improvements, eval frameworks, and training data.
- Drive the evals and measurement strategy: what "good" looks like, how we detect regressions, and how we track progress.
- Create transparency and accountability for quality across the ATA Product team.
Minimum Qualifications:
- Strong quantitative skills and experience defining complex metrics
- Comfort with ambiguous problem spaces where the right metrics do not yet exist
- 5+ years of relevant industry experience with at least 2 years in Product Management
- Bachelor's degree (or relevant degree equivalent): STEM subject ideal but not essential (Computer Science, Engineering, Information Systems, Analytics, Mathematics, Physics, Applied Sciences)
- Experience partnering closely with data science and ML engineering teams
- Track record of driving product improvements through data and experimentation
- Direct experience building evals for AI products end to end: task set construction, rubric design, instrumentation, and analysis
- Experience running eval-driven development cycles, with a clear view of where evals are informative and where they mislead
- Willingness to get into the weeds of eval data and rubrics, with high standards for eval rigor and an obsession with quality
- Deep understanding of LLM capabilities and failure modes
Preferred Qualifications:
- Experience building annotation, labeling, or crowd-sourcing systems
- Experience with reinforcement learning from human feedback (RLHF) or similar human-in-the-loop systems
- Background in evals, trust and safety measurement, or ML quality infrastructure
- Demonstrated ability to integrate AI tools to optimize/redesign workflows and drive measurable impact (e.g., efficiency gains, quality improvements)
- Experience adhering to and implementing responsible, ethical AI practices (e.g., risk assessment, bias mitigation, quality and accuracy reviews)
- Demonstrated ongoing AI skill development (e.g., prompt/context engineering, agent orchestration) and staying current with emerging AI technologies
About Meta:
Meta builds technologies that help people connect, find communities, and grow businesses. When Facebook launched in 2004, it changed the way people connect. Apps like Messenger, Instagram and WhatsApp further empowered billions around the world. Now, Meta is moving beyond 2D screens toward immersive experiences like augmented and virtual reality to help build the next evolution in social technology. People who choose to build their careers by building with us at Meta help shape a future that will take us beyond what digital connection makes possible today—beyond the constraints of screens, the limits of distance, and even the rules of physics.
Meta is committed to providing reasonable accommodations for candidates with disabilities in our recruiting process. If you need any assistance or accommodations due to a disability, please let us know at accommodations-ext@meta.com.
$146,000/year to $204,000/year + bonus + equity + benefits
Individual compensation is determined by skills, qualifications, experience, and location. Compensation details listed in this posting reflect the base hourly rate, monthly rate, or annual salary only, and do not include bonus, equity or sales incentives, if applicable. In addition to base compensation, Meta offers benefits. Learn more about benefits at Meta.
About Meta
Sourced by ZipRecruiter
Industry
Internet and it, media and telecom and software development
Company size
10,000+ Employees
Headquarters location
Menlo Park, CA, US