Video Labelling Jobs in Seattle, WA (NOW HIRING)

Prime Video is changing the way people watch movies and TV shows, with millions of titles available on-demand across devices worldwide. Within our Trust & Safety organization, we are building the future of automated content classification, leveraging large language models (LLMs) to predict maturity ratings and content descriptors at scale. This role sits at the intersection of Operations, Engineering, and Content Policy, and is critical to ensuring our customers receive accurate, consistent, and trustworthy information to make viewing decisions.
We are looking for a Program Manager who will own the end-to-end prompt lifecycle for our content classification automation systems

You will deeply understand our Standard Operating Procedures (SOPs), translate nuanced policy requirements into precise prompts, rigorously test outputs, and deploy changes to production. You will influence without authority across Science, Engineering, Operations, and Policy teams to drive alignment and deliver results. This is a high-judgment role where you will make strategic tradeoff decisions between precision and recall to optimize classification quality while balancing customer experience and operational efficiency.
Key job responsibilities
Prompt Lifecycle Ownership: Own end-to-end prompt engineering for content classification automation, including drafting, iterating, A/B testing, and deploying prompt changes to production environments.
SOP Expertise & Translation: Develop deep expertise in maturity rating and content descriptor SOPs

Identify critical decision points, edge cases, and nuances that must be translated into prompt logic to ensure automated outputs mirror or is better than human judgment.
Testing & Validation: Design and execute rigorous testing frameworks to validate prompt outputs against ground truth. Analyze false positives and false negatives, and make high-judgment calls on acceptable thresholds.
Precision vs. Recall Tradeoffs: Make strategic decisions on where to optimize for precision (minimizing false positives) versus recall (minimizing missed content), balancing customer trust, regulatory requirements, and operational cost.
Influence Without Authority: Drive alignment and decision-making across Science, Engineering, Operations, Legal, and Policy teams without direct reporting relationships

Build consensus on prompt strategies, escalation paths, and deployment timelines.
Production Deployment & Monitoring: Coordinate production deployments of prompt updates, monitor real-time performance metrics, and rapidly iterate based on output quality signals.
Continuous Improvement: Establish and track KPIs for automation accuracy, coverage, and efficiency. Identify opportunities to expand automation scope and reduce manual review dependency.
Governance & Risk Management: Maintain program governance structures for prompt changes, including change management protocols, rollback procedures, and audit trails.
Cross-Functional Collaboration: Partner with Science teams on model behavior, Engineering on deployment infrastructure, Operations on ground truth labeling, and Policy on evolving content standards.
Knowledge Management & Documentation: Develop and maintain comprehensive documentation of prompt logic, testing results, decision rationale, and SOP-to-prompt mapping to enable knowledge transfer and organizational continuity.
A day in the life
A Day in the Life
Reviewing automation outputs, identifying misclassifications, and diagnosing whether root cause is prompt logic, model drift, or SOP ambiguity.
Collaborating with Science and Engineering partners to configure prompt refinements based on testing insights, influencing prioritization without direct authority over their roadmaps.
Running controlled tests on prompt variations, analyzing precision/recall metrics, and making judgment calls on which version to advance to production.
Meeting with Policy and Operations stakeholders to discuss upcoming SOP changes and translating those into prompt modification plans.
Presenting weekly automation performance summaries to leadership, including tradeoff recommendations and deployment plans.