San Francisco, CA · On-site
$155K - $300K/yr
We work directly with frontier AI lab researchers to create evaluations, publish benchmarks, and push the boundary of data. We've grown from $0 to ~$1B run rate and pay ~$60M to over 30K individuals ...
Quick apply
San Francisco, CA · On-site
$155K - $300K/yr
We work directly with frontier AI lab researchers to create evaluations, publish benchmarks, and push the boundary of data. We've grown from $0 to ~$1B run rate and pay ~$60M to over 30K individuals ...
... success rates, and build alerting that catches issues before they become incidents. You will be ... Snorkel AI is the frontier AI data lab, building the data and environments behind advanced AI ...
... success rates, and build alerting that catches issues before they become incidents. You will be ... Snorkel AI is the frontier AI data lab, building the data and environments behind advanced AI ...
San Francisco, CA · On-site
$145K - $170K/yr
We work directly with frontier AI lab researchers to create evaluations, publish benchmarks, and push the boundary of data. We've grown from $0 to ~$1B run rate and pay ~$60M to over 30K individuals ...
Quick apply
San Francisco, CA · On-site
$145K - $170K/yr
We work directly with frontier AI lab researchers to create evaluations, publish benchmarks, and push the boundary of data. We've grown from $0 to ~$1B run rate and pay ~$60M to over 30K individuals ...
$113K - $213K/yr
... AI research initiatives. In this role, you will design end-to-end data acquisition strategies ... Benefits may also be pro-rated for those who start working during the calendar year. Equal ...
$113K - $213K/yr
... AI research initiatives. In this role, you will design end-to-end data acquisition strategies ... Benefits may also be pro-rated for those who start working during the calendar year. Equal ...
Los Angeles, CA · On-site
$113K - $213K/yr
... AI research initiatives. In this role, you will design end-to-end data acquisition strategies ... Benefits may also be pro-rated for those who start working during the calendar year. Equal ...
Los Angeles, CA · On-site
$113K - $213K/yr
... AI research initiatives. In this role, you will design end-to-end data acquisition strategies ... Benefits may also be pro-rated for those who start working during the calendar year. Equal ...
... rate and compare multiple AI responses based on their reasoning quality and implementation soundness. This is a fully remote, hourly paid contractor role with SME Careers, a fast-growing AI data ...
... rate and compare multiple AI responses based on their reasoning quality and implementation soundness. This is a fully remote, hourly paid contractor role with SME Careers, a fast-growing AI data ...
Validate our agent/MCP interface - contract conformance, rate limiting, authorization, and safe ... A genuine interest in testing AI - comfortable with non-determinism, evals, and prompts. * Data ...
Validate our agent/MCP interface - contract conformance, rate limiting, authorization, and safe ... A genuine interest in testing AI - comfortable with non-determinism, evals, and prompts. * Data ...
Palo Alto, CA · On-site
$113K - $213K/yr
... AI research initiatives. In this role, you will design end-to-end data acquisition strategies ... Benefits may also be pro-rated for those who start working during the calendar year. Equal ...
Palo Alto, CA · On-site
$113K - $213K/yr
... AI research initiatives. In this role, you will design end-to-end data acquisition strategies ... Benefits may also be pro-rated for those who start working during the calendar year. Equal ...
Los Angeles, CA · On-site
$113K - $213K/yr
... AI research initiatives. In this role, you will design end-to-end data acquisition strategies ... Benefits may also be pro-rated for those who start working during the calendar year. Equal ...
Los Angeles, CA · On-site
$113K - $213K/yr
... AI research initiatives. In this role, you will design end-to-end data acquisition strategies ... Benefits may also be pro-rated for those who start working during the calendar year. Equal ...
Design and implement data privacy controls, including PII/PHI detection, redaction, and data ... rated based on the hours worked per week. A new hire earns up to 17 days of CTO per calendar year.
Design and implement data privacy controls, including PII/PHI detection, redaction, and data ... rated based on the hours worked per week. A new hire earns up to 17 days of CTO per calendar year.
Validate our agent/MCP interface - contract conformance, rate limiting, authorization, and safe ... A genuine interest in testing AI - comfortable with non-determinism, evals, and prompts. * Data ...
Validate our agent/MCP interface - contract conformance, rate limiting, authorization, and safe ... A genuine interest in testing AI - comfortable with non-determinism, evals, and prompts. * Data ...
... Data Quality • Platform Reliability About Finalytics.ai Finalytics.ai is the leading provider of ... Validate our agent/MCP interface - contract conformance, rate limiting, authorization, and safe ...
... Data Quality • Platform Reliability About Finalytics.ai Finalytics.ai is the leading provider of ... Validate our agent/MCP interface - contract conformance, rate limiting, authorization, and safe ...
San Ramon, CA · On-site
Design and implement data privacy controls, including PII/PHI detection, redaction, and data ... rated based on the hours worked per week. A new hire earns up to 17 days of CTO per calendar year.
San Ramon, CA · On-site
Design and implement data privacy controls, including PII/PHI detection, redaction, and data ... rated based on the hours worked per week. A new hire earns up to 17 days of CTO per calendar year.
Furthermore, Treasure AI employees are enthusiastic, data-driven, and customer-obsessed. We are a ... co-sell win rates on a regular cadence. * Support AWS-focused demand generation activities ...
New
Quick apply
Furthermore, Treasure AI employees are enthusiastic, data-driven, and customer-obsessed. We are a ... co-sell win rates on a regular cadence. * Support AWS-focused demand generation activities ...
New
San Francisco, CA · Remote
$40 - $60/hr
... rate and compare multiple AI responses based on their reasoning quality and implementation soundness. This is a fully remote, hourly paid contractor role with SME Careers, a fast-growing AI data ...
San Francisco, CA · Remote
$40 - $60/hr
... rate and compare multiple AI responses based on their reasoning quality and implementation soundness. This is a fully remote, hourly paid contractor role with SME Careers, a fast-growing AI data ...
San Francisco, CA · On-site
$150K - $250K/yr
About us Encord is the universal data layer for AI that helps 300+ AI teams train and run models on ... frame rates * Work across the full stack - from backend data pipelines and storage systems to ...
San Francisco, CA · On-site
$150K - $250K/yr
About us Encord is the universal data layer for AI that helps 300+ AI teams train and run models on ... frame rates * Work across the full stack - from backend data pipelines and storage systems to ...
San Francisco, CA · On-site
$150K - $250K/yr
About us Encord is the universal data layer for AI that helps 300+ AI teams train and run models on ... frame rates * Work across the full stack -- from backend data pipelines and storage systems to ...
Quick apply
San Francisco, CA · On-site
$150K - $250K/yr
About us Encord is the universal data layer for AI that helps 300+ AI teams train and run models on ... frame rates * Work across the full stack -- from backend data pipelines and storage systems to ...
San Francisco, CA · On-site
$158K - $175K/yr
We work directly with frontier AI lab researchers to create evaluations, publish benchmarks, and push the boundary of data. We've grown from $0 to ~$1B run rate and pay ~$60M to over 30K individuals ...
Quick apply
San Francisco, CA · On-site
$158K - $175K/yr
We work directly with frontier AI lab researchers to create evaluations, publish benchmarks, and push the boundary of data. We've grown from $0 to ~$1B run rate and pay ~$60M to over 30K individuals ...
San Francisco, CA · On-site
$145K - $190K/yr
... rates in tens of millions of radiology reports by nearly 50%. Rad AI has secured over $140M in ... We are seeking a Senior Data Engineer to join our engineering team. With our rapid client growth ...
San Francisco, CA · On-site
$145K - $190K/yr
... rates in tens of millions of radiology reports by nearly 50%. Rad AI has secured over $140M in ... We are seeking a Senior Data Engineer to join our engineering team. With our rapid client growth ...
... rates, sales cycle, ARR, net revenue retention, and rep productivity. * Own and optimize the GTM ... Experience in AI, data, or enterprise platform software. * Experience supporting GTM through ...
... rates, sales cycle, ARR, net revenue retention, and rep productivity. * Own and optimize the GTM ... Experience in AI, data, or enterprise platform software. * Experience supporting GTM through ...
An AI Data Rater evaluates and rates AI-generated content, such as search engine results, chat responses, or recommendations, to improve machine learning models. They follow specific guidelines to assess relevance, accuracy, and quality. This role helps refine AI systems by providing valuable feedback to enhance their performance. It typically requires strong analytical skills, attention to detail, and familiarity with the subject matter being rated.
To succeed as an AI Data Rater, you need strong analytical skills, attention to detail, and proficiency in evaluating data quality, typically requiring at least a high school diploma or equivalent. Familiarity with computer systems, web browsers, and proprietary rating platforms is often necessary, and training in data privacy or AI guidelines is sometimes provided. Excellent time management, adaptability, and effective written communication help candidates stand out in this largely remote and independent role. These skills ensure accurate data evaluations, support AI improvement, and enable consistent, high-quality performance.
As an AI Data Rater, your main responsibilities include reviewing and evaluating various types of data—such as search queries, images, or social media content—according to detailed guidelines provided by your employer. You will typically work independently, using specialized tools or web-based platforms to rate data quality, relevance, or appropriateness. Attention to detail and consistency are important, as your feedback directly impacts the effectiveness of AI systems. Depending on the employer, you may also participate in training sessions or occasional team meetings to stay updated on the latest guidelines or project requirements.
$155K - $300K/yr
Full-time
Medical, Dental, Vision, Retirement, PTO
Re-posted 3 days ago
Handshake was founded on a simple belief that everyone deserves a path to a great career, regardless of where they went to school or who they know. Today, we power 25 million job seekers, 1 million+ employers, and 1,600 educational institutions.
In 2025, we started Handshake AI and built the fastest-growing AI data business in history. We work directly with frontier AI lab researchers to create evaluations, publish benchmarks, and push the boundary of data. We’ve grown from $0 to ~$1B run rate and pay ~$60M to over 30K individuals every month.
Why join Handshake now:
Shape how every career evolves in the AI economy, at global scale, with impact your friends, family and peers can see and feel
Partner hand-in-hand with world-class AI labs, Fortune 500 partners and the world’s top educational institutions
Work together with engineers, scientists, operators, and more from Palantir, Meta, Scale AI, and former YC founders
Build a massive, fast-growing business with billions in revenue
About Handshake AI
Human data is the core infrastructure to AI advancement. Frontier AI labs currently improve model capabilities with various data-intensive post-training techniques. We believe that data spend for AI training will increase by 3-5x in the next few years and continue for much longer as models take on new domains. Handshake AI supports all of the frontier AI labs, working on
About the RoleAs a Forward Deployed Engineer at Handshake AI Enterprise, you'll embed directly inside enterprise customer environments as part of a small, expert team. You'll learn each customer's business deeply — their workflows, their bottlenecks, where the real leverage is — and translate that understanding into production-grade AI agents that measurably change how they operate.
This isn't an implementation or consulting role. You'll own the full stack: defining the solution, building and deploying agents, designing evals, and iterating until performance actually moves. Over time, you'll become a genuine domain expert in your customer's vertical — and use that expertise to build AI that keeps getting better.
We're looking for engineers across a range of experience — from those who've already shipped real AI in production, to seasoned engineers ready to set the technical bar for the team. If you've built AI that works in the real world and want to do it again at much higher stakes — with better data, closer lab relationships, and a founding team that moves fast — this is the role.
Embed directly with enterprise customers as part of a small deployment team, developing deep understanding of their business and workflows
Define AI-driven solutions based on real business needs — not theoretical use cases
Build and deploy production-grade agents tailored to specific customer use cases, owning end-to-end delivery
Design and run evals to measure agent performance; iterate and hill-climb until results move
Become a domain expert in your customer's vertical and use that expertise to build better AI over time
Work closely with Product and Platform engineers on your team to ship cohesive, reliable solutions
Establish engineering best practices, agent patterns, and reusable frameworks that help the forward-deployed team scale output without sacrificing quality
Surface insights from deployments that inform Handshake's platform and product roadmap
Location: San Francisco, CA | 5 days / week in-office
Full-stack engineering experience with strong backend depth
Real-world experience building and shipping AI applications in production — not just fine-tuning or prototyping
Strong understanding of agent architectures, evals, and how to measure and systematically improve AI performance
Comfort working directly with enterprise customers in ambiguous, high-stakes environments
Strong systems thinking — you can zoom out to the business problem and zoom in to the technical solution without losing either thread
High ownership mentality — you care about outcomes, not just outputs
Strong communication skills — you'll be in the room with senior stakeholders regularly and need to earn their trust quickly
Background at a company with a forward deployment or field engineering model
Experience building multi-agent systems in production
Domain expertise in a specific enterprise vertical (recruiting, finance, ops, legal, etc.)
Familiarity with enterprise security requirements, VPC deployments, or on-prem configurations
History of building evals infrastructure or AI quality measurement tooling
Handshake delivers benefits that help you feel supported—and thrive at work and in life.
The below benefits are for full-time US employees.
🎯 Ownership: Equity in a fast-growing company
💰 Financial Wellness: 401(k) match, competitive compensation, financial coaching
🍼 Family Support: Paid parental leave, fertility benefits, parental coaching
💝 Wellbeing: Medical, dental, and vision, mental health support, $500 wellness stipend
📚 Growth: $2,000 learning stipend, ongoing development
💻 Remote & Office: Internet, commuting, and free lunch/gym in our SF office
🏝 Time Off: Flexible PTO, 15 holidays + 2 flex days
🤝 Connection: Team outings & referral bonuses
Explore our mission, values, and comprehensive US benefits at joinhandshake.com/careers.
Compensation Range: $155K - $300K
