ZipRecruiter

Log In

1

Ai Rater Jobs (NOW HIRING)

Highlight AI

Head of AI

San Francisco, CA · On-site

$250K - $350K/yr

Own output quality across Highlight chat, actions, and workflows; drive toward industry leading acceptance rates. * Build and lead a world-class ML Engineering team; Establish AI/ML best practices ...

Hume AI

Senior/Staff AI Research Engineer

San Jose, CA · On-site +1

$180K - $350K/yr

Hume AI is seeking talented researchers and engineers interested in working with our AI research ... They are rated higher than models by OpenAI and others on empathy, expressiveness, naturalness, and ...

Distyl AI

Applied AI Researcher, Benchmarking

New York, NY · On-site

$150K - $250K/yr

The results reflect this approach: a 100% production deployment success rate for our customers and one of the few enterprise AI companies to run a profitable business. What We Are Looking For At ...

Worth AI

Senior Agentic (AI) Engineer

Miami, FL · Remote

$107K - $146.90K/yr

Worth AI is hiring a Senior Agentic AI Engineer to design and ship production agent systems that ... Measurable improvements in task success rate, grounding accuracy, and hallucination rate on our ...

Worth AI

Senior Agentic (AI) Engineer

Tampa, FL · Remote

$107K - $146.90K/yr

Worth AI is hiring a Senior Agentic AI Engineer to design and ship production agent systems that ... Measurable improvements in task success rate, grounding accuracy, and hallucination rate on our ...

Worth AI

Senior Agentic (AI) Engineer

Orlando, FL · On-site +1

$97.60K - $134K/yr

Worth AI is hiring a Senior Agentic AI Engineer to design and ship production agent systems that ... Measurable improvements in task success rate, grounding accuracy, and hallucination rate on our ...

Worth AI

Senior Agentic (AI) Engineer

Orlando, FL · Remote

$107K - $146.90K/yr

Worth AI is hiring a Senior Agentic AI Engineer to design and ship production agent systems that ... Measurable improvements in task success rate, grounding accuracy, and hallucination rate on our ...

Worth AI

Senior Agentic (AI) Engineer

Miami, FL · On-site +1

$99.90K - $137.20K/yr

Worth AI is hiring a Senior Agentic AI Engineer to design and ship production agent systems that ... Measurable improvements in task success rate, grounding accuracy, and hallucination rate on our ...

Worth AI

Senior Agentic (AI) Engineer

Orlando, FL · On-site +1

$97.60K - $134K/yr

Worth AI is hiring a Senior Agentic AI Engineer to design and ship production agent systems that ... Measurable improvements in task success rate, grounding accuracy, and hallucination rate on our ...

Worth AI

Senior Agentic (AI) Engineer

Atlanta, GA · Remote

$107K - $146.90K/yr

Worth AI is hiring a Senior Agentic AI Engineer to design and ship production agent systems that ... Measurable improvements in task success rate, grounding accuracy, and hallucination rate on our ...

Distyl AI

AI Strategist (All Levels)

New York, NY · On-site

$150K - $250K/yr

The results reflect this approach: a 100% production deployment success rate for our customers and one of the few enterprise AI companies to run a profitable business. What We Are Looking For As an ...

Distyl AI

AI Strategist (All Levels)

San Francisco, CA

$150K - $250K/yr

The results reflect this approach: a 100% production deployment success rate for our customers and one of the few enterprise AI companies to run a profitable business. What We Are Looking For As an ...

Worth AI

Senior Agentic (AI) Engineer

Atlanta, GA · On-site +1

$100.50K - $138K/yr

Worth AI is hiring a Senior Agentic AI Engineer to design and ship production agent systems that ... Measurable improvements in task success rate, grounding accuracy, and hallucination rate on our ...

Worth AI

Senior Agentic (AI) Engineer

Tampa, FL · On-site +1

$98.80K - $135.60K/yr

Worth AI is hiring a Senior Agentic AI Engineer to design and ship production agent systems that ... Measurable improvements in task success rate, grounding accuracy, and hallucination rate on our ...

Distyl AI

AI Strategist, Healthcare Solutions

New York, NY · On-site

$132.90K - $171.80K/yr

The results reflect this approach: a 100% production deployment success rate for our customers and one of the few enterprise AI companies to run a profitable business. What We Are Looking For As an ...

Lotus Health AI, Inc

AI Engineer

San Francisco, CA · On-site

AI Engineer @ Lotus AI Who we are Lotus AI is a groundbreaking primary care app that integrates ... Build monitoring and analytics for background jobs to monitor failure rates and identify partner vs ...

next page

Showing results 1-20

People also search for

All JobsAi Rater Jobs

Ai Rater information

What is an AI Rater job?

An AI Rater evaluates and provides feedback on artificial intelligence models, typically improving search engines, chatbots, or recommendation systems. They assess the relevance, accuracy, and quality of AI-generated content based on specific guidelines. This role requires strong analytical skills, attention to detail, and familiarity with the subject matter being reviewed. AI Raters often work remotely and on a flexible schedule.

What are the key skills and qualifications needed to thrive in the Ai Rater position, and why are they important?

To thrive as an AI Rater, you generally need strong attention to detail, analytical thinking, and proficiency in English, often supported by formal education such as a high school diploma or higher. Familiarity with web browsers, online research, and company-specific rating platforms or guidelines is essential. Excellent time management, adaptability, and effective written communication help individuals excel in this position. These skills and qualities ensure accurate and consistent evaluations of AI-generated content, directly impacting the improvement of artificial intelligence systems.

What does a typical day look like for an AI Rater?

A typical day for an AI Rater involves reviewing and evaluating various types of content, such as search engine results, social media posts, advertisements, or chatbot responses, to ensure they meet quality and relevancy standards. You may follow detailed guidelines to rate or annotate content, complete assigned tasks in a web-based platform, and provide feedback to help improve AI performance. Most positions are remote and offer flexible schedules, allowing you to plan your workload around personal commitments. Collaboration is generally limited, as most work is performed independently, but periodic communication with team leads for training or updates is common.
More about Ai Rater jobs
What cities are hiring for Ai Rater jobs? Cities with the most Ai Rater job openings:
What are the most commonly searched types of Ai Rater jobs? The most popular types of Ai Rater jobs are:
What states have the most Ai Rater jobs? States with the most job openings for Ai Rater jobs include:
What job categories do people searching Ai Rater jobs look for? The top searched job categories for Ai Rater jobs are:
Ai Rater jobs near you
Infographic showing various Ai Rater job openings in the United States as of May 2026, with employment types broken down into 100% Full Time. Highlights an 77% Physical, 4% Hybrid, and 19% Remote job distribution.

Head of AI

Highlight AI

San Francisco, CA • On-site

$250K - $350K/yr

Full-time

Medical, Dental, Vision, PTO

Posted 21 days ago

Job description

Highlight is building a shared intelligence layer for the modern workforce. Highlight unifies context across every person and tool on your team, seamlessly bridging information silos. It evolves with your organization to proactively route knowledge and reliably automate workflows.
The Role
We're hiring a Head of AI Engineering to lead and scale our ML and AI efforts as we build the engine that powers Highlight. You'll own the architecture, quality, and roadmap for how we ingest, model, and surface context, starting from data pipelines and evals to the context graph that makes our system truly useful. This is a hands-on leadership role: you'll write code, set technical direction, mentor engineers, and collaborate closely with Backend and Product teams to ship features that feel like magic.
We're looking for a technical leader who's equally comfortable diving into model architectures and rallying a team around ambitious goals. You have deep expertise in LLMs, knowledge systems, and retrieval. You're energized by the challenge of building something new. You thrive in ambiguity, ship fast, and hold yourself and your team to a high bar.
Note: this is an on-site role, requiring five days a week in our office.
Job Responsibilities
  • Own the context graph: architect and build Highlight's memory systems end-to-end, including data ingestion, modeling, retrieval, and evals
  • Research, prototype and deploy state-of-the-art machine learning text and OCR models (e.g., transformer architectures, computer vision, time series forecasting, reinforcement learning)
  • Lead the full ML project lifecycle: data pipelines, training, evals, deployment, monitoring, scalability, latency, retraining, A/B testing, and model lifecycle management
  • Own output quality across Highlight chat, actions, and workflows; drive toward industry leading acceptance rates.
  • Build and lead a world-class ML Engineering team; Establish AI/ML best practices across the broader engineering org.
  • Stay current on knowledge representation, continual learning, and retrieval; translate insights into features that feel like magic; Research novel approaches and publish when appropriate.

Profile
We're looking for someone who is interested in building the AI user experience for the future. We punch above our weight so we value extreme ownership, accountability, and proactiveness. The ideal candidate has deep, experienced understanding of LLMs or Knowledge systems, and a track record of shipping production AI systems at scale.
You are a good fit if you have:
  • 7+ years in ML/AI engineering, with 3+ years leading teams or major technical initiatives
  • Master's or PhD in Computer Science, Machine Learning, Statistics, Applied Math or equivalent experience.
  • Published research (or experience shipping to production) in knowledge graphs, memory systems, retrieval, or continual learning
  • Experience working at top AI labs (e.g. DeepMind, OpenAI, Anthropic, Meta FAIR, xAI) or leading AI application companies (e.g. Google, Cursor, Perplexity)
  • Strong architectural chops: you've designed and scaled ML infrastructure from scratch
  • Hands-on proficiency with modern ML stacks (PyTorch, TensorFlow, RAG, vector DBs, cloud infra)
  • A player-coach mentality: you love mentoring engineers and getting your hands dirty in the code
  • Ownership mentality (no task is too small for you) - it's all hands on deck here and we need everyone rowing the boat.
  • Excellent communication skills and a collaborative mindset - we're extremely lean so we're looking for a team player who works well with others.
  • Type-A tendencies: maybe you're extremely detail-oriented. Or maybe you take pride in shipping high-quality products. Whatever it is you do, you give it your all.
  • Must be based in or willing to relocate to SF - although we're flexible with days off & schedules, we have a 100% in-office culture during the week.

And even if you don't fall neatly into any of these buckets, we're looking for scrappy and motivated self-starters above all. Hustle is expected, grit is required.
Perks
  • Competitive salary and generous equity package
  • Health, dental, and vision insurance
  • Flexible PTO and parental leave
  • Paid team lunches and dinners during the week
  • Relocation package

Apply