ZipRecruiter

Log In

1

Ai Rating Jobs (NOW HIRING)

Distyl AI

Applied AI Researcher, Benchmarking

New York, NY · On-site

$150K - $250K/yr

The results reflect this approach: a 100% production deployment success rate for our customers and one of the few enterprise AI companies to run a profitable business. What We Are Looking For At ...

Worth AI

Senior Agentic (AI) Engineer

Atlanta, GA · On-site +1

$100K - $138K/yr

Worth AI is hiring a Senior Agentic AI Engineer to design and ship production agent systems that ... Measurable improvements in task success rate, grounding accuracy, and hallucination rate on our ...

Worth AI

Senior Agentic (AI) Engineer

Tampa, FL · On-site +1

$98K - $135K/yr

Worth AI is hiring a Senior Agentic AI Engineer to design and ship production agent systems that ... Measurable improvements in task success rate, grounding accuracy, and hallucination rate on our ...

Weekday AI

Insurance Claims Management AI Expert

$100 - $120/hr

Implement AI tools to track recovery potential, automate documentation, and improve recovery rates through data-driven insights. Required Qualifications: * Bachelor's or Master's degree in Computer ...

Worth AI

Senior Agentic (AI) Engineer

Orlando, FL · On-site +1

$97K - $134K/yr

Worth AI is hiring a Senior Agentic AI Engineer to design and ship production agent systems that ... Measurable improvements in task success rate, grounding accuracy, and hallucination rate on our ...

Worth AI

Senior Agentic (AI) Engineer

Miami, FL · Remote

$107K - $146K/yr

Worth AI is hiring a Senior Agentic AI Engineer to design and ship production agent systems that ... Measurable improvements in task success rate, grounding accuracy, and hallucination rate on our ...

Distyl AI

AI Strategist, Healthcare Solutions

New York, NY · On-site

$132K - $171K/yr

The results reflect this approach: a 100% production deployment success rate for our customers and one of the few enterprise AI companies to run a profitable business. What We Are Looking For As an ...

Worth AI

Senior Agentic (AI) Engineer

Atlanta, GA · Remote

$107K - $146K/yr

Worth AI is hiring a Senior Agentic AI Engineer to design and ship production agent systems that ... Measurable improvements in task success rate, grounding accuracy, and hallucination rate on our ...

Worth AI

Senior Agentic (AI) Engineer

Tampa, FL · Remote

$107K - $146K/yr

Worth AI is hiring a Senior Agentic AI Engineer to design and ship production agent systems that ... Measurable improvements in task success rate, grounding accuracy, and hallucination rate on our ...

Worth AI

Senior Agentic (AI) Engineer

Miami, FL · On-site +1

$99K - $137K/yr

Worth AI is hiring a Senior Agentic AI Engineer to design and ship production agent systems that ... Measurable improvements in task success rate, grounding accuracy, and hallucination rate on our ...

Worth AI

Senior Agentic (AI) Engineer

Orlando, FL · Remote

$107K - $146K/yr

Worth AI is hiring a Senior Agentic AI Engineer to design and ship production agent systems that ... Measurable improvements in task success rate, grounding accuracy, and hallucination rate on our ...

Weekday AI

Investment Banking AI Specialist

$100 - $130/hr

... AI lab focused on foundational models. In this role, you will apply your expertise in financial ... Hourly rate: $100-$130 per hour * Opportunity for rate increases based on performance and ...

next page

Showing results 1-20

All JobsAi Rating Jobs

Ai Rating information

See salary details

$13

$27

$43

How much do ai rating jobs pay per hour?

As of Jul 13, 2026, the average hourly pay for ai rating in the United States is $27.65, according to ZipRecruiter salary data. Most workers in this role earn between $20.43 and $33.65 per hour, depending on experience, location, and employer.

What are the main responsibilities and typical daily tasks for an AI Rater?

As an AI Rater, your primary responsibility is to evaluate search results, advertisements, or other AI-generated content for relevance, accuracy, and quality according to provided guidelines. You may spend your workdays reviewing data sets, rating outputs, and providing feedback to help optimize machine learning algorithms. The role often involves independent, remote work while following clear evaluation standards and meeting productivity goals. Consistent attention to detail and impartiality are crucial to ensure your assessments help enhance the overall AI system performance.

What are the key skills and qualifications needed to thrive in the Ai Rating position, and why are they important?

To excel as an AI Rater, you need strong analytical skills, attention to detail, and familiarity with computer-based evaluation, often supported by a relevant educational background or work experience in data annotation or quality assessment. Experience using web-based evaluation platforms, and sometimes basic knowledge of machine learning frameworks, is valuable. Critical thinking, adaptability, and clear written communication are important soft skills for providing precise and actionable feedback. These abilities ensure that AI systems are accurately assessed and improved, directly impacting the quality and effectiveness of AI-driven products.

What is an AI Rating job?

An AI Rating job involves evaluating artificial intelligence systems, models, or algorithms based on specific criteria such as accuracy, fairness, and performance. Professionals in this role assess AI-generated content, provide feedback, and help improve machine learning models. They may work on tasks like rating search engine results, analyzing chatbots, or reviewing AI-generated text and images. This role is critical in training AI systems to be more reliable and user-friendly.

More about Ai Rating jobs
What cities are hiring for Ai Rating jobs? Cities with the most Ai Rating job openings:
What are the most commonly searched types of Ai Rating jobs? The most popular types of Ai Rating jobs are:
What states have the most Ai Rating jobs? States with the most job openings for Ai Rating jobs include:
What job categories do people searching Ai Rating jobs look for? The top searched job categories for Ai Rating jobs are:
Ai Rating jobs near you
Infographic showing various Ai Rating job openings in the United States as of July 2026, with employment types broken down into 6% Internship, 44% Full Time, 44% Part Time, and 6% Contract. Highlights an 67% In-person, and 33% Remote job distribution, with an average salary of $57,520 per year, or $27.7 per hour.

Applied AI Researcher, Benchmarking

Distyl AI

New York, NY • On-site

$150K - $250K/yr

Full-time

Medical, Dental, Vision, Retirement

Re-posted 2 hours ago

Job description

About Distyl AI
Distyl is an applied AI technology company partnering with the world's most ambitious institutions to rearchitect critical operations for the frontier of AI. Our customers include the largest companies in telecom, healthcare, insurance, manufacturing, consumer goods, and global social organizations.
We research and deploy technologies that power AI-native operations - both for our partners and for Distyl itself. Our work spans research into self-constructing systems, the development of the most reliable execution of AI systems, and products that transform mission-critical workflows. As a result, Distyl's technologies affect some of the world's largest operations - from hundreds of millions of consumer interactions to tens of millions of supply chain transactions and millions of patient journeys.
Distyl is backed by leading investors including Lightspeed Venture Partners, Khosla Ventures, Coatue, DST Global, and the board-members of 20+ F500s. The results reflect this approach: a 100% production deployment success rate for our customers and one of the few enterprise AI companies to run a profitable business.
What We Are Looking For
At Distyl we're pushing the envelope of AI utilization in enterprise. This requires creative researchers who don't just want to drive incremental improvements on benchmarks or optimize an existing process but instead are looking to creatively redefine how software is used.
Our researchers come from many academic backgrounds but have strong research track records, operate in an AI-native way, and would be bored staying on the rails of a traditional research org.
Key Responsibilities
  • The Benchmarking team defines how progress is measured. Researchers design evaluation frameworks that capture reasoning depth, interaction quality, reliability, and operational impact. They construct benchmarks that reflect real-world complexity. Their systems become the standard by which new architectures, techniques, and releases are judged.
  • Researchers in Benchmarking explore new paradigms for evaluating intelligent systems: adversarial robustness testing, longitudinal performance tracking, and human-in-the-loop assessment. They investigate how metrics shape model behavior and establish rigorous methodologies for quantifying emergent capability. Their insights drive both Distyl's internal research priorities and industry-wide standards.
Who You Are
  • Experience Designing and Running Evaluations: You've built or maintained benchmarks, test suites, or experimental frameworks to measure model or system performance
  • Statistical and Analytical Rigor: You design fair, reproducible experiments and can extract signal from noisy empirical results
  • Experience Building with Models, Not Just Building Models: We develop intelligent systems using models rather than training or fine-tuning them. Ideal candidates have expertise in compound AI systems, agentic collaboration, and associated techniques (ensembling, ReAct, graph-of-thoughts, etc.)
  • Proven Track Record of Research Results: Whether you've published in top journals, posted amazing work on twitter, or somewhere else we want to see what you've done
  • Uses AI Every Day: Before you can revolutionize someone else's workflow, you need to revolutionize yours. You should be using tools like ChatGPT, Cursor, and Perplexity to accelerate your workflow
  • Strong Programming and Data Analysis Skills: While you might not consider yourself a software engineer you need to be able to build prototypes of your ideas and then perform the experiments to prove the effectiveness to a F500 Head of AI
  • Biases Towards Showing vs Telling: Our customers want to see the power of AI today vs discuss the most elegant idea that will take 5 years to realize
What We Offer
  • The base salary range for this role is $150K - $250K, depending on experience, location, and level. In addition to base compensation, this role is eligible for meaningful equity, along with a comprehensive benefits package
  • 100% coverage of medical, dental, and vision insurance for employee and dependents
  • Flexible time off
  • Retirement and financial planning benefits, including access to pre-tax HSA, FSA, and commuter accounts, 401(k), and financial coaching resources
  • Comprehensive wellness benefits, including physical fitness, mental well-being, and fertility and family-building benefits through Carrot
  • Complimentary in-office lunches and snacks provided
  • Access to state-of-the-art AI models, generous usage of modern AI tools, and real-world business problems
  • Ownership of high-impact projects across top enterprises
  • A mission-driven, fast-moving culture that values curiosity, pragmatism, and excellence

Distyl has offices in San Francisco and New York. This role follows a hybrid collaboration model with 3+ days per week (Tuesday-Thursday) in‑office.
#LI-Hybrid
We believe diverse perspectives make our work stronger and more impactful. We are an equal opportunity employer and evaluate all applicants without regard to race, color, religion, sex, sexual orientation, gender identity or expression, national origin, age, disability, veteran status, or any other legally protected characteristic. We encourage candidates from all backgrounds to apply.

Apply