ZipRecruiter

Log In

1

Ai Rating Jobs (NOW HIRING)

next page

Showing results 1-20

All JobsAi Rating Jobs

Ai Rating information

See salary details

$13

$27

$43

How much do ai rating jobs pay per hour?

As of Jun 10, 2026, the average hourly pay for ai rating in the United States is $27.65, according to ZipRecruiter salary data. Most workers in this role earn between $20.43 and $33.65 per hour, depending on experience, location, and employer.

What are the main responsibilities and typical daily tasks for an AI Rater?

As an AI Rater, your primary responsibility is to evaluate search results, advertisements, or other AI-generated content for relevance, accuracy, and quality according to provided guidelines. You may spend your workdays reviewing data sets, rating outputs, and providing feedback to help optimize machine learning algorithms. The role often involves independent, remote work while following clear evaluation standards and meeting productivity goals. Consistent attention to detail and impartiality are crucial to ensure your assessments help enhance the overall AI system performance.

What are the key skills and qualifications needed to thrive in the Ai Rating position, and why are they important?

To excel as an AI Rater, you need strong analytical skills, attention to detail, and familiarity with computer-based evaluation, often supported by a relevant educational background or work experience in data annotation or quality assessment. Experience using web-based evaluation platforms, and sometimes basic knowledge of machine learning frameworks, is valuable. Critical thinking, adaptability, and clear written communication are important soft skills for providing precise and actionable feedback. These abilities ensure that AI systems are accurately assessed and improved, directly impacting the quality and effectiveness of AI-driven products.

What is an AI Rating job?

An AI Rating job involves evaluating artificial intelligence systems, models, or algorithms based on specific criteria such as accuracy, fairness, and performance. Professionals in this role assess AI-generated content, provide feedback, and help improve machine learning models. They may work on tasks like rating search engine results, analyzing chatbots, or reviewing AI-generated text and images. This role is critical in training AI systems to be more reliable and user-friendly.

More about Ai Rating jobs
What cities are hiring for Ai Rating jobs? Cities with the most Ai Rating job openings:
What are the most commonly searched types of Ai Rating jobs? The most popular types of Ai Rating jobs are:
What states have the most Ai Rating jobs? States with the most job openings for Ai Rating jobs include:
What job categories do people searching Ai Rating jobs look for? The top searched job categories for Ai Rating jobs are:
Ai Rating jobs near you
Infographic showing various Ai Rating job openings in the United States as of June 2026, with employment types broken down into 25% Internship, 13% Full Time, 37% Part Time, and 25% Temporary. Highlights an 87% In-person, and 13% Remote job distribution, with an average salary of $57,520 per year, or $27.7 per hour.

Applied AI Researcher, Post-Training

Distyl AI

New York, NY • On-site

$150K - $250K/yr

Full-time

Medical, Dental, Vision, Retirement

Posted 26 days ago

Job description

About Distyl AI
Distyl is an applied AI technology company partnering with the world's most ambitious institutions to rearchitect critical operations for the frontier of AI. Our customers include the largest companies in telecom, healthcare, insurance, manufacturing, consumer goods, and global social organizations.
We research and deploy technologies that power AI-native operations - both for our partners and for Distyl itself. Our work spans research into self-constructing systems, the development of the most reliable execution of AI systems, and products that transform mission-critical workflows. As a result, Distyl's technologies affect some of the world's largest operations - from hundreds of millions of consumer interactions to tens of millions of supply chain transactions and millions of patient journeys.
Distyl is backed by leading investors including Lightspeed Venture Partners, Khosla Ventures, Coatue, DST Global, and the board-members of 20+ F500s. The results reflect this approach: a 100% production deployment success rate for our customers and one of the few enterprise AI companies to run a profitable business.
What We Are Looking For
At Distyl we're pushing the envelope of AI utilization in enterprise. This requires creative researchers who don't just want to drive incremental improvements on benchmarks or optimize an existing process but instead are looking to creatively redefine how software is used.
Our researchers come from many academic backgrounds but have strong research track records, operate in an AI-native way, and would be bored staying on the rails of a traditional research org.
Key Responsibilities
  • The Post-Training team focuses on adapting foundation models to real-world performance and alignment requirements. Researchers develop and evaluate techniques such as supervised fine-tuning, preference optimization (DPO, RLHF, RLAIF), and continual adaptation to align models with Distyl's enterprise systems. The goal is to bridge raw model capability with trustworthy, contextually aligned system behavior
  • Researchers in Post-Training investigate new methods for aligning large models with human and system-level objectives. They explore trade-offs between generalization and specialization, data efficiency and robustness, capability and controllability. Their work informs how Distyl leverages foundation models safely, effectively, and at scale across industries
What We Require
  • Deep Understanding of Post-training Techniques: Familiarity with supervised fine-tuning, preference optimization (RLHF/DPO), LoRA/PEFT, and instruction-tuning pipelines.
  • Experience Adapting Frontier Models: You've tuned or adapted LLMs/SLMs to specialized domains or behaviors through data curation, reward modeling, or continual pretraining.
  • Experience Building with Models, Not Just Building Models: We develop intelligent systems using models rather than training or fine-tuning them. Ideal candidates have expertise in compound AI systems, agentic collaboration, and associated techniques (ensembling, ReAct, graph-of-thoughts, etc.).
  • Proven Track Record of Research Results: Whether you've published in top journals, posted amazing work on twitter, or somewhere else we want to see what you've done.
  • Uses AI Every Day: Before you can revolutionize someone else's workflow, you need to revolutionize yours. You should be using tools like ChatGPT, Cursor, and Perplexity to accelerate your workflow.
  • Strong Programming and Data Analysis Skills: While you might not consider yourself a software engineer you need to be able to build prototypes of your ideas and then perform the experiments to prove the effectiveness to a F500 Head of AI.
  • Biases Towards Showing vs Telling: Our customers want to see the power of AI today vs discuss the most elegant idea that will take 5 years to realize.
What We Offer
  • The base salary range for this role is $150K - $250K, depending on experience, location, and level. In addition to base compensation, this role is eligible for meaningful equity, along with a comprehensive benefits package
  • 100% covered medical, dental, and vision for employees and dependents
  • 401(k) with additional perks (e.g., commuter benefits, in‑office lunch)
  • Access to state‑of‑the‑art models, generous usage of modern AI tools, and real‑world business problems
  • Ownership of high‑impact projects across top enterprises
  • A mission‑driven, fast‑moving culture that prizes curiosity, pragmatism, and excellence

Distyl has offices in San Francisco and New York. This role follows a hybrid collaboration model with 3+ days per week (Tuesday-Thursday) in‑office.
#LI-Hybrid
We believe diverse perspectives make our work stronger and more impactful. We are an equal opportunity employer and evaluate all applicants without regard to race, color, religion, sex, sexual orientation, gender identity or expression, national origin, age, disability, veteran status, or any other legally protected characteristic. We encourage candidates from all backgrounds to apply.

Apply