ZipRecruiter

Log In

1

Ai Rater Jobs in Redmond, WA (NOW HIRING)

Salesforce, Inc.

Director, AI & Tooling

Bellevue, WA · On-site

Help Agent resolution rate and quality scores (completeness, correctness, relevance) improve ... AI & Tooling functions as a center of excellence for generative AI evaluation and tooling practices ...

Brex

Manager, CX AI Strategy

Seattle, WA · Hybrid

Collaborate with CX leaders to drive performance metrics: resolution rate, CSAT, quality ... Own the CX AI roadmap from opportunity discovery through implementation - prioritize where AI can ...

Brex

Manager, CX AI Strategy

Seattle, WA · On-site

Brex's AI-native automation and world-class service eliminate manual expense and accounting tasks ... Collaborate with CX leaders to drive performance metrics: resolution rate, CSAT, quality ...

Apex Systems

AI Engineer

Bellevue, WA · On-site

Job#: 3046714 AI Software Engineer Location: United States (Remote) Work Type : Contract Role ... Message and data rates may apply. Carriers are not liable for delayed or undelivered messages. You ...

New

FHLB Des Moines

AI Security Engineer

Seattle, WA · On-site

$88 - $142/hr

... rate limits, output filtering, and secrets isolation.- Participate in recurring red-team exercises against AI platforms mapped to the OWASP LLM Top 10, the OWASP Top 10 for Agentic Applications, and ...

Uw

AI Security Engineer

Seattle, WA · On-site

... rate limits, output filtering, and secrets isolation. - Participate in recurring red-team exercises against AI platforms mapped to the OWASP LLM Top 10, the OWASP Top 10 for Agentic Applications, and ...

next page

Showing results 1-20

All JobsAi Rater JobsAi Rater Jobs in Redmond, WA

Ai Rater information

What is an AI Rater?

An AI Rater evaluates and provides feedback on artificial intelligence models, typically improving search engines, chatbots, or recommendation systems. They assess the relevance, accuracy, and quality of AI-generated content based on specific guidelines. This role requires strong analytical skills, attention to detail, and familiarity with the subject matter being reviewed. AI Raters often work remotely and on a flexible schedule.

What does an AI Rater do?

A typical day for an AI Rater involves reviewing and evaluating various types of content, such as search engine results, social media posts, advertisements, or chatbot responses, to ensure they meet quality and relevancy standards. You may follow detailed guidelines to rate or annotate content, complete assigned tasks in a web-based platform, and provide feedback to help improve AI performance. Most positions are remote and offer flexible schedules, allowing you to plan your workload around personal commitments. Collaboration is generally limited, as most work is performed independently, but periodic communication with team leads for training or updates is common.

What skills and qualifications are needed to thrive as an AI Rater?

To thrive as an AI Rater, you generally need strong attention to detail, analytical thinking, and proficiency in English, often supported by formal education such as a high school diploma or higher. Familiarity with web browsers, online research, and company-specific rating platforms or guidelines is essential. Excellent time management, adaptability, and effective written communication help individuals excel in this position. These skills and qualities ensure accurate and consistent evaluations of AI-generated content, directly impacting the improvement of artificial intelligence systems.

How to become an AI Rater?

To become an AI Rater, candidates typically need a high school diploma or equivalent, strong language and analytical skills, and the ability to follow detailed guidelines. The role often involves evaluating search engine results or content for accuracy and relevance, using online platforms or specific assessment tools. Prior experience in data annotation or quality assurance can be beneficial, and flexible scheduling is common.

What job categories do people searching Ai Rater jobs in Redmond, WA look for?

The top searched job categories for Ai Rater jobs in Redmond, WA are:

What cities near Redmond, WA are hiring for Ai Rater jobs?

Cities near Redmond, WA with the most Ai Rater job openings:

Ai Rater jobs near you
Infographic showing various Ai Rater job openings in Redmond, WA as of June 2026, with employment types broken down into 9% Internship, 40% Full Time, and 51% Part Time. Highlights an 62% In-person, and 38% Remote job distribution.

Senior Physics Domain Specialist - AI Rater

micro1 AI

Renton, WA • Remote

$80 - $160/hr

Part-time

Posted 19 days ago

Job description

Role Title: Physics Expert (Professor / Principal Investigator)


Role Type: Contractor.


Location: Remote


micro1 is engaging Physics Experts—established Professors or Principal Investigators—to provide high-level domain guidance as part of an impactful project for a customer. In this role, you'll apply your expertise to help train next-generation AI systems. Your work will shape how models learn, reason, and perform through high-quality, real-world input. No prior experience in AI is required — your domain knowledge is what matters.


Scope of Work

  1. Adjudicate and render expert judgment on contested or competing physics arguments, solutions, or interpretations within your subfield.
  2. Compare alternative approaches to the same problem, detailing which is superior, under what assumptions, and in which regimes.
  3. Identify and articulate meta-level criteria for evaluating the robustness and validity of competing physics work, such as key assumptions and breaking points of approximations.
  4. Exercise calibrated confidence by providing authoritative assessments while transparently acknowledging genuine uncertainty or open questions in the field.
  5. Draft defensible written evaluations suitable for review by fellow senior physicists, ensuring clarity and rigor.
  6. Leverage technical tools such as LaTeX, SymPy, Python, and Jupyter to verify or contrast technical claims as needed.
  7. Clearly communicate when a question is unresolved within the field and delineate the pertinent considerations.


Preferred Qualifications

  1. PhD in physics with demonstrated expertise and scholarly impact in your specified subfield.
  2. Current or former Associate Professor, Full Professor, Chair Professor, or Principal Investigator/Group Leader with a track record of independent research leadership.
  3. Ongoing research activity in one or more of these areas: High Energy Physics, Mathematical Physics, Biophysics, Statistical Physics, Condensed Matter, AMO/Quantum Optics, Gravitation, Cosmology, Astrophysics, Quantum Information, or Optical Properties of Materials.
  4. 3–5 recent representative publications in your target subfield, with arXiv or DOI references.
  5. Prior experience supervising PhD students or postdocs, or equivalent leadership in industry research settings.
  6. Proficiency with LaTeX, SymPy, Python, and Jupyter (please indicate any gaps in experience with these tools).
  7. Exceptional written communication skills, with the ability to articulate nuanced and well-reasoned judgments.

Apply