ZipRecruiter

Log In

1

Ai Rater Jobs in Edmonds, WA (NOW HIRING)

ZS

Lead AI Engineer

Bellevue, WA · On-site

$115K - $151K/yr

The Lead AI Engineer will lead the development of production-grade LLM systems, focusing on ... rate limiting • Experience with vector DB including: Pinecone, Weaviate, or Chroma, Embedding ...

Coupang

Sr. Director, AI Infrastructure

Seattle, WA · On-site

$184 - $376/hr

  • Medical

  • Dental

  • Vision

  • Life

  • Retirement

  • PTO

The resource utilization rate and cost efficiency of the AI compute infrastructure. * The reliability and uptime of the core AI platform services. * The talent retention and development within the AI ...

Apex Systems

Sr AI Analyst

Seattle, WA · On-site

$83 - $138/hr

  • Medical

  • Dental

  • Vision

  • Life

  • Retirement

# Sr AI AnalystApply**Job#: 3045147**** **Sr AI Analyst**Location:** Seattle, Washington (Onsite ... Message and data rates may apply. Carriers are not liable for delayed or undelivered messages. You ...

previous page

Showing results 41-60

All JobsAi Rater JobsAi Rater Jobs in Edmonds, WA

Ai Rater information

What is an AI Rater?

An AI Rater evaluates and provides feedback on artificial intelligence models, typically improving search engines, chatbots, or recommendation systems. They assess the relevance, accuracy, and quality of AI-generated content based on specific guidelines. This role requires strong analytical skills, attention to detail, and familiarity with the subject matter being reviewed. AI Raters often work remotely and on a flexible schedule.

What does an AI Rater do?

A typical day for an AI Rater involves reviewing and evaluating various types of content, such as search engine results, social media posts, advertisements, or chatbot responses, to ensure they meet quality and relevancy standards. You may follow detailed guidelines to rate or annotate content, complete assigned tasks in a web-based platform, and provide feedback to help improve AI performance. Most positions are remote and offer flexible schedules, allowing you to plan your workload around personal commitments. Collaboration is generally limited, as most work is performed independently, but periodic communication with team leads for training or updates is common.

What skills and qualifications are needed to thrive as an AI Rater?

To thrive as an AI Rater, you generally need strong attention to detail, analytical thinking, and proficiency in English, often supported by formal education such as a high school diploma or higher. Familiarity with web browsers, online research, and company-specific rating platforms or guidelines is essential. Excellent time management, adaptability, and effective written communication help individuals excel in this position. These skills and qualities ensure accurate and consistent evaluations of AI-generated content, directly impacting the improvement of artificial intelligence systems.

How to become an AI Rater?

To become an AI Rater, candidates typically need a high school diploma or equivalent, strong language and analytical skills, and the ability to follow detailed guidelines. The role often involves evaluating search engine results or content for accuracy and relevance, using online platforms or specific assessment tools. Prior experience in data annotation or quality assurance can be beneficial, and flexible scheduling is common.

What are popular job titles related to Ai Rater jobs in Edmonds, WA?

For Ai Rater jobs in Edmonds, WA, the most frequently searched job titles are:

What job categories do people searching Ai Rater jobs in Edmonds, WA look for?

The top searched job categories for Ai Rater jobs in Edmonds, WA are:

What cities near Edmonds, WA are hiring for Ai Rater jobs?

Cities near Edmonds, WA with the most Ai Rater job openings:

Ai Rater jobs near you

Lead AI Engineer

ZS

Bellevue, WA • On-site

$115K - $151K/yr

Full-time

Re-posted 20 days ago

Job description

Job Summary:
ZS is a management consulting and technology firm focused on improving life through data, science, and technology. The Lead AI Engineer will lead the development of production-grade LLM systems, focusing on building and optimizing AI applications and pipelines.
Responsibilities:
• Design and implement LLM-powered applications using state-of-the-art transformer models.
• Build and optimize RAG pipelines using embeddings, chunking strategies, and vector search.
• Experiment with prompt engineering, structured outputs (JSON schemas/function calling), and tool-augmented LLMs (agents/workflows).
• Fine-tune models using techniques such as LoRA, PEFT, and instruction tuning.
• Develop and evaluate embedding models for similarity search and semantic retrieval.
• Conduct LLM evaluation using automated and human-in-the-loop techniques (offline + online).
• Optimize inference workflows for latency, GPU utilization, and cost efficiency (quantization, batching, caching).
• Build and maintain REST API Services (FastAPI etc.) to deploy LLM/RAG endpoints, integrate with product systems, and support scalable inference.
• Contribute to integration of AI systems into production software environments (CI/CD, monitoring, reliability).
• Research and prototype cutting-edge approaches in Generative AI and share learnings with the team.
Qualifications:
Required:
• A master's or bachelor's degree in Computer Science or related field from a top university
• 4+ years' hands-on experience in Machine Learning (ML) with production LLM systems
• Good fundamentals of machine learning, deep learning and fine tuning models (LLM) including: Understanding of transformer architectures, Prompt engineering expertise, Embeddings and vector search
• Experienced in backend API design with FastAPI, async patterns, rate limiting
• Experience with vector DB including: Pinecone, Weaviate, or Chroma, Embedding storage and similarity search, Hybrid search implementations
• Strong programming expertise in Python is must including: Async programming (asyncio, async/await), Type hints and Pydantic, SOLID principles and design patterns
• Experience in ML Ops to measure and track model performance including: MLFlow for model tracking, Langfuse for LLM observability (strongly preferred), Model versioning and A/B testing
• Experience in working with NLP & computer vision
• Fluency in English
• Client-first mentality
• Intense work ethic
• Collaborative spirit and problem-solving approach
Preferred:
• Langfuse for LLM observability
Company:
ZS is a management consulting and technology firm that partners with companies to improve life and how we live it. Founded in 1983, the company is headquartered in Evanston, USA, with a team of 10001+ employees. The company is currently Late Stage.
ZS logo

About ZS

Sourced by ZipRecruiter

Industry

Business management consulting

Company size

10,000+ Employees

Headquarters location

Evanston, IL, US

Year founded

1983

View All ZS Jobs

Apply