ZipRecruiter

Log In

1

Ai Rater Jobs in California (NOW HIRING)

Prophecy Technologies

AI Backend Engineer

Rosemead, CA · On-site

Implement Python microservices and APIs (FastAPI/Flask/Django) with clean contracts, versioning, pagination, and rate limiting. * Build REST/GraphQL endpoints and internal SDKs to enable AI enhanced ...

JS Consulting

Product Manager - AI

Oakland, CA · On-site

Job Title- Product Manager - AI Project Location - Hybrid at Oakland, CA office 2-3 days onsite in ... Monitor output metrics such as asset acceptance rate, generation cost, and asset velocity to ...

Conduit AI

Backend Engineer

San Francisco, CA

$150/hr

The reliability of message delivery, the speed of AI responses, the depth of integrations, the ... Webhook handlers, retries, delivery receipts, per-workspace rate limits. Sub-second delivery ...

Rad AI

Product Lead, Orchestration

San Francisco, CA · On-site

$210K - $235K/yr

With one of the largest proprietary radiology report datasets in the world, our AI has helped uncover hundreds of new cancer diagnoses and reduced error rates in tens of millions of radiology reports ...

Apex Systems

AI Engineer

Beverly Hills, CA

Design and implement end-to-end AI use cases , from problem definition through production ... Message and data rates may apply. Carriers are not liable for delayed or undelivered messages. You ...

C3 AI

Vice President, Marketing

Redwood City, CA

C3 AI is hiring a Vice President of Marketing to lead the next chapter of our global marketing ... contribution, conversion rates, and CAC. * Own and execute Account-Based Marketing programs ...

Rad AI

Product Manager, SDK

San Francisco, CA · On-site

$180K - $210K/yr

With one of the largest proprietary radiology report datasets in the world, our AI has helped uncover hundreds of new cancer diagnoses and reduced error rates in tens of millions of radiology reports ...

ClifyX

Applied AI Engineer

Sunnyvale, CA

... AI experience required) Production AI Systems Has shipped AI/LLM features serving real users at ... limits, rate limiting, structured outputs, API failure modes LLM Evaluation Understands how to ...

Rad AI

Product Manager, Workflows

San Francisco, CA · On-site

$180K - $210K/yr

With one of the largest proprietary radiology report datasets in the world, our AI has helped uncover hundreds of new cancer diagnoses and reduced error rates in tens of millions of radiology reports ...

next page

Showing results 1-20

All JobsAi Rater JobsAi Rater Jobs in California

Ai Rater information

What is an AI Rater job?

An AI Rater evaluates and provides feedback on artificial intelligence models, typically improving search engines, chatbots, or recommendation systems. They assess the relevance, accuracy, and quality of AI-generated content based on specific guidelines. This role requires strong analytical skills, attention to detail, and familiarity with the subject matter being reviewed. AI Raters often work remotely and on a flexible schedule.

What are the key skills and qualifications needed to thrive in the Ai Rater position, and why are they important?

To thrive as an AI Rater, you generally need strong attention to detail, analytical thinking, and proficiency in English, often supported by formal education such as a high school diploma or higher. Familiarity with web browsers, online research, and company-specific rating platforms or guidelines is essential. Excellent time management, adaptability, and effective written communication help individuals excel in this position. These skills and qualities ensure accurate and consistent evaluations of AI-generated content, directly impacting the improvement of artificial intelligence systems.

What does a typical day look like for an AI Rater?

A typical day for an AI Rater involves reviewing and evaluating various types of content, such as search engine results, social media posts, advertisements, or chatbot responses, to ensure they meet quality and relevancy standards. You may follow detailed guidelines to rate or annotate content, complete assigned tasks in a web-based platform, and provide feedback to help improve AI performance. Most positions are remote and offer flexible schedules, allowing you to plan your workload around personal commitments. Collaboration is generally limited, as most work is performed independently, but periodic communication with team leads for training or updates is common.

What are the most commonly searched types of Ai Rater jobs in California? The most popular types of Ai Rater jobs in California are:
What are popular job titles related to Ai Rater jobs in California? For Ai Rater jobs in California, the most frequently searched job titles are:
What job categories do people searching Ai Rater jobs in California look for? The top searched job categories for Ai Rater jobs in California are:
What cities in California are hiring for Ai Rater jobs? Cities in California with the most Ai Rater job openings:
Ai Rater jobs near you
Infographic showing various Ai Rater job openings in California as of June 2026, with employment types broken down into 15% Internship, 31% Full Time, 46% Part Time, and 8% Contract. Highlights an 69% In-person, and 31% Remote job distribution.

AI Backend Engineer

Prophecy Technologies

Rosemead, CA

Other

Posted 2 days ago

Job description

Role Overview:
This role is for an AI Backend Engineer, also described as a Python Full Stack Developer, with strong Python and AI/ML fundamentals. The position focuses on hands-on experience in prompt engineering, integrating pretrained/foundation models into enterprise applications, and deploying AI solutions using CI/CD. The engineer will be versatile in constructing AI pipelines using tools like LangChain, LlamaIndex, and AutoRAG, with an emphasis on model optimization through Optuna and GridSearchCV.
Key Responsibilities:
  • Implement Python microservices and APIs (FastAPI/Flask/Django) with clean contracts, versioning, pagination, and rate limiting.
  • Build REST/GraphQL endpoints and internal SDKs to enable AI enhanced features (prompt routing, retrieval, redaction) while maintaining strict separation from model ownership.
  • Implement asynchronous and event driven processing (e.g., Celery/Kafka/queues) for high throughput pipelines and background jobs.
  • Integrate services with enterprise AI platforms / LLM APIs (e.g., Azure OpenAI via enterprise gateway), handling prompt orchestration, tool invocation, moderation hooks, and response validation.
  • Enforce runtime guardrails: input sanitization, PII redaction, toxicity/NSFW filters, output signing, and fallbacks.
  • Implement semantic retrieval and vector search via approved platforms; do not train or host custom models.
Required Skills:
  • Strong Python and AI/ML fundamentals.
  • Hands-on experience in prompt engineering.
  • Experience integrating pretrained/foundation models into enterprise applications.
  • Proficiency in deploying AI solutions using CI/CD.
  • Versatility in constructing AI pipelines using LangChain, LlamaIndex, and AutoRAG.
  • Experience with model optimization through Optuna and GridSearchCV.
  • Familiarity with Python microservices and APIs (FastAPI/Flask/Django).
  • Knowledge of REST/GraphQL endpoints and internal SDKs.
  • Experience with asynchronous and event-driven processing (e.g., Celery/Kafka/queues).
  • Ability to integrate with enterprise AI platforms / LLM APIs (e.g., Azure OpenAI).
  • Understanding of prompt orchestration, tool invocation, moderation hooks, and response validation.
  • Capability to implement runtime guardrails including input sanitization, PII redaction, toxicity/NSFW filters, output signing, and fallbacks.
  • Experience with semantic retrieval and vector search.
Qualifications:
  • No specific years of experience mentioned.

Preferred Skills:

Apply