1

Ai Rater Jobs in Riverside, CA (NOW HIRING)

Applied AI Engineer

Irvine, CA ยท On-site

$121K - $145K/yr

... rate limiting, and escalation controls to ensure reliable and responsible operation at scale. โ€ข Strong proficiency in Python, SQL, and relevant AI/ML libraries and frameworks. โ€ข Hands-on ...

Job AI Automation Intern

Orange, CA

$16 - $21.75/hr

AI Automation Intern Location: Orange, CA, US, 92865 Business Unit: Energy Conversion Solutions ... From the center of town referred to as the Plaza to our top-rated hospitals, schools, and parks, w ...

next page

Showing results 1-20

Ai Rater information

What is an AI Rater job?

An AI Rater evaluates and provides feedback on artificial intelligence models, typically improving search engines, chatbots, or recommendation systems. They assess the relevance, accuracy, and quality of AI-generated content based on specific guidelines. This role requires strong analytical skills, attention to detail, and familiarity with the subject matter being reviewed. AI Raters often work remotely and on a flexible schedule.

What are the key skills and qualifications needed to thrive in the Ai Rater position, and why are they important?

To thrive as an AI Rater, you generally need strong attention to detail, analytical thinking, and proficiency in English, often supported by formal education such as a high school diploma or higher. Familiarity with web browsers, online research, and company-specific rating platforms or guidelines is essential. Excellent time management, adaptability, and effective written communication help individuals excel in this position. These skills and qualities ensure accurate and consistent evaluations of AI-generated content, directly impacting the improvement of artificial intelligence systems.

What does a typical day look like for an AI Rater?

A typical day for an AI Rater involves reviewing and evaluating various types of content, such as search engine results, social media posts, advertisements, or chatbot responses, to ensure they meet quality and relevancy standards. You may follow detailed guidelines to rate or annotate content, complete assigned tasks in a web-based platform, and provide feedback to help improve AI performance. Most positions are remote and offer flexible schedules, allowing you to plan your workload around personal commitments. Collaboration is generally limited, as most work is performed independently, but periodic communication with team leads for training or updates is common.

What are popular job titles related to Ai Rater jobs in Riverside, CA? For Ai Rater jobs in Riverside, CA, the most frequently searched job titles are:
What job categories do people searching Ai Rater jobs in Riverside, CA look for? The top searched job categories for Ai Rater jobs in Riverside, CA are:
What cities near Riverside, CA are hiring for Ai Rater jobs? Cities near Riverside, CA with the most Ai Rater job openings:
Infographic showing various Ai Rater job openings in Riverside, CA as of June 2026, with employment types broken down into 15% Internship, 31% Full Time, 46% Part Time, and 8% Contract. Highlights an 69% In-person, and 31% Remote job distribution.
Technical Product Owner - AI

Technical Product Owner - AI

Mutual of Omaha Mortgage

Irvine, CA โ€ข On-site

$125K - $145K/yr

Full-time

Medical, Dental, Vision, Life, Retirement, PTO

Posted 12 days ago


Job description

Technical Product Owner โ€” AI

Location: Location: Hybrid - Irvine, CAย ย 

Mutual of Omaha is a Fortune 300 Company. Mutual of Omaha Mortgage is inspired by hometown values and a commitment to being responsible and caring for each other. We exist for the benefit of our customers and employees.ย ย ย 
Mutual of Omaha Mortgage is a full-service lending company offering both Forward and Reverse Mortgage products including a complete line of residential mortgage, refinancing, specialty, and HECM loans. We employ a knowledgeable staff of experienced Loan Officers with an operations team that is second to none. If you are interested in joining a team that promotes from within and works together toward a common goal of helping customers with their mortgage needs, please review and apply for our opening below!ย ย 

Mutual of Omaha Mortgage is hiring a Technical Product Owner โ€” AI to own the performance and lifecycle of our AI products. This is a hands-on, technical role for someone who can take AI products from 0-to-1: scoping the problem, shaping prompts, partnering with engineering and data, instrumenting outcomes, and driving measurable lift on conversion, containment, and customer experience metrics. You will sit on the AI Initiatives team and own a portfolio that spans voice and SMS AI agents, agent-assist tooling, and the data and observability foundation that keeps them performant.ย 

Roles & Responsibilities:ย 

  • Define, instrument, and report on KPIs for each AI product โ€” including containment rate, goal completion, AI resolution rate, conversion, drop-off, and revenue attributionย 
  • Run weekly performance reviews on live AI products;ย identifyย regressions, root-cause them across prompt, model, data, and integration layers, and drive fixes to closureย 
  • Build andย maintainย QA sampling frameworks and call/conversation review processes; turn qualitative findings into prompt and flow changesย 
  • Take new AI use cases from concept to production: write the PRD, define success metrics, scope the MVP, partner with engineering and vendors on build, and lead the launchย 
  • Run structured POCs (typically 30โ€“90 days) with clear hypotheses, evaluation rubrics, and go/no-go criteriaย 
  • Own vendor evaluations end-to-end โ€” requirements, scoring, reference checks, contract input, and onboarding through the EVMP and AI governance processesย 
  • Author, version, and tune prompts for voice agents, SMS agents, and assistive AI tools across the customer and loan officer journeysย 
  • Design and run prompt evaluations: build eval sets from real conversations, score outputs against rubrics, and iterate systematically rather than anecdotallyย 
  • Translate operational requirements (compliance disclosures, escalation rules, brand voice, edge cases) into prompts, tools, and guardrails the model willย actually followย 
  • Write production-quality SQL against Databricks, Salesforce, Encompass, and call/conversation log sources to investigate performance, build dashboards, and answer ad-hoc questionsย 
  • Partner with data engineering on the schemas, pipelines, and event tracking needed to measure AI product performanceย 
  • Read API documentation, debug integrations, and reason about call flows, webhooks, and tool-use patterns at a level where you can have a substantive conversation with engineersย 
  • Serve as the single point of accountability for assigned AI products: align stakeholders across Sales, Operations, Compliance, Legal, and Engineeringย 
  • Contribute to AI governance reviews and ensure products meet NIST AI RMF expectations and applicable state AI law requirementsย 

Required Qualifications:ย 

  • 5+ years in technical product management, product ownership, or a comparable applied AI/ML product role, including direct ownership of a production AI or ML productโ€™s performance metricsย 
  • Demonstrated 0-to-1 experience โ€” you have shipped at least one product from blank-page concept to live, measured users, and can speak credibly about what worked, what failed, and whyย 
  • Hands-on prompt engineering โ€” you have written, evaluated, and iterated on production prompts for LLM-based products (chat, voice, SMS, agent-assist, or similar)ย 
  • Strong SQL โ€” comfortable writing multi-table joins, window functions, and CTEs without help; can pull and analyze your own data on Databricks, SQL Server, or equivalentย 
  • Data fluency โ€” comfortable with funnels, cohort analysis, and basic statistical reasoning; able to build a dashboard or explanatory chart yourselfย 
  • Technical literacy โ€” you can read REST API docs, trace a webhook, and discuss system design with engineers without needing translationย 
  • Operating rigor โ€” strong written communication, structured PRDs, clear success criteria, andย a track recordย of holding yourself and your partners to measurable outcomesย 
  • Salesforce experience โ€” hands-on experience working with Salesforce as a product owner, admin, or power user; comfortable with objects, flows, reports, and SOQLย 
  • Mortgage industry experience โ€” direct experience with mortgage operations, loan origination, or servicing (HECM/reverse, forward, or related)ย 

Preferred Qualifications:ย 

  • Experience with conversational AI platforms (Bland AI,ย ElevenLabs, Twilio, Five9, or similar) and contact center architectureย 
  • Startup or early-stage product experience โ€” comfortย operatingย in ambiguity, building from scratch, and moving fast without heavy processย 
  • Familiarity with Databricks and the Lakehouse/Medallion data architecture patternย 
  • Familiarity with NIST AI RMF and U.S. state AI law landscape (Colorado, Texas, California, Utah)ย 

The salary range for this position is $125,000-$145,000 annually.

Mutual of Omaha Mortgage is an Equal Opportunity Employer, and we encourage diverse, talented, qualified applicants to apply.ย We offer an extensive compensation package. Benefits include:ย ย ย 

  • Vacation โ€” Vacation hours accrue on a per pay period basis. Balance maximums are based on years of service.ย ย ย 
  • Paid Sick Time โ€” 40 hours of paid sick time after 90 days of employment. State sick time requirements will be added as needed.ย ย ย 
  • 9ย Paid Holidays + 1 Cultural Celebration Day (Floating Holiday)ย ย ย 
  • Multiple PPO Medical Plans, as well as HDHP eligible plan.ย ย ย 
  • Dental Coverageย ย ย 
  • Vision Coverageย ย ย 
  • Company Paid Life Insuranceย ย ย 
  • 401K with a generous employer matchย ย ย 
  • Additional Benefits including โ€“ Optional Life, FSA, Pet Insurance etc.ย ย ย 
  • Free Legal Servicesย ย ย 
  • Employee Loan Programย ย ย 

Powered by JazzHR

dqqXY1UkF8