ZipRecruiter

Log In

1

Ai Rater Jobs in Riverside, CA (NOW HIRING)

Acra Lending

AI Engineer

Irvine, CA · On-site

Responsibilities : • Design, develop, and deploy AI agents and multi-agent systems to automate ... Acra Lending specializes in lending services and adjustable-rate mortgages as well as alternative ...

Cotality

AI Integration Architect

Irvine, CA

$76 - $98/hr

Establish CI/CD pipelines and evaluation frameworks for AI agents that measure accuracy, hallucination rates, and performance regressions before changes reach production. * Optimize AI workload ...

New

Qcells

Applied AI Engineer

Irvine, CA · On-site

$160K - $190K/yr

Experience deploying AI agents to production, including implementation of safety guardrails, output validation, rate limiting, and escalation controls to ensure reliable and responsible operation at ...

Qcells

Applied AI Engineer

Irvine, CA

$160K - $190K/yr

Experience deploying AI agents to production, including implementation of safety guardrails, output validation, rate limiting, and escalation controls to ensure reliable and responsible operation at ...

Hyundai Capital

AI Product Manager

Irvine, CA · Hybrid

Ensure product quality through measurable KPIs such as task success, grounded response rates, and ... Apply Responsible AI practices (fairness, explainability, auditability) throughout product ...

DataAnnotation

Treasury Analyst - AI Trainer

Riverside, CA · Remote

$50 - $60/hr

Projects are paid hourly starting at $50-$100+/hr, with bonus rates available on some projects Responsibilities: * Give AI chatbots diverse and complex problems and evaluate their outputs * Evaluate ...

DataAnnotation

Treasury Analyst - AI Trainer

Irvine, CA · Remote

$50 - $60/hr

Projects are paid hourly starting at $50-$100+/hr, with bonus rates available on some projects Responsibilities: * Give AI chatbots diverse and complex problems and evaluate their outputs * Evaluate ...

DataAnnotation

Treasury Analyst - AI Trainer

Fontana, CA · Remote

$50 - $60/hr

Projects are paid hourly starting at $50-$100+/hr, with bonus rates available on some projects Responsibilities: * Give AI chatbots diverse and complex problems and evaluate their outputs * Evaluate ...

DataAnnotation

Financial Planner - AI Trainer

Hesperia, CA · Remote

$50 - $60/hr

Projects are paid hourly starting at $50-$100+/hr, with bonus rates available on some projects Responsibilities: * Give AI chatbots diverse and complex problems and evaluate their outputs * Evaluate ...

DataAnnotation

Treasury Analyst - AI Trainer

Santa Ana, CA · Remote

$50 - $60/hr

Projects are paid hourly starting at $50-$100+/hr, with bonus rates available on some projects Responsibilities: * Give AI chatbots diverse and complex problems and evaluate their outputs * Evaluate ...

DataAnnotation

Financial Planner - AI Trainer

Ontario, CA · Remote

$50 - $60/hr

Projects are paid hourly starting at $50-$100+/hr, with bonus rates available on some projects Responsibilities: * Give AI chatbots diverse and complex problems and evaluate their outputs * Evaluate ...

DataAnnotation

Financial Planner - AI Trainer

Menifee, CA · Remote

$50 - $60/hr

Projects are paid hourly starting at $50-$100+/hr, with bonus rates available on some projects Responsibilities: * Give AI chatbots diverse and complex problems and evaluate their outputs * Evaluate ...

next page

Showing results 1-20

All JobsAi Rater JobsAi Rater Jobs in Riverside, CA

Ai Rater information

What is an AI Rater job?

An AI Rater evaluates and provides feedback on artificial intelligence models, typically improving search engines, chatbots, or recommendation systems. They assess the relevance, accuracy, and quality of AI-generated content based on specific guidelines. This role requires strong analytical skills, attention to detail, and familiarity with the subject matter being reviewed. AI Raters often work remotely and on a flexible schedule.

What are the key skills and qualifications needed to thrive in the Ai Rater position, and why are they important?

To thrive as an AI Rater, you generally need strong attention to detail, analytical thinking, and proficiency in English, often supported by formal education such as a high school diploma or higher. Familiarity with web browsers, online research, and company-specific rating platforms or guidelines is essential. Excellent time management, adaptability, and effective written communication help individuals excel in this position. These skills and qualities ensure accurate and consistent evaluations of AI-generated content, directly impacting the improvement of artificial intelligence systems.

What does a typical day look like for an AI Rater?

A typical day for an AI Rater involves reviewing and evaluating various types of content, such as search engine results, social media posts, advertisements, or chatbot responses, to ensure they meet quality and relevancy standards. You may follow detailed guidelines to rate or annotate content, complete assigned tasks in a web-based platform, and provide feedback to help improve AI performance. Most positions are remote and offer flexible schedules, allowing you to plan your workload around personal commitments. Collaboration is generally limited, as most work is performed independently, but periodic communication with team leads for training or updates is common.

What are popular job titles related to Ai Rater jobs in Riverside, CA? For Ai Rater jobs in Riverside, CA, the most frequently searched job titles are:
What job categories do people searching Ai Rater jobs in Riverside, CA look for? The top searched job categories for Ai Rater jobs in Riverside, CA are:
What cities near Riverside, CA are hiring for Ai Rater jobs? Cities near Riverside, CA with the most Ai Rater job openings:
Ai Rater jobs near you
Infographic showing various Ai Rater job openings in Riverside, CA as of June 2026, with employment types broken down into 9% Internship, 41% Full Time, and 50% Part Time. Highlights an 62% In-person, and 38% Remote job distribution.
AI Engineer

AI Engineer

Acra Lending

Irvine, CA • On-site

Full-time

Posted 11 days ago

Job description

Job Summary:
Acra Lending is a company that specializes in alternative income loan products, and they are seeking an experienced AI Engineer focused on Agentic AI and Workflow Automation. This role will be responsible for architecting, building, and deploying intelligent systems to enhance operational efficiency and improve the borrower and broker experience.
Responsibilities:
• Design, develop, and deploy AI agents and multi-agent systems to automate mortgage workflows across the loan lifecycle.
• Build intelligent orchestration frameworks capable of autonomous decision support, task execution, and workflow routing.
• Develop AI copilots and internal assistants for underwriting, loan processing, sales, operations, secondary markets, compliance, capital markets, and executive leadership.
• Create AI-powered exception handling and escalation frameworks for complex loan scenarios.
• Identify, redesign, and automate high-friction operational workflows across the mortgage platform.
• Develop automation solutions for loan intake, document classification, income and asset analysis, credit review, conditions management, broker communication, borrower engagement, QC and compliance reviews, and post-close processes.
• Implement Retrieval-Augmented Generation (RAG) systems using lending guidelines, overlays, investor matrices, and SOPs.
• Build prompt orchestration, memory systems, and agent reasoning frameworks.
• Evaluate and deploy emerging AI technologies for document intelligence, NLP, computer vision, and decision support.
• Integrate AI systems with LOS platforms, CRM systems, pricing engines, OCR/document recognition tools and data platforms.
• Develop APIs and middleware to enable seamless AI workflow orchestration.
• Ensure AI implementations align with mortgage regulatory requirements and governance standards.
• Design controls around explainability, auditability, model monitoring, and human-in-the-loop approvals.
• Help define and execute the enterprise AI strategy.
• Prioritize high-ROI automation opportunities that improve revenue, pull-through, turn times, cost-to-originate, scalability, and EBITDA.
Qualifications:
Required:
• 5+ years of software engineering, AI engineering, or machine learning experience.
• 2+ years building LLM-based applications or agentic AI systems.
• Experience with orchestration frameworks such as LangChain, LangGraph, CrewAI, AutoGen, Semantic Kernel, or MCP-based architectures.
• Strong Python development skills and experience with APIs, vector databases, prompt engineering, RAG architectures, and workflow automation.
Preferred:
• Experience in mortgage lending, fintech, banking, or financial services.
• Familiarity with Non-QM underwriting guidelines including DSCR, Bank Statement, Asset Qualifier, ITIN, Foreign National, and Jumbo products.
• Experience with mortgage LOS platforms and deploying AI in regulated environments.
• Languages: Python, SQL, JavaScript/TypeScript
• AI/LLM: OpenAI, Anthropic, open-source LLMs, Hugging Face
• Automation: n8n, UiPath, Zapier, Make, Apache Airflow
• Cloud & DevOps: AWS, Azure, GCP, Docker, Kubernetes, CI/CD
Company:
Acra Lending specializes in lending services and adjustable-rate mortgages as well as alternative income products. Founded in 2003, the company is headquartered in Lake Forest, USA, with a team of 201-500 employees. The company is currently Growth Stage.

Apply