1

Ai Evaluator Jobs in Riverside, CA (NOW HIRING)

Lead AI Engineer

Irvine, CA ยท On-site

$121 - $185/hr

Contribute to development of an AI lab for experimentation, prototyping, evaluation, and rapid iterationDefine and implement AI-DLC practices including experimentation, evaluation, governance ...

Participate in governance reviews, architecture reviews, and technology evaluations for AI-related initiatives. Partner with Cybersecurity, Legal, Compliance, and Risk Management teams to ensure ...

Participate in governance reviews, architecture reviews, and technology evaluations for AI-related initiatives. Partner with Cybersecurity, Legal, Compliance, and Risk Management teams to ensure ...

Participate in governance reviews, architecture reviews, and technology evaluations for AI-related initiatives. Partner with Cybersecurity, Legal, Compliance, and Risk Management teams to ensure ...

Enterprise AI Lead

Irvine, CA ยท On-site

$94 - $135/hr

Participate in governance reviews, architecture reviews, and technology evaluations for AI-related initiatives. Partner with Cybersecurity, Legal, Compliance, and Risk Management teams to ensure ...

Participate in governance reviews, architecture reviews, and technology evaluations for AI-related initiatives. Partner with Cybersecurity, Legal, Compliance, and Risk Management teams to ensure ...

AI Engineer

Irvine, CA ยท On-site

$50K - $112K/yr

... evaluation frameworks, including LLM-as-judge pipelines, regression testing, and adversarial ... for AI projects - Utilizing machine learning libraries like Scikit-Learn for data analysis ...

This role builds the AI systems that extend that platform so the documentation pipeline handles ... Design evaluation frameworks and regression testing for prompts, models, tools, retrieval pipelines ...

Sr AI/Agentic Engineer

Tustin, CA ยท On-site

$111 - $185/hr

The evaluation and observability layer that turns AI reliability from a hope into a measured, managed property of the system.LLM Systems OwnershipOwn end-to-end LLM features -- from requirements ...

New

AI Systems Engineer

Santa Ana, CA ยท On-site

$191K - $253K/yr

You will build and maintain AI-assisted authoring, automated publishing, and multi-agent ... Design evaluation frameworks and regression testing for prompts, models, tools, retrieval pipelines ...

AI Technical Lead

Irvine, CA ยท On-site

$180 - $280/hr

The solution will leverage advanced Agentic AI capabilities to significantly reduce the time ... Implement strict evaluation and observability frameworks to monitor production latency, API costs ...

AI Agent Performance Lead

Irvine, CA ยท On-site

$154 - $193/hr

This role serves as the platform owner and architect for conversational AI, defining, testing, evaluating, and optimizing agent behaviors to drive measurable sales outcomes. Across the customer org ...

New

AI Product Manager

Irvine, CA ยท On-site

$140 - $190/hr

Familiarity with AI/ML lifecycle (model evaluation, deployment, and monitoring). Experience working in regulated environments (financial services, healthcare, etc.). Exposure to cloud AI ecosystems ...

New

The job is to make Melissa easier for AI answer engines and technical evaluators to resolve, understand, trust, and recommend by improving technical evidence, third-party authority, machine-readable ...

AI Product Manager

Irvine, CA ยท On-site

$140 - $190/hr

Familiarity with AI/ML lifecycle (model evaluation, deployment, and monitoring). Experience working in regulated environments (financial services, healthcare, etc.). Exposure to cloud AI ecosystems ...

Apply guardrails, evaluation metrics, and release criteria for AI products * Ensure product quality through measurable KPIs such as task success, grounded response rates, and adoption metrics

AI Product Manager

Irvine, CA ยท On-site

$100K - $155K/yr

Apply guardrails, evaluation metrics, and release criteria for AI products * Ensure product quality through measurable KPIs such as task success, grounded response rates, and adoption metrics

next page

Showing results 1-20

Ai Evaluator information

See Riverside, CA salary details

$30.8K

$68.3K

$111.1K

How much do ai evaluator jobs pay per year?

As of Sep 4, 2026, the average yearly pay for ai evaluator in Riverside, CA is $68,304.00, according to ZipRecruiter salary data. Most workers in this role earn between $46,400.00 and $82,900.00 per year, depending on experience, location, and employer.

What is an AI evaluator?

An AI Evaluator assesses the performance, accuracy, and relevance of artificial intelligence models, often focusing on language models, search engines, or recommendation systems. They review AI-generated responses, ensuring they align with human expectations and industry standards. Evaluators may follow specific guidelines to rate or provide feedback on outputs, helping improve AI functionality. This role typically requires analytical skills, attention to detail, and proficiency in the target language. Many AI Evaluators work remotely on a contract or freelance basis.

What are the key skills and qualifications needed to thrive as an AI evaluator?

To thrive as an AI Evaluator, you need a solid understanding of machine learning concepts, data analysis, and critical thinking, often supported by a degree in computer science, data science, or a related field. Familiarity with annotation tools, model assessment platforms, and sometimes programming languages like Python is highly advantageous. Attention to detail, strong communication skills, and the ability to provide constructive feedback are essential soft skills. These competencies are crucial for accurately assessing AI model outputs and collaborating with development teams to improve system performance.

What are some typical challenges an AI evaluator faces in their daily work?

AI Evaluators often encounter complex data or ambiguous responses that require nuanced judgment to assess accurately. Adapting to rapidly evolving guidelines and learning new toolsets as AI projects progress is also common. Routine tasks may include evaluating AI-generated outputs for relevance and bias, documenting errors, and discussing findings with engineers or linguists. While the work is intellectually stimulating, it demands precision and flexibility to ensure models meet high-quality standards.

How do you become an AI evaluator?

To become an AI evaluator, candidates typically need a background in computer science, data analysis, or related fields, along with strong analytical skills. Experience with machine learning tools, programming languages like Python, and understanding of AI models are often required, and some roles may require familiarity with data annotation or labeling platforms. Certifications in AI or data science can enhance prospects, and the work usually involves evaluating AI outputs for accuracy and bias.

How much do AI evaluators make?

AI evaluators typically earn between $15 and $30 per hour, depending on experience, location, and the complexity of tasks. Some roles may offer freelance or part-time opportunities with flexible schedules, and higher pay is often associated with specialized skills or certifications in AI and data annotation.

What are the most commonly searched types of Ai Evaluator jobs in Riverside, CA?

The most popular types of Ai Evaluator jobs in Riverside, CA are:

What are popular job titles related to Ai Evaluator jobs in Riverside, CA?

For Ai Evaluator jobs in Riverside, CA, the most frequently searched job titles are:

What job categories do people searching Ai Evaluator jobs in Riverside, CA look for?

The top searched job categories for Ai Evaluator jobs in Riverside, CA are:

What cities near Riverside, CA are hiring for Ai Evaluator jobs?

Cities near Riverside, CA with the most Ai Evaluator job openings:

Infographic showing various Ai Evaluator job openings in Riverside, CA as of August 2026, with employment types broken down into 76% Full Time, 21% Part Time, and 3% Contract. Highlights an 71% Physical, 3% Hybrid, and 26% Remote job distribution, with an average salary of $68,304 per year, or $32.8 per hour.

Principal Research Scientist - Frontier Industrial AI

Aveva

Lake Forest, CA โ€ข Hybrid

$213K - $355K/yr

Full-time

Medical, Dental, Vision, Retirement, PTO

Posted 29 days ago


Key responsibilities

  • Define and lead ambitious research initiatives in frontier industrial AI.

  • Develop new models, algorithms, evaluation methods, and system architectures.

  • Build high-quality experimental systems and validated research prototypes.


Job description

AVEVA is creating software trusted by over 90% of leading industrial companies.

Salary Range:

$213,500.00 - $355,500.00

This pay range represents the minimum and maximum compensation that the position offers, and final compensation can vary within the range depending on work location, job experience, skills, and relevant educational attainment and/or training.

Position: Principal Research Scientist - Frontier Industrial AI

Location: San Leandro, CA, Boston, MA, New York, NY (hybrid)
Role Type: Individual contributor

The role

AVEVA's frontier AI research team, as part of the Chief Technologist Organization, focuses on developing the next generation of industrial intelligence. We are looking for exceptional researchers who combine original thinking with the ability to turn ambitious ideas into working systems.

You will define and pursue high-impact research questions, build experimental prototypes, publish influential work, and create defensible intellectual property. Research may span industrial foundation models for time-series and multimodal data, simulation and world models, trustworthy decision-support agents and staged autonomy, and AI-native approaches to industrial data foundations, ontology learning, and evaluation.

This is a hands-on role for someone who thrives in uncertain problem spaces, works with high autonomy, and finds practical ways to move difficult initiatives forward.

What you will do

  • Define and lead ambitious research initiatives in frontier industrial AI.

  • Develop new models, algorithms, evaluation methods, and system architectures.

  • Build high-quality experimental systems and validated research prototypes.

  • Publish at leading AI and machine learning venues and contribute to AVEVA's patent and IP portfolio.

  • Create benchmarks, datasets, and evaluation frameworks for industrial AI.

  • Partner with leading AI labs, universities, and technology organizations

  • Take research from initial hypothesis through prototype and validation

  • Help shape AVEVA's longer-term AI research direction and technical strategy.

What we are looking for

  • A PhD or equivalent research experience in machine learning, artificial intelligence, computer science, applied mathematics, engineering, or a related field.

  • Evidence of original research through strong publications, patents, open-source work, prototypes, or other meaningful technical contributions.

  • Strong hands-on ability in AI experimentation and software development.

  • Ability to independently identify important problems, formulate research hypotheses, and execute projects with limited structure.

  • Deep expertise in one or more areas such as foundation models, multimodal learning, time-series modeling, generative models, reinforcement learning, agentic systems, simulation, world models, representation learning, or AI evaluation.

  • Strong scientific judgment and the ability to design rigorous experiments and communicate results clearly.

  • High agency, intellectual curiosity, and a constructive problem-solving mindset.

  • Ability to collaborate across research, engineering, product, and teams.

Preferred qualifications

  • Experience working with industrial, manufacturing, energy, infrastructure, engineering, or scientific data.

  • Recent publications at leading machine learning, AI, data mining, robotics, or systems venues.

  • Experience developing models at scale or building complex research systems.

  • Experience with simulation environments, digital twins, multimodal data, or industrial time series.

  • A track record of initiating and advancing research projects with limited supervision.

  • Exceptional recent PhD graduates with a strong research record are encouraged to apply.


USA Benefits include:

Flex work hours, 20 days PTO rising to 25 with service, three paid volunteering days, primary and secondary parental leave, well-being support, medical, dental, vision, and 401K.


It's possible we're hiring for this position in multiple countries, in which case the above benefits apply to the primary location. Specific benefits vary by country, but our packages are similarly comprehensive.


Find out more: aveva.com/en/about/careers/benefits/


Hybrid working

We work in a hybrid way at AVEVA. Most roles are based at a local AVEVA office, with an expectation of being on-site 50% of your working hours to support collaboration and connection. Some positions are fully office-based depending on the nature of the work, and certain roles that support specific customers or markets may be remote. The working arrangement for this position will be confirmed during the hiring process.


Hiring process

Interested? Great! Get started by submitting your cover letter and CV through our application portal. AVEVA is committed to recruiting and retaining people with disabilities. Please let us know in advance if you need reasonable support during your application process.


Find out more: aveva.com/en/about/careers/hiring-process


About AVEVA

AVEVA is a global leader in industrial software with more than 6,500 employees in over 40 countries. Our cutting-edge solutions are used by thousands of enterprises to deliver the essentials of life - such as energy, infrastructure, chemicals, and minerals - safely, efficiently, and more sustainably.


We are committed to embedding sustainability and inclusion into our operations, our culture, and our core business strategy. Learn more about how we are progressing against our ambitious 2030 targets: sustainability-report.aveva.com/


Find out more: aveva.com/en/about/careers/


AVEVA requires all successful applicants to undergo and pass a drug screening and comprehensive background check before they start employment. Background checks will be conducted in accordance with local laws and may, subject to those laws, include proof of educational attainment, employment history verification, proof of work authorization, criminal records, identity verification, credit check. Certain positions dealing with sensitive and/or third-party personal data may involve additional background check criteria.


AVEVA is an Equal Opportunity Employer. We are committed to being an exemplary employer with an inclusive culture, developing a workplace environment where all our employees are treated with dignity and respect. We value diversity and the expertise that people from different backgrounds bring to our business. AVEVA provides reasonable accommodation to applicants with disabilities where appropriate. If you need reasonable accommodation for any part of the application and hiring process, please notify your recruiter. Determinations on requests for reasonable accommodation will be made on a case-by-case basis.