1

Virtual Ai Rater Jobs in Orem, UT (NOW HIRING)

Our AI-powered Tutor Copilot enhances your sessions with real-time instructional support, lesson ... and virtual presentation tools. Ability to explain the principles of visual communication ...

... and virtual card, can consume through well-defined APIs and tooling. * Partner with Data and AI ... Deep fluency in rewards and card economics, including interchange, take rate, rewards cost as a ...

Our AI-powered Tutor Copilot enhances your sessions with real-time instructional support, lesson ... Adapts instruction using virtual and hands-on labs, visual models, and cross-disciplinary ...

... and virtual card, can consume through well-defined APIs and tooling. * Partner with Data and AI ... Deep fluency in rewards and card economics, including interchange, take rate, rewards cost as a ...

... schedule, earn competitive rates, and make a real impact on students' academic success and ... Our AI-powered Tutor Copilot enhances your sessions with real-time instructional support, lesson ...

CompTIA A+ Tutor

Provo, UT · Remote

$25 - $40/hr

Our AI-powered Tutor Copilot enhances your sessions with real-time instructional support, lesson ... Adapts instruction using virtual lab environments, hardware identification practice, and practice ...

CompTIA A+ Tutor

Spanish Fork, UT · Remote

$25 - $40/hr

Our AI-powered Tutor Copilot enhances your sessions with real-time instructional support, lesson ... Adapts instruction using virtual lab environments, hardware identification practice, and practice ...

... schedule, earn competitive rates, and make a real impact on students' academic success and ... Our AI-powered Tutor Copilot enhances your sessions with real-time instructional support, lesson ...

AP Chemistry Tutor

Provo, UT · Remote

$18 - $40/hr

... schedule, earn competitive rates, and make a real impact on students' academic success and ... Our AI-powered Tutor Copilot enhances your sessions with real-time instructional support, lesson ...

C++ Tutor

Spanish Fork, UT · Remote

$18 - $40/hr

... schedule, earn competitive rates, and make a real impact on students' academic success and ... Our AI-powered Tutor Copilot enhances your sessions with real-time instructional support, lesson ...

Our AI-powered Tutor Copilot enhances your sessions with real-time instructional support, lesson ... Adapts instruction using virtual lab environments, capture-the-flag exercises, and real-world case ...

Cyber Security Tutor

Provo, UT · Remote

$18 - $40/hr

Our AI-powered Tutor Copilot enhances your sessions with real-time instructional support, lesson ... Adapts instruction using virtual lab environments, capture-the-flag exercises, and real-world case ...

College Biology Tutor

Provo, UT · Remote

$18 - $40/hr

... schedule, earn competitive rates, and make a real impact on students' academic success and ... Our AI-powered Tutor Copilot enhances your sessions with real-time instructional support, lesson ...

C++ Tutor

Provo, UT · Remote

$18 - $40/hr

... schedule, earn competitive rates, and make a real impact on students' academic success and ... Our AI-powered Tutor Copilot enhances your sessions with real-time instructional support, lesson ...

Cameras must be on for all virtual interviews. AI tools are strictly prohibited during interviews ... Benefits * Rate of Pay: $17.75 / Hour * 30-50% Employee Discount * Paid Time Off, Paid Parental ...

next page

Showing results 1-20

Virtual Ai Rater information

See Orem, UT salary details

$10

$21

$29

How much do virtual ai rater jobs pay per hour?

As of Sep 6, 2026, the average hourly pay for virtual ai rater in Orem, UT is $21.21, according to ZipRecruiter salary data. Most workers in this role earn between $17.74 and $23.85 per hour, depending on experience, location, and employer.

What is a Virtual AI Rater?

Virtual AI Raters are individuals who remotely evaluate and assess the accuracy, relevance, and quality of artificial intelligence outputs, such as search engine results, ads, or chatbot responses. They follow specific guidelines to rate or annotate data, helping improve AI systems' performance. This role typically requires strong attention to detail, familiarity with online search engines, and the ability to provide objective feedback. Virtual AI Raters usually work part-time and have flexible schedules, making it a popular option for those seeking remote work opportunities.

What are the key skills and qualifications needed to thrive as a Virtual AI Rater, and why are they important?

To thrive as a Virtual AI Rater, you generally need strong analytical skills, attention to detail, and proficiency in English or the target language, often supported by a high school diploma or higher. Familiarity with web browsers, online research, and rating platforms or proprietary evaluation systems is typically required. Excellent time management, reliability, and the ability to follow detailed instructions set top performers apart in this role. These skills ensure accurate and consistent feedback, which is crucial for improving AI systems and maintaining quality standards.

What are some common challenges Virtual AI Raters face when evaluating AI-generated content, and how can these be addressed?

Virtual AI Raters often encounter challenges such as maintaining objectivity, adapting to evolving evaluation criteria, and managing repetitive tasks. To address these, it's important to follow standardized guidelines closely, participate in regular calibration sessions with peers or supervisors, and utilize provided tools for efficient task management. Engaging in ongoing training and staying updated on best practices can also help raters ensure consistent and high-quality evaluations.

What are the most commonly searched types of Ai Rater jobs in Orem, UT?

The most popular types of Ai Rater jobs in Orem, UT are:

What are popular job titles related to Virtual Ai Rater jobs in Orem, UT?

For Virtual Ai Rater jobs in Orem, UT, the most frequently searched job titles are:

What cities near Orem, UT are hiring for Virtual Ai Rater jobs?

Cities near Orem, UT with the most Virtual Ai Rater job openings:

Senior Director, Software Engineering (Lehi)

Collective Health

Lehi, UT • On-site

$237K/yr

Full-time

Medical, Retirement, PTO

Posted 9 days ago


Key responsibilities

  • Own the engineering strategy and execution for member digital experience, advocate tooling, and contact center experience.

  • Lead the AI roadmap for contact center automation, including Agent Assist, virtual assistants, IVR automation, and contact deflection features.

  • Deliver and maintain the member-facing digital experience on web and mobile, ensuring compliance with security and privacy requirements.


Collective Health rating

7.5

Company rating: 7.5 out of 10

Based on 6 frontline employees who took The Breakroom Quiz

206th of 500 rated business services


Job description

At Collective Health, we’re transforming how employers and their people engage with their health benefits by seamlessly integrating cutting‑edge technology, compassionate service, and world‑class user experience design.

Role Overview

Collective Health is transforming healthcare for millions who use our platform to understand, navigate, and pay for care. The Member Experience Engineering team builds every interface a member or Member Advocate interacts with: our web and mobile apps, plus the tools and AI powering our contact center.

We are hiring a Senior Director of Member Experience Engineering to lead this organization. You will own the engineering strategy and execution across three connected domains:

  • Member digital experience — the member web portal and mobile apps, including care navigation, secure messaging, benefits and claims views, and the notification systems that keep members informed.
  • Member Advocate tooling — the internal application suite our advocates use to serve members, plus the platforms that make advocates faster and more accurate.
  • Contact center experience (our biggest opportunity) — the AI, automation, and platform work that reduces call volume, deflects and resolves inquiries earlier, and makes every advocate interaction better. This includes our Contact-Center-as-a-Service (CCaaS) platform, Agent Assist, virtual assistants, IVR automation, and conversational analytics.

The main focus of the role is using AI to lower the cost and raise the quality of member support — deflecting avoidable contacts, resolving inquiries in self‑service, and giving advocates real‑time, accurate answers when a human is the right channel.

What you’ll do
  • Set the strategy for member experience engineering across web, mobile, advocate tooling, and the contact center — and translate it into a roadmap tied to measurable business outcomes (cost-to-serve, contact reduction, member and advocate satisfaction).
  • Lead the AI agenda for the contact center. Drive the roadmap for Agent Assist, Smart Search, virtual assistants, IVR automation, and contact‑deflection features. Push for real, defensible reductions in call demand and average handle time — not demos.
  • Own the call‑center technology platform, including our CCaaS migration and the integrations that connect telephony, chat, and digital channels into one member journey.
  • Own conversational and contact analytics — topic tagging, quality monitoring at scale, and the reporting that tells us what members are calling about and which contacts we can prevent. Ensure this data actually steers the roadmap.
  • Deliver the member‑facing digital experience on web and mobile, meeting client and regulatory commitments (access controls, dependent access, SSO, privacy) on committed timelines.
  • Own the advocate tooling suite — the internal applications that determine how efficiently and accurately advocates serve members.
  • Partner deeply with our Customer Experience, Product and Design teams to build quality products for our members and member advocates
  • Build and grow the team — hire, mentor, and develop engineering managers and senior engineers; set the bar for technical quality, security, and reliability in a HIPAA‑regulated, PHI‑handling environment.
  • Report up and out. Communicate strategy, trade‑offs, and results to executive leadership and represent engineering in cross‑functional and client‑facing forums.
To be successful in this role, you’ll need:
  • 15+ years in software engineering with 5+ years leading engineering teams, including managing managers.
  • Proven ownership of large‑scale, member‑or customer‑facing web and mobile products.
  • Contact center / customer support technology experience — hands‑on familiarity with CCaaS platforms, telephony/IVR, agent‑assist tooling, and support‑operations metrics (contact volume, deflection rate, average handle time, first‑contact resolution, cost‑to‑serve, quality/CSAT).
  • Applied AI/ML fluency, especially using LLMs / GenAI to reduce support demand: knowledge of Retrieval‑Augmentented Generation (RAG), intent detection, conversational analytics, and automated quality monitoring. You know how to evaluate accuracy, manage hallucination risk, and measure whether an AI investment actually moved the metric.
  • Strong track record turning operational metrics into an engineering roadmap and defending trade‑offs to executives.
  • Excellent cross‑functional leadership across product, operations, design, data/insights, and external vendors.
  • Comfort operating in a regulated, data‑sensitive domain (healthcare/HIPAA a strong plus) where security and privacy are non‑negotiable.
Nice to have:
  • Healthcare, health‑benefits, insurance, or other regulated‑industry experience.
  • Experience running a vendor selection and migration for a major contact‑center or AI platform.
  • Background scaling both customer‑facing product engineering and internal operational tooling in the same org.
Pay Transparency Statement

This is a hybrid position based out of one of our offices: San Francisco, CA, Plano, TX, or Lehi, UT. Hybrid employees are expected to be in the office two days per week.

The actual pay rate offered within the range will depend on factors including geographic location, qualifications, experience, and internal equity. In addition to the salary, you will be eligible for 1,000,000 stock options and benefits like health insurance, 401k, and paid time off.

Learn more about our benefits at https://jobs.collectivehealth.com/benefits/.

San Francisco, CA Pay Range: $268,000 USD - $335,000 USD

Lehi, UT Pay Range: $214,400 USD - $268,000 USD

Plano, TX Pay Range: $235,840 USD - $294,800 USD

Why Join Us?
  • Mission‑driven culture that values innovation, collaboration, and a commitment to excellence in healthcare
  • Impactful projects that shape the future of our organization
  • Opportunities for professional development through internal mobility opportunities, mentorship programs, and courses tailored to your interests
  • Flexible work arrangements and a supportive work‑life balance

We are an equal opportunity employer and value diversity at our company. We do not discriminate on the basis of race, religion, color, national origin, gender, sexual orientation, age, marital status, veteran status, or disability status. Collective Health is committed to providing support to candidates who require reasonable accommodation during the interview process. If you need assistance, please contact recruiting‑accommodations@collectivehealth.com.

Privacy Notice

For more information about why we need your data and how we use it, please see our privacy policy: https://collectivehealth.com/privacy-policy/.

#J-18808-Ljbffr

What Collective Health employees say

Pay

Hours and flexibility

Workplace

Get the full story on Breakroom