1

Ai Rater Jobs in Metuchen, NJ (NOW HIRING)

Collaborate with CX leaders to drive performance metrics: resolution rate, CSAT, quality ... Own the CX AI roadmap from opportunity discovery through implementation - prioritize where AI can ...

AI Agent Engineer

New York, NY · On-site

$200K - $300K/yr

With a team of five, it scaled to a $2M annualized run rate in just a few months, targeting $10M ARR this year. About the Role Building its voice AI agent infrastructure in-house and needs an AI ...

Track and improve key trial metrics, including batch completion rate, trial success rate ... Use AI tools, automation, and structured workflows to reduce manual effort, improve consistency ...

Brex's AI-native automation and world-class service eliminate manual expense and accounting tasks ... Collaborate with CX leaders to drive performance metrics: resolution rate, CSAT, quality ...

Senior Applied AI Software Engineer ( AI)

New York, NY · On-site +1

$134K - $176K/yr

Experience with AI system evaluation, observability, reliability, fallback strategies, safety guardrails, latency optimization, and rate-limit management within enterprise production environments.

Senior Applied AI Software Engineer ( AI)

New York, NY · On-site +1

$134K - $176K/yr

Experience with AI system evaluation, observability, reliability, fallback strategies, safety guardrails, latency optimization, and rate-limit management within enterprise production environments.

AI Engineer

New York, NY · On-site

$190K - $200K/yr

Today our commercial teams run rate strategy, RFP negotiations, and account planning on spreadsheets and intuition. We're hiring an AI Engineer to turn that work into software - models and tools that ...

Its AI agents handle the full late-stage recovery process -- asset research, pre-legal outreach ... Fast traction: ~$2M annualized run rate in a few months with a team of five, targeting $10M ARR ...

Monitor coding KPIs such as coder productivity, accuracy rates, unbilled accounts, and claim denial ... Annotate AI-generated coding outputs and provide structured feedback to support AI training ...

AI Strategy Lead

New York, NY · On-site

$147K - $245K/yr

Role Summary The AI Strategy Lead is a hands-on leadership role responsible for defining and ... Target AIP rates will be commensurate with role level and posted career stage. Individual salary ...

AI Strategy Lead

New York, NY · On-site

$147K - $245K/yr

Role Summary The AI Strategy Lead is a hands-on leadership role responsible for defining and ... Target AIP rates will be commensurate with role level and posted career stage. Individual salary ...

Showing results 21-40

Ai Rater information

What is an AI Rater?

An AI Rater evaluates and provides feedback on artificial intelligence models, typically improving search engines, chatbots, or recommendation systems. They assess the relevance, accuracy, and quality of AI-generated content based on specific guidelines. This role requires strong analytical skills, attention to detail, and familiarity with the subject matter being reviewed. AI Raters often work remotely and on a flexible schedule.

What does an AI Rater do?

A typical day for an AI Rater involves reviewing and evaluating various types of content, such as search engine results, social media posts, advertisements, or chatbot responses, to ensure they meet quality and relevancy standards. You may follow detailed guidelines to rate or annotate content, complete assigned tasks in a web-based platform, and provide feedback to help improve AI performance. Most positions are remote and offer flexible schedules, allowing you to plan your workload around personal commitments. Collaboration is generally limited, as most work is performed independently, but periodic communication with team leads for training or updates is common.

What skills and qualifications are needed to thrive as an AI Rater?

To thrive as an AI Rater, you generally need strong attention to detail, analytical thinking, and proficiency in English, often supported by formal education such as a high school diploma or higher. Familiarity with web browsers, online research, and company-specific rating platforms or guidelines is essential. Excellent time management, adaptability, and effective written communication help individuals excel in this position. These skills and qualities ensure accurate and consistent evaluations of AI-generated content, directly impacting the improvement of artificial intelligence systems.

How to become an AI Rater?

To become an AI Rater, candidates typically need a high school diploma or equivalent, strong language and analytical skills, and the ability to follow detailed guidelines. The role often involves evaluating search engine results or content for accuracy and relevance, using online platforms or specific assessment tools. Prior experience in data annotation or quality assurance can be beneficial, and flexible scheduling is common.

What cities near Metuchen, NJ are hiring for Ai Rater jobs?

Cities near Metuchen, NJ with the most Ai Rater job openings:

Infographic showing various Ai Rater job openings in Metuchen, NJ as of August 2026, with employment types broken down into 44% Full Time, and 56% Part Time. Highlights an 100% Remote job distribution.

Manager, CX AI Strategy

Brex

New York, NY • Hybrid

Full-time

Re-posted 23 days ago


Job description

Customer Experience at Brex

The Customer Experience team is the connective tissue between Brex's product and the companies that depend on it every day. We don't just resolve issues - we surface insights, close feedback loops, and help shape the product roadmap. As Brex becomes an AI-native company, our CX organization leads that shift: building the systems, metrics, and workflows that let AI handle routine complexity while humans focus on judgment and relationships. We measure success not by tickets closed, but by customers who don't need to contact us in the first place.

What you'll do

Brex is looking for an experienced AI operator & leader to own the strategy and execution of AI-powered customer experience. You'll lead the team responsible for Brex's AI customer service platform - optimizing instruction sets, driving quality, and expanding AI across chat, voice, and email. You'll also own the internal side of the equation: building and deploying AI-powered tools that give Brex's CX team a measurable productivity edge - from agent-assist and real-time guidance to QA automation and workflow tooling. You'll own the metrics that matter on both sides, define what "great" looks like for AI performance, and partner with Product and Engineering to shape the roadmap. This is not a research or strategy-deck role. You'll build, ship, and iterate on systems that make Brex's CX the best support on the planet - and lead the team that makes it happen.

Where you'll work

This role will be based in our New York office. We are a hybrid environment that combines the energy and connections of being in the office with the benefits and flexibility of working from home. We currently require a minimum of three coordinated days in the office per week, Monday, Wednesday and Thursday. As a perk, we also have up to four weeks per year of fully remote work!

Responsibilities

Customer-facing

  • Lead the CX Strategy team, setting direction, developing team members, and aligning priorities to CX and company goals.
  • Collaborate with CX leaders to drive performance metrics: resolution rate, CSAT, quality, resolution time, escalation rates, etc. Monitor the results and drive improvement when targets aren't met.
  • Own the CX AI roadmap from opportunity discovery through implementation - prioritize where AI can improve efficiency and customer experience, and sequence investments that compound over time.
  • Collaborate with Systems and Engineering to drive CX AI performance - instruction set optimization, channel expansion (chat, voice, email), containment quality, and escalation handling, etc.

Internal AI tools & team productivity

  • Define the standard for what an AI-augmented CX team looks like at Brex: how AI agents and human operators divide and conquer, where handoffs happen, and how to maintain customer experience quality as automation scales.
  • Own the development and deployment of internal AI tools that make Brex's CX team faster, more accurate, and more consistent - including agent-assist tooling, real-time guidance systems, QA automation, and workflow-level automations.
  • Partner with Engineering, Data, and Product Ops to build and maintain the AI infrastructure underneath these tools - knowledge reliability, shared workflows, and feedback loops that improve both customer-facing and internal AI systems over time.
  • Measure internal AI adoption and impact: track agent productivity, time-to-resolution improvements, QA automation rates, and coaching effectiveness. Close the loop between data and iteration.

Cross-functional & leadership

  • Partner cross-functionally with CX Leadership, Strategy & Enablement, Product, Engineering, and Data to scope, build, and launch AI improvements. Represent CX in EPD conversations with a point of view grounded in customer outcomes and operational metrics.
  • Drive internal AI adoption - ensure the CX team is equipped with the training, workflows, and confidence to work alongside AI effectively.
  • Communicate AI performance and strategy to CX leadership and executive stakeholders; translate data into clear narratives that drive decisions.

Requirements

  • 4+ years in CX strategy, AI operations, product operations, or a related function at the intersection of technology and customer experience - ideally in a fast-paced tech or fintech environment
  • 1+ years managing or developing a team of 4+ ICs, with a track record of setting direction, developing people, and delivering results
  • Proven experience owning and improving AI or automation initiatives in a support environment - from opportunity analysis through rollout and iteration, with measurable outcomes
  • Product-minded builder: equally comfortable writing a requirements doc, configuring a platform, and partnering with Engineering to ship something net-new. You don't wait for a product team to build what your customers need
  • Strong analytical skills: comfortable digging into conversation data, contact driver analysis, and AI performance metrics to turn raw signal into smart decisions
  • Technical fluency with AI-enabled CX platforms and the ability to ship directly or partner confidently with Engineering and Product to make automation work at scale
  • Clear, direct communicator - you write with precision, translate between technical and non-technical audiences, and know how to make a data story land with leadership
  • Proven cross-functional collaboration skills - you've worked across CX, Product, Engineering, and Data to drive customer-centric improvements

Bonus Points

  • Hands-on experience with Sierra or comparable AI voice/chat/email platforms in a customer-facing environment
  • Background in fintech, financial services, or enterprise SaaS
  • Experience building or owning QA and eval frameworks for AI systems
  • Experience building internal productivity tooling or agent-assist systems - whether through third-party configuration, prompt engineering, or partnering with Engineering to ship net-new tools
  • Familiarity with product knowledge infrastructure - how content is structured, maintained, and surfaced to AI systems at scale
  • Experience translating AI operational learnings into product feedback that influenced roadmap decisions

Compensation

The expected salary range for this role is $141,928 - $177,410.  However, the starting base pay will depend on a number of factors including the candidate's location, skills, experience, market demands, and internal pay parity. Depending on the position offered, equity and other forms of compensation may be provided as part of a total compensation package.

Brex LLC is a wholly owned subsidiary of Capital One, N.A.