ZipRecruiter

Log In

2

Full Time Ai Evaluator Jobs (NOW HIRING)

Fanatics Inc.

AI Engineer

New York, NY

We're looking for a full-time AI Engineer to help shape and execute Fanatics' AI strategy across ... Help shape AI governance and best practices, including tool evaluation, security and InfoSec ...

Fluency

AI Engineer

San Francisco, CA · On-site

$150K - $250K/yr

We're hiring a full-time AI Engineer to own the prompts, agents, evals, and pipelines behind user ... Improve AI output quality through prompt engineering, model selection, retrieval, and evaluation.

McCarthy Holdings, Inc.

AI Engineer II

Saint Louis, MO · On-site

$91K - $125K/yr

POSITION SUMMARY McCarthy is seeking a full-time AI Engineer II who will be part of the Engineering ... Participate in MLOps and PromptOps processes, including deployment, monitoring, evaluation ...

McCarthy Holdings, Inc.

AI Engineer II

Dallas, TX

$96K - $132K/yr

POSITION SUMMARY McCarthy is seeking a full-time AI Engineer II who will be part of the Engineering ... Participate in MLOps and PromptOps processes, including deployment, monitoring, evaluation ...

McCarthy Holdings, Inc.

AI Engineer II

Phoenix, AZ · On-site

$88K - $121K/yr

POSITION SUMMARY McCarthy is seeking a full-time AI Engineer II who will be part of the Engineering ... Participate in MLOps and PromptOps processes, including deployment, monitoring, evaluation ...

McCarthy Holdings, Inc.

AI Engineer II

Phoenix, AZ

$88K - $121K/yr

POSITION SUMMARY McCarthy is seeking a full-time AI Engineer II who will be part of the Engineering ... Participate in MLOps and PromptOps processes, including deployment, monitoring, evaluation ...

McCarthy Holdings, Inc.

AI Engineer II

Dallas, TX · On-site

$96K - $132K/yr

POSITION SUMMARY McCarthy is seeking a full-time AI Engineer II who will be part of the Engineering ... Participate in MLOps and PromptOps processes, including deployment, monitoring, evaluation ...

McCarthy Holdings, Inc.

AI Engineer II

Saint Louis, MO · On-site

$91K - $125K/yr

POSITION SUMMARY McCarthy is seeking a full-time AI Engineer II who will be part of the Engineering ... Participate in MLOps and PromptOps processes, including deployment, monitoring, evaluation ...

Nexus Employment

Forklift Operator

Romeoville, IL · On-site

$18 - $20/hr

Schmidt Road Bolingbrook, IL 60440 Job Type: Full-time AI Disclosure Our recruitment process may include AI-assisted tools to support candidate evaluation. These tools are designed to assist our ...

Nexus Employment

Forklift

Montgomery, IL

$19 - $20/hr

Perform all general warehouse duties * Full Time, Steady Work Job Type: Full-time AI Disclosure Our recruitment process may include AI-assisted tools to support candidate evaluation. These tools are ...

New

Fanatics Inc.

AI Engineer

New York, NY · On-site

We're looking for a full-time AI Engineer to help shape and execute Fanatics' AI strategy across ... Help shape AI governance and best practices, including tool evaluation, security and InfoSec ...

Giga Energy

AI Training & Enablement Lead

Austin, TX · On-site +1

What you'll do Giga is hiring a full-time AI Training & Enablement Lead to build the learning and ... Giga develops the habit of evaluating frontier AI quickly, using it safely, and scaling only what ...

Deposco

AI Evaluation Engineer

Alpharetta, GA · On-site

Deposco is seeking an experienced AI Evaluation Engineer to join our innovative quality assurance ... Coffee bar with cold brew on tap and a full time barista * Standing desk (if you're into that sort ...

next page

Showing results 1-20

All Jobsfull time JobsEducation JobsHigher Education JobsAdmissions Evaluator JobsFull Time Ai Evaluator Jobs

Full Time Ai Evaluator information

See salary details

$29.5K

$65.5K

$106.5K

How much do full time ai evaluator jobs pay per year?

As of Sep 4, 2026, the average yearly pay for full time ai evaluator in the United States is $65,471.00, according to ZipRecruiter salary data. Most workers in this role earn between $44,500.00 and $79,500.00 per year, depending on experience, location, and employer.

What is a full time AI evaluator?

Full Time AI Evaluators are professionals who assess, test, and provide feedback on artificial intelligence systems to ensure their accuracy, fairness, and reliability. They work with machine learning models, chatbots, search algorithms, or other AI products to identify errors, biases, and areas for improvement. Their role is crucial in enhancing AI performance and ensuring that these systems meet ethical, technical, and user-centric standards. Full Time AI Evaluators may collaborate with data scientists, engineers, and product teams to refine and optimize AI technologies.

What are the key skills and qualifications needed to thrive as a full time AI evaluator, and why are they important?

To thrive as a Full Time AI Evaluator, you need strong analytical thinking, attention to detail, and a foundational understanding of artificial intelligence concepts, often supported by a degree in computer science or a related field. Familiarity with data annotation tools, evaluation frameworks, and sometimes programming languages like Python is typically required. Excellent communication, critical thinking, and problem-solving skills help you interpret results and provide actionable feedback. These abilities ensure that AI models are accurately assessed, refined, and aligned with quality standards, which is vital for their effective deployment.

What are some common challenges faced by full time AI evaluators and how can they be addressed?

Full Time AI Evaluators often encounter challenges such as managing large volumes of data, maintaining objectivity during repetitive tasks, and staying updated with evolving AI guidelines. To address these, it is important to develop strong attention to detail, regularly review updated protocols, and engage in open communication with team leads about unclear criteria. Collaborating with peers and participating in ongoing training sessions can also help evaluators handle complex cases and ensure consistent, high-quality assessments.

Can I get a full time AI evaluator job with no experience?

Full-time AI evaluator roles often require some familiarity with data annotation, machine learning concepts, or related tools, but many entry-level positions are available for candidates without prior experience. Employers may provide training or onboarding, and having strong attention to detail and basic computer skills can help you qualify for such roles.

How to become a full time AI evaluator?

To become a full-time AI evaluator, candidates typically need strong language skills, attention to detail, and familiarity with AI and machine learning concepts. Relevant experience in data annotation, content moderation, or related fields can be beneficial, and some roles may require specific training or certifications. A reliable internet connection and the ability to work independently are also important for remote positions.
More about Full Time Ai Evaluator jobs

What cities are hiring for Full Time Ai Evaluator jobs?

Cities with the most Full Time Ai Evaluator job openings:

What are the most commonly searched types of Ai Evaluator jobs?

The most popular types of Ai Evaluator jobs are:

What states have the most Full Time Ai Evaluator jobs?

States with the most job openings for Full Time Ai Evaluator jobs include:

What job categories do people searching Full Time Ai Evaluator jobs look for?

The top searched job categories for Full Time Ai Evaluator jobs are:

Full Time Ai Evaluator jobs near you
Infographic showing various Full Time Ai Evaluator job openings in the United States as of August 2026, with employment types broken down into 100% Full Time. Highlights an 80% In-person, and 20% Remote job distribution, with an average salary of $65,471 per year, or $31.5 per hour.

Platform Lead Engineer / AI & Developer Productivity

Motion Recruitment

Waltham, MA • Hybrid

Full-time

Medical, Dental, Vision, Retirement, PTO

Posted 13 days ago

Job description

AI Engineer (Generative AI & Backend Systems)

A fast-growing technology company located in Waltham, MA (Hybrid - 3 days onsite) is seeking a full-time AI Engineer to design and develop production-grade AI applications. This position combines backend software engineering, cloud-native development, and generative AI technologies to deliver intelligent customer-facing solutions. The ideal candidate brings strong software engineering fundamentals alongside experience integrating machine learning and large language models into real-world products.

Unlike many AI positions focused solely on prototyping, this role centers on shipping scalable systems that create measurable business impact. You'll work directly on the architecture, deployment, monitoring, and optimization of AI-powered applications while helping shape the organization's approach to generative AI. This is a great opportunity for an engineer who wants to move beyond experimentation and build technology used in production every day.

Required Skills & Experience
  • 4+ years of backend software development experience
  • Strong programming skills in Python, Java, Go, or similar languages
  • Experience deploying machine learning or LLM-powered solutions in production environments
  • Experience building APIs, services, and scalable distributed applications
  • Strong understanding of cloud infrastructure and modern software architecture
  • Experience monitoring, evaluating, and improving AI system performance
  • Strong analytical and troubleshooting abilities
  • Excellent communication and collaboration skills
Desired Skills & Experience
  • Hands-on experience building Generative AI applications
  • Familiarity with LLM evaluation methodologies and frameworks
  • Production monitoring and observability experience
  • Experience designing highly available service architectures
  • Strong systems design background
  • Experience owning products, services, or features from concept to launch
  • Background working within high-growth engineering organizations
What You Will Be Doing Tech Breakdown
  • 40% Generative AI Development
  • 35% Backend Engineering & Service Development
  • 15% AI Quality, Monitoring & Reliability
  • 10% Architecture & Technical Design
Daily Responsibilities
  • 80% Hands-On Development
  • 10% Cross-Functional Collaboration
  • 10% Technical Planning & Design
The Offer
  • $180,000 - $220,000
  • Bonus eligible

You will receive the following benefits:

  • Medical, Dental, and Vision Insurance
  • Vacation Time
  • 401(k)
  • Hybrid Work Environment
  • Exposure to Emerging AI Technologies

Applicants must be currently authorized to work in the US on a full-time basis now and in the future.

Apply