ZipRecruiter

Log In

1

Contract Ai Evaluator Jobs (NOW HIRING)

Protingent

AI Engineer

Santa Clara, CA · On-site

$55 - $63/hr

Protingent Staffing has an exciting contract AI Engineer with our client that is fully remote. Job ... Build AI evaluation, monitoring, and observability capabilities using tools such as Langfuse or ...

Weekday AI

AI Evaluation Specialist

$70/hr

This is a fully remote, contract-based opportunity with flexible working hours. Requirements Key ... Familiarity with artificial intelligence, large language models, or AI evaluation methodologies.

Weekday AI

Technology AI Evaluation Expert

$60 - $75/hr

Requirements Key Responsibilities Design AI Evaluation Tasks * Create realistic, multi-step ... Contract Information * Independent contractor engagement. * Fully remote work completed on your own ...

Weekday AI

Healthcare operations Evaluator

$80 - $120/hr

Evaluate AI-generated artifacts against domain-specific quality rubrics. * Identify factual ... Contract and Payment Terms * You will be engaged as an independent contractor. * This is a fully ...

Weekday AI

Healthcare operations Evaluator

$80 - $120/hr

Evaluate AI-generated artifacts against domain-specific quality rubrics. * Identify factual ... Contract and Payment Terms * You will be engaged as an independent contractor. * This is a fully ...

Weekday AI

Legal AI Evaluation Expert

$100 - $150/hr

Your evaluations and structured feedback will directly contribute to improving AI systems designed ... Contract Information * Independent contractor engagement. * Fully remote work completed on your own ...

Weekday AI

People ops / recruiting Evaluator

$80 - $120/hr

Evaluate AI-generated artifacts against domain-specific quality rubrics. * Identify factual ... Contract and Payment Terms * You will be engaged as an independent contractor. * This is a fully ...

next page

Showing results 1-20

All Jobsfreelance JobsEducation JobsHigher Education JobsAdmissions Evaluator JobsContract Ai Evaluator Jobs

Contract Ai Evaluator information

See salary details

$29.5K

$65.5K

$106.5K

How much do contract ai evaluator jobs pay per year?

As of Sep 7, 2026, the average yearly pay for contract ai evaluator in the United States is $65,471.00, according to ZipRecruiter salary data. Most workers in this role earn between $44,500.00 and $79,500.00 per year, depending on experience, location, and employer.

What is a Contract AI Evaluator?

A Contract AI Evaluator is a professional who reviews and assesses the performance, accuracy, and reliability of artificial intelligence systems, often under a contractual or temporary arrangement. Their work typically involves analyzing AI outputs, ensuring the AI meets specific guidelines, and providing feedback to improve system performance. These evaluators may focus on areas such as data labeling, content moderation, or evaluating machine learning models. Contract AI Evaluators often work remotely, offering flexibility, and play a crucial role in developing fair and effective AI technologies.

What are the key skills and qualifications needed to thrive as a contract AI evaluator, and why are they important?

To thrive as a Contract AI Evaluator, you generally need a solid understanding of AI concepts, data analysis, and strong critical thinking skills, often supported by a degree in a relevant field such as computer science, linguistics, or mathematics. Familiarity with annotation tools, data labeling platforms, and sometimes scripting languages like Python is common, along with experience using workflow management systems. Attention to detail, effective communication, and time management are essential soft skills for accurately assessing AI outputs and collaborating with teams. These skills ensure precise evaluation of AI systems, contribute to model improvement, and uphold project quality and deadlines.

What are some common challenges faced by contract AI evaluators when assessing machine learning models?

Contract AI Evaluators often encounter challenges such as understanding the nuances of different AI models and ensuring their evaluations align with project-specific guidelines. Since tasks may involve analyzing outputs for accuracy, bias, or relevance, adapting quickly to varied subject matter and maintaining consistency across large batches of data can be demanding. Additionally, as contract roles are typically remote and asynchronous, effective communication with project managers and other evaluators is crucial to clarify expectations and resolve ambiguities.

What is the difference between Contract Ai Evaluator vs Data Annotator?

AspectContract Ai EvaluatorData Annotator
Required CredentialsBasic computer skills, attention to detailBasic education, training in annotation tools
Work EnvironmentRemote or on-site, tech companies, AI firmsRemote or on-site, data labeling companies
Industry UsageAI development, machine learning projectsData preparation, training datasets
Common Search IntentEvaluating AI outputs, quality controlLabeling data, preparing datasets

Contract Ai Evaluators focus on assessing AI outputs and ensuring quality in machine learning projects, often requiring critical thinking and familiarity with AI systems. Data Annotators primarily label and prepare data for training models, emphasizing accuracy in data labeling. While both roles involve working with data, Contract Ai Evaluators are more involved in evaluating AI performance, whereas Data Annotators focus on data preparation.

What cities are hiring for Contract Ai Evaluator jobs?

Cities with the most Contract Ai Evaluator job openings:

What are the most commonly searched types of Ai Evaluator jobs?

The most popular types of Ai Evaluator jobs are:

What states have the most Contract Ai Evaluator jobs?

States with the most job openings for Contract Ai Evaluator jobs include:

What job categories do people searching Contract Ai Evaluator jobs look for?

The top searched job categories for Contract Ai Evaluator jobs are:

Contract Ai Evaluator jobs near you
Infographic showing various Contract Ai Evaluator job openings in the United States as of August 2026, with employment types broken down into 76% Full Time, 20% Part Time, and 4% Contract. Highlights an 66% Physical, 4% Hybrid, and 30% Remote job distribution, with an average salary of $65,471 per year, or $31.5 per hour.

AI Engineer

Protingent

Santa Clara, CA • On-site

$55 - $63/hr

Contractor

Medical, Retirement, PTO

Posted 15 days ago

Job description


Job Title:AI Engineer
Position Description: Protingent Staffing has an exciting contract AI Engineer with our client that is fully remote.
Job Responsibilities:
  • Design and develop AI agents, workflows, and applications using Python, LangChain, LangGraph, Snowflake Cortex/Cortex Agents, and MCP.
  • Build RAG solutions, including data retrieval, embeddings, context management, tool calling, and prompt engineering.
  • Develop integrations between AI agents and enterprise platforms including Snowflake, Hightouch/CDP, Salesforce, Marketo, and other Martech systems.
  • Contribute to the enterprise AI orchestration layer, including agent routing, tool management, context management, and workflow execution.
  • Build AI evaluation, monitoring, and observability capabilities using tools such as Langfuse or similar platforms.
  • Develop reusable frameworks, agents, tools, APIs, and engineering patterns to accelerate AI adoption.
  • Implement security, access controls, guardrails, and responsible AI practices within AI applications and workflows.
  • Partner with Enterprise Architecture, Data, Security, and business teams to prototype and productionize high-value AI use cases.

Job Qualifications:
  • 3+ years of experience in software engineering, AI/ML engineering, data engineering, or related technical fields.
  • Bachelors in Computer Science
  • Strong Python and SQLskills and experience building APIs and enterprise integrations.
  • Hand -on experience building LLM applications or AI agents.
  • Experience with LangChain, LangGraph, Snowflake Cortex, MCP, RAG, or similar technologies.
  • Experience with Snowflake or other modern cloud data platforms.
  • Familiarity with AI observability, evaluation, security, and governance.
  • Experience with Git, testing, CI/CD, and modern software development practices.
  • Ability to translate business problems into practical, scalable AI solutions.

Job Details:
  • Job Type: Contract
  • Pay Range: $55- $63/hr
  • Location: Fully Remote

Benefits Package: Protingent offers competitive salaries, insurance plan options (HDHP plan or POS plan), education/certification reimbursement, pre-tax commuter benefits, Paid Time Off (PTO), and an administered 401k plan.
About Protingent: Protingent is an Award-Winning provider of top-tier Engineering and IT talent, trusted by companies at the forefront of innovation - from Software and Aerospace to AI, Clean Tech, Medical Devices, and Connected Technologies. We're passionate about making a positive impact by connecting exceptional talent with meaningful opportunities and helping our clients build the future.
Meet Your Recruiter
Subhrajit Das

Apply