ZipRecruiter

Log In

1

Ai Response Evaluator Jobs (NOW HIRING)

Mercor

Public Procurement Evaluator - Expert

New York, NY · Remote

$80 - $120/hr

Position: Public-sector procurement / RFI response Evaluator Type: Contract Compensation: $80-$120/hour Location: Remote Role Responsibilities * Evaluate AI-generated artifacts against domain ...

YO AI Labs

English Language Expert - Remote

Palo Alto, CA · Remote

$30 - $50/hr

... AI training and evaluation project. In this hourly remote role, you will review AI-generated English-language responses, create expert-level language content, evaluate reasoning quality, and provide ...

YO AI Labs

English Language Expert - Remote

Chicago, IL · Remote

$30 - $50/hr

... AI training and evaluation project. In this hourly remote role, you will review AI-generated English-language responses, create expert-level language content, evaluate reasoning quality, and provide ...

YO AI Labs

English Language Expert - Remote

Houston, TX · Remote

$30 - $50/hr

... AI training and evaluation project. In this hourly remote role, you will review AI-generated English-language responses, create expert-level language content, evaluate reasoning quality, and provide ...

YO AI Labs

English Language Expert - Remote

Chicago, IL · Remote

$30 - $50/hr

... AI training and evaluation project. In this hourly remote role, you will review AI-generated English-language responses, create expert-level language content, evaluate reasoning quality, and provide ...

YO AI Labs

English Language Expert - Remote

New York, NY · Remote

... AI training and evaluation project. In this hourly remote role, you will review AI-generated English-language responses, create expert-level language content, evaluate reasoning quality, and provide ...

YO AI Labs

English Language Expert - Remote

Boston, MA · Remote

$30 - $50/hr

... AI training and evaluation project. In this hourly remote role, you will review AI-generated English-language responses, create expert-level language content, evaluate reasoning quality, and provide ...

YO AI Labs

English Language Expert - Remote

Phoenix, NY · Remote

$30 - $50/hr

... AI training and evaluation project. In this hourly remote role, you will review AI-generated English-language responses, create expert-level language content, evaluate reasoning quality, and provide ...

YO AI Labs

English Language Expert - Remote

Miami, FL · Remote

$30 - $50/hr

... AI training and evaluation project. In this hourly remote role, you will review AI-generated English-language responses, create expert-level language content, evaluate reasoning quality, and provide ...

YO AI Labs

English Language Expert - Remote

Atlanta, GA · Remote

$30 - $50/hr

... AI training and evaluation project. In this hourly remote role, you will review AI-generated English-language responses, create expert-level language content, evaluate reasoning quality, and provide ...

YO AI Labs

English Language Expert - Remote

Seattle, WA · Remote

$30 - $50/hr

... AI training and evaluation project. In this hourly remote role, you will review AI-generated English-language responses, create expert-level language content, evaluate reasoning quality, and provide ...

YO AI Labs

English Language Expert - Remote

Dallas, TX · Remote

$30 - $50/hr

... AI training and evaluation project. In this hourly remote role, you will review AI-generated English-language responses, create expert-level language content, evaluate reasoning quality, and provide ...

YO AI Labs

English Language Expert - Remote

San Jose, CA · Remote

$30 - $50/hr

... AI training and evaluation project. In this hourly remote role, you will review AI-generated English-language responses, create expert-level language content, evaluate reasoning quality, and provide ...

YO AI Labs

English Language Expert - Remote

Los Angeles, CA · Remote

$30 - $50/hr

... AI training and evaluation project. In this hourly remote role, you will review AI-generated English-language responses, create expert-level language content, evaluate reasoning quality, and provide ...

next page

Showing results 1-20

All JobsGovernment JobsEmergency Services JobsEmergency Services Professional JobsAi Response Evaluator Jobs

Ai Response Evaluator information

See salary details

$29.5K

$65.5K

$106.5K

How much do ai response evaluator jobs pay per year?

As of Sep 3, 2026, the average yearly pay for ai response evaluator in the United States is $65,471.00, according to ZipRecruiter salary data. Most workers in this role earn between $44,500.00 and $79,500.00 per year, depending on experience, location, and employer.
More about Ai Response Evaluator jobs

What cities are hiring for Ai Response Evaluator jobs?

Cities with the most Ai Response Evaluator job openings:

What states have the most Ai Response Evaluator jobs?

States with the most job openings for Ai Response Evaluator jobs include:

What job categories do people searching Ai Response Evaluator jobs look for?

The top searched job categories for Ai Response Evaluator jobs are:

Ai Response Evaluator jobs near you
Infographic showing various Ai Response Evaluator job openings in the United States as of August 2026, with employment types broken down into 100% Full Time. Highlights an 82% In-person, and 18% Remote job distribution, with an average salary of $65,471 per year, or $31.5 per hour.

Threat Intel - AI / LLM Trainer - Make Your Own Hours

Remotasks

Remote

$49K - $66K/yr

Full-time

Re-posted 17 days ago

Job description

Job Title: AI Response Evaluator for Cyber Security Threat Intelligence

Location: Remote

Job Type: Task-Based Contract (Make your own hours: 5 hours per week minimum)

Overview:

We are seeking a highly skilled and motivated individual to join our team as an AI Response Evaluator with a focus on Cyber Security Threat Intelligence. This position is at the forefront of integrating Artificial Intelligence with Cyber Security to enhance threat intelligence and incident response capabilities. The successful candidate will be involved in evaluating AI-generated prompts using reinforcement learning with human feedback to grade and improve AI quality. This role is an exceptional opportunity to work at the cutting edge nexus of AI and Cyber Security, contributing to the development of smarter, more efficient systems capable of defending against the ever-evolving cyber threat landscape.

Responsibilities:

- Evaluate AI-generated prompt responses for accuracy, relevance, and effectiveness in the context of Cyber Security Threat Intelligence.

- Use reinforcement learning with human feedback to grade AI prompt responses and guide the AI's learning process for improved performance.

- Collaborate with cybersecurity professionals and data scientists to refine AI models based on real-world cyber threat intelligence and incident data.

- Participate in the continuous improvement of AI training processes, including the selection of training data and feedback mechanisms.

- Stay abreast of the latest developments in cyber security threats, tactics, techniques, and procedures (TTPs) to ensure the AI's outputs are relevant and up-to-date.

- Provide insights and feedback on the AI's performance and potential areas for enhancement in detecting and responding to cyber threats.

Preferred Certifications:

  - SANS GCIH (GIAC Certified Incident Handler)

  - SANS GCTI (GIAC Cyber Threat Intelligence)

  - Other relevant certifications in information security incident handling, vulnerability management, and threat intelligence are highly desirable (e.g., CISSP, CEH, OSCP).

Required Experience:

Candidates should have significant (multiple years) of experience in at least one of the following areas:

- Analyzing, triaging, and responding to cyber security incidents and investigations, particularly in response to recent vulnerabilities. This includes knowledge of threat actor group tactics, techniques, and procedures (TTPs) and how to detect and defend against them.

- Assessing Cyber Threat Intelligence and determining applicable risk for an organization via threat modeling. This involves understanding threat actor group TTPs and how to detect and defend against them.

- Identifying, managing, and remediating vulnerabilities, especially in response to well-known vulnerabilities exploited by threat actor groups.

Apply