ZipRecruiter

Log In

2

Remote Evaluation Jobs in Kentucky (NOW HIRING)

micro1 AI

Commercial Counsel - Remote

Louisville, KY · Remote

$90 - $130/hr

Remote Job Summary: We are seeking seasoned General Counsels for a part-time role at the forefront ... Create objective evaluation frameworks and grading criteria to assess AI performance on contract ...

micro1 AI

General Counsel - Remote

Lexington, KY · Remote

$90 - $130/hr

Remote Job Summary: We are seeking seasoned General Counsels for a part-time role at the forefront ... Create objective evaluation frameworks and grading criteria to assess AI performance on contract ...

micro1 AI

Corporate Counsel - Remote

Louisville, KY · Remote

$90 - $130/hr

Remote Job Summary: We are seeking seasoned General Counsels for a part-time role at the forefront ... Create objective evaluation frameworks and grading criteria to assess AI performance on contract ...

micro1 AI

Commercial Counsel - Remote

Lexington, KY · Remote

$90 - $130/hr

Remote Job Summary: We are seeking seasoned General Counsels for a part-time role at the forefront ... Create objective evaluation frameworks and grading criteria to assess AI performance on contract ...

micro1 AI

General Counsel - Remote

Louisville, KY · Remote

$90 - $130/hr

Remote Job Summary: We are seeking seasoned General Counsels for a part-time role at the forefront ... Create objective evaluation frameworks and grading criteria to assess AI performance on contract ...

micro1 AI

Corporate Counsel - Remote

Lexington, KY · Remote

$90 - $130/hr

Remote Job Summary: We are seeking seasoned General Counsels for a part-time role at the forefront ... Create objective evaluation frameworks and grading criteria to assess AI performance on contract ...

micro1 AI

Legal AI Trainer - Remote

Lexington, KY · Remote

$90 - $150/hr

Remote We are seeking seasoned Funds Attorneys for a part-time role at the forefront of legal AI ... This opportunity is for elite lawyers who want to help shape how advanced AI is trained, evaluated ...

micro1 AI

Private Funds Attorney - Remote

Louisville, KY · Remote

$90 - $150/hr

Remote We are seeking seasoned Funds Attorneys for a part-time role at the forefront of legal AI ... This opportunity is for elite lawyers who want to help shape how advanced AI is trained, evaluated ...

micro1 AI

Legal AI Trainer - Remote

Louisville, KY · Remote

$90 - $150/hr

Remote We are seeking seasoned Funds Attorneys for a part-time role at the forefront of legal AI ... This opportunity is for elite lawyers who want to help shape how advanced AI is trained, evaluated ...

micro1 AI

Private Funds Attorney - Remote

Lexington, KY · Remote

$90 - $150/hr

Remote We are seeking seasoned Funds Attorneys for a part-time role at the forefront of legal AI ... This opportunity is for elite lawyers who want to help shape how advanced AI is trained, evaluated ...

micro1 AI

AI Legal Counsel - Remote

Lexington, KY · Remote

$90 - $130/hr

Remote Job Summary: We are seeking seasoned in-house transactional attorneys for a part-time role ... This opportunity is for elite lawyers who want to help shape how advanced AI is trained, evaluated ...

next page

Showing results 1-20

All JobsEvaluation JobsRemote Evaluation JobsRemote Evaluation Jobs in Kentucky

Remote Evaluation information

What is a remote evaluation?

A Remote Evaluation job involves assessing data, products, services, or processes from a remote location. This can include reviewing applications, analyzing research data, conducting quality assessments, or providing feedback on various projects. It is commonly found in education, market research, healthcare, and tech industries. Evaluators use digital tools to complete assessments without needing to travel or work on-site. These roles require strong analytical skills, attention to detail, and the ability to work independently.

What does a remote evaluation do?

As a Remote Evaluation professional, your daily responsibilities often include reviewing and scoring applications, surveys, or assessments, analyzing data, and compiling detailed evaluation reports. You'll typically work independently but may also participate in virtual meetings with team members or stakeholders to ensure alignment on evaluation criteria and share findings. Adhering to strict deadlines and maintaining confidentiality of sensitive information are common expectations. The workload can vary based on project cycles, so strong organizational skills are essential for managing multiple assignments. Collaboration tools such as email, project management platforms, and video conferencing software are frequently used in this role.

What skills and qualifications are needed for remote evaluation?

To thrive in a Remote Evaluation role, you need strong analytical skills, attention to detail, and a relevant bachelor’s degree or specialized training in assessment or evaluation. Proficiency in digital assessment platforms, data analysis tools such as Excel or Tableau, and familiarity with industry-specific evaluation software are often required. Outstanding written communication, independent time management, and adaptability help remote evaluators excel in a virtual environment. These skills ensure accurate, efficient, and meaningful assessments while maintaining productivity and effective collaboration across remote teams.

How to become a remote evaluation?

To become a remote evaluator, typically you need relevant experience in the field you will assess, strong analytical skills, and proficiency with online communication tools. Some roles may require specific certifications or training, and a reliable internet connection is essential for remote work.

What are the most commonly searched types of Evaluation jobs in Kentucky?

The most popular types of Evaluation jobs in Kentucky are:

What are popular job titles related to Remote Evaluation jobs in Kentucky?

For Remote Evaluation jobs in Kentucky, the most frequently searched job titles are:

What job categories do people searching Remote Evaluation jobs in Kentucky look for?

The top searched job categories for Remote Evaluation jobs in Kentucky are:

What cities in Kentucky are hiring for Remote Evaluation jobs?

Cities in Kentucky with the most Remote Evaluation job openings:

Remote Evaluation jobs near you
Infographic showing various Remote Evaluation job openings in Kentucky as of August 2026, with employment types broken down into 2% As Needed, 79% Full Time, 17% Part Time, and 2% Contract. Highlights an 90% Physical, 2% Hybrid, and 8% Remote job distribution.

Principal Coding Annotator / LLM Evaluation Engineer

Braintrust

Alexandria, KY • On-site, Remote

$75 - $90/hr

Full-time

Posted 4 days ago

Job description

Company
Braintrust is a global talent network that connects top independent professionals with leading companies for high-quality, flexible work. We help organizations hire skilled talent faster while giving professionals access to vetted opportunities with innovative teams. Job description

This is a contracting engagement - initially 6 months - with potential for long term engagement.

Location: Paris or London-based preferred; alternatively Europe remote for strong candidates


We are building and evaluating state-of-the-art large language models (LLMs) and are looking for experienced software engineers to join our evaluation and annotation team. This role sits at the intersection of real-world software engineering, model evaluation, and applied AI, and is critical to improving model reliability, reasoning, and code quality.

You will design challenging coding tasks, evaluate model outputs against rigorous benchmarks, identify failure modes, and contribute to reinforcement learning and model improvement workflows.

This is not a junior annotation role. We are looking for practitioners with deep hands-on coding experience who can think like both an engineer and an evaluator.

What You’ll Do
  • Evaluate coding tasks involving software vulnerabilities, exploit verification, and security patches.
  • Create high-quality coding prompts and reference answers (benchmark-style, e.g. SWE-Bench-like problems).
  • Evaluate LLM outputs for code generation, refactoring, debugging, and implementation tasks.
  • Identify and document model failures, edge cases, and reasoning gaps.
  • Perform head-to-head evaluations between private LLMs (Mistral-based) and leading external models.
  • Build or configure coding environments to support evaluation and reinforcement learning (RL).
  • Follow detailed annotation and evaluation guidelines with high consistency.
What We’re Looking For
  • 5+ years of professional software development experience.
  • Strong Python skills (required).
  • Knowledge of at least one additional programming language (bonus).
  • Experience with professional code review, coding annotation, LLM/code evaluation, or benchmark design is a plus, but not required.
  • Hands-on experience with vulnerability research, exploit reproduction or verification, or implementing, backporting, or validating security patches.
  • Proven ability to apply structured evaluation criteria and write clear technical feedback.
  • Fluent in English (written and spoken).
  • Team lead or mentoring experience is a strong plus.
Why This Role
  • Work hands-on with cutting-edge LLMs.
  • Apply real-world engineering judgment to model evaluation and improvement.
  • High-impact, technical work with a focused, senior team.

Apply