ZipRecruiter

Log In

1

Evaluation Jobs (NOW HIRING)

Elicit

Evaluation Engineer

Oakland, CA · On-site +1

Ensuring evaluations are accurate and reliable * We need to evaluate how well Elicit actually helps with decision-making in pharma, not just measure what's easy to measure. This requires encoding ...

MSR Technology Group

Evaluation Engineer

Saline, MI · On-site

* Description: -Plan and lead prototype evaluations(Serviceability, Waterleak and Wireharness routing) -Conduct drawing reviews during drawing stage activities proposing structure countermeasures to ...

University of Mississippi

Evaluation Associate

Oxford, MS · On-site

$14 - $18.50/hr

As an Evaluation Associate you will design and manage evaluation projects under the direction of the center director and Principal Evaluation Associates. You will also manage day-to-day relationships ...

Brightline

Evaluation Provider

New York, NY · On-site

$80K - $105K/yr

The Evaluation Provider conducts comprehensive psychological evaluations for youth up to age 18, serving as a specialist resource across the region. If you are as passionate about evidence-based ...

Brightline

Evaluation Provider

Manhattan, NY · On-site

$80K - $105K/yr

The Evaluation Provider conducts comprehensive psychological evaluations for youth up to age 18, serving as a specialist resource across the region. If you are as passionate about evidence-based ...

Brightline

Evaluation Provider

Manhattan, NY · On-site

$80K - $105K/yr

The Evaluation Provider conducts comprehensive psychological evaluations for youth up to age 18, serving as a specialist resource across the region. If you are as passionate about evidence-based ...

Brightline

Evaluation Provider

New York, NY · On-site

$80K - $105K/yr

The Evaluation Provider conducts comprehensive psychological evaluations for youth up to age 18, serving as a specialist resource across the region. If you are as passionate about evidence-based ...

Brightline

Evaluation Provider

Albany, NY · Remote

$80K - $105K/yr

The Evaluation Provider conducts comprehensive psychological evaluations for youth up to age 18, serving as a specialist resource across the region. If you are as passionate about evidence-based ...

Interfaith America

Evaluation Manager

$65K - $75K/yr

The Evaluation Manager is someone who can hold relationships with partner organizations over time, help staff across the organization understand and use data, and turn evaluation thinking into ...

Brightline

Evaluation Provider

Albany, NY · On-site

$80K - $105K/yr

The Evaluation Provider conducts comprehensive psychological evaluations for youth up to age 18, serving as a specialist resource across the region. If you are as passionate about evidence-based ...

next page

Showing results 1-20

All JobsEvaluation Jobs

Evaluation information

See salary details

$10

$36

$70

How much do evaluation jobs pay per hour?

As of Jun 8, 2026, the average hourly pay for evaluation in the United States is $36.50, according to ZipRecruiter salary data. Most workers in this role earn between $23.08 and $43.27 per hour, depending on experience, location, and employer.

What are some common challenges faced by Evaluation professionals when assessing program effectiveness, and how can they be addressed?

Evaluation professionals often encounter challenges such as limited access to quality data, stakeholder resistance, or unclear project objectives. To address these, evaluators can establish clear communication with stakeholders early on, set achievable and measurable objectives, and use mixed-methods approaches to compensate for data gaps. Building strong relationships and maintaining transparency throughout the evaluation process can also help increase buy-in and ensure more meaningful, actionable results.

What are the key skills and qualifications needed to thrive as an Evaluation Specialist, and why are they important?

To thrive as an Evaluation Specialist, you need strong analytical skills, knowledge of research methodologies, and typically a degree in social sciences, public health, or a related field. Familiarity with data analysis software such as SPSS, R, or Excel, and experience with survey design and statistical reporting are often required. Critical thinking, attention to detail, and effective communication help you interpret findings and convey results to stakeholders. These skills ensure that programs are accurately assessed and improved, supporting evidence-based decision-making.

What is the difference between Evaluation vs Assessment?

AspectEvaluationAssessment
PurposeTo determine the value, effectiveness, or quality of a program, project, or processTo measure knowledge, skills, or performance of an individual or group
FocusOverall impact and outcomesIndividual performance or understanding
MethodsData analysis, reports, feedbackTests, quizzes, observations
UsageUsed by organizations to improve programsUsed by educators or employers to gauge individual progress

Evaluation and assessment are related but serve different purposes. Evaluation focuses on judging the effectiveness of a program or project, while assessment measures individual knowledge or skills. Both are essential in different contexts but differ in scope and application.

What are evaluation jobs?

Evaluation jobs involve assessing the effectiveness, quality, or impact of programs, projects, or products. Professionals in evaluation roles collect and analyze data, provide feedback, and make recommendations to help organizations improve their operations or outcomes. These roles are common in sectors like education, healthcare, nonprofit, and government, where measuring success and accountability is essential. Evaluation specialists use qualitative and quantitative methods and often communicate findings through detailed reports or presentations.
More about Evaluation jobs
What cities are hiring for Evaluation jobs? Cities with the most Evaluation job openings:
What are the most commonly searched types of Evaluation jobs? The most popular types of Evaluation jobs are:
What states have the most Evaluation jobs? States with the most job openings for Evaluation jobs include:
What job categories do people searching Evaluation jobs look for? The top searched job categories for Evaluation jobs are:
Evaluation jobs near you
Infographic showing various Evaluation job openings in the United States as of May 2026, with employment types broken down into 3% As Needed, 82% Full Time, 13% Part Time, and 2% Contract. Highlights an 91% Physical, 2% Hybrid, and 7% Remote job distribution, with an average salary of $75,914 per year, or $36.5 per hour.
Evaluation Engineer

Evaluation Engineer

Elicit

Oakland, CA • On-site, Remote

Full-time

Medical, Dental, Vision, Life, Retirement, PTO

Posted 18 days ago

Job description

About Elicit
Elicit is an AI research platform that uses language models to help researchers figure out what's true and make better decisions, starting with common research tasks like literature review.
What we're aiming for:
  1. Elicit radically increases the amount of good reasoning in the world.
    • For experts, Elicit pushes the frontier forward.
    • For non-experts, Elicit makes good reasoning more affordable. People who don't have the tools, expertise, time, or mental energy to make well-reasoned decisions on their own can do so with Elicit.
  2. Elicit is a scalable ML system based on human-understandable task decompositions, with supervision of process, not outcomes. This expands our collective understanding of safe AGI architectures.

Visit our Twitter to learn more about how Elicit is helping researchers and making progress on our mission.
The mission of Elicit evals
Some orgs build evals to warn us about dangerous capabilities. Others build evals to understand trends and predict future developments. Yet others build evals to hill-climb towards models that users will like more.
At Elicit, we're focused on something different-we want to understand, and hill-climb towards, models that help us make better decisions.
This is tougher than "what will users like better"-it's hard to evaluate decision support, and users' knee-jerk reactions may not align with what actually helps for decision-making. Because it's hard, and because the sales pitch is more complicated, there aren't many doing this well. If we nail this, we have a unique opportunity to push AI toward helping us make better decisions, both within Elicit and beyond.
Why we're hiring for this role
We need someone to own the technical foundation of our auto-evaluation systems. Our evals are currently much slower than they need to be, and our interfaces aren't optimized for the diverse set of people who need to use them-ML engineers iterating on models, product managers monitoring quality, and customers assessing trust in results.
The right person for this role won't just build infrastructure. You'll think deeply about what it actually means for Elicit to help with decision-making in pharma and encode that understanding into our evaluation systems.
What you'll own
The core auto-eval platform
You'll build a comprehensive system that runs fast, is easy to use, and supports quickly building new evals:
  • Speed: You'll build a lightning-fast basic evals infrastructure that schedules tasks to introduce practically no latency; and then you'll figure out clever ways to solve the fundamental sources of latency (building a version of Elicit, running it on a query, and evaluating it using LMs)
  • Interfaces: ML engineers need evals to kick off automatically on relevant commits, with results they can see at a glance and drill into. Product managers need dashboards showing performance over time and what's going wrong in production.
  • Architecture: Your code must be well-architected so other team members and ML engineers can understand and build on it. An engineer starting on a new feature should be able to quickly add examples and run an eval.

Ensuring evaluations are accurate and reliable
  • We need to evaluate how well Elicit actually helps with decision-making in pharma, not just measure what's easy to measure. This requires encoding real knowledge about how pharma customers make decisions (for example, choosing appropriate gold standards).
  • You'll provide appropriate statistical tests and confidence intervals so we can trust our results.
A month in your life
In a typical month, expect to spend:
  • 60% working on the core eval platform
  • 15% working closely with the evals team to build and improve specific evals (e.g., an eval of our paper search within our systematic review flow)
  • 10% mentoring our evals engineering intern
  • The rest on learning how people interact with the eval system so you can make it work better for them, and understanding what our users want from Elicit so evals measure what matters
What you bring to the role
Requirements
  • At least 3 years of experience as a professional software engineer, with demonstrated experience building complex backend systems (e.g., backend for a complex website, data pipelines, etc.)
  • Aptitude and interest in evaluating how Elicit helps with pharma decision-making. There's no particular experience you must have, but we'll evaluate your aptitude.

Will make you more competitive for the role
  • Knowledge of statistics (for e.g. calculating power and credence intervals for evals)
  • Experience with advanced Python (asyncio/trio and parallel processing strategies)
  • Front-end experience and strong UX sensibility (you'll be building dashboards). TypeScript experience is a plus.
  • Experience building developer tools (ML engineers are one of your most important clients)
  • Previous experience as a data engineer or working on AI infrastructure
  • Knowledge of pharma/biomed
  • Experience evaluating ML systems
  • Experience building language-model-based systems (helps with understanding Elicit and how to evaluate it)

This is a diverse list of nice-to-haves. We expect the candidate we select to have some, but not all, of these. Other team members can fill in for skills you lack.
Location and travel
We have a lovely office in Oakland, CA, but we're flexible about where you work. You're welcome to work remotely, from our Oakland headquarters, or in a hybrid setup. The only in-person requirement is attending our quarterly team retreats, typically held on the west coast.
Compensation, benefits, and perks
In addition to working on important problems as part of a productive and positive team, we also offer great benefits (with some variation based on location):
  • Flexible work environment: work from our office in Oakland or remotely with time zone overlap (between GMT and GMT-8), as long as you can travel for in-person retreats and coworking events
  • Fully covered health, dental, vision, and life insurance for you, generous coverage for the rest of your family
  • Flexible vacation policy, with a minimum recommendation of 20 days/year + company holidays
  • 401K with a 6% employer match
  • A new Mac + $1,000 budget to set up your workstation or home office in your first year, then $500 every year thereafter
  • $1,000 quarterly AI Experimentation & Learning budget, so you can freely experiment with new AI tools, take courses, purchase educational resources, or attend AI-focused conferences and events
  • A team administrative assistant who can help you with personal and work tasks

For all roles at Elicit, we use a data-backed compensation framework to keep salaries market-competitive, equitable, and simple to understand. For this role, we target starting ranges of:
  • Career (L3): $140-170k + equity
  • Senior (L4): $165-200k + equity

Apply