They are seeking an Evaluation Engineer to own the technical foundation of their auto-evaluation systems, ensuring efficiency and reliability in evaluating decision-making processes, particularly in ...
They are seeking an Evaluation Engineer to own the technical foundation of their auto-evaluation systems, ensuring efficiency and reliability in evaluating decision-making processes, particularly in ...
Evaluation Engineer
Oakland, CA · On-site +1
An engineer starting on a new feature should be able to quickly add examples and run an eval. Ensuring evaluations are accurate and reliable * We need to evaluate how well Elicit actually helps with ...
Evaluation Engineer
Oakland, CA · On-site +1
An engineer starting on a new feature should be able to quickly add examples and run an eval. Ensuring evaluations are accurate and reliable * We need to evaluate how well Elicit actually helps with ...
Evaluation Engineer
Suwanee, GA · On-site
Engineer II - requires 2-5 years of product design and evaluation experience. * A strong understanding of thermal systems/Refrigeration is required. * Excellent communication skills, oral & written.
Evaluation Engineer
Suwanee, GA · On-site
Engineer II - requires 2-5 years of product design and evaluation experience. * A strong understanding of thermal systems/Refrigeration is required. * Excellent communication skills, oral & written.
Evaluation Engineer
Saline, MI · On-site
* Description: -Plan and lead prototype evaluations(Serviceability, Waterleak and Wireharness routing) -Conduct drawing reviews during drawing stage activities proposing structure countermeasures to ...
Quick apply
Evaluation Engineer
Saline, MI · On-site
* Description: -Plan and lead prototype evaluations(Serviceability, Waterleak and Wireharness routing) -Conduct drawing reviews during drawing stage activities proposing structure countermeasures to ...
Systems Evaluation Engineers are hands-on technical evaluators who rapidly learn unfamiliar technologies, configure and assess them in development and test environments, and determine their ...
Systems Evaluation Engineers are hands-on technical evaluators who rapidly learn unfamiliar technologies, configure and assess them in development and test environments, and determine their ...
Product Evaluation Engineer
Birmingham, AL · Hybrid
$82K - $96K/yr
Product Evaluation Engineer Birmingham, AL | Hybrid ( Two Days in Office) Salary: $82,900-$96,000 annually IAPMO is seeking a Product Evaluation Engineer to join our Uniform Evaluation Services (UES ...
New
Quick apply
Product Evaluation Engineer
Birmingham, AL · Hybrid
$82K - $96K/yr
Product Evaluation Engineer Birmingham, AL | Hybrid ( Two Days in Office) Salary: $82,900-$96,000 annually IAPMO is seeking a Product Evaluation Engineer to join our Uniform Evaluation Services (UES ...
New
Systems Evaluation Engineers are hands-on technical evaluators who rapidly learn unfamiliar technologies, configure and assess them in development and test environments, and determine their ...
Systems Evaluation Engineers are hands-on technical evaluators who rapidly learn unfamiliar technologies, configure and assess them in development and test environments, and determine their ...
Product Evaluation Engineer
Birmingham, AL · On-site
$82K - $96K/yr
Product Evaluation Engineer Birmingham, AL | Hybrid ( Two Days in Office) Salary: $82,900-$96,000 annually IAPMO is seeking a Product Evaluation Engineer to join our Uniform Evaluation Services (UES ...
Product Evaluation Engineer
Birmingham, AL · On-site
$82K - $96K/yr
Product Evaluation Engineer Birmingham, AL | Hybrid ( Two Days in Office) Salary: $82,900-$96,000 annually IAPMO is seeking a Product Evaluation Engineer to join our Uniform Evaluation Services (UES ...
Product Evaluation Engineer
Birmingham, AL · Hybrid
$82K - $96K/hr
Product Evaluation Engineer Birmingham, AL | Hybrid ( Two Days in Office) Salary: $82,900-$96,000 annually IAPMO is seeking a Product Evaluation Engineer to join our Uniform Evaluation Services (UES ...
New
Product Evaluation Engineer
Birmingham, AL · Hybrid
$82K - $96K/hr
Product Evaluation Engineer Birmingham, AL | Hybrid ( Two Days in Office) Salary: $82,900-$96,000 annually IAPMO is seeking a Product Evaluation Engineer to join our Uniform Evaluation Services (UES ...
New
Test & Evaluation Engineer
Manassas, VA · On-site
$30 - $35/hr
As a Test & Evaluation Engineer, you'll play a pivotal role in the success of our projects. Your responsibilities will include: Collaborating with CWL and MTWS engineers to conduct testing and ...
Test & Evaluation Engineer
Manassas, VA · On-site
$30 - $35/hr
As a Test & Evaluation Engineer, you'll play a pivotal role in the success of our projects. Your responsibilities will include: Collaborating with CWL and MTWS engineers to conduct testing and ...
Systems Evaluation Engineers are hands-on technical evaluators who rapidly learn unfamiliar technologies, configure and assess them in development and test environments, and determine their ...
Systems Evaluation Engineers are hands-on technical evaluators who rapidly learn unfamiliar technologies, configure and assess them in development and test environments, and determine their ...
Test & Evaluation Engineer
Mclean, VA · On-site
$110K - $130K/yr
Overview AMERICAN SYSTEMS is seeking a Test and Evaluation Engineer with demonstrated expertise supporting Department of Defense (DoD) programs. This position will be responsible for providing ...
Test & Evaluation Engineer
Mclean, VA · On-site
$110K - $130K/yr
Overview AMERICAN SYSTEMS is seeking a Test and Evaluation Engineer with demonstrated expertise supporting Department of Defense (DoD) programs. This position will be responsible for providing ...
Test & Evaluation Engineer
Mclean, VA · On-site
$110K - $130K/yr
AMERICAN SYSTEMS is seeking a Test and Evaluation Engineer with demonstrated expertise supporting Department of Defense (DoD) programs. This position will be responsible for providing subject matter ...
Test & Evaluation Engineer
Mclean, VA · On-site
$110K - $130K/yr
AMERICAN SYSTEMS is seeking a Test and Evaluation Engineer with demonstrated expertise supporting Department of Defense (DoD) programs. This position will be responsible for providing subject matter ...
Machine Evaluation Engineer
Dubuque, IA · On-site
Machine Evaluation Engineer The Machine Evaluation Engineer is responsible to plan and execute performance and functionality tests of core machine infrastructure to support the next generation of ...
Machine Evaluation Engineer
Dubuque, IA · On-site
Machine Evaluation Engineer The Machine Evaluation Engineer is responsible to plan and execute performance and functionality tests of core machine infrastructure to support the next generation of ...
Complaint Evaluation Engineer
Rancho Santa Margarita, CA · On-site
$72K/yr
The Complaint Evaluation Engineer plays a critical role in Applied Medical's post-market quality and patient safety efforts by investigating returned medical devices and evaluating real-world product ...
Complaint Evaluation Engineer
Rancho Santa Margarita, CA · On-site
$72K/yr
The Complaint Evaluation Engineer plays a critical role in Applied Medical's post-market quality and patient safety efforts by investigating returned medical devices and evaluating real-world product ...
Complaint Evaluation Engineer
$78K - $100K/yr
The Complaint Evaluation Engineer plays a critical role in Applied Medical's post-market quality and patient safety efforts by investigating returned medical devices and evaluating real-world product ...
Complaint Evaluation Engineer
$78K - $100K/yr
The Complaint Evaluation Engineer plays a critical role in Applied Medical's post-market quality and patient safety efforts by investigating returned medical devices and evaluating real-world product ...
Complaint Evaluation Engineer
$78K - $100K/yr
The Complaint Evaluation Engineer plays a critical role in Applied Medical's post-market quality and patient safety efforts by investigating returned medical devices and evaluating real-world product ...
Complaint Evaluation Engineer
$78K - $100K/yr
The Complaint Evaluation Engineer plays a critical role in Applied Medical's post-market quality and patient safety efforts by investigating returned medical devices and evaluating real-world product ...
Machine Evaluation Engineer The Machine Evaluation Engineer is responsible to plan and execute performance and functionality tests of core machine infrastructure to support the next generation of ...
Quick apply
Machine Evaluation Engineer The Machine Evaluation Engineer is responsible to plan and execute performance and functionality tests of core machine infrastructure to support the next generation of ...
We are seeking a motivated Test & Evaluation Engineer to join our dynamic team. This role will support developmental test and evaluation (DT&E) activities for Electronic Warfare systems and ...
Quick apply
We are seeking a motivated Test & Evaluation Engineer to join our dynamic team. This role will support developmental test and evaluation (DT&E) activities for Electronic Warfare systems and ...
Test & Evaluation Engineer 4
Berkeley, MO · On-site
Our client is currently seeking a Test & Evaluation Engineer 4 Senior Test & Evaluation Engineer Berkeley, MO Long Term Contract Overview: We are seeking a highly experienced Test & Evaluation ...
Test & Evaluation Engineer 4
Berkeley, MO · On-site
Our client is currently seeking a Test & Evaluation Engineer 4 Senior Test & Evaluation Engineer Berkeley, MO Long Term Contract Overview: We are seeking a highly experienced Test & Evaluation ...
Evaluation Engineer information
See salary details
$55.5K - $65.5K
12% of jobs
$65.5K - $75.6K
0% of jobs
$75.6K - $85.6K
0% of jobs
$85.6K - $95.7K
0% of jobs
$95.7K - $105.7K
0% of jobs
$105.7K - $115.8K
8% of jobs
$118.3K is the 25th percentile. Wages below this are outliers.
$115.8K - $125.8K
18% of jobs
The median wage is $132.6K / yr.
$125.8K - $135.9K
18% of jobs
$135.9K - $145.9K
18% of jobs
$147.3K is the 75th percentile. Wages above this are outliers.
$145.9K - $156K
13% of jobs
$156K - $166K
13% of jobs
$55.5K
$128.4K
$166K
How much do evaluation engineer jobs pay per year?
What does an evaluation engineer do?
What engineers make $300,000 a year?
What engineers make $200,000 a year?
What is an Evaluation Engineer?
What engineers make $500,000 a year?
What are some common challenges faced by Evaluation Engineers when assessing new products or systems?
What is the difference between Evaluation Engineer vs Test Engineer?
| Aspect | Evaluation Engineer | Test Engineer |
|---|---|---|
| Required Credentials | Bachelor's in Engineering, certifications in testing or evaluation methods | Bachelor's in Engineering, certifications in testing or quality assurance |
| Work Environment | Research labs, product development, quality assessment | Manufacturing plants, testing labs, product validation |
| Industry Usage | Used in electronics, aerospace, automotive for evaluating performance | Used across industries for testing products and systems |
Evaluation Engineers focus on assessing product performance, reliability, and compliance through detailed analysis, often in research or development settings. Test Engineers primarily execute testing procedures to identify defects and ensure quality during manufacturing or pre-release stages. While both roles require technical skills and certifications, Evaluation Engineers emphasize evaluation and analysis, whereas Test Engineers concentrate on testing execution and defect detection.
What are the key skills and qualifications needed to thrive as an Evaluation Engineer, and why are they important?

Job description
Elicit is an AI research platform that leverages language models to assist researchers in making informed decisions. They are seeking an Evaluation Engineer to own the technical foundation of their auto-evaluation systems, ensuring efficiency and reliability in evaluating decision-making processes, particularly in the pharmaceutical sector.
Responsibilities:
• You'll build a comprehensive system that runs fast, is easy to use, and supports quickly building new evals:
• You’ll build a lightning-fast basic evals infrastructure that schedules tasks to introduce practically no latency; and then you’ll figure out clever ways to solve the fundamental sources of latency (building a version of Elicit, running it on a query, and evaluating it using LMs)
• ML engineers need evals to kick off automatically on relevant commits, with results they can see at a glance and drill into.
• Product managers need dashboards showing performance over time and what's going wrong in production.
• Your code must be well-architected so other team members and ML engineers can understand and build on it.
• We need to evaluate how well Elicit actually helps with decision-making in pharma, not just measure what's easy to measure.
• This requires encoding real knowledge about how pharma customers make decisions (for example, choosing appropriate gold standards).
• You'll provide appropriate statistical tests and confidence intervals so we can trust our results.
• In a typical month, expect to spend:
• 60% working on the core eval platform
• 15% working closely with the evals team to build and improve specific evals (e.g., an eval of our paper search within our systematic review flow)
• 10% mentoring our evals engineering intern
• The rest on learning how people interact with the eval system so you can make it work better for them, and understanding what our users want from Elicit so evals measure what matters.
Qualifications:
Required:
• At least 3 years of experience as a professional software engineer, with demonstrated experience building complex backend systems (e.g., backend for a complex website, data pipelines, etc.)
• Aptitude and interest in evaluating how Elicit helps with pharma decision-making. There's no particular experience you must have, but we'll evaluate your aptitude.
Preferred:
• Knowledge of statistics (for e.g. calculating power and credence intervals for evals)
• Experience with advanced Python (asyncio/trio and parallel processing strategies)
• Front-end experience and strong UX sensibility (you'll be building dashboards). TypeScript experience is a plus.
• Experience building developer tools (ML engineers are one of your most important clients)
• Previous experience as a data engineer or working on AI infrastructure
• Knowledge of pharma/biomed
• Experience evaluating ML systems
• Experience building language-model-based systems (helps with understanding Elicit and how to evaluate it)
Company:
Elicit uses language models to help users automate research workflows. Founded in 2023, the company is headquartered in Oakland, USA, with a team of 11-50 employees. The company is currently Early Stage.