They are seeking an Evaluation Engineer to own the technical foundation of their auto-evaluation systems, ensuring efficiency and reliability in evaluating decision-making processes, particularly in ...
They are seeking an Evaluation Engineer to own the technical foundation of their auto-evaluation systems, ensuring efficiency and reliability in evaluating decision-making processes, particularly in ...
* Description: -Plan and lead prototype evaluations(Serviceability, Waterleak and Wireharness routing) -Conduct drawing reviews during drawing stage activities proposing structure countermeasures to ...
Quick apply
* Description: -Plan and lead prototype evaluations(Serviceability, Waterleak and Wireharness routing) -Conduct drawing reviews during drawing stage activities proposing structure countermeasures to ...
Align with Evaluation Support Functional Area initiatives as a Internal Evaluator that Conducts in-house evaluations, ensuring programs align with internal goals and performance metrics.. Provide ...
Align with Evaluation Support Functional Area initiatives as a Internal Evaluator that Conducts in-house evaluations, ensuring programs align with internal goals and performance metrics.. Provide ...
AI Evaluation / Testing (Evaluation Engineer) Fort Worth, TX (Remote) Long Term Contract Job Summary: We are seeking a skilled AI Evaluation Engineer to validate AI models and agent workflows built ...
AI Evaluation / Testing (Evaluation Engineer) Fort Worth, TX (Remote) Long Term Contract Job Summary: We are seeking a skilled AI Evaluation Engineer to validate AI models and agent workflows built ...
ProSidian Seeks a Evaluation Coordinator | Evaluation Support [DOEOP047052] - DPLH Est.: 480 Hrs. ST | 0 Hrs. OT on a Exempt 1099 Contract: No Overtime Pay Contract Contingent Basis Mid Atlantic ...
ProSidian Seeks a Evaluation Coordinator | Evaluation Support [DOEOP047052] - DPLH Est.: 480 Hrs. ST | 0 Hrs. OT on a Exempt 1099 Contract: No Overtime Pay Contract Contingent Basis Mid Atlantic ...
Evaluation Psychologist
Colorado Springs, CO · On-site
$90K - $120K/yr
Neuropsychological/Psychological Evaluation-Psychologist If you have a passion for assessment and want to make an impact to the lives of the children, adults, and families we serve, this may be the ...
Quick apply
Evaluation Psychologist
Colorado Springs, CO · On-site
$90K - $120K/yr
Neuropsychological/Psychological Evaluation-Psychologist If you have a passion for assessment and want to make an impact to the lives of the children, adults, and families we serve, this may be the ...
Evaluation Psychologist
Denver, CO · On-site
$90K - $120K/yr
Neuropsychological/Psychological Evaluation-Psychologist If you have a passion for assessment and want to make an impact to the lives of the children, adults, and families we serve, this may be the ...
Quick apply
Evaluation Psychologist
Denver, CO · On-site
$90K - $120K/yr
Neuropsychological/Psychological Evaluation-Psychologist If you have a passion for assessment and want to make an impact to the lives of the children, adults, and families we serve, this may be the ...
Evaluation Intern
Lansing, MI · Hybrid
$15.25 - $20.25/hr
Conduct literature reviews on evaluation methods and best practices. Assist with survey development, administration, and analysis. Help monitor program outcomes using established evaluation ...
Evaluation Intern
Lansing, MI · Hybrid
$15.25 - $20.25/hr
Conduct literature reviews on evaluation methods and best practices. Assist with survey development, administration, and analysis. Help monitor program outcomes using established evaluation ...
Evaluation Specialist
San Jose, CA · On-site
Evaluation Specialist Apply now Job no: 557227 Work type: Staff Location: San Jose Categories: Unit 4 - APC - Academic Professionals of California, Probationary, Full Time, Student Services Job ...
Evaluation Specialist
San Jose, CA · On-site
Evaluation Specialist Apply now Job no: 557227 Work type: Staff Location: San Jose Categories: Unit 4 - APC - Academic Professionals of California, Probationary, Full Time, Student Services Job ...
Evaluation Manager
New York, NY · On-site
$32/hr
The Evaluation Manager will develop & maintain a resource pool and provide RCMI MPIs and Core Directors consultation on research design and reporting methodologies; will aggregate and standardize ...
Evaluation Manager
New York, NY · On-site
$32/hr
The Evaluation Manager will develop & maintain a resource pool and provide RCMI MPIs and Core Directors consultation on research design and reporting methodologies; will aggregate and standardize ...
Evaluation Nurse
$35 - $37/hr
Evaluation Nurse Assisted Living/Memory Care StoryPoint Romeoville $35 37/hr Cell Phone and Mileage Reimbursement Job Summary The Evaluation Nurse is responsible for conducting comprehensive ...
Evaluation Nurse
$35 - $37/hr
Evaluation Nurse Assisted Living/Memory Care StoryPoint Romeoville $35 37/hr Cell Phone and Mileage Reimbursement Job Summary The Evaluation Nurse is responsible for conducting comprehensive ...
Evaluation Specialist
Pierre, SD · On-site
Responsible to perform internal real estate evaluations for residential, commercial, and agricultural properties. As the subject matter expert for the Bank; provide independent and credible ...
Evaluation Specialist
Pierre, SD · On-site
Responsible to perform internal real estate evaluations for residential, commercial, and agricultural properties. As the subject matter expert for the Bank; provide independent and credible ...
Evaluation Specialist
San Jose, CA · On-site
The Evaluation Specialist is responsible for interpreting and applying complex policies, including handling exceptions, and performs Designated School Official (DSO) duties. Additional ...
Evaluation Specialist
San Jose, CA · On-site
The Evaluation Specialist is responsible for interpreting and applying complex policies, including handling exceptions, and performs Designated School Official (DSO) duties. Additional ...
Responsible to perform internal real estate evaluations for residential, commercial, and agricultural properties. As the subject matter expert for the Bank; provide independent and credible ...
Responsible to perform internal real estate evaluations for residential, commercial, and agricultural properties. As the subject matter expert for the Bank; provide independent and credible ...
Seeking Policy Evaluation Analyst candidates with relevant Energy, Science, and Technology Research Sector Experience (functional and technical area expertise also ideal) to support professional ...
Seeking Policy Evaluation Analyst candidates with relevant Energy, Science, and Technology Research Sector Experience (functional and technical area expertise also ideal) to support professional ...
ProSidian Seeks a Impact Evaluation Specialist | Evaluation Support [DOEOP051056] - DPLH Est.: 480 Hrs. ST | 0 Hrs. OT on a Exempt 1099 Contract: No Overtime Pay Contract Contingent Basis Mid ...
ProSidian Seeks a Impact Evaluation Specialist | Evaluation Support [DOEOP051056] - DPLH Est.: 480 Hrs. ST | 0 Hrs. OT on a Exempt 1099 Contract: No Overtime Pay Contract Contingent Basis Mid ...
Evaluation Lead
San Francisco, CA · On-site +1
$159K - $260K/yr
To learn more visit: www.waabi.ai We are looking for a hands-on leader to build a new centralized Evaluation team. This team will be responsible for providing comprehensive and holistic analysis on ...
Evaluation Lead
San Francisco, CA · On-site +1
$159K - $260K/yr
To learn more visit: www.waabi.ai We are looking for a hands-on leader to build a new centralized Evaluation team. This team will be responsible for providing comprehensive and holistic analysis on ...
ProSidian Seeks a Formative Evaluation Expert | Evaluation Support [DOEOP050055] - DPLH Est.: 480 Hrs. ST | 0 Hrs. OT on a Exempt 1099 Contract: No Overtime Pay Contract Contingent Basis Mid Atlantic ...
ProSidian Seeks a Formative Evaluation Expert | Evaluation Support [DOEOP050055] - DPLH Est.: 480 Hrs. ST | 0 Hrs. OT on a Exempt 1099 Contract: No Overtime Pay Contract Contingent Basis Mid Atlantic ...
Evaluation Nurse
Romeoville, IL · On-site
$35 - $37/hr
Evaluation Nurse - Assisted Living/Memory Care StoryPoint Romeoville $35 - 37/hr Cell Phone and Mileage Reimbursement Job Summary The Evaluation Nurse is responsible for conducting comprehensive ...
Quick apply
Evaluation Nurse
Romeoville, IL · On-site
$35 - $37/hr
Evaluation Nurse - Assisted Living/Memory Care StoryPoint Romeoville $35 - 37/hr Cell Phone and Mileage Reimbursement Job Summary The Evaluation Nurse is responsible for conducting comprehensive ...
Description As the Eval Systems Architect, you will own the technical architecture of Siri's evaluation infrastructure - a system spanning real-device automation, simulated product evaluation, AI ...
Description As the Eval Systems Architect, you will own the technical architecture of Siri's evaluation infrastructure - a system spanning real-device automation, simulated product evaluation, AI ...
Evaluation Job information
What is the difference between Evaluation Job vs Data Analyst?
| Aspect | Evaluation Job | Data Analyst |
|---|---|---|
| Required Credentials | Typically requires degrees in education, social sciences, or related fields; certifications in evaluation methods are common | Usually requires degrees in statistics, mathematics, or computer science; certifications in data analysis tools are common |
| Work Environment | Often in educational, government, or nonprofit sectors; focus on program assessment | Primarily in corporate, healthcare, or tech industries; focus on data interpretation and reporting |
| Employer & Industry Usage | Used by government agencies, educational institutions, and nonprofits for program evaluation | Used across industries for data-driven decision making and reporting |
While Evaluation Jobs focus on assessing programs and policies, Data Analysts primarily analyze data sets to inform business or organizational decisions. Both roles require strong analytical skills, but Evaluation Jobs emphasize evaluation methodologies, whereas Data Analysts focus on data manipulation and visualization.
More about Evaluation Job jobs
What cities are hiring for Evaluation Job jobs? Cities with the most Evaluation Job job openings:
What states have the most Evaluation Job jobs? States with the most job openings for Evaluation Job jobs include:
What job categories do people searching Evaluation Job jobs look for? The top searched job categories for Evaluation Job jobs are:
Job description
Job Summary:
Elicit is an AI research platform that leverages language models to assist researchers in making informed decisions. They are seeking an Evaluation Engineer to own the technical foundation of their auto-evaluation systems, ensuring efficiency and reliability in evaluating decision-making processes, particularly in the pharmaceutical sector.
Responsibilities:
• You'll build a comprehensive system that runs fast, is easy to use, and supports quickly building new evals:
• You’ll build a lightning-fast basic evals infrastructure that schedules tasks to introduce practically no latency; and then you’ll figure out clever ways to solve the fundamental sources of latency (building a version of Elicit, running it on a query, and evaluating it using LMs)
• ML engineers need evals to kick off automatically on relevant commits, with results they can see at a glance and drill into.
• Product managers need dashboards showing performance over time and what's going wrong in production.
• Your code must be well-architected so other team members and ML engineers can understand and build on it.
• We need to evaluate how well Elicit actually helps with decision-making in pharma, not just measure what's easy to measure.
• This requires encoding real knowledge about how pharma customers make decisions (for example, choosing appropriate gold standards).
• You'll provide appropriate statistical tests and confidence intervals so we can trust our results.
• In a typical month, expect to spend:
• 60% working on the core eval platform
• 15% working closely with the evals team to build and improve specific evals (e.g., an eval of our paper search within our systematic review flow)
• 10% mentoring our evals engineering intern
• The rest on learning how people interact with the eval system so you can make it work better for them, and understanding what our users want from Elicit so evals measure what matters.
Qualifications:
Required:
• At least 3 years of experience as a professional software engineer, with demonstrated experience building complex backend systems (e.g., backend for a complex website, data pipelines, etc.)
• Aptitude and interest in evaluating how Elicit helps with pharma decision-making. There's no particular experience you must have, but we'll evaluate your aptitude.
Preferred:
• Knowledge of statistics (for e.g. calculating power and credence intervals for evals)
• Experience with advanced Python (asyncio/trio and parallel processing strategies)
• Front-end experience and strong UX sensibility (you'll be building dashboards). TypeScript experience is a plus.
• Experience building developer tools (ML engineers are one of your most important clients)
• Previous experience as a data engineer or working on AI infrastructure
• Knowledge of pharma/biomed
• Experience evaluating ML systems
• Experience building language-model-based systems (helps with understanding Elicit and how to evaluate it)
Company:
Elicit uses language models to help users automate research workflows. Founded in 2023, the company is headquartered in Oakland, USA, with a team of 11-50 employees. The company is currently Early Stage.
Elicit is an AI research platform that leverages language models to assist researchers in making informed decisions. They are seeking an Evaluation Engineer to own the technical foundation of their auto-evaluation systems, ensuring efficiency and reliability in evaluating decision-making processes, particularly in the pharmaceutical sector.
Responsibilities:
• You'll build a comprehensive system that runs fast, is easy to use, and supports quickly building new evals:
• You’ll build a lightning-fast basic evals infrastructure that schedules tasks to introduce practically no latency; and then you’ll figure out clever ways to solve the fundamental sources of latency (building a version of Elicit, running it on a query, and evaluating it using LMs)
• ML engineers need evals to kick off automatically on relevant commits, with results they can see at a glance and drill into.
• Product managers need dashboards showing performance over time and what's going wrong in production.
• Your code must be well-architected so other team members and ML engineers can understand and build on it.
• We need to evaluate how well Elicit actually helps with decision-making in pharma, not just measure what's easy to measure.
• This requires encoding real knowledge about how pharma customers make decisions (for example, choosing appropriate gold standards).
• You'll provide appropriate statistical tests and confidence intervals so we can trust our results.
• In a typical month, expect to spend:
• 60% working on the core eval platform
• 15% working closely with the evals team to build and improve specific evals (e.g., an eval of our paper search within our systematic review flow)
• 10% mentoring our evals engineering intern
• The rest on learning how people interact with the eval system so you can make it work better for them, and understanding what our users want from Elicit so evals measure what matters.
Qualifications:
Required:
• At least 3 years of experience as a professional software engineer, with demonstrated experience building complex backend systems (e.g., backend for a complex website, data pipelines, etc.)
• Aptitude and interest in evaluating how Elicit helps with pharma decision-making. There's no particular experience you must have, but we'll evaluate your aptitude.
Preferred:
• Knowledge of statistics (for e.g. calculating power and credence intervals for evals)
• Experience with advanced Python (asyncio/trio and parallel processing strategies)
• Front-end experience and strong UX sensibility (you'll be building dashboards). TypeScript experience is a plus.
• Experience building developer tools (ML engineers are one of your most important clients)
• Previous experience as a data engineer or working on AI infrastructure
• Knowledge of pharma/biomed
• Experience evaluating ML systems
• Experience building language-model-based systems (helps with understanding Elicit and how to evaluate it)
Company:
Elicit uses language models to help users automate research workflows. Founded in 2023, the company is headquartered in Oakland, USA, with a team of 11-50 employees. The company is currently Early Stage.