Microsoft AI is seeking an experienced Member of Technical Staff - Copilot AI Evaluation Engineering Manager to lead building LLM evaluation solutions for Copilot. The role involves managing a team ...
Microsoft AI is seeking an experienced Member of Technical Staff - Copilot AI Evaluation Engineering Manager to lead building LLM evaluation solutions for Copilot. The role involves managing a team ...
US Tech - AI Evaluation Engineer - Manager
Seattle, WA · On-site
$73.50K - $244K/yr
... AI solutions, designing testing strategies, evaluation frameworks, and governance controls to ... engineering, data engineering, or software engineering - In lieu of a Bachelor's Degree ...
US Tech - AI Evaluation Engineer - Manager
Seattle, WA · On-site
$73.50K - $244K/yr
... AI solutions, designing testing strategies, evaluation frameworks, and governance controls to ... engineering, data engineering, or software engineering - In lieu of a Bachelor's Degree ...
Lead Forward Deployed Engineer, AI Evaluation Platform
Seattle, WA · On-site
$171.60K - $258.10K/yr
Lead Forward Deployed Engineer, AI Evaluation Platform AI systems are only as trustworthy as the methods used to evaluate them. At Apple, where AI powers experiences for billions of people, getting ...
Lead Forward Deployed Engineer, AI Evaluation Platform
Seattle, WA · On-site
$171.60K - $258.10K/yr
Lead Forward Deployed Engineer, AI Evaluation Platform AI systems are only as trustworthy as the methods used to evaluate them. At Apple, where AI powers experiences for billions of people, getting ...
Lead Forward Deployed Engineer, AI Evaluation Platform
$171.60K - $258.10K/yr
Join Apple Services Engineering to build the next generation of AI evaluation systems. We are building the scientific foundation and self-service tools for how AI evaluation is done at scale ...
Lead Forward Deployed Engineer, AI Evaluation Platform
$171.60K - $258.10K/yr
Join Apple Services Engineering to build the next generation of AI evaluation systems. We are building the scientific foundation and self-service tools for how AI evaluation is done at scale ...
Measurement Scientist, AI Evaluation Platform
Seattle, WA · On-site
$171.60K - $258.10K/yr
Description Our team, part of Apple Services Engineering, is building the scientific foundation for how AI systems are evaluated across Apple. We are seeking a Measurement Scientist to ensure that ...
Measurement Scientist, AI Evaluation Platform
Seattle, WA · On-site
$171.60K - $258.10K/yr
Description Our team, part of Apple Services Engineering, is building the scientific foundation for how AI systems are evaluated across Apple. We are seeking a Measurement Scientist to ensure that ...
Role Number: 200659247-3337 Summary Join Apple Services Engineering to build the next generation of AI evaluation systems. We are seeking a staff machine learning platform engineer to lead the ...
Role Number: 200659247-3337 Summary Join Apple Services Engineering to build the next generation of AI evaluation systems. We are seeking a staff machine learning platform engineer to lead the ...
Machine Learning Platform Engineer, AI Evaluation Platform (All Levels) Join Apple Services Engineering to build the next generation of AI evaluation systems. We are seeking machine learning platform ...
Machine Learning Platform Engineer, AI Evaluation Platform (All Levels) Join Apple Services Engineering to build the next generation of AI evaluation systems. We are seeking machine learning platform ...
Machine Learning Platform Engineer, AI Evaluation Platform (All levels)
Seattle, WA · On-site
$171.60K - $258.10K/yr
Join Apple Services Engineering to build the next generation of AI evaluation systems. We are seeking machine learning platform engineers at multiple levels (Mid-Level to Principal) to architect and ...
Machine Learning Platform Engineer, AI Evaluation Platform (All levels)
Seattle, WA · On-site
$171.60K - $258.10K/yr
Join Apple Services Engineering to build the next generation of AI evaluation systems. We are seeking machine learning platform engineers at multiple levels (Mid-Level to Principal) to architect and ...
ML Research Engineer, AI Evaluation Platform AI systems are only as trustworthy as the methods used to evaluate them. At Apple, where AI powers experiences for billions of people, getting evaluation ...
ML Research Engineer, AI Evaluation Platform AI systems are only as trustworthy as the methods used to evaluate them. At Apple, where AI powers experiences for billions of people, getting evaluation ...
ML Research Engineer, AI Evaluation Platform
Seattle, WA · On-site
$171.60K - $258.10K/yr
At Apple, where AI powers experiences for billions of people, getting evaluation right is not a support function-it is a foundational science. Our team, part of Apple Services Engineering, is ...
ML Research Engineer, AI Evaluation Platform
Seattle, WA · On-site
$171.60K - $258.10K/yr
At Apple, where AI powers experiences for billions of people, getting evaluation right is not a support function-it is a foundational science. Our team, part of Apple Services Engineering, is ...
Senior/Staff Applied ML Engineer - AI/ML Evaluation & Simulation
Seattle, WA · On-site
$171.60K - $302.20K/yr
Senior/Staff Applied ML Engineer - AI/ML Evaluation & Simulation We're building the next generation of AI evaluation systems -- and we're looking for a hands-on engineer who can bridge ML, software ...
Senior/Staff Applied ML Engineer - AI/ML Evaluation & Simulation
Seattle, WA · On-site
$171.60K - $302.20K/yr
Senior/Staff Applied ML Engineer - AI/ML Evaluation & Simulation We're building the next generation of AI evaluation systems -- and we're looking for a hands-on engineer who can bridge ML, software ...
Senior Software Engineer, Agentic AI
Redmond, WA · On-site
$137.20K - $180.90K/yr
... Engineer for their Agentic AI team. The role involves architecting advanced coding agents, scaling ... Create and implement rigorous AI evaluation methodologies to measure the accuracy, safety, and ...
Senior Software Engineer, Agentic AI
Redmond, WA · On-site
$137.20K - $180.90K/yr
... Engineer for their Agentic AI team. The role involves architecting advanced coding agents, scaling ... Create and implement rigorous AI evaluation methodologies to measure the accuracy, safety, and ...
Senior/Staff Applied ML Engineer - AI/ML Evaluation & Simulation
Seattle, WA · On-site
$171.60K - $302.20K/yr
We're building the next generation of AI evaluation systems - and we're looking for a hands-on engineer who can bridge ML, software, and product to make AI systems more measurable, testable, and ...
Senior/Staff Applied ML Engineer - AI/ML Evaluation & Simulation
Seattle, WA · On-site
$171.60K - $302.20K/yr
We're building the next generation of AI evaluation systems - and we're looking for a hands-on engineer who can bridge ML, software, and product to make AI systems more measurable, testable, and ...
Applied ML Engineer - AI/ML Evaluation & Simulation
Seattle, WA · On-site
$120.30K - $210.10K/yr
Applied ML Engineer - AI/ML Evaluation & Simulation We're building the next generation of AI evaluation systems -- and we're looking for a motivated early-career engineer who's excited to work at the ...
Applied ML Engineer - AI/ML Evaluation & Simulation
Seattle, WA · On-site
$120.30K - $210.10K/yr
Applied ML Engineer - AI/ML Evaluation & Simulation We're building the next generation of AI evaluation systems -- and we're looking for a motivated early-career engineer who's excited to work at the ...
Senior Software Engineer, Agentic AI
Redmond, WA · On-site
$137.20K - $180.90K/yr
Develop Evaluation Frameworks: Create and implement rigorous AI evaluation methodologies to measure the accuracy, safety, and efficiency of generated code and agentic logic. * Optimize for ...
Senior Software Engineer, Agentic AI
Redmond, WA · On-site
$137.20K - $180.90K/yr
Develop Evaluation Frameworks: Create and implement rigorous AI evaluation methodologies to measure the accuracy, safety, and efficiency of generated code and agentic logic. * Optimize for ...
Senior Software Engineer, Agentic AI
$137.20K - $180.90K/yr
Develop Evaluation Frameworks: Create and implement rigorous AI evaluation methodologies to measure the accuracy, safety, and efficiency of generated code and agentic logic. * Optimize for ...
Senior Software Engineer, Agentic AI
$137.20K - $180.90K/yr
Develop Evaluation Frameworks: Create and implement rigorous AI evaluation methodologies to measure the accuracy, safety, and efficiency of generated code and agentic logic. * Optimize for ...
... for AI agents - Validating integrations with Power Automate platform - Executing LLM evaluation frameworks using defined metrics - Working with data scientists and ML engineers - Upholding ...
... for AI agents - Validating integrations with Power Automate platform - Executing LLM evaluation frameworks using defined metrics - Working with data scientists and ML engineers - Upholding ...
Research Scientist, AI Evaluation Science
Seattle, WA · On-site
$201.30K - $302.20K/yr
Our team, part of Apple Services Engineering, is building that scientific foundation: rigorous, scalable evaluation methodology for LLMs, agentic systems, and human-AI interaction. What makes this ...
Research Scientist, AI Evaluation Science
Seattle, WA · On-site
$201.30K - $302.20K/yr
Our team, part of Apple Services Engineering, is building that scientific foundation: rigorous, scalable evaluation methodology for LLMs, agentic systems, and human-AI interaction. What makes this ...
Applied ML Engineer - AI/ML Evaluation & Simulation
Seattle, WA · On-site
$120.30K - $210.10K/yr
We're building the next generation of AI evaluation systems - and we're looking for a motivated early-career engineer who's excited to work at the intersection of ML, software, and product. You'll ...
Applied ML Engineer - AI/ML Evaluation & Simulation
Seattle, WA · On-site
$120.30K - $210.10K/yr
We're building the next generation of AI evaluation systems - and we're looking for a motivated early-career engineer who's excited to work at the intersection of ML, software, and product. You'll ...
Staff Machine Learning Platform Engineer, AI Evaluation
Seattle, WA · On-site
$201.30K - $302.20K/yr
Join Apple Services Engineering to build the next generation of AI evaluation systems. We are seeking a staff machine learning platform engineer to lead the architectural design and development of ...
Staff Machine Learning Platform Engineer, AI Evaluation
Seattle, WA · On-site
$201.30K - $302.20K/yr
Join Apple Services Engineering to build the next generation of AI evaluation systems. We are seeking a staff machine learning platform engineer to lead the architectural design and development of ...
Ai Evaluation Engineer information
See Seattle, WA salary details
$29 - $34.29
1% of jobs
$34.29 - $39.59
5% of jobs
$39.59 - $44.89
9% of jobs
$49.46 is the 25th percentile. Wages below this are outliers.
$44.89 - $50.19
12% of jobs
$50.19 - $55.48
10% of jobs
The median wage is $60.40 / hr.
$55.48 - $60.78
15% of jobs
$60.78 - $66.08
15% of jobs
$69.83 is the 75th percentile. Wages above this are outliers.
$66.08 - $71.38
13% of jobs
$71.38 - $76.67
10% of jobs
$76.67 - $81.97
10% of jobs
$81.97 - $87.27
2% of jobs
$28
$61
$87
How much do ai evaluation engineer jobs pay per hour?
Member of Technical Staff - Copilot AI Evaluation Engineering Manager
Microsoft AIRedmond, WA • On-site
Full-time
This job post has expired today. Applications are no longer accepted.
Job description
Microsoft AI is seeking an experienced Member of Technical Staff - Copilot AI Evaluation Engineering Manager to lead building LLM evaluation solutions for Copilot. The role involves managing a team of engineers to deliver evaluation solutions while collaborating with cross-functional teams to improve technology for millions of users.
Responsibilities:
• Hire, manage, and lead a team of software engineers, AI engineers, and machine learning engineers responsible for delivering world-class LLM evaluation solutions.
• Collaborate with Eng and Product leadership to prioritize features and improve our world-class AI companion to the world
• Design and build evaluation platforms, novel evaluation techniques, and agentic solutions for measuring and improving copilot quality.
• Drive implementation of features and systems, breaking down long-term goals into clear milestones, aligning with release plans, and ensuring cross-team coordination.
• Embody our Culture and Values.
Qualifications:
Required:
• Bachelor's Degree in Computer Science, or related technical discipline AND 6+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
Preferred:
• Bachelor's Degree in Computer Science, or related technical discipline AND 8+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR Master's Degree in Computer Science or related technical field AND 8+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience.
• 3+ years people management experience.
• Hands on experience with ML and/or AI evaluation OR equivalent experience.
• Experience leading engineering teams to deliver large-scale software systems, preferably in AI, machine learning, graphics or related fields.
• Thrive in a fast-paced, collaborative environment and are comfortable making progress in ambiguity.
• Enjoy working closely with cross-functional partners and teammates in an inclusive, curious culture.
• Have strong opinions about best investments to make in establishing the most delightful and performant AI companion engineering system.
Company:
Microsoft AI is a software development company. Founded in 2024, the company is headquartered in Redmond, USA, with a team of 5001-10000 employees. The company is currently Late Stage.