1

Ai Evaluation Engineer Jobs in Seattle, WA (NOW HIRING)

Senior Software Engineer, Agentic AI

Redmond, WA · On-site

$137.20K - $180.90K/yr

... Engineer for their Agentic AI team. The role involves architecting advanced coding agents, scaling ... Create and implement rigorous AI evaluation methodologies to measure the accuracy, safety, and ...

Senior Software Engineer, Agentic AI

Redmond, WA

$137.20K - $180.90K/yr

Develop Evaluation Frameworks: Create and implement rigorous AI evaluation methodologies to measure the accuracy, safety, and efficiency of generated code and agentic logic. * Optimize for ...

Our team, part of Apple Services Engineering, is building that scientific foundation: rigorous, scalable evaluation methodology for LLMs, agentic systems, and human-AI interaction. What makes this ...

next page

Showing results 1-20

Ai Evaluation Engineer information

See Seattle, WA salary details

$28

$61

$87

How much do ai evaluation engineer jobs pay per hour?

As of May 28, 2026, the average hourly pay for ai evaluation engineer in Seattle, WA is $61.03, according to ZipRecruiter salary data. Most workers in this role earn between $49.23 and $70.87 per hour, depending on experience, location, and employer.
What are popular job titles related to Ai Evaluation Engineer jobs in Seattle, WA? For Ai Evaluation Engineer jobs in Seattle, WA, the most frequently searched job titles are:
What job categories do people searching Ai Evaluation Engineer jobs in Seattle, WA look for? The top searched job categories for Ai Evaluation Engineer jobs in Seattle, WA are:

Member of Technical Staff - Copilot AI Evaluation Engineering Manager

Microsoft AI

Redmond, WA • On-site

Full-time

This job post has expired today. Applications are no longer accepted.


Job description

Job Summary:
Microsoft AI is seeking an experienced Member of Technical Staff - Copilot AI Evaluation Engineering Manager to lead building LLM evaluation solutions for Copilot. The role involves managing a team of engineers to deliver evaluation solutions while collaborating with cross-functional teams to improve technology for millions of users.
Responsibilities:
• Hire, manage, and lead a team of software engineers, AI engineers, and machine learning engineers responsible for delivering world-class LLM evaluation solutions.
• Collaborate with Eng and Product leadership to prioritize features and improve our world-class AI companion to the world
• Design and build evaluation platforms, novel evaluation techniques, and agentic solutions for measuring and improving copilot quality.
• Drive implementation of features and systems, breaking down long-term goals into clear milestones, aligning with release plans, and ensuring cross-team coordination.
• Embody our Culture and Values.
Qualifications:
Required:
• Bachelor's Degree in Computer Science, or related technical discipline AND 6+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
Preferred:
• Bachelor's Degree in Computer Science, or related technical discipline AND 8+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR Master's Degree in Computer Science or related technical field AND 8+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience.
• 3+ years people management experience.
• Hands on experience with ML and/or AI evaluation OR equivalent experience.
• Experience leading engineering teams to deliver large-scale software systems, preferably in AI, machine learning, graphics or related fields.
• Thrive in a fast-paced, collaborative environment and are comfortable making progress in ambiguity.
• Enjoy working closely with cross-functional partners and teammates in an inclusive, curious culture.
• Have strong opinions about best investments to make in establishing the most delightful and performant AI companion engineering system.
Company:
Microsoft AI is a software development company. Founded in 2024, the company is headquartered in Redmond, USA, with a team of 5001-10000 employees. The company is currently Late Stage.