Flywheel Partners Jobs in Missouri (NOW HIRING)

Owning the eval flywheel's strategy and architecture: how road and simulation driving data becomes curated golden datasets, how metrics are measured against them (precision/recall), and how those results earn lasting trust with the teams that depend on them.
Setting the standard for evaluation quality: golden dataset curation, versioning, and health; metric performance measurement; and release processes that keep results dependable as the system evolves.
Building the tooling that helps our metric developers iterate quickly: self-serve dataset pipelines, metric performance measurement, and quality reporting used every day by the team and our partners.
Partnering with senior engineers and leaders across test engineering, behavior planning, and infrastructure — setting expectations, working through trade-offs, and being the voice of evaluation quality in cross-team decisions.
Working directly with AI model developers so evaluation iteration speed becomes an advantage for the whole program, including our push into learned, VLM-based evaluation.

Requirements

• 12+ years building software, with significant time in autonomous vehicles, robotics, or large-scale ML systems.
• Deep experience evaluating ML or robotic systems: metric design, ground-truth and golden dataset curation, precision/recall methodology, and the data pipelines behind them.
• Strong Python and data engineering skills for production-scale pipelines.
• BS or MS in Computer Science, Robotics, or a related field (or equivalent experience).

Core Competencies

Demonstrates expertise in building and evaluating machine learning systems, with a focus on golden dataset curation, metric performance measurement, and data pipeline development. Strong collaboration with cross-functional teams to ensure evaluation quality and system reliability.

Highest-signal resume keywords

• Machine Learning Evaluation
• Golden Dataset Curation
• Metric Performance Measurement
• Python Programming
• Data Engineering

ATS Optimization KeywordsHard Skills

• Machine Learning
• Metric Design
• Ground-Truth Curation
• Precision/Recall Methodology
• Data Pipeline Development
• Software Development
• Robotics
• Autonomous Vehicles
• Large-Scale ML Systems
• Quality Reporting

Soft Skills

• Collaboration
• Communication
• Strategic Thinking
• Problem Solving

Industry Keywords

• Autonomous Vehicles
• Robotics
• Machine Learning Systems
• Evaluation Quality
• Versioning
• Release Processes

Tools & Technologies

• Data Pipelines
• Self-Serve Dataset Tools
• Quality Reporting Tools