In this role, you will guide a team responsible for the critical data and evaluation pipelines that ... Description As the Engineering Manager for this team, you will be at the forefront of our AI/ML ...
In this role, you will guide a team responsible for the critical data and evaluation pipelines that ... Description As the Engineering Manager for this team, you will be at the forefront of our AI/ML ...
Associate Director of Data & Evaluation
Los Angeles, CA · On-site
$100 - $140/hr
They will have extensive experience with data management, program evaluation, and outcome reporting, preferably in a non-profit setting. The Associate Director will drive data strategy and program ...
Associate Director of Data & Evaluation
Los Angeles, CA · On-site
$100 - $140/hr
They will have extensive experience with data management, program evaluation, and outcome reporting, preferably in a non-profit setting. The Associate Director will drive data strategy and program ...
Maintain organized and accurate documentation, case records, and evaluation data * Provide expert ... Management or supervisory experience in a forensic or clinical setting * Prior experience providing ...
Maintain organized and accurate documentation, case records, and evaluation data * Provide expert ... Management or supervisory experience in a forensic or clinical setting * Prior experience providing ...
Algorithm Evaluation Manager
$206K - $356K/yr
In this role, you will guide a team responsible for the critical data and evaluation pipelines that ... Description As the Engineering Manager for this team, you will be at the forefront of our AI/ML ...
Algorithm Evaluation Manager
$206K - $356K/yr
In this role, you will guide a team responsible for the critical data and evaluation pipelines that ... Description As the Engineering Manager for this team, you will be at the forefront of our AI/ML ...
Associate Director of Data & Evaluation
Los Angeles, CA · On-site
$90 - $120/hr
They will have extensive experience with data management, program evaluation, and outcome reporting, preferably in a non-profit setting. The Associate Director will drive data strategy and program ...
Associate Director of Data & Evaluation
Los Angeles, CA · On-site
$90 - $120/hr
They will have extensive experience with data management, program evaluation, and outcome reporting, preferably in a non-profit setting. The Associate Director will drive data strategy and program ...
Forensic Evaluation Manager
Los Angeles, CA · On-site
$121 - $136/hr
Maintain accurate documentation, case records, and evaluation data * Provide expert testimony in ... Ability to manage multiple priorities and meet deadlines in a high‑demand environment * Strong ...
Forensic Evaluation Manager
Los Angeles, CA · On-site
$121 - $136/hr
Maintain accurate documentation, case records, and evaluation data * Provide expert testimony in ... Ability to manage multiple priorities and meet deadlines in a high‑demand environment * Strong ...
Data Manager
San Diego, CA · On-site
The Data Manager serves as the primary architect and administrator of the organization's data ... Lead and support data collection efforts toward data evaluation, driven by program outcomes
Data Manager
San Diego, CA · On-site
The Data Manager serves as the primary architect and administrator of the organization's data ... Lead and support data collection efforts toward data evaluation, driven by program outcomes
Data Manager
Chatsworth, CA · On-site
$70K/yr
Reporting to the Director of Data & Evaluation, the Data Manager leads a team of Data Coordinators and quality assurance staff. They oversee data management, analysis, contract compliance, and HMIS ...
Quick apply
Data Manager
Chatsworth, CA · On-site
$70K/yr
Reporting to the Director of Data & Evaluation, the Data Manager leads a team of Data Coordinators and quality assurance staff. They oversee data management, analysis, contract compliance, and HMIS ...
Technical Program Manager, Evaluation & Validation
Sunnyvale, CA · On-site
$214K - $274K/yr
The role As a Technical Program Manager in Simulation, Evaluation & Validation at Wayve, you'll ... Data-driven: Comfortable defining and using metrics - signal quality, coverage, time-to-insight ...
Technical Program Manager, Evaluation & Validation
Sunnyvale, CA · On-site
$214K - $274K/yr
The role As a Technical Program Manager in Simulation, Evaluation & Validation at Wayve, you'll ... Data-driven: Comfortable defining and using metrics - signal quality, coverage, time-to-insight ...
... Data Evaluation: Assess sample datasets for coverage, quality, refresh frequency, schema design, and interoperability with Fabrion's knowledge graphs. • Partnership Pipeline: Maintain CRM-style ...
... Data Evaluation: Assess sample datasets for coverage, quality, refresh frequency, schema design, and interoperability with Fabrion's knowledge graphs. • Partnership Pipeline: Maintain CRM-style ...
ABOUT THE ROLE We're looking for a manager to lead a team of researchers to focus on data evaluation, error analysis and data valuation methods to predict model performance. This team is responsible ...
ABOUT THE ROLE We're looking for a manager to lead a team of researchers to focus on data evaluation, error analysis and data valuation methods to predict model performance. This team is responsible ...
The company is seeking a Director of Research to lead a team focused on data evaluation and ... Required : • 7+ years in applied AI, ML, or research roles, with 4+ years managing technical ...
The company is seeking a Director of Research to lead a team focused on data evaluation and ... Required : • 7+ years in applied AI, ML, or research roles, with 4+ years managing technical ...
We seek a highly skilled and experienced Test & Evaluation Manager who is passionate about ... Your team will perform and supervise data analysis related to system performance during lab and ...
We seek a highly skilled and experienced Test & Evaluation Manager who is passionate about ... Your team will perform and supervise data analysis related to system performance during lab and ...
Data Platform Engineer
San Francisco, CA · On-site
$200K - $400K/yr
Monaco is building an AI-native revenue platform that replaces the fragmented GTM stack - CRM, ... Support ML workflows: training data, evaluation, embeddings, feature pipelines. * Solve distributed ...
Data Platform Engineer
San Francisco, CA · On-site
$200K - $400K/yr
Monaco is building an AI-native revenue platform that replaces the fragmented GTM stack - CRM, ... Support ML workflows: training data, evaluation, embeddings, feature pipelines. * Solve distributed ...
We seek a highly skilled and experienced Test & Evaluation Manager who is passionate about ... Your team will perform and supervise data analysis related to system performance during lab and ...
We seek a highly skilled and experienced Test & Evaluation Manager who is passionate about ... Your team will perform and supervise data analysis related to system performance during lab and ...
Data Platform Engineer
San Francisco, CA · On-site
$150 - $210/hr
Monaco is building an AI-native revenue platform that replaces the fragmented GTM stack (CRM, ... Support ML workflows: training data, evaluation, embeddings, feature pipelines. * Solve distributed ...
Data Platform Engineer
San Francisco, CA · On-site
$150 - $210/hr
Monaco is building an AI-native revenue platform that replaces the fragmented GTM stack (CRM, ... Support ML workflows: training data, evaluation, embeddings, feature pipelines. * Solve distributed ...
Data Partnerships Analyst
Bodega Bay, CA · On-site
Data Evaluation : Assess sample datasets for coverage, quality, refresh frequency, schema design, and interoperability with Fabrion's knowledge graphs. * Partnership Pipeline : Maintain CRM-style ...
Quick apply
Data Partnerships Analyst
Bodega Bay, CA · On-site
Data Evaluation : Assess sample datasets for coverage, quality, refresh frequency, schema design, and interoperability with Fabrion's knowledge graphs. * Partnership Pipeline : Maintain CRM-style ...
CA · On-site
$95 - $125/hr
Working knowledge of the ML lifecycle, including data preparation, training, evaluation, deployment, and monitoring. * Experience managing technical dependencies across research, engineering ...
New
CA · On-site
$95 - $125/hr
Working knowledge of the ML lifecycle, including data preparation, training, evaluation, deployment, and monitoring. * Experience managing technical dependencies across research, engineering ...
New
Technical Program Manager- LLM supporting Nvidia
Santa Clara, CA · On-site
$95 - $125/hr
Working knowledge of the ML lifecycle, including data preparation, training, evaluation, deployment, and monitoring. * Experience managing technical dependencies across research, engineering ...
Technical Program Manager- LLM supporting Nvidia
Santa Clara, CA · On-site
$95 - $125/hr
Working knowledge of the ML lifecycle, including data preparation, training, evaluation, deployment, and monitoring. * Experience managing technical dependencies across research, engineering ...
Technical Program Manager- LLM supporting Nvidia
Santa Clara, CA · On-site
$95 - $125/hr
Working knowledge of the ML lifecycle, including data preparation, training, evaluation, deployment, and monitoring. * Experience managing technical dependencies across research, engineering ...
New
Technical Program Manager- LLM supporting Nvidia
Santa Clara, CA · On-site
$95 - $125/hr
Working knowledge of the ML lifecycle, including data preparation, training, evaluation, deployment, and monitoring. * Experience managing technical dependencies across research, engineering ...
New
Data Evaluation Manager information
What is a data evaluation manager?
Data Evaluation Managers are professionals responsible for overseeing the assessment, analysis, and interpretation of data within an organization. They ensure that collected data is accurate, relevant, and effectively used to inform business decisions. Their role often includes developing evaluation frameworks, managing data collection processes, and presenting findings to stakeholders. Data Evaluation Managers may work in various sectors, including business, healthcare, and education, to improve programs and strategies based on data insights.
How does a data evaluation manager typically collaborate with other departments within an organization?
Data Evaluation Managers frequently work cross-functionally, partnering with teams such as IT, data analytics, operations, and business strategy to ensure that data collection, analysis, and interpretation align with organizational goals. They may lead meetings to discuss data needs, coordinate with analysts to clarify evaluation methodologies, and present findings to decision-makers. Effective collaboration ensures that data-driven insights are actionable and relevant, and it often involves translating complex data concepts into clear recommendations for non-technical stakeholders.
What are the key skills and qualifications needed to thrive as a data evaluation manager, and why are they important?
To thrive as a Data Evaluation Manager, you need strong analytical skills, expertise in data analysis methodologies, and a background in statistics or a related field, typically supported by a relevant degree. Familiarity with data visualization tools (such as Tableau or Power BI), statistical software (like R or SPSS), and database management systems is essential. Excellent communication, leadership, and problem-solving abilities help you translate complex data insights into actionable recommendations and lead cross-functional teams effectively. These skills are crucial for ensuring accurate data-driven decision-making and maximizing the value of organizational data assets.
What is the difference between Data Evaluation Manager vs Data Analyst?
| Aspect | Data Evaluation Manager | Data Analyst |
|---|---|---|
| Required Credentials | Bachelor's degree in data science, statistics, or related field; experience in data management | Bachelor's degree in data analysis, statistics, or related field; proficiency in data tools |
| Work Environment | Oversees data evaluation teams, manages data quality processes, collaborates with stakeholders | Analyzes data sets, creates reports, supports decision-making |
| Employer & Industry Usage | Used in organizations with large data teams, focus on data quality and evaluation | Common across industries for data reporting and insights |
The Data Evaluation Manager focuses on overseeing data quality, evaluation processes, and team management, ensuring data integrity for strategic decisions. In contrast, Data Analysts primarily analyze data sets, generate reports, and support operational and business insights. While both roles require similar educational backgrounds, the Manager role involves leadership and process oversight, whereas the Analyst role emphasizes data analysis skills.
What are popular job titles related to Data Evaluation Manager jobs in California?
For Data Evaluation Manager jobs in California, the most frequently searched job titles are:
What job categories do people searching Data Evaluation Manager jobs in California look for?
The top searched job categories for Data Evaluation Manager jobs in California are:
What cities in California are hiring for Data Evaluation Manager jobs?
Cities in California with the most Data Evaluation Manager job openings:
Algorithm Evaluation Manager
Sunnyvale, CA • On-site
Apple •
Computer and Electronic Product Manufacturing • 10K+ employees10,000+ employees
8.0
Based on 677 frontline employees who took The Breakroom Quiz
7th of 30 rated technology retailers
People enjoy working here
Good employer
Recommended by students
Paid breaks
Recommended by parents
Full-time
Re-posted 27 days ago
Job description
We are looking for an experienced and highly motivated Engineering Manager to lead a dynamic team focused on machine learning algorithms or Large Language Model (LM) evaluation. In this role, you will guide a team responsible for the critical data and evaluation pipelines that ensure our models are accurate, robust, and performant. The ideal candidate will bring a strong mix of technical leadership, expertise in data curation and annotation processes, and deep analytical skills. You will collaborate closely with cross-functional research and engineering teams, requiring exceptional communication and strategic thinking.
Description
As the Engineering Manager for this team, you will be at the forefront of our AI/ML development lifecycle. Your day-to-day responsibilities will include:
- Team Leadership: Lead, mentor, and grow a team of engineers and data specialists. Foster a culture of innovation, rigorous analysis, and continuous learning.
- Evaluation Strategy: Define and execute the evaluation strategy for both CV and LM models. Build robust, scalable evaluation pipelines that accurately reflect real-world performance.
- Data Pipeline Management: Oversee the end-to-end data lifecycle. This includes establishing data curation guidelines, managing data quality, and optimizing large-scale annotation workflows with external vendors or internal teams.
- Analytical Deep Dives: Guide the team in performing rigorous data analysis to troubleshoot model regressions, uncover data quality issues, and identify opportunities for algorithmic improvements.
- Strategic Alignment: Act as the primary point of contact for your team, communicating progress, bottlenecks, and strategic data needs to leadership and partner teams.
Minimum Qualifications
Education & Experience: BS and a minimum of 10 years relevant industry experience
Management Experience: 2+ years of direct people management experience, with a track record of hiring, mentoring, and leading high-performing technical teams.
Domain Expertise: Proven experience in model evaluation, benchmarking, and A/B testing methodologies for machine learning models (Computer Vision or Foundation Models).
Inference Infrastructure: Familiarity with the design and architecture of machine learning inference pipelines and underlying infrastructure.
Data & Annotation: Hands-on experience designing and managing data curation strategies and human-in-the-loop annotation processes.
Data Analysis: Strong analytical skills with the ability to dive deep into datasets to identify trends, biases, and areas for model improvement.
Communication: Excellent verbal and written communication skills, with the ability to translate complex technical concepts to both technical and non-technical stakeholders.
Preferred Qualifications
Advanced Degree: PhD in Computer Science, Machine Learning, or a related field.
Deep Domain Knowledge: Expertise in both Computer Vision (CV) algorithms and Large Language Model (LM) evaluation methodologies (e.g., RLHF, prompt evaluation).
Scale & Operations: Experience scaling large data operations, managing complex annotation workflows, and working directly with external data vendors.
Technical Stack: Familiarity with Python, SQL, and ML frameworks (e.g., PyTorch) to effectively review technical work and guide engineering decisions.
Cross-Functional Leadership: Demonstrated ability to drive strategic alignment across downstream product teams, ML researchers, and platform engineers in a highly matrixed environment.
Description
As the Engineering Manager for this team, you will be at the forefront of our AI/ML development lifecycle. Your day-to-day responsibilities will include:
- Team Leadership: Lead, mentor, and grow a team of engineers and data specialists. Foster a culture of innovation, rigorous analysis, and continuous learning.
- Evaluation Strategy: Define and execute the evaluation strategy for both CV and LM models. Build robust, scalable evaluation pipelines that accurately reflect real-world performance.
- Data Pipeline Management: Oversee the end-to-end data lifecycle. This includes establishing data curation guidelines, managing data quality, and optimizing large-scale annotation workflows with external vendors or internal teams.
- Analytical Deep Dives: Guide the team in performing rigorous data analysis to troubleshoot model regressions, uncover data quality issues, and identify opportunities for algorithmic improvements.
- Strategic Alignment: Act as the primary point of contact for your team, communicating progress, bottlenecks, and strategic data needs to leadership and partner teams.
Minimum Qualifications
Education & Experience: BS and a minimum of 10 years relevant industry experience
Management Experience: 2+ years of direct people management experience, with a track record of hiring, mentoring, and leading high-performing technical teams.
Domain Expertise: Proven experience in model evaluation, benchmarking, and A/B testing methodologies for machine learning models (Computer Vision or Foundation Models).
Inference Infrastructure: Familiarity with the design and architecture of machine learning inference pipelines and underlying infrastructure.
Data & Annotation: Hands-on experience designing and managing data curation strategies and human-in-the-loop annotation processes.
Data Analysis: Strong analytical skills with the ability to dive deep into datasets to identify trends, biases, and areas for model improvement.
Communication: Excellent verbal and written communication skills, with the ability to translate complex technical concepts to both technical and non-technical stakeholders.
Preferred Qualifications
Advanced Degree: PhD in Computer Science, Machine Learning, or a related field.
Deep Domain Knowledge: Expertise in both Computer Vision (CV) algorithms and Large Language Model (LM) evaluation methodologies (e.g., RLHF, prompt evaluation).
Scale & Operations: Experience scaling large data operations, managing complex annotation workflows, and working directly with external data vendors.
Technical Stack: Familiarity with Python, SQL, and ML frameworks (e.g., PyTorch) to effectively review technical work and guide engineering decisions.
Cross-Functional Leadership: Demonstrated ability to drive strategic alignment across downstream product teams, ML researchers, and platform engineers in a highly matrixed environment.
About Apple
Sourced by ZipRecruiter
Imagine what you could do here! At Apple, new ideas have a way of becoming extraordinary products, services, and customer experiences very quickly. Bring passion and dedication to your job and there's no telling what you could accomplish. Dynamic, intelligent people and inspiring, innovative technologies are the norm here. The people who work here have reinvented entire industries with all Apple Hardware products. The same real passion for innovation that goes into our products also applies to our practices strengthening our dedication to leave the world better than we found it.
Industry
Computer and electronic product manufacturing
Company size
10,000+ Employees
Headquarters location
Cupertino, CA, US
Year founded
1976
