Remote Evaluation Jobs in Colorado (NOW HIRING)

ABOUT THE ORGANIZATION Yorktown Systems Group, Inc., and its wholly-owned subsidiaries, are a committed team of dedicated former military and civilian professionals who believe in providing ethical and quality services to Government customers. Our leadership team is composed primarily of Veterans who are now serving in a corporate environment rather than in uniform. Our customer's missions become our own and we are committed to working as a team to achieve success. Because of the depth and experiences of our corporate leadership, we can assure all our customers that "we will do what we say we can do" and will focus on our customer's missions rather than corporate goals. Our business model is based on a personal commitment from our leaders to maintain contact with our customers to continually and consistently gauge our performance. Yorktown Systems Group was founded on the idea that providing quality and ethical services with a laser focus on our customer's goals is an effective long-term business model. Our mission, therefore, is to help our customers meet their requirements and goals. The contractor will not discharge or in any other manner discriminate against any employee or applicant for employment because such employee or applicant has inquired about, discussed, or disclosed the compensation of the employee or applicant or another employee or applicant. This provision shall not apply to instances in which an employee who has access to the compensation information of other employees or applicants as a part of such employee's essential job functions discloses the compensation of such other employees or applicants to individuals who do not otherwise have access to such information, unless such disclosure is in response to a formal complaint or charge, in furtherance of an investigation, proceeding, hearing, or action, including an investigation conducted by the employer, or is consistent with the contractor's legal duty to furnish information. The Unconventional, LLC is a wholly-owned subsidiary of Yorktown Systems Group, Inc.
Job Title
Evaluation and Research Director, USAFA
Location
Colorado Springs, CO - Colorado Springs, CO 80903 US (Primary)
Remote, Virtual, US - AL US
Job Description
Summary:
Yorktown Systems Group, Inc. (YSG) is seeking a highly qualified Evaluation and Research Director to provide comprehensive Warfighter Training Support Services at the United States Air Force Academy (USAFA). The purpose of this position is to support the planning, development, execution, management, and evaluation of military training for approximately 4,200 cadets annually during both the academic year and summer training programs. This position will assist the USAFA in delivering a coherent, progressive, and operationally relevant 47-month cumulative military training continuum aligned with Department of the Air Force (DAF) readiness objectives, Joint Force expectations, and USAFA cadet development outcomes.
Specific duties may include, but are not limited to:

• Serves as the lead and primary Evaluation and Research representative, providing management and oversight of the Evaluation & Research Team, as well as being the point of contact for all program Evaluation & Research activities/efforts.
• Convert execution findings into future planning inputs
• Aggregate and analyze performance data across events, cohorts, and training cycles within the Moodle/TUTOR VSP to identify trends, systemic strengths, and recurring performance gaps.
• Work with USAFA leadership, instructional designers, and training support personnel to ensure evaluation methodologies, performance measures, and assessment requirements remain aligned with program objectives.
• Convert evaluation findings, performance trends, and lessons learned into recommendations that support refinement of warfighter competencies, training effectiveness, learning outcomes, and program improvement initiatives.
• Converts execution observations, metrics, and lessons learned into resource planning inputs that inform future assessments, refinement, and recommendations.
• Capture observations, rubric results, AAR inputs, instructor feedback, participant performance data, and lessons learned during and after training events.
• Collectively execute all program evaluation activities across the WTIS framework.
• Apply Kirkpatrick's four-level training evaluation model within a repeatable process that integrates assessment tool development, disciplined data capture, structured AAR consolidation, and performance analysis within the required environment and tools.
• Define and maintain the data structure and workflows required to capture, store, and export evaluation data in a manner that supports consistent analysis.
• Conducts analytical review of existing and available Program of Instruction (POI), courseware, lesson materials, exercise scenarios, training schedules, TLOs, ELOs, primary tasks and objectives, evaluation criteria, recurring training events, historical planning products, and after-action inputs.
• Use assessment data and other evaluation inputs to develop dashboard reporting, leadership briefings, annual program assessments, and evidence-based recommendations for program improvement.
• Design and execute qualitative and quantitative research studies that assess cadet development, training effectiveness, and progression across the military training continuum.
• Prepare executive-level reports, dashboards, briefings, and recommendations for USAFA leadership utilizing evaluation findings and performance trends.
• Ensure evaluation methodologies, data collection activities, and reporting processes meet accepted standards for program evaluation, research integrity, and statistical validity

Job Requirements
Required Qualifications:

• Must possess 8+ years experience as an evaluation and/or research lead.
• Graduate degree in Program Evaluation, Education Statistics, Social Science, Research Methods, Organizational Development, or related field.
• Training/certification in evaluation methodologies (e.g., ROI Institute, Kirkpatrick).
• Experience supporting assessment frameworks, AAR methodology, rubric development, data analysis, trend reporting, and presentation of findings to stakeholders.
• Experience evaluating programs/projects; creation of evaluation plans and logic models; developing data collection tools and procedures; facilitating data collection; conducting statistical analysis of data; writing evaluation reports and providing statistical analysis of programs of similar scale and duration.
• Possess an in-depth and current understanding of program evaluation including the four major categories of standards (propriety, utility, feasibility, and accuracy) when conducting a program evaluation.
• Ability to evaluate the implementation and effectiveness of key initiatives and programs through the use of quantitative and qualitative research methods, and to provide results that inform policymakers and stakeholders' decisions regarding program viability and improvement.
• Ability to capture, conduct analysis, and organize collected.
• Possess an in-depth and current understanding of research and evaluation methods and techniques.

Clearance: Must be able to obtain a SECRET security clearance.
Location: Colorado Springs, CO / Remote
Travel: Some travel will be required
Security Clearance
Eligible for Secret Security Clearance (1)
Travel
Some travel may be required
Job Type
Full-Time
Exemption Type
Exempt
Category
Contractors
EEO STATEMENT Yorktown Systems Group, Inc., and its wholly-owned subsidiaries, are an Equal Opportunity Employer. No employee or applicant for employment is denied equal opportunity because of race, color, sex, national origin, religion, age, disability, marital status, pregnancy, sexual orientation, gender identity, genetic information, any other non-merit-based factor, or other characteristics protected by law. As part of the company's equal employment opportunity policy, Yorktown Systems Group, Inc., and its subsidiaries, will also take affirmative action as called for by applicable laws and Executive Orders to ensure that minority group individuals, females, disabled veterans, recently separated veterans, other protected veterans, Armed Forces service medal veterans, and qualified disabled persons are introduced into our workforce and considered for promotional opportunities. The Unconventional, LLC. is a wholly-owned subsidiary of Yorktown Systems Group, Inc.