Remote Assessment Scorer Jobs (NOW HIRING)

Senior Director I, AP Math, Curriculum and Assessment

College Board-AP

Location:This is a remote role. Candidates who live near CB offices have theoptionof being fully remote or hybrid (Tuesday and Wednesday in office). All CB employeesare required tooccasionally travel to meet in person for business purposes.

Role Type:This is a full-time position

About the Team

The AP Curriculum and Assessment Team at College Board (125+ staff) collaborates with colleagues across all aspects of the AP Program to develop, manage, and deliver AP's 43courses in a wide variety of subject areas. AP is a rigorous academic program built on the commitment, passion, and hard work of students and educators from secondary schools and higher education. AP provides willing and academically prepared high school students with the opportunity to study and learn at the college level. AP'scourse teamscomprised ofeducators and disciplinary expertsensure that course curricula are aligned to higher education expectations and reflect the state of the art in the discipline, contribute to instructional resources and tools for teachers, and develop assessments that allow students in these courses to demonstrate their mastery of course content and skills.AP leads in strategic use of AI to expand student access, strengthen instructional design and professional support, and enhanceassessmentcreation and exam analysis.The Math and Computer Science department, which includes computer science, precalculus, calculus, and statistics, is currently made up of 11 people supporting 6 courses in the AP portfolio.

About the Opportunity

As theSenior Director I, APMathAssessment Generalistyou willbe responsible forpreserving and improving the quality and validity of the AP Program's core deliverables within the subject domain: the exam, the course curriculum, and the professional development content. You are also responsible for item development and management from authoring to administration across multiple course titles; training and collaborating with subject-matter experts (SMEs), typically college professors and secondary school teachers. You will ethically and effectively integrate AI technologies in assessment creation and review, providing leadership and modeling for course experts across multiple course titles. This includes judiciously using AIassistedtools to support fairness, validity, and innovation in AP assessments. You will train SMEs on assessment development protocols, translate between academics and technical experts (psychometricians), and collaborate to develop formative assessment materials and resources to support AP Precalculus, Calculus, and Statistics teachers worldwide. You will serve as a point of contact in AP for committees and communities of subject-matter experts and will be responsible for the curriculum and assessment for AP Precalculus, Calculus, and Statistics, and, in partnership with other AP teams, further the strategic growth of AP Precalculus, Calculus, and Statistics across the globe. Additionally, you may have the opportunity to present, speak, and moderate dialogue with academic and membership audiences to ensure that ongoing change and improvement within AP courses and exams is understood, accepted, and supported in secondary and post-secondary educational communities.

In this role, you will:

AssessmentDevelopment and Scoring(40-50%)

• Serve as an assessment leader for APPrecalculus, Calculus, and Statistics,with primary responsibility for assessment developmentand finalassessment(items and forms)approvalfor APPrecalculus, Calculus, and StatisticsYourwork will vary from year to year, with accountability across multiple test titles, requiring assessment and content domainexpertiseacross multiple subject areas. You will be accountable for developing and reviewingcontent, andproviding final program sign-off on test forms. You will be assigned work based upon needs that vary year to year, which means you will be accountable forseamlessly moving in and out of assessment workstreams across subjects,leveragingyourexpertiseabout assessment, assessment processes, and content domainexpertise.Your work in developing and revising test content is of the quality that typically requires no adjustments based on feedback from your manager and other program leaders.

• Independently leadprocesses forauthoringandrevising assessment content, includingtraining educator constituents. Leveragegenerative AI (asappropriate forsubject/discipline)to authorand/or reviewassessment contentto improve and/or make more efficientassessmentprocesses and outputs.

• Independently leadthe development and management of assessment content(formative and summative) and scoring materialsfor APPrecalculus, Calculus, and Statisticsthrough iterative review stages with multiple internal and external stakeholders, includingtheAPPrecalculus, Calculus, and StatisticsTeam, Assessment Production team, Test Development Committee, and the Chief Reader, as appropriate.

• Independently leadthedevelopment of assessment formsfor APPrecalculus, Calculus, and Statistics, ensuring the AP Exam development aligns with approved curricula and test specifications.

• Leadmultiple face-to-face, weekend meetings, and virtual meetings (during work week, evenings, or weekends) annually withthe APPrecalculus, Calculus, and StatisticsTest Development Committees.Youindependentlystrategize and develop an agenda and approach to ensure the committee's meeting time is of the highest productivity; you successfully adapt and pivot during the meeting as needed; and you successfully resolve all post-meeting item content edits.

• Train and directly superviseTest DevelopmentCommittee members in APPrecalculus, Calculus, and Statisticsas content development contributorsand reviewers.

• Leadthe successful scoring of studentresponses for APPrecalculus, Calculus, and StatisticsExams at the annual scoring event in person and online-the "AP Reading"-and produce AP Reading publications materials for teacher and student use.Youindependentlyplan all-year, with increasing intensity in the months leading up to the Reading, ensuring all workflow steps for this incredibly complex event, as well as all post-Reading activities,are accounted for and successfully executed.

AssessmentQuality and Process(25-30%)

• Contribute to current research and best practices in assessment, and engage regularly with AP Curriculum & Assessment colleagues to align on standards and shared principles guiding AP's assessment directions

• Providefunctional leadership of cross-subjectassessment workstreamsto ensure consistency and leverage efficiencies.Will serve asan expert resource for course team and leadership consultation.

• Provide formal training and informal mentoring to other Course Experts within yourAPPrecalculus, Calculus, and Statistics team, based onneed.

• Develop strong efficiencies in item development through well-defined and well-documented task models,item development training and processes, and highly effective use of generative AI.

• Independently lead(with limited managerialsupport)initiativesto refine and improve question task models as well as exam design in collaboration with AP Curriculum & Assessment leaders and aligned to other College BoardinitiativesincludingAIinnovationandprofessional learningbestpractices thatscaleassessmenttoachieve psychometric and disciplinary best practices on APPrecalculus, Calculus, and Statisticsexams.

• Monitor exam validity,security,reliability, fairness, and quality, as well as reader reliabilityin accordance withestablished Program thresholdsforAPPrecalculus, Calculus, and Statisticsexams.Identifyareas for improvement and independently(with limited managerialsupport)leadandexecute targeted initiatives to improve.

• Collaborate with psychometrics and AP Curriculum & Assessment staff toestablishfair, reliable, and valid cut scores for APPrecalculus, Calculus, and Statisticsexams.

Staff Development and Capacity Building(25-30%)

• Train and support course experts in assessment development practices, including quality, validity, fairness, and use of generative AI, deepening their understanding of theitem and test development lifecycle, and effective use of item authoring and item bank platforms.

• Mentor team members in effectivelyfacilitatingtest development committees and working with external stakeholders.

Course DevelopmentandProgramSupport(0-10%)

• Refine and improve APPrecalculus, Calculus, and StatisticsCourse Frameworks to ensure clear and explicitlearning outcomes thatalign with strategic priorities, including ensuring college/disciplinary standards as well as expanding the scope ofreaching a broader audience of AP students.

• Collaborate with AP teams to support the development ofnew productsfor APPrecalculus, Calculus, and Statisticsdesigned to address unmet teacher instructional needs,potentiallyincluding developing prototypes,participatingin small-scale market-testing, and creating models forsubsequentdevelopment in conjunction with other AP workstreams.

About You

To qualify for this role, you must have:

• AMaster'sdegree inMath or Statisticsora directly relateddiscipline,and knowledge of current trends in the discipline (required), although a doctorate in the discipline is strongly preferred

• ExpertiseinPrecalculus, Calculus, or Statistics with at least10years of experience in standardized assessment development or related work; experience with digital assessment and teaching preferred

• Strong oral and written communication skills, with solid technicalproficiencyand a customer-focused mindset

• Excellent organizational and planning skills, with the ability to manage multiple tasks andmaintainclose attention to detail, including proofreading

• Demonstrated ability to implement processes and procedures, manage project plans and schedules, andmaintaintracking documentation

• Strong interpersonal and collaboration skills, with the ability to work effectively across all levels, and engage in giving and receiving constructive feedback

• Ability to travel 6-8 times per year, plus up to twoadditionalweeks for the AP Reading; must be eligible to work in the United States

All roles at College Board require:

• A passion for expanding educational and career opportunities and mission-driven work

• Curiosity and enthusiasm for emerging technologies, with a willingness to experiment with and adopt new AI-driven solutions and comfort with learning and applying new digital tools independently and proactively.

• Clear and concise communication skills, written and verbal

• A learner's mindset and a commitment to growth: welcoming diverse perspectives, giving and receivingtimely, respectful feedback, and continuously improving through iterative learning and user input.

• A drive for impact and excellence: solving complex problems, making data-informed decisions, prioritizing what matters most, and continuously improving through learning, user input, and external benchmarking.

• A collaborative and empathetic approach: working across differences, fostering trust, and contributing to a culture of shared success

• Authorization to work in the United States

About Our Process

• Application review will begin immediately and will continue until the position is filled.This role is expected to accept applications for a minimum of 5 business days.

• Whilethehiring processmay vary, it generallyincludes:resume and application submission, recruiter phone/video screen, hiring manager interview, performance exercise such as live coding, a panel interview, a conversation with leadership and reference checks.

What We Offer

AtCollegeBoard, we offer more than a paycheck: we provide a meaningful career, a supportive team, and a comprehensive package designed to help you thrive.We'rea self-sustaining nonprofit that believes in fair and competitive compensation grounded in your qualifications, experience, impact, and the market.

A Thoughtful Approach to Compensation

• The hiring range for this role is $112,000 -$165,000.

• Your exact salary will depend on your location, experience, and how your background compares to others in similar roles at the College Board.

• We aim to make our best offer upfront, rooted in fairness, transparency, and market data.

• We adjust salaries by location to ensure fairness, no matter where you live.

You'llhave open, transparent conversations about compensation, benefits, and whatit'slike to work atCollegeBoard throughout your hiring process. Check outourcareers pageformore.

#li-dr1

#li-remote