Entry Level Standardized Test Developer Jobs (NOW HIRING)

Department: Office of Medical Standards and Assessments
Reports To: Director of Psychometrics and Assessment Science
Location: Dallas, TX – ABOG National Center for Certification and Continuing Education (Uptown); Hybrid Work environment with expectation for 60%

Travel: Meeting Travel Required (up to 10%) as needed.
FLSA Status: Exempt

Summary: The Test Developer I – Continuing Certification (CC) is responsible for coordinating and supporting logistics within and across the development team to ensure smooth workflows. The Test Developer I – CC is also responsible for coordinating and maintaining assigned Continuing Certification content and Subject Matter Expertise (SME) activities within the item bank and supporting vendor coordination. In addition, the Test Developer I – CC will support the content editorial team with editing.

Working within established assessment-development standards and under general direction, this role supports Continuing Certification assessment-development workflows, item-bank content readiness, SME coordination, quality-control activities, and assessment publishing. The Test Developer I – CC exercises professional judgment within established procedures when identifying content issues, coordinating assigned workflows, resolving routine operational matters, and escalating higher-risk or policy-level issues to senior staff or leadership.

ESSENTIAL DUTIES AND RESPONSIBILITIES:

• Coordinates and maintains content and Subject Matter Experts (SMEs) within the item bank, including assignments for SMEs, specifically for Continuing Certification assessments.
• Coordinates vendor relations (item bank), as needed, including routine communications, deliverable tracking, and escalation of service or system issues as appropriate.
• Organizes and maintains files/records related to assessment development, including images and video clips.
• Supports and maintains gap analysis for items within the item bank, identifying content needs and communicating gaps or potential risks to senior staff or leadership.
• Reviews and edits content for grammar, punctuation, spelling, and format, ensuring clarity, accuracy, and consistency according to ABOG and AMA style guidelines and psychometric standards.
• Performs assigned quality-control reviews of assessment content and materials in accordance with established standards and procedures.
• Identifies potential efficiencies and workflow improvements in the content-development process and provides recommendations to senior staff or leadership, while performing quality-control checks, as needed.
• Assists in developing, updating, and maintaining guides and procedures specific to item writing and editing for initial and continuing certification.
• Prepares content for assessment meetings, as needed.
• Supports meeting readiness by confirming content status, SME assignments, item/case materials, supporting documentation, and required follow-up items, and escalates identified issues as appropriate.
• Works with the Psychometrics and Research team on form layout/item reviews.
• Supports item and form review activities by coordinating materials, documentation, content updates, and follow-up requirements in accordance with established assessment-development processes.
• Supports assessment publishing activities with test delivery platforms in coordinating with senior staff, Psychometrics and Research, vendors, and other internal stakeholders.
• Interfaces with ABOG committees, Board of Directors, Subspecialty Divisions, and societies, as needed, to support assigned assessment-development activities and facilitate timely information flow.
• Assists the Director of Psychometrics and Assessment Science, and other assessment department members with office operations as requested.
• Participates in assessment development meetings, including participating in writing, editing, and review sessions.
• Tracks assigned assessment-development activities, stakeholder follow-up items, and deliverables to support established timelines and program requirements.
• Exercises professional judgment within established assessment-development standards when coordinating assigned workflows, identifying content or operational issues, resolving routine matters, and escalating higher-risk or policy-level matters as appropriate.
• Performs other duties as needed to support departmental and organizational goals.

SKILLS AND QUALIFICATIONS:

• Demonstrable Proficiency: Candidates may be required to demonstrate proficiency in essential skills during the interview process (e.g., work samples, analysis exercise, communication brief).
• Bachelor’s degree in a related field (e.g., Education, Health Sciences, English, Communications) preferred, or equivalent combination of education and experience.
• One or more years of experience in test development, assessment coordination, certification programs, content development, editing, project coordination, or a related field preferred.
• Knowledge and familiarity with basic psychometric principles (e.g., blueprinting, item performance analysis, standard setting concepts).
• Understanding of large-scale exam operations and vendor coordination (e.g., Pearson VUE or other test delivery providers) preferred.
• Familiarity with copyright and permissions processes for assessment content.
• Strong organizational, project management, and workflow optimization skills.
• Exceptional interpersonal, written communication, verbal communication , and collaboration skills.
• Ability to synthesize data into actionable feedback for SMEs (e.g., report cards) with appropriate guidance.
• Detail-oriented with strong analytical and problem-solving capabilities.
• Ability to exercise professional judgment within established standards, identify routine operational or content issues, and appropriately escalate matters requiring broader assessment-development decisions.
• Ability to maintain confidentiality and exercise discretion when working with secure assessment content, SME materials, candidate-related information, psychometric materials, and internal assessment records.
• Experience with web-based programs and software applications, including MS Word, MS Excel, MS PowerPoint, MS Office 365, MS Teams, Zoom, SharePoint, item-bank platforms, test delivery systems, and assessment-related systems.
• Ability to adapt to changing priorities and organizational needs.

PHYSICAL REQUIREMENTS

The following essential functions describe what must be accomplished and may be performed with or without reasonable accommodation:

• Primarily sedentary computer-based work; frequent keyboard/mouse use and on-screen analysis.
• Regular verbal and written communication in meetings and documentation; ability to present findings.
• Occasional standing/walking/meeting facilitation; occasional lifting/carrying of typical office items (up to 20 lbs.).
• Periodic travel (up to 10%) for meetings or conferences.

ABOG engages in an interactive process and provides reasonable accommodations to qualified individuals with disabilities.

WORKING CONDITIONS

Typical professional office/administrative environment with low noise levels; hybrid schedule with 60% in-office presence (role-specific positions that align with the nature of their work) and periodic travel for meetings/conferences. Work involves handling sensitive information under strict confidentiality, data governance, and security protocols. ABOG provides reasonable accommodation throughout the application and employment process upon request.

COMPENSATION

Salary commensurate with experience and qualifications.

BENEFITS

Comprehensive benefits including Health, Dental, Vision, HSA, employer-match 401(k), Basic Life/AD&D, and LTD. Additional benefits and eligibility will be shared in the recruiting process.

EEO STATEMENT

ABOG is an Equal Opportunity Employer. We consider all qualified applicants without regard to race, color, religion, sex (including pregnancy, sexual orientation), national origin, age, disability, genetic information, veteran status, or any other protected status. We welcome requests for reasonable accommodation at any stage of the hiring process.

The American Board of Obstetrics and Gynecology (ABOG) is a national, non-profit, apolitical organization that offers voluntary certification to obstetricians and gynecologists (OB-GYNs) and offers continuing certification to OB-GYNs in the United States and Canada.