1

Exam Developer Jobs in Pennsylvania (NOW HIRING)

Software Engineer III

Philadelphia, PA · On-site

$93K - $143K/yr

POSITION OVERVIEW NBME is seeking an AWS Serverless Software Engineer to join the Product Engineering Unit as a key member of the Exam Delivery Team. In this role, you will develop, deploy, and ...

Career Developer

York, PA · On-site

$24.50/hr

The Career Developer leads the effort in building relationships with businesses inspiring and ... exam, and drug tests * Proficiency in the use of technology, including but not limited to ...

POSITION OVERVIEWNBME is seeking an AWS Serverless Software Engineer to join the Product Engineering Unit as a key member of the Exam Delivery Team. In this role, you will develop, deploy, and ...

next page

Showing results 1-20

Exam Developer information

What does an exam developer do?

An Exam Developer is responsible for designing, developing, and maintaining assessments to evaluate knowledge, skills, or competencies. They work with subject matter experts to create test questions, ensure exams align with learning objectives, and uphold testing standards. Exam Developers also analyze test performance data to improve question quality and exam fairness. Their role is crucial in certification, education, and professional testing programs.

What are the key skills and qualifications needed to thrive as an exam developer?

To thrive as an Exam Developer, you need expertise in instructional design, assessment creation, psychometrics, and typically a background in education or a related field. Familiarity with item banking software, test delivery platforms, and data analysis tools such as Excel or SPSS is often required, along with certifications like Certified Assessment Professional (CAP) being advantageous. Attention to detail, strong written communication, and collaboration skills help ensure clarity, fairness, and effectiveness in exam design. These abilities are essential to produce valid, reliable assessments that accurately measure candidates' knowledge and skills.

What are the most commonly searched types of Exam Developer jobs in Pennsylvania? The most popular types of Exam Developer jobs in Pennsylvania are:
Infographic showing various Exam Developer job openings in Pennsylvania as of August 2026, with employment types broken down into 3% As Needed, 71% Full Time, 23% Part Time, and 3% Contract. Highlights an 95% Physical, 1% Hybrid, and 4% Remote job distribution.

Other

This job post has expired 1 day ago. Applications are no longer accepted.


Job description

The American Board of Internal Medicine (ABIM) is currently seeking a Psychometrician to join our team. In this role, the Psychometrician is responsible for leading the psychometric activities for examinations and facilitating improvements to psychometric methods, processes, and relevant issues in the evaluation of medical knowledge and education.


Reporting to the Manager, Psychometric Operations, the Psychometrician has the following primary responsibilities:


  • Facilitate/perform item analysis, IRT calibrations, scoring, equating, standard setting, and validity and reliability studies for several certification examinations.
  • Develop, maintain, and/or improve operational psychometric processes
  • Collaborate with subject matter experts and exam developers in item development and review processes and exam design, development, and review processes.
  • Report examination results and related research to physician and non-physician audiences.
  • Provide oversight and support for data analysts in research projects and operational work.
  • Handle inquiries (by phone and in writing) related to examination scoring.
  • Collaborate on research and development projects within and across departments and communicate results to the board and to the research community.
  • Advise on research, measurement, statistical, and systems issues.
  • Plan for projects by anticipating work and the required resources, and understand the importance of operational and project planning processes as it relates to the use of company’s fiscal and human resources.


The ideal candidate has a doctorate degree in educational/psychological measurement, statistics, or related field with zero to three years’ experience and has the ability to effectively use statistical analysis programs and IRT software including (but not limited to) SAS and R. In addition, experience in the principles and application of psychometrics including item response theory (i.e., item calibration, item evaluation, linking/equating, and IRT scoring), classical test theory, and standard setting. To thrive in this role at ABIM, one must have excellent communication, organizational, planning and problem-solving skills.


This role is based in our offices at 510 Walnut Street, Philadelphia PA, with the ability to work remotely three days a week. Our technology and facility teams provide and support a seamless hybrid work environment for all employees.


* * *


At the American Board of Internal Medicine (ABIM), our team of unique and talented professionals, and the inspiring work they do, are essential to meeting the needs and expectations of ABIM’s diverse community of physicians.


ABIM is like no other workplace, and we are proud of it. We are committed to recognizing the importance of our people by investing in their lives through ongoing learning opportunities and exceptional total compensation & benefit offerings.


We look forward to learning more about your interest in joining our team. Apply online, or email your resume to careers@abim.org. EOE