Psychometric Analyst Jobs (NOW HIRING)

Job Type: Full-time/Exempt

Work Location: Remote

Dept: Center for Assessment and Global Certification

Salary: Starting at $90,000, commensurate with experience

Overview:

TruMerit is seeking an Expert Psychometrician who will design, develop, and validate assessments and measurement tools, ensuring the reliability, validity, and fairness of testing instruments. The role involves management of test development processes, statistical analysis, data interpretation, and collaboration with multidisciplinary teams, locally and globally, to produce work and to provide insights for developing and validating assessment protocols and decision-making processes for global stakeholders. Reports to the Chief, Global Health Workforce Development Institute. Plans and manages all assessment and global certification activities and implements strategic objectives of the Institute.

Essential Functions and Responsibilities:

Test Development and Validation:

• Design and develop psychological and educational assessments for use in various contexts (education, clinical settings, workplace assessments).
• Conduct research to ensure assessments meet reliability and validity standards.
• Collaborate with subject matter experts to ensure content accuracy and relevance.
• Track and prepare performance metrics and documentation for accountability.
• Serve as resident psychometric expert to provide content and application guidance across the organization as appropriate.
• Design, develop, and facilitate Standard Settings for new certification tests and maintenance years

Statistical Analysis:

• Perform item analysis and recommend modifications to improve test quality.
• Develop scoring models and interpret psychometric data for stakeholders.

Data Management:

• Manage small and large datasets and maintain the integrity of data collected from assessments.
• Perform statistical programming and data analysis.

Report Writing:

• Prepare technical reports on the development, implementation, and evaluation of assessments.
• Present findings and recommendations to stakeholders, including non-technical audiences.
• Develop and review project proposals or plans to determine time frame, procedures for accomplishing project, staffing requirements, and allotment of available resources to various phases of projects to ensure successful outputs being delivered on time and within budget.
• Publications in peer-reviewed high impact professional journals and presentations at high-caliber professional conferences expected.
• Prepare documentation for certification test accreditation.

Research and Innovation:

• Stay current with advances in psychometrics and assessment technology.
• Conduct research on new methods and techniques for improving testing practices.
• Conduct research and gather information to guide decision-making for the Institute and for the Center.
• Champions interdisciplinary thinking and entrepreneurial approaches to problem-solving and innovation.

Collaboration and Communication:

• Responsible for the effective and efficient management of the Center for Assessment and Global Certification, its personnel, budgets, and contracts, and all its activities, assessment or otherwise.
• Collaborate with Institute Chief and other team members in formulating and administering organizational policies and processes at all levels of managerial functions.
• Work with Institute Chief and colleagues to ensure implementation of organizational and Institute goals in a triangulated and collaborative fashion.
• Organize and conduct meetings as appropriate. Prepares agenda and high-level reporting. Serves as staff to external committees as assigned.
• Assume project management responsibilities that cut across departmental boundaries.
• Collaborate with Institute Chief in assessment and global certification products and/or business development activities.
• Interface with all divisions of the organization to promote teamwork, to leverage existing resources, and to contribute to Institute and overall organizational goals.
• Work directly with assessment vendor, local representatives, external constituencies, standards committees, international taskforces, subject matter experts, and applicants to achieve desired outcomes.
• Manage administrative duties and projects and acts as project leader as appropriate.
• Manage staff performance and continual professional development outcomes.

Qualifications:

Education:

• Master’s degree in psychometrics or related fields required. PhD or EdD preferred.

Experience, Skills & Abilities:

• Five or more years of experience in a management role in an assessment, evaluation, and measurement organization.
• Experience in working with professional certification standards, programs, and services highly desirable.
• Experience in creating assessment for global audiences highly desirable.
• Experience in working with the healthcare industry highly desirable.
• Expert in psychometric analysis techniques and statistical software.
• Experience in developing and validating assessments.
• Experience in applied settings, such as educational testing, psychological testing, or organizational assessments.
• Knowledge of ethical standards in testing and assessment.
• Familiarity with automated test scoring, adaptive testing methodologies, test translation, remote proctoring, and emerging technology interventions in the testing industry.
• Ability to read, analyze and interpret complex documents and situations.
• Ability to respond effectively to sensitive and/or confidential materials.
• Ability to make presentations on complex topics to senior management, public and/or Board of Trustees.
• Ability to write proposals, reports, and visual presentations commensurate with position.
• Ability to define problems, collect data, establish facts, and draw valid conclusions.
• Ability to work with abstract and concrete variables.
• Strong verbal, written, organizational and interpersonal skills.

About TruMerit, formerly CGFNS International, Inc.

TruMerit, formerly CGFNS International, is an immigration-neutral nonprofit organization that helps foreign educated healthcare professionals live and work in their country of choice by assessing and validating their academic and professional credentials.

We provide foreign students and healthcare professionals with a comprehensive assessment of their academic records to facilitate their successful admission to schools in the US and other countries.

We help protect migrating healthcare professionals by advocating for ethical recruitment practices and continuously monitoring the global landscape for developing trends in employment recruitment and workplace norms.

TruMerit, formerly CGFNS International, is an NGO in Consultative Status with the United Nations Economic and Social Council (ECOSOC), which serves as the central forum for international and social issues.

TruMerit, formerly CGFNS International, Inc., is an Equal Opportunity employer committed to inclusion and diversity in the workplace. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, age, national origin, disability, veteran status, gender identity, or any other factor protected by applicable federal, state, or local laws.

TruMerit, formerly CGFNS International, Inc., will not discriminate against or retaliate against applicants who inquire about, disclose, or discuss their compensation or that of other applicants.

Reasonable accommodations are available for applicants with disabilities or religious needs.

Benefits & Compensation:

We offer competitive compensation and benefits to meet different employee needs and lifestyles. Benefits include a retirement plan with a match after 1 year of service for eligible contributions, medical, dental, vision, company-paid basic life insurance, short-term disability, long-term disability, and accidental death and dismemberment insurance, employee and dependent supplemental life insurance, generous paid time off, and tuition reimbursement.