Psychometrician

Job Description

The National Board of Osteopathic Medical Examiners (NBOME) is seeking an experienced Psychometrician to support psychometric operations, including test design, test construction, standard setting, and item analysis, as well as scaling, equating, scoring and score reporting for NBOME examinations. The role also includes supporting research initiatives focused on the application of AI in operational assessment settings.

Hybrid Work Schedule to include two days remote (Monday & Friday) and three days onsite work in our Rosemont/O’Hare office (Tuesday-Thursday).

Responsibilities:

• Following the processing and analysis of existing products to ensure highest quality and integrity, including test design, test construction, standard setting, item analysis, equating, scoring and score reporting.
• Designs, conducts, and coordinates psychometric research for presentation or publication
• Internal coordination of departmental planning; IT needs; cross-functional teams; activities in support of psychometric analysis and research; other internal processes.
• Willing and able to work some weekends for onsite meetings.
• Other duties as requested by supervisor or senior leadership staff.

Qualifications:

• Doctorate degree in Educational/Psychological Measurement, Statistics, or a related field is required.
• Minimum of three years of work experience as a psychometrician related to psychological and educational testing required.
• Strong background in psychometric theory and application, including knowledge of IRT, CTT, statistics, test development procedures, and research design.
• Knowledge and/or experience in natural language processing, automated item generation, process data analytic methods, formative assessment approaches is highly desirable.
• Strong data analysis skills, problem solving skills, and scientific computing skills using (e.g. SAS, R, Python and Calibration software).
• Experience in designing, conducting, summarizing and presenting psychometric studies.
• Ability to work well with exam committees and interdepartmental colleagues.
• Strong oral and written communication skills.