What are the responsibilities and job description for the Psychometrician I position at College Board?
About the Team The Psychometrics Team supports College Board in serving more than seven million students a year as they prepare for a successful transition to college through programs and services in college readiness and college success. College Board’s Psychometrics Team provides its partners with measurement solutions that set the standard for quality, efficiency, and innovation through operational excellence and research leadership that advances the field of Psychometrics and supports College Board’s mission of access and equity in Education. About the Opportunity As Psychometrician I, you will conduct routine psychometric operational and research work for the College Board SAT Suite of Assessments. Tasks include developing, modifying, and running code to conduct routine analyses, interpreting results, raising issues/making recommendations based on results. Analyses include procedures such as item calibration, producing reports using classical and item response theory models, creating and reviewing test documentation materials, facilitating standard setting, drafting papers and reports, and presenting findings to internal and external audiences. These tasks are carried out independently or with senior staff. The role includes providing psychometric support for other College Board Assessment Programs (ACCUPLACER, CLEP, and AP) as needed. In this role, you will: Operational Psychometrics (70%) Design and execute routine operational psychometric analyses for College Board assessments as assigned, including but not limited to item calibration and pretest analyses, DIF, and standard-setting, using standard and customized psychometric analysis tools and statistical software packages Lead the development and improvement of operational processes Independently conduct quality assurance and quality control procedures and identify opportunities for improvement of quality and efficiency of workflow Independently develop software programs, documentation, and implementation of statistical and reporting systems Responsible for the design, quality, and execution of technical reports for internal and external clients Psychometric Research (20%) Independently conduct research consistent with the research agenda for the program and Psychometrics Create and deliver presentations of research you have led to internal and external audiences Have papers accepted to major measurement conferences (such as NCME) where you are the first author and primary presenter at the conference Be a named author in a professional publication in a peer-reviewed journal Relationship Management (10%) Build good working relationships with colleagues across psychometrics that are collegial and productive and show respect and appreciation for those you collaborate with Work collaboratively with program staff and with committees (e.g., exam committees and technical advisory committees) Serve as a mentor to interns About you You have: A Doctorate in psychometrics, educational research, educational measurement or a related field At least three years of post-PhD experience in the field of psychometrics Experience in an operational setting with item response theory, classical test theory, equating, item and test analyses, DIF, standard setting, and other psychometric analyses is required Operational experience with multiple statistical analysis tools (e.g., SAS, R, flexMIRT, GENOVA, and Python) Demonstrated ability to design and conduct psychometric analyses, research studies, and complex statistical analyses Proficiency with other statistical analysis and programming tools, such as: R, flexMIRT, C or Python Ability to quickly and accurately work with new datasets and assessment data. Ability to work in a collaborative environment that emphasizes quality, rigor, adaptability, and critical thinking Ability and interest to apply evolving technologies to measurement challenges and issues Excellent organizational, time management, and detail orientation skills Excellent oral and written communication skills, including technical presentation, public speaking, interpersonal, and writing and editing skills Strong problem-solving skills Ability to travel up to 4 times a year #LI-REMOTE #LI-GG1 About College Board We are a mission-focused, not-for-profit membership organization promoting innovation, equity, and excellence for all students. Our members include more than 6,000 of the world’s leading educational institutions. We have 1,600 employees in 13 offices across the continental U.S. and Puerto Rico. We are advocates for children and parents, we empower teachers and educators, and we're a strong presence in thousands of schools and communities across the country through our programs and services—the SAT®, Advanced Placement® (AP®), and Pre-AP® are just a few. Our work falls broadly into four categories: College Readiness, College Connection & Success, Student Opportunities, and Advocacy. Mission Clearing a path for all students to own their future. EEOC statement College Board is proud to be an equal opportunity employer. We’re committed to equal employment opportunity regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity, or Veteran status.
