Standard Setting Meetings
Over time, jobs evolve and the expectations of an entry-level technologist change. This is why we perform routine standard settings for each ARRT examination program. These are the culmination of the practice analysis process and set new cut scores that represent expectations for the candidate.
To achieve this, the ARRT relies on the standard setting method generally attributed to William Angoff where a group of subject matter experts (SMEs) is empaneled to give their expert opinion on whether, and how frequently, a "just barely passing" candidate will answer an item correctly.
Committee members will also be asked to provide global ratings. That is to say each committee member will provide their expert view on their expectation on passing rates. This will help the psychometricians create meaningful boundaries in addition to the standard Angoff recommendation.
After the standard setting committee has provided their recommendation (over three successive rounds of applying judgments and some mathmagic from the psychometricians), the ARRT Board of Trustees receives the committee recommendation, and an estimate of how all statistically similar possible cut scores would affect the first-time pass rate for the exam. From there, the Board makes a final decision, the public is notified, and the new standard is implemented six to twelve months later.
