Because ARRT is about to begin more standard settings, I would like to take a few moments to discuss how we do them. First there are myriad ways to conduct standard settings, but ARRT primarily uses what's called the modified Angoff approach. In my past, I've used a few other standard setting methods like the bookmark method, which is better suited to very large-scale assessments with multiple cut scores.
In modified Angoff, we impanel a committee of subject matter experts (SMEs), or people registered with ARRT for the discipline in question, to set where the cut score should fall. They take the test and are guided through discussions by a psychometrician. They see impact data, or what pass rates would likely be given their cut score placement. They get the opportunity to change their cut scores, and finally their recommendation is passed to the ARRT Board of Trustees.
As can be seen, the importance of SME judgment cannot be overstated, as it ultimately informs the Board of Trustees. Their recommendation impacts candidates for the next half decade; so, it is imperative that all decisions are made with the utmost thoughtfulness. This is also why ARRT and the psychometric team work as diligently as possible to find willing volunteers to make these judgments that the rest of us cannot make.
|
Dec 19, 2025
|
by Assessments Department
|
