Did you know that incorrect answers tell us a lot about how an item works? ARRT psychometricians review incorrect answers that candidates give to items to see how well each item is doing. Called distractor analysis, this process ensures each item works properly, which helps an ARRT exam distinguish technologists who are prepared to practice from those who are not yet ready. A good distractor relates to practice, so candidates must apply genuine knowledge to select the correct answer.
After enough candidates take an exam form, ARRT psychometricians review each item on the form, looking at certain statistics for each option. For example, psychometricians inspect how often each distractor is chosen and whether it attracts lower-scoring candidates more than higher-scoring candidates. A distractor selected by no candidates might be implausible while a distractor preferred by higher-scoring candidates could signal ambiguous wording. Specifically, an implausible distractor likely lies outside of the exam's content specifications, such as an option related to pizza toppings; candidates would know that this option is incorrect. On the other hand, ambiguous wording in a distractor could prompt higher-scoring candidates to overanalyze the item's stem, to apply advanced reasoning, and to select the ambiguous distractor.
Statistics do not tell the whole story. After reviewing items, psychometricians share flagged items with volunteer subject matter experts (SMEs), who check if distractors reflect current practice. Imaging technology changes: a distractor related to film-screen radiography might have been reasonable in previous decades but could now confuse candidates. SMEs revise distractor wording, replace outdated content, and ensure every option remains realistic.
Routine distractor analysis keeps each item on ARRT exams related to practice. By pairing statistical evidence with expert judgment, psychometricians ensure that relevant misconceptions appear as distractors. The outcome is an effective examination that distinguishes qualified candidates and promotes patient safety.
