Previously, we have discussed standard setting meetings (here and here). Following standard setting, the cut score generally must change to reflect changes in the expectations of an entry level technologist. We change the difficulty based on the committee's and psychometrics' recommendations, public comment, and the ARRT Board of Trustees' final decision. Using multiple recommendations, like the ARRT does, allows for a theoretically best cut score and is industry standard practice.
To keep a scaled score of 75 as the passing point, psychometrics transforms a hidden, underlying scale into the scoring scale with the cut always coming at 75. By following the scaling process, we can ensure that the difficulty does not change because of the candidates taking the test; rather, the test maintains criterion reference (supported by judgments from experts in the field rather than a comparison to other examinees).
Finally, the ARRT communicates the change in cut score by posting an explanation of the standard setting process and expected impact of the change to the ARRT website so candidates have as fair of an opportunity to show their knowledge as candidates had before the changes coming from the standard setting procedure. Current candidates taking the test before the new cut score will continue to be tested against the prior cut score and content outline.
