Decision Consistency

The term decision consistency refers to the measure of reliability of a test decision across either multiple forms of a single test or repeated administrations of identical tests. This measurement is similar to that of decision accuracy, though their purposes are different. Although decision consistency measures the consistency of multiple decisions for an examinee on an exam, decision accuracy refers to the correct classification of an examinee using the exam based on the examinee’s true classification status. That is, decision consistency measures the reliability of an exam across multiple occurrences, whereas decision accuracy measures reliability within a single occurrence. For example, decision accuracy would be focused on measuring whether an end-of-year exam would be accurate in determining a proficient rating given that the student taking ...