‘This is a book that should be on the desk of anyone truly concerned with reliability. The whole question of conditional reliabilities is current and important; and, the question of reliability generalization is being opened out and moving away from Cronbach s approach. The topic is an important one’ – Richard L Gorsuch, Fuller Theological Seminary. In a world of ‘high stakes’ testing, it has become more important than ever to make certain the scores on which we base our decisions are reliable. Aimed at helping researchers create and evaluate scores better, this reader presents the basic concepts of classical (or ‘true score’) and modern (‘generalizability’) test theory. Beginning with a review of reliability and validity issues in measurement, the book covers score reliability, reliability induction, and reliability generalization. Exercises with sample data are included at the end of each section so readers can demonstrate knowledge of the principles.
“Reliability Generalization” is a meta-analysis of score reliability or standard-error-of-measurement (SEM) coefficients. This extension of “validity generalization” was first elaborated in detail by Vacha-Haase's (1998) Educational and Psychological Measurement article, reproduced here as Chapter 13.
Also included are several subsequent “RG” studies. [The August, ...