Methodology Review: Statistical Approaches for Assessing Measurement Bias

Abstract

Statistical methods developed over the last decade for detecting measurement bias in psycho logical and educational tests are reviewed. Earlier methods for assessing measurement bias generally have been replaced by more sophisticated statistical techniques, such as the Mantel-Haenszel procedure, the standardization approach, logistic regression models, and item response theory approaches. The review employs a conceptual framework that distin guishes methods of detecting measurement bias based on either observed or unobserved conditional invariance models. Although progress has been made in the development of statistical methods for detecting measurement bias, issues related to the choice of matching variable, the nonuniform nature of measurement bias, the suitability of cur rent approaches for new and emerging perform ance assessment methods, and insights into the causes of measurement bias remain elusive. Clearly, psychometric solutions to the problems of measurement bias will further understanding of the more central issue of construct validity. The con tinuing development of statistical methods for detecting and understanding the causes of mea surement bias will continue to be an important scientific challenge.