The DOI matches its Crossref record.
Statistical Theories of Mental Test Scores
Abstract
This is a reprint of the orginal book released in 1968. Our primary goal in this book is to sharpen the skill, sophistication, and in- tuition of the reader in the interpretation of mental test data, and in the construction and use of mental tests both as instruments of psychological theory and as tools in the practical problems of selection, evaluation, and guidance. We seek to do this by exposing the reader to some psychologically meaningful statistical theories of mental test scores. Although this book is organized in terms of test-score theories and models, the practical applications and limitations of each model studied receive substantial emphasis, and these discussions are presented in as nontechnical a manner as we have found possible. Since this book catalogues a host of test theory models and formulas, it may serve as a reference handbook. Also, for a limited group of specialists, this book aims to provide a more rigorous foundation for further theoretical research than has heretofore been available.One aim of this book is to present statements of the assumptions, together with derivations of the implications, of a selected group of statistical models that the authors believe to be useful as guides in the practices of test construction and utilization. With few exceptions we have given a complete proof for each major result presented in the book. In many cases these proofs are simpler, more complete, and more illuminating than those originally offered. When we have omitted proofs or parts of proofs, we have generally provided a reference containing the omitted argument. We have left some proofs as exercises for the reader, but only when the general method of proof has already been demonstrated. At times we have proved only special cases of more generally stated theorems, when the general proof affords no additional insight into the problem and yet is substantially more complex mathematically.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cited by
Intraclass correlations: Uses in assessing rater reliability.
Shrout, P. E., & Fleiss, J. L. (1979) · Psychological Bulletin · doi:10.1037/0033-2909.86.2.420 · Cited by 24,532
Cross validatory choice and assessment of statistical predictions
Stone, M. (1974) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1974.tb00994.x · Cited by 10,881
Mixed-effects modeling with crossed random effects for subjects and items
Baayen, R. H., Davidson, D. J., & Bates, D. M. (2008) · Journal of Memory and Language · doi:10.1016/j.jml.2007.12.005 · Cited by 8,540
What is coefficient alpha? An examination of theory and applications
Cortina, J. M. (1993) · Journal of Applied Psychology · doi:10.1037/0021-9010.78.1.98 · Cited by 8,810
Accounting for common method variance in cross-sectional research designs
Lindell, M. K., & Whitney, D. J. (2001) · Journal of Applied Psychology · doi:10.1037/0021-9010.86.1.114 · Cited by 8,490
Jacobson, N. S., & Truax, P. (1991) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.59.1.12 · Cited by 7,770
DETERMINANTS OF INNOVATIVE BEHAVIOR: A PATH MODEL OF INDIVIDUAL INNOVATION IN THE WORKPLACE.
Scott, S. G., & Bruce, R. A. (1994) · Academy of Management Journal · doi:10.2307/256701 · Cited by 6,068
An updated paradigm for scale development incorporating unidimensionality and its assessment
Gerbing, D. W., & Anderson, J. C. (1988) · Journal of Marketing Research · doi:10.1177/002224378802500207 · Cited by 6,293
Distribution Theory for Glass's Estimator of Effect Size and Related Estimators
Hedges, L. V. (1981) · Journal of Educational Statistics · doi:10.2307/1164588 · Cited by 5,695
A Model of Distributor Firm and Manufacturer Firm Working Partnerships
Anderson, J. C., & Narus, J. A. (1990) · Journal of Marketing · doi:10.1177/002224299005400103 · Cited by 5,826
Estimating within-group interrater reliability with and without response bias
James, L. R., Demaree, R. G., & Wolf, G. (1984) · Journal of Applied Psychology · doi:10.1037/0021-9010.69.1.85 · Cited by 4,774
The Handbook of Research Synthesis and Meta-Analysis
(2019) · doi:10.7758/9781610448864 · Cited by 4,553
Measurement Invariance, Factor Analysis and Factorial Invariance
Meredith, W. (1993) · Psychometrika · doi:10.1007/bf02294825 · Cited by 4,536
Equivalence of the Mediation, Confounding and Suppression Effect
MacKinnon, D. P., Krull, J. L., & Lockwood, C. M. (2000) · Prevention Science · doi:10.1023/a:1026595011371 · Cited by 4,188
Starting at the beginning: an introduction to coefficient alpha and internal consistency
Streiner, D. L. (2003) · Journal of Personality Assessment · doi:10.1207/s15327752jpa8001_18 · Cited by 3,794
EMPLOYEE CREATIVITY: PERSONAL AND CONTEXTUAL FACTORS AT WORK.
Oldham, G. R., & Cummings, A. (1996) · Academy of Management Journal · doi:10.2307/256657 · Cited by 3,749
Specification, evaluation, and interpretation of structural equation models
Bagozzi, R. P., & Yi, Y. (2012) · Journal of the Academy of Marketing Science · doi:10.1007/s11747-011-0278-x · Cited by 3,735
Conventional wisdom on measurement: A structural equation perspective.
Bollen, K., & Lennox, R. (1991) · Psychological Bulletin · doi:10.1037/0033-2909.110.2.305 · Cited by 3,618
Answers to 20 questions about interrater reliability and interrater agreement
LeBreton, J. M., & Senter, J. L. (2008) · Organizational Research Methods · doi:10.1177/1094428106296642 · Cited by 3,608
On the practice of dichotomization of quantitative variables.
MacCallum, R. C., Zhang, S., Preacher, K. J., & Rucker, D. D. (2002) · Psychological Methods · doi:10.1037/1082-989x.7.1.19 · Cited by 3,538
A self‐report measure of pubertal status: Reliability, validity and initial norms
Petersen, A. C., Crockett, L., Richards, M., & Boxer, A. (1988) · Journal of Youth and Adolescence · doi:10.1007/bf01537962 · Cited by 3,129
Consistent Partial Least Squares Path Modeling1
Dijkstra, T. K., & Henseler, J. (2015) · MIS Quarterly · doi:10.25300/misq/2015/39.2.02 · Cited by 2,898
On the use, the misuse, and the very limited usefulness of Cronbach’s alpha
Sijtsma, K. (2009) · Psychometrika · doi:10.1007/s11336-008-9101-0 · Cited by 2,814
The reliability of a two-item scale: Pearson, Cronbach, or spearman-brown?
Eisinga, R., Grotenhuis, M. T., & Pelzer, B. (2013) · International Journal of Public Health · doi:10.1007/s00038-012-0416-3 · Cited by 2,695
Uses and abuses of coefficient alpha
Schmitt, N. (1996) · Psychological Assessment · doi:10.1037/1040-3590.8.4.350 · Cited by 2,588
Marginal Maximum Likelihood Estimation of Item Parameters: Application of an EM Algorithm
Bock, R. D., & Aitkin, M. (1981) · Psychometrika · doi:10.1007/bf02293801 · Cited by 2,339
Self-discipline outdoes IQ in predicting academic performance of adolescents.
Duckworth, A. L., & Seligman, M. E. P. (2005) · Psychological Science · doi:10.1111/j.1467-9280.2005.01641.x · Cited by 2,253
Estimation of Latent Ability Using a Response Pattern of Graded Scores
Samejima, F. (1969) · Psychometrika · doi:10.1007/bf03372160 · Cited by 2,194
Aggregation bias in estimates of perceptual agreement.
James, L. R. (1982) · Journal of Applied Psychology · doi:10.1037/0021-9010.67.2.219 · Cited by 2,139
Representing and Testing Organizational Theories: A Holistic Construal
Bagozzi, R. P., & Phillips, L. W. (1982) · Administrative Science Quarterly · doi:10.2307/2392322 · Cited by 2,064
Validating the interpretations and uses of test scores
Kane, M. T. (2013) · Journal of Educational Measurement · doi:10.1111/jedm.12000 · Cited by 2,110
The Sources of Four Commonly Reported Cutoff Criteria: What Did They Really Say?
Lance, C. E., Butts, M. M., & Michels, L. C. (2006) · Organizational Research Methods · doi:10.1177/1094428105284919 · Cited by 2,053
Tufford (2017) · doi:10.1007/s · Cited by 2,003
Scaling of theory-of-mind tasks.
Wellman, H. M., & Liu, D. (2004) · Child Development · doi:10.1111/j.1467-8624.2004.00691.x · Cited by 1,980
Molenaar, P. C. M. (2004) · Measurement: Interdisciplinary Research & Perspective · doi:10.1207/s15366359mea0204_1 · Cited by 1,943
Developing the World Health Organization Disability Assessment Schedule 2.0
Üstün, T. B., Chatterji, S., Kostanjsek, N., Rehm, J., Kennedy, C., Epping-Jordan, J., Saxena, S., von Korff, M., & Pull, C. (2010) · Bulletin of the World Health Organization · doi:10.2471/blt.09.067231 · Cited by 1,851
Estimation of composite reliability for congeneric measures
Raykov, T. (1997) · Applied Psychological Measurement · doi:10.1177/01466216970212006 · Cited by 1,775
Comorbidity: a network perspective
Cramer, A. O. J., Waldorp, L. J., van der Maas, H. L. J., & Borsboom, D. (2010) · Behavioral and Brain Sciences · doi:10.1017/s0140525x09991567 · Cited by 1,575
The theoretical status of latent variables.
Borsboom, D., Mellenbergh, G. J., & van Heerden, J. (2003) · Psychological Review · doi:10.1037/0033-295x.110.2.203 · Cited by 1,566
The reliability paradox: Why robust cognitive tasks do not produce reliable individual differences
Hedge, C., Powell, G., & Sumner, P. (2018) · Behavior Research Methods · doi:10.3758/s13428-017-0935-1 · Cited by 1,457
Lewis, G., Pelosi, A. J., Araya, R., & Dunn, G. (1992) · Psychological Medicine · doi:10.1017/s0033291700030415 · Cited by 1,487
Stability of aggressive reaction patterns in males: A review.
Olweus, D. (1979) · Psychological Bulletin · doi:10.1037/0033-2909.86.4.852 · Cited by 1,392
Yu, L., Buysse, D. J., Germain, A., Moul, D. E., Stover, A., Dodds, N. E., Johnston, K. L., & Pilkonis, P. A. (2012) · Behavioral Sleep Medicine · doi:10.1080/15402002.2012.636266 · Cited by 1,241
Glick, W. H. (1985) · The Academy of Management Review · doi:10.5465/amr.1985.4279045 · Cited by 1,286
Weighted Likelihood Estimation of Ability in Item Response Theory
Warm, T. A. (1989) · Psychometrika · doi:10.1007/bf02294627 · Cited by 1,216
Construct Validity: A Review of Basic Issues and Marketing Practices
Peter, J. P. (1981) · Journal of Marketing Research · doi:10.2307/3150948 · Cited by 1,189
Behavioral Development and Construct Validity: The Principle of Aggregation
Rushton, J. P., Brainerd, C. J., & Pressley, M. (1983) · Psychological Bulletin · doi:10.1037/0033-2909.94.1.18 · Cited by 940
The psychological effects of meditation: a meta-analysis
Sedlmeier, P., Eberth, J., Schwarz, M., Zimmermann, D., Haarig, F., Jaeger, S., & Kunze, S. (2012) · Psychological Bulletin · doi:10.1037/a0028168 · Cited by 910
Madjar, N., Oldham, G. R., & Pratt, M. G. (2002) · Academy of Management Journal · doi:10.2307/3069309 · Cited by 921
The measurement of fear of crime
Ferraro, K. F., & Grange, R. L. (1987) · Sociological Inquiry · doi:10.1111/j.1475-682x.1987.tb01181.x · Cited by 908
Lean body mass estimation by bioelectrical impedance analysis: a four-site cross-validation study
Segal, K., Van Loan, M., Fitzgerald, P., Hodgdon, A., & Van Itallie, T. (1988) · The American Journal of Clinical Nutrition · doi:10.1093/ajcn/47.1.7 · Cited by 881
Comparison of Stopping Rules in Forward “Stepwise” Regression
Bendel, R. B., & Afifi, A. A. (1977) · Journal of the American Statistical Association · doi:10.1080/01621459.1977.10479905 · Cited by 885
Robinaugh, D. J., Hoekstra, R. H. A., Toner, E. R., & Borsboom, D. (2020) · Psychological Medicine · doi:10.1017/s0033291719003404 · Cited by 861
Deconstructing the construct: a network perspective on psychological phenomena
Schmittmann, V. D., Cramer, A. O. J., Waldorp, L. J., Epskamp, S., Kievit, R. A., & Borsboom, D. (2013) · New Ideas in Psychology · doi:10.1016/j.newideapsych.2011.02.007 · Cited by 740
The Role of Conspiracist Ideation and Worldviews in Predicting Rejection of Science
Lewandowsky, S., Gignac, G. E., & Oberauer, K. (2013) · PLoS ONE · doi:10.1371/journal.pone.0075637 · Cited by 693
Respect for Human Rights has Improved Over Time: Modeling the Changing Standard of Accountability
FARISS, C. J. (2014) · American Political Science Review · doi:10.1017/s0003055414000070 · Cited by 706
Confirmatory tetrad analysis in PLS path modeling
Gudergan, S. P., Ringle, C. M., Wende, S., & Will, A. (2008) · Journal of Business Research · doi:10.1016/j.jbusres.2008.01.012 · Cited by 704
Psychometric perspectives on diagnostic systems
Borsboom, D. (2008) · Journal of Clinical Psychology · doi:10.1002/jclp.20503 · Cited by 691
Arbitrary metrics in psychology
Blanton, H., & Jaccard, J. (2006) · American Psychologist · doi:10.1037/0003-066x.61.1.27 · Cited by 681
An Essay on Measurement and Factorial Invariance
Meredith, W., & Teresi, J. A. (2006) · Medical Care · doi:10.1097/01.mlr.0000245438.73837.89 · Cited by 664
HTMT2–an improved criterion for assessing discriminant validity in structural equation modeling
Roemer, E., Schuberth, F., & Henseler, J. (2021) · Industrial Management & Data Systems · doi:10.1108/imds-02-2021-0082 · Cited by 630
Hobart, J., & Cano, S. (2009) · Health Technology Assessment · doi:10.3310/hta13120 · Cited by 621
Narcissism and Leadership: A Meta‐Analytic Review of Linear and Nonlinear Relationships
Grijalva, E., Harms, P. D., Newman, D. A., Gaddis, B. H., & Fraley, R. C. (2015) · Personnel Psychology · doi:10.1111/peps.12072 · Cited by 572
Measurement error in psychological research: Lessons from 26 research scenarios.
Schmidt, F. L., & Hunter, J. E. (1996) · Psychological Methods · doi:10.1037/1082-989x.1.2.199 · Cited by 567
Ponterotto, J. G., & Ruckdeschel, D. E. (2007) · Perceptual and Motor Skills · doi:10.2466/pms.105.3.997-1014 · Cited by 555
On the Meaning of within-Factor Correlated Measurement Errors
Gerbing, D. W., & Anderson, J. C. (1984) · Journal of Consumer Research · doi:10.1086/208993 · Cited by 526
Limitations of Coefficient Alpha as an Index of Test Unidimensionality1
Green, S. B., Lissitz, R. W., & Mulaik, S. A. (1977) · Educational and Psychological Measurement · doi:10.1177/001316447703700403 · Cited by 522
Kohn, M. L., & Schooler, C. (1978) · American Journal of Sociology · doi:10.1086/226739 · Cited by 508
Hobart, J. C., Cano, S. J., Zajicek, J. P., & Thompson, A. J. (2007) · The Lancet Neurology · doi:10.1016/s1474-4422(07)70290-9 · Cited by 495
APPLICATION OF COMPUTERIZED ADAPTIVE TESTING TO EDUCATIONAL PROBLEMS
WEISS, D. J., & KINGSBURY, G. G. (1984) · Journal of Educational Measurement · doi:10.1111/j.1745-3984.1984.tb01040.x · Cited by 501
Cicchetti, D. V. (1991) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00065675 · Cited by 496
The Fallacy of Formative Measurement
Edwards, J. R. (2011) · Organizational Research Methods · doi:10.1177/1094428110378369 · Cited by 495
Adult Outcomes of Youth Irritability: A 20-Year Prospective Community-Based Study
Stringaris, A., Cohen, P., Pine, D. S., & Leibenluft, E. (2009) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2009.08121849 · Cited by 486
Eaves, L. J., Silberg, J. L., Meyer, J. M., Maes, H. H., Simonoff, E., Pickles, A., Rutter, M., Reynolds, C. A., Heath, A. C., Truett, K. R., et al. (1997) · Journal of Child Psychology and Psychiatry · doi:10.1111/j.1469-7610.1997.tb01614.x · Cited by 489
The treatment utility of assessment: A functional approach to evaluating assessment quality.
Hayes, S. C., Nelson, R. O., & Jarrett, R. B. (1987) · American Psychologist · doi:10.1037/0003-066x.42.11.963 · Cited by 486
Rodebaugh, T. L., Woods, C. M., Thissen, D. M., Heimberg, R. G., Chambless, D. L., & Rapee, R. M. (2004) · Psychological Assessment · doi:10.1037/1040-3590.16.2.169 · Cited by 477
A Tutorial on Hierarchically Structured Constructs
Brunner, M., Nagy, G., & Wilhelm, O. (2012) · Journal of Personality · doi:10.1111/j.1467-6494.2011.00749.x · Cited by 459
Model-fitting approaches to the analysis of human behaviour
Eaves, L. J., Last, K. A., Young, P. A., & Martin, N. G. (1978) · Heredity · doi:10.1038/hdy.1978.101 · Cited by 457
Analysis of multiplicative combination rules when the causal variables are measured with error
Busemeyer, J. R., & Jones, L. E. (1983) · Psychological Bulletin · doi:10.1037/0033-2909.93.3.549 · Cited by 448
Suppression situations in psychological research: Definitions, implications, and applications
Tzelgov, J., & Henik, A. (1991) · Psychological Bulletin · doi:10.1037/0033-2909.109.3.524 · Cited by 424
Making Reliability Reliable: A Systematic Approach to Reliability Coefficients
Cho, E. (2016) · Organizational Research Methods · doi:10.1177/1094428116656239 · Cited by 378
The effect of schooling and ability on achievement test scores
Hansen, K. T., Heckman, J. J., & Mullen, K. J. (2004) · Journal of Econometrics · doi:10.1016/j.jeconom.2003.10.011 · Cited by 366
The stability of resting frontal electroencephalographic asymmetry in depression
Allen, J. J. B., Urry, H. L., Hitt, S. K., & Coan, J. A. (2004) · Psychophysiology · doi:10.1111/j.1469-8986.2003.00149.x · Cited by 359
Sharp, C., Goodyer, I. M., & Croudace, T. J. (2006) · Journal of Abnormal Child Psychology · doi:10.1007/s10802-006-9027-x · Cited by 358
Genetic covariation between neuroticism and the symptoms of anxiety and depression
Jardine, R., Martin, N. G., Henderson, A. S., & Rao, D. C. (1984) · Genetic Epidemiology · doi:10.1002/gepi.1370010202 · Cited by 351
Claro, M., Preiss, D. D., San Martín, E., Jara, I., Hinostroza, J. E., Valenzuela, S., Cortes, F., & Nussbaum, M. (2012) · Computers & Education · doi:10.1016/j.compedu.2012.04.004 · Cited by 345
Failure-to-Rescue: Comparing Definitions to Measure Quality of Care
Silber, J. H., Romano, P. S., Rosen, A. K., Wang, Y., Even-Shoshan, O., & Volpp, K. G. (2007) · Medical Care · doi:10.1097/mlr.0b013e31812e01cc · Cited by 333
Sandler, I. N., Ayers, T. S., Wolchik, S. A., Tein, J.-Y., Kwok, O.-M., Haine, R. A., Twohey-Jacobs, J., Suter, J., Lin, K., Padgett-Jones, S., et al. (2003) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.71.3.587 · Cited by 333
Draheim, C., Mashburn, C. A., Martin, J. D., & Engle, R. W. (2019) · Psychological Bulletin · doi:10.1037/bul0000192 · Cited by 322
Validity of the Medical College Admission Test for predicting medical school performance
Julian, E. R. (2005) · Academic Medicine · doi:10.1097/00001888-200510000-00010 · Cited by 319
Screening for somatization and hypochondriasis in primary care and neurological in-patients
Fink, P., Ewald, H., Jensen, J., Sørensen, L., Engberg, M., Holm, M., & Munk-Jørgensen, P. (1999) · Journal of Psychosomatic Research · doi:10.1016/s0022-3999(98)00092-0 · Cited by 314
Segal, K., Burastero, S., Chun, A., Coronel, P., Pierson, R., & Wang, J. (1991) · The American Journal of Clinical Nutrition · doi:10.1093/ajcn/54.1.26 · Cited by 311
Effect-Size Estimates: Issues and Problems in Interpretation
Fern, E. F., & Monroe, K. B. (1996) · Journal of Consumer Research · doi:10.1086/209469 · Cited by 301
A direct test of the diathesis-stress model for depression
Major Depressive Disorder Working Group of the Psychiatric Genomics Consortium, Colodro-Conde, L., Couvy-Duchesne, B., Zhu, G., Coventry, W. L., Byrne, E. M., Gordon, S., Wright, M. J., Montgomery, G. W., Madden, P. A. F., et al. (2018) · Molecular Psychiatry · doi:10.1038/mp.2017.130 · Cited by 285
Rehm, J., Üstün, T. B., Saxena, S., Nelson, C. B., Chatterji, S., Ivis, F., & Adlaf, E. (1999) · International Journal of Methods in Psychiatric Research · doi:10.1002/mpr.61 · Cited by 287
Meta-analysis of Cohen’s kappa
Sun, S. (2011) · Health Services and Outcomes Research Methodology · doi:10.1007/s10742-011-0077-3 · Cited by 282
The impact of background music on adult listeners: A meta-analysis
Kämpfe, J., Sedlmeier, P., & Renkewitz, F. (2011) · Psychology of Music · doi:10.1177/0305735610376261 · Cited by 285
Campbell-Sills, L., Liverant, G. I., & Brown, T. A. (2004) · Psychological Assessment · doi:10.1037/1040-3590.16.3.244 · Cited by 280
Parameter Recovery in the Graded Response Model Using MULTILOG
Reise, S. P., & Yu, J. (1990) · Journal of Educational Measurement · doi:10.1111/j.1745-3984.1990.tb00738.x · Cited by 277
Estimation in Parallel Randomized Experiments
Rubin, D. B. (1981) · Journal of Educational Statistics · doi:10.3102/10769986006004377 · Cited by 269
Metadata
- Authors
- Rozeboom, W. W., Lord, F. M., Novick, M. R., & Birnbaum, A.
- Venue
- American Educational Research Journal
- Publisher
- SAGE Publications
- Published
- 1969-01
- Volume
- 6
- Issue
- 1
- Pages
- 112
- ISSN
- 0002-8312 (ISSN-L)
- OpenAlex
- W2084398551
- Cited by
- 8,022
- References
- 0
- FWCI
- 114.25
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.