The new rules of measurement.
The DOI matches its Crossref record; 22 of the 22 references it cites were found in a registry or an index.
Abstract
Classical test theory, which the authors maintain applied psychologists are still too often exclusively taught, are contrasted with the new rules of measurement. In the newer, model-based version of test theory, called item response theory (IRT), some well-known rules of measurement o longer apply. Six old rules of measurement that conflict with the new rules are reviewed, and intuitive xplanations of the new rules are provided. Readers are also directed to additional informational sources about IRT, which, it is argued, every psychologist hould be familiar with. In an ever-changing world, psychological testing remains the flagship of applied psychology. Although both the context of application and the legal guidelines for using tests have changed, psychological tests themselves have been relatively stable. Many historically valued tests, in somewhat revised forms, remain in active current use. Further, although several new tests have de-veloped in response to contemporary needs in applied psychol-ogy, the principles underlying test development have remained constant. Or have they?
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Probabilistic Models for Some Intelligence and Attainment Tests
(1961) · Information and Control · doi:10.1016/s0019-9958(61)80061-2 · Cited by 6,939
"General Intelligence," Objectively Determined and Measured
Spearman, C. (1904) · The American Journal of Psychology · doi:10.2307/1412107 · Cited by 6,207
A Rasch model for partial credit scoring
Masters, G. N. (1982) · Psychometrika · doi:10.1007/bf02296272 · Cited by 3,782
Fundamentals of item response theory
(1992) · Choice Reviews Online · doi:10.5860/choice.29-4185 · Cited by 3,414
Handbook of Modern Item Response Theory
(1997) · Springer eBooks · doi:10.1007/978-1-4757-2691-6 · Cited by 2,305
Gulliksen, H. (1950) · John Wiley & Sons, Inc. eBooks · doi:10.1037/13240-000 · Cited by 2,177
Andrich, D. (1988) · doi:10.4135/9781412985598 · Cited by 1,345
Rasch Models in Latent Classes: An Integration of Two Approaches to Item Analysis
Rost, J. (1990) · Applied Psychological Measurement · doi:10.1177/014662169001400305 · Cited by 552
Lord, F. M. (1952) · Cited by 494
(1995) · Springer eBooks · doi:10.1007/978-1-4612-4230-7 · Cited by 359
Cited by
Refining the construct of psychopathy: Towards a hierarchical model.
Cooke, D. J., & Michie, C. (2001) · Psychological Assessment · doi:10.1037/1040-3590.13.2.171 · Cited by 1,535
Item Response Theory and Health Outcomes Measurement in the 21st Century
Hays, R. D., Morales, L. S., & Reise, S. P. (2000) · Medical Care · doi:10.1097/00005650-200009002-00007 · Cited by 869
Edelen, M. O., & Reeve, B. B. (2007) · Quality of Life Research · doi:10.1007/s11136-007-9198-0 · Cited by 824
Rutter, M., Caspi, A., & Moffitt, T. E. (2003) · Journal of Child Psychology and Psychiatry · doi:10.1111/1469-7610.00194 · Cited by 672
McArdle, J. J., Ferrer-Caja, E., Hamagami, F., & Woodcock, R. W. (2002) · Developmental Psychology · doi:10.1037/0012-1649.38.1.115 · Cited by 544
Greco, L. A., Lambert, W., & Baer, R. A. (2008) · Psychological Assessment · doi:10.1037/1040-3590.20.2.93 · Cited by 514
Modeling and Measuring the Structure of Professional Vision in Preservice Teachers
Seidel, T., & Stürmer, K. (2014) · American Educational Research Journal · doi:10.3102/0002831214531321 · Cited by 514
Reliability from α to ω: A tutorial.
Revelle, W., & Condon, D. M. (2019) · Psychological Assessment · doi:10.1037/pas0000754 · Cited by 506
Rose, M., Bjorner, J. B., Becker, J., Fries, J. F., & Ware, J. E. (2008) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2006.06.025 · Cited by 503
Condon, D. M., & Revelle, W. (2014) · Intelligence · doi:10.1016/j.intell.2014.01.004 · Cited by 433
An Introduction to Item Response Theory for Patient-Reported Outcome Measurement
Nguyen, T. H., Han, H.-R., Kim, M. T., & Chan, K. S. (2014) · The Patient - Patient-Centered Outcomes Research · doi:10.1007/s40271-013-0041-0 · Cited by 421
Development and Testing of an Abbreviated Numeracy Scale: A Rasch Analysis Approach
Weller, J. A., Dieckmann, N. F., Tusler, M., Mertz, C. K., Burns, W. J., & Peters, E. (2013) · Journal of Behavioral Decision Making · doi:10.1002/bdm.1751 · Cited by 392
Vitacco, M. J., Neumann, C. S., & Jackson, R. L. (2005) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.73.3.466 · Cited by 356
Azouvi, P., Olivier, S., de Montety, G., Samuel, C., Louis-Dreyfus, A., & Tesio, L. (2003) · Archives of Physical Medicine and Rehabilitation · doi:10.1053/apmr.2003.50062 · Cited by 335
MEASURING BEHAVIOURS AND PERCEPTIONS: RASCH ANALYSIS AS A TOOL FOR REHABILITATION RESEARCH
Tesio, L. (2003) · Journal of Rehabilitation Medicine · doi:10.1080/16501970310010448 · Cited by 335
Hartung, C. M., & Widiger, T. A. (1998) · Psychological Bulletin · doi:10.1037/0033-2909.123.3.260 · Cited by 333
The role of antisociality in the psychopathy construct: Comment on Skeem and Cooke (2010).
Hare, R. D., & Neumann, C. S. (2010) · Psychological Assessment · doi:10.1037/a0013635 · Cited by 332
Children's Somatization Inventory: Psychometric Properties of the Revised Form (CSI-24)
Walker, L. S., Beck, J. E., Garber, J., & Lambert, W. (2009) · Journal of Pediatric Psychology · doi:10.1093/jpepsy/jsn093 · Cited by 320
Growth Curve Analysis in Contemporary Psychological Research
McArdle, J. J., & Nesselroade, J. R. (2003) · Handbook of Psychology · doi:10.1002/0471264385.wei0218 · Cited by 288
Neumann, C. S., Kosson, D. S., Forth, A. E., & Hare, R. D. (2006) · Psychological Assessment · doi:10.1037/1040-3590.18.2.142 · Cited by 280
Psychopathy across cultures: North America and Scotland compared.
Cooke, D. J., & Michie, C. (1999) · Journal of Abnormal Psychology · doi:10.1037//0021-843x.108.1.58 · Cited by 275
Cooke, D. J., Kosson, D. S., & Michie, C. (2001) · Psychological Assessment · doi:10.1037//1040-3590.13.4.531 · Cited by 268
Analyzing Multiple-Item Measures of Crime and Deviance I: Item Response Theory Scaling
Osgood, D. W., McMorris, B. J., & Potenza, M. T. (2002) · Journal of Quantitative Criminology · doi:10.1023/a:1016008004010 · Cited by 265
The Revised Behavior and Symptom Identification Scale (BASIS-R): Reliability and Validity
Eisen, S. V., Normand, S.-L., Belanger, A. J., Spiro, A., & Esch, D. (2004) · Medical Care · doi:10.1097/00005650-200412000-00010 · Cited by 262
A Multigroup Item Response Theory Analysis of the Psychopathy Checklist-Revised.
Bolt, D. M., Hare, R. D., Vitale, J. E., & Newman, J. P. (2004) · Psychological Assessment · doi:10.1037/1040-3590.16.2.155 · Cited by 260
Chen, C. X., Kroenke, K., Stump, T. E., Kean, J., Carpenter, J. S., Krebs, E. E., Bair, M. J., Damush, T. M., & Monahan, P. O. (2018) · Pain · doi:10.1097/j.pain.0000000000001121 · Cited by 199
Assessing vocabulary size through multiple-choice formats: Issues with guessing and sampling rates
Gyllstad, H., Vilkaitė, L., & Schmitt, N. (2015) · ITL - International Journal of Applied Linguistics · doi:10.1075/itl.166.2.04gyl · Cited by 164
Capturing specific abilities as a window into human individuality: The example of face recognition
Wilmer, J. B., Germine, L., Chabris, C. F., Chatterjee, G., Gerbasi, M., & Nakayama, K. (2012) · Cognitive Neuropsychology · doi:10.1080/02643294.2012.753433 · Cited by 140
Zaidman‐Zait, A., Mirenda, P., Zumbo, B. D., Wellington, S., Dua, V., & Kalynchuk, K. (2010) · Journal of Child Psychology and Psychiatry · doi:10.1111/j.1469-7610.2010.02266.x · Cited by 131
Kroenke, K., Stump, T. E., Chen, C. X., Kean, J., Bair, M. J., Damush, T. M., Krebs, E. E., & Monahan, P. O. (2020) · Journal of Affective Disorders · doi:10.1016/j.jad.2020.01.101 · Cited by 131
“(Embretson, 1996; Hays et al., 2000) Specifically, the square root of the mean of variance (i.e., standard error squared) for each Tscore across persons in the sample was computed to derive the sample SEMs.”
MethodDevelopment of a Brief Screening Instrument: The HANDS
Baer, L., Jacobs, D. G., Meszler-Reizes, J., Blais, M., Fava, M., Kessler, R., Magruder, K., Murphy, J., Kopans, B., Cukor, P., et al. (2000) · Psychotherapy and Psychosomatics · doi:10.1159/000012364 · Cited by 128
Edelen, M. O., & Saliba, D. (2010) · The Journals of Gerontology Series A: Biological Sciences and Medical Sciences · doi:10.1093/gerona/glp215 · Cited by 68
Oakland, T., Douglas, S., & Kane, H. (2016) · Journal of Psychoeducational Assessment · doi:10.1177/0734282915595303 · Cited by 52
Metacognitive knowledge in children at early elementary school
Haberkorn, K., Lockl, K., Pohl, S., Ebert, S., & Weinert, S. (2014) · Metacognition and Learning · doi:10.1007/s11409-014-9115-1 · Cited by 18
Metadata
- Authors
- Embretson, S. E.
- Venue
- Psychological Assessment
- Published
- 1996-12
- Volume
- 8
- Issue
- 4
- Pages
- 341-349
- ISSN
- 1040-3590 (ISSN-L)
- 1939-134X
- OpenAlex
- W2083879993
- Cited by
- 469
- References
- 22
- FWCI
- 10.33
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.