The DOI matches its Crossref record.
The Relation of the Reliability of Multiple-Choice Tests to the Distribution of Item Difficulties
Abstract
Under certain assumptions an expression, in terms of item difficulties and intercorrelations, is derived for the curvilinear correlation of test score on the “ability underlying the test,” this ability being defined as the common factor of the item tetrachoric intercorrelations corrected for guessing. It is shown that this curvilinear correlation is equal to the square root of the test reliability. Numerical values for these curvilinear correlations are presented for a number of hypothetical tests, defined in terms of their item parameters. These numerical results indicate that the reliability and the curvilinear correlation will be maximized by (1) minimizing the variability of item difficulty and (2) making the level of item difficulty somewhat easier than the halfway point between a chance percentage of correct answers and 100 per cent correct answers.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cited by
Objective Tests as Instruments of Psychological Theory
Loevinger, J. (1957) · Psychological Reports · doi:10.2466/pr0.1957.3.3.635 · Cited by 1,473
Hobart, J., & Cano, S. (2009) · Health Technology Assessment · doi:10.3310/hta13120 · Cited by 621
Kerr, S. L., & Neale, J. M. (1993) · Journal of Abnormal Psychology · doi:10.1037/0021-843x.102.2.312 · Cited by 584
The measurement of differential deficit
Chapman, L. J., & Chapman, J. P. (1978) · Journal of Psychiatric Research · doi:10.1016/0022-3956(78)90034-1 · Cited by 525
Hobart, J. C., Cano, S. J., Zajicek, J. P., & Thompson, A. J. (2007) · The Lancet Neurology · doi:10.1016/s1474-4422(07)70290-9 · Cited by 495
Problems in the measurement of cognitive deficits.
Chapman, L. J., & Chapman, J. P. (1973) · Psychological Bulletin · doi:10.1037/h0034541 · Cited by 383
Bernstein, I. H., & Teng, G. (1989) · Psychological Bulletin · doi:10.1037//0033-2909.105.3.467 · Cited by 321
Applied Measurement with jMetrik
Meyer, J. P. (2014) · doi:10.4324/9780203115190 · Cited by 170
Multiple-choice testing in education: Are the best practices for assessment also good for learning?
Butler, A. C. (2018) · Journal of Applied Research in Memory and Cognition · doi:10.1016/j.jarmac.2018.07.002 · Cited by 142
Cwik, J. C., Forkmann, T., Glaesmer, H., Paashaus, L., Schönfelder, A., Rath, D., Prinz, S., Juckel, G., & Teismann, T. (2020) · BMC Psychiatry · doi:10.1186/s12888-020-02812-9 · Cited by 5
Metadata
- Authors
- Lord, F. M.
- Venue
- Psychometrika
- Publisher
- Cambridge University Press (CUP)
- Published
- 1952-06
- Volume
- 17
- Issue
- 2
- Pages
- 181-194
- ISSN
- 0033-3123 (ISSN-L)
- 1860-0980
- OpenAlex
- W2064889271
- Cited by
- 178
- References
- 0
- FWCI
- 5.83
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.