The DOI matches its Crossref record.
The Theory of the Estimation of Test Reliability
Abstract
The theoretically best estimate of the reliability coefficient is stated in terms of a precise definition of the equivalence of two forms of a test. Various approximations to this theoretical formula are derived, with reference to several degrees of completeness of information about the test and to special assumptions. The familiar Spearman-Brown Formula is shown to be a special case of the general formulation of the problem of reliability. Reliability coefficients computed in various ways are presented for comparative purposes.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cited by
Coefficient Alpha and the Internal Structure of Tests
Cronbach, L. J. (1951) · Psychometrika · doi:10.1007/bf02310555 · Cited by 43,931
Intraclass correlations: Uses in assessing rater reliability.
Shrout, P. E., & Fleiss, J. L. (1979) · Psychological Bulletin · doi:10.1037/0033-2909.86.2.420 · Cited by 24,532
Downs, S. H., & Black, N. (1998) · Journal of Epidemiology and Community Health · doi:10.1136/jech.52.6.377 · Cited by 8,252
Constructing validity: Basic issues in objective scale development.
Clark, L. A., & Watson, D. (1995) · Psychological Assessment · doi:10.1037/1040-3590.7.3.309 · Cited by 6,567
Starting at the beginning: an introduction to coefficient alpha and internal consistency
Streiner, D. L. (2003) · Journal of Personality Assessment · doi:10.1207/s15327752jpa8001_18 · Cited by 3,794
On the use, the misuse, and the very limited usefulness of Cronbach’s alpha
Sijtsma, K. (2009) · Psychometrika · doi:10.1007/s11336-008-9101-0 · Cited by 2,814
Evidence for a three-factor theory of emotions
Russell, J. A., & Mehrabian, A. (1977) · Journal of Research in Personality · doi:10.1016/0092-6566(77)90037-x · Cited by 1,940
A methodological framework for assessing health indices
Kirshner, B., & Guyatt, G. (1985) · Journal of Chronic Diseases · doi:10.1016/0021-9681(85)90005-0 · Cited by 1,538
A Basis for Analyzing Test-Retest Reliability
Guttman, L. (1945) · Psychometrika · doi:10.1007/bf02288892 · Cited by 1,122
Carron, A. V., Widmeyer, W. N., & Brawley, L. R. (1985) · Journal of Sport Psychology · doi:10.1123/jsp.7.3.244 · Cited by 1,050
Affects of variable and subject sampling on factor pattern recovery.
Velicer, W. F., & Fava, J. L. (1998) · Psychological Methods · doi:10.1037/1082-989x.3.2.231 · Cited by 998
Evolutionary Personality Psychology
Buss, D. M. (1991) · Annual Review of Psychology · doi:10.1146/annurev.ps.42.020191.002331 · Cited by 930
Rethinking Internal Consistency in Cronbach’s Alpha
Vaske, J. J., Beaman, J., & Sponarski, C. C. (2017) · Leisure Sciences · doi:10.1080/01490400.2015.1127189 · Cited by 856
Joiner, T. E., Van Orden, K. A., Witte, T. K., Selby, E. A., Ribeiro, J. D., Lewis, R., & Rudd, M. D. (2009) · Journal of Abnormal Psychology · doi:10.1037/a0016500 · Cited by 814
SemEval-2018 Task 1: Affect in Tweets
Mohammad, S., Bravo-Marquez, F., Salameh, M., & Kiritchenko, S. (2018) · Proceedings of The 12th International Workshop on Semantic Evaluation · doi:10.18653/v1/s18-1001 · Cited by 746
Reliability: on the reproducibility of assessment data
Downing, S. M. (2004) · Medical Education · doi:10.1111/j.1365-2929.2004.01932.x · Cited by 721
Reassessing the reliability and validity of self-report delinquency measures
Huizinga, D., & Elliott, D. S. (1986) · Journal of Quantitative Criminology · doi:10.1007/bf01064258 · Cited by 717
Hobart, J., & Cano, S. (2009) · Health Technology Assessment · doi:10.3310/hta13120 · Cited by 621
Making Reliability Reliable: A Systematic Approach to Reliability Coefficients
Cho, E. (2016) · Organizational Research Methods · doi:10.1177/1094428116656239 · Cited by 378
Coulter, R. W. S., Mair, C., Miller, E., Blosnich, J. R., Matthews, D. D., & McCauley, H. L. (2017) · Prevention Science · doi:10.1007/s11121-017-0762-8 · Cited by 380
Stewart, E. B. (2008) · Education and Urban Society · doi:10.1177/0013124507304167 · Cited by 361
Low and decreasing self-esteem during adolescence predict adult depression two decades later.
Steiger, A. E., Allemand, M., Robins, R. W., & Fend, H. A. (2014) · Journal of Personality and Social Psychology · doi:10.1037/a0035133 · Cited by 348
Feldt, L. S. (1969) · Psychometrika · doi:10.1007/bf02289364 · Cited by 345
A New Model for Predicting Behavioral Intentions: An Alternative to Fishbein
Warshaw, P. R. (1980) · Journal of Marketing Research · doi:10.1177/002224378001700201 · Cited by 340
Marc, L. G., Raue, P. J., & Bruce, M. L. (2008) · The American Journal of Geriatric Psychiatry · doi:10.1097/jgp.0b013e318186bd67 · Cited by 320
Kelley, K., & Pornprasertmanit, S. (2016) · Psychological Methods · doi:10.1037/a0040086 · Cited by 259
When Can Subscores Have Value?
Haberman, S. J. (2008) · Journal of Educational and Behavioral Statistics · doi:10.3102/1076998607302636 · Cited by 240
Olderbak, S., Wilhelm, O., Olaru, G., Geiger, M., Brenneman, M. W., & Roberts, R. D. (2015) · Frontiers in Psychology · doi:10.3389/fpsyg.2015.01503 · Cited by 228
Revisiting the role of impulsivity and compulsivity in problematic sexual behaviors
Bőthe, B., Tóth-Király, I., Potenza, M. N., Griffiths, M. D., Orosz, G., & Demetrovics, Z. (2019) · The Journal of Sex Research · doi:10.1080/00224499.2018.1480744 · Cited by 220
Metzelthin, S. F., Daniëls, R., van Rossum, E., de Witte, L., van den Heuvel, W. J., & Kempen, G. I. (2010) · BMC Public Health · doi:10.1186/1471-2458-10-176 · Cited by 169
The influence of religion on death anxiety and death acceptance
Harding, S. R., Flannelly, K. J., Weaver, A. J., & Costa, K. G. (2005) · Mental Health, Religion & Culture · doi:10.1080/13674670412331304311 · Cited by 168
Hill, H. E., Haertzen, C. A., Wolbach, A. B., & Miner, E. J. (1963) · Psychopharmacologia · doi:10.1007/bf02584089 · Cited by 159
Jung, H., von Sternberg, K., & Davis, K. (2016) · Psychiatry Research · doi:10.1016/j.psychres.2016.06.034 · Cited by 154
von Hippel, P., & Hamrock, C. (2019) · Sociological Science · doi:10.15195/v6.a3 · Cited by 149
Item analysis of multiple choice questions: A quality assurance test for an assessment tool
Kumar, D., Jaipurkar, R., Shekhar, A., Sikri, G., & Srinivas, V. (2021) · Medical Journal Armed Forces India · doi:10.1016/j.mjafi.2020.11.007 · Cited by 109
Komaroff, E. (1997) · Applied Psychological Measurement · doi:10.1177/01466216970214004 · Cited by 94
Gruenenfelder-Steiger, A. E., Harris, M. A., & Fend, H. A. (2016) · Developmental Psychology · doi:10.1037/dev0000147 · Cited by 92
Fife, D. A., Mendoza, J. L., & Terry, R. (2012) · Educational and Psychological Measurement · doi:10.1177/0013164411430225 · Cited by 57
Park, C. S., & Kaye, B. K. (2018) · Journalism & Mass Communication Quarterly · doi:10.1177/1077699017753149 · Cited by 55
Vissoci, J. R. N., Hertz, J., El-Gabri, D., Andrade Do Nascimento, J. R., Pestillo De Oliveira, L., Mmbaga, B. T., Mvungi, M., & Staton, C. A. (2018) · Alcohol and Alcoholism · doi:10.1093/alcalc/agx058 · Cited by 40
Testing enhances learning across a range of episodic memory abilities
Pan, S. C., Pashler, H., Potter, Z. E., & Rickard, T. C. (2015) · Journal of Memory and Language · doi:10.1016/j.jml.2015.04.001 · Cited by 41
Liu, Q., Ma, J., Yu, S., Wang, Q., & Xu, S. (2022) · Journal of Science Education and Technology · doi:10.1007/s10956-022-10014-z · Cited by 35
Dajani, D. R., Odriozola, P., Winters, M., Voorhies, W., Marcano, S., Baez, A., Gates, K. M., Dick, A. S., & Uddin, L. Q. (2020) · Journal of Cognitive Neuroscience · doi:10.1162/jocn_a_01536 · Cited by 27
Karbownik, M. S., Kręczyńska, J., Kwarta, P., Cybula, M., Wiktorowska-Owczarek, A., Kowalczyk, E., Pietras, T., & Szemraj, J. (2020) · Nutrients · doi:10.3390/nu12051469 · Cited by 26
Dsouza, J. P., Van den Broucke, S., Pattanshetty, S., & Dhoore, W. (2022) · BMC Women's Health · doi:10.1186/s12905-022-02019-y · Cited by 20
Wicherts, J. M. (2017) · Intelligence · doi:10.1016/j.intell.2016.11.002 · Cited by 17
Vourletsis, I., & Politis, P. (2025) · Education and Information Technologies · doi:10.1007/s10639-024-12887-6 · Cited by 12
Efficient Benchmarking (of Language Models)
Perlitz, Y., Bandel, E., Gera, A., Arviv, O., Ein-Dor, L., Shnarch, E., Slonim, N., Shmueli-Scheuer, M., & Choshen, L. (2024) · Proceedings of the 2024 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 1: Long Papers) · doi:10.18653/v1/2024.naacl-long.139 · Cited by 7
Narine, L. K., & Diaz, J. M. (2026) · Education Sciences · doi:10.3390/educsci16101700
Metadata
- Authors
- Kuder, G. F., & Richardson, M. W.
- Venue
- Psychometrika
- Publisher
- Cambridge University Press (CUP)
- Published
- 1937-09
- Volume
- 2
- Issue
- 3
- Pages
- 151-160
- ISSN
- 0033-3123 (ISSN-L)
- 1860-0980
- OpenAlex
- W2028944185
- Cited by
- 2,002
- References
- 0
- FWCI
- 4.34
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.
