The DOI matches its Crossref record; 8 of the 8 references it cites were found in a registry or an index.
A Basis for Analyzing Test-Retest Reliability
Abstract
Three sources of variation in experimental results for a test are distinguished: trials, persons, and items. Unreliability is defined only in terms of variation over trials. This definition leads to a more complete analysis than does the conventional one; Spearman's contention is verified that the conventional approach—which was formulated by Yule—introduces unnecessary hypotheses. It is emphasized that at least two trials are necessary to estimate the reliability coefficient. This paper is devoted largely to developing lower bounds to the reliability coefficient that can be computed from but a single trial; these avoid the experimental difficulties of making two independent trials. Six different lower bounds are established, appropriate for different situations. Some of the bounds are easier to compute than are conventional formulas, and all the bounds assume less than do conventional formulas. The terminology used is that of psychological and sociological testing, but the discussion actually provides a general analysis of the reliability of the sum of n variables.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The proof and measurement of association between two things
Spearman, C. (1904) · The American Journal of Psychology · doi:10.2307/1412159 · Cited by 8,039
The Theory of the Estimation of Test Reliability
Kuder, G. F., & Richardson, M. W. (1937) · Psychometrika · doi:10.1007/bf02288391 · Cited by 2,002
A Basis for Scaling Qualitative Data
Guttman, L. (1944) · American Sociological Review · doi:10.2307/2086306 · Cited by 1,317
Self-citationCORRELATION CALCULATED FROM FAULTY DATA
SPEARMAN, C. (1910) · British Journal of Psychology, 1904-1920 · doi:10.1111/j.2044-8295.1910.tb00206.x · Cited by 1,144
(1921) · Mind · doi:10.1093/mind/xxx.119.375 · Cited by 867
Test Reliability Estimated by Analysis of Variance
Hoyt, C. (1941) · Psychometrika · doi:10.1007/bf02289270 · Cited by 513
Multiple Rectilinear Prediction and the Resolution into Components
Guttman, L. (1940) · Psychometrika · doi:10.1007/bf02287866 · Cited by 75
Self-citationMultiple Rectilinear Prediction and the Resolution into Components: II
Guttman, L., & Cohen, J. (1943) · Psychometrika · doi:10.1007/bf02288701 · Cited by 67
Self-citation
Cited by
Coefficient Alpha and the Internal Structure of Tests
Cronbach, L. J. (1951) · Psychometrika · doi:10.1007/bf02310555 · Cited by 43,931
Moore, G. C., & Benbasat, I. (1991) · Information Systems Research · doi:10.1287/isre.2.3.192 · Cited by 9,150
Perceived Usefulness, Ease of Use, and Usage of Information Technology: A Replication
Adams, D. A., Nelson, R. R., & Todd, P. A. (1992) · MIS Quarterly · doi:10.2307/249577 · Cited by 3,084
On the use, the misuse, and the very limited usefulness of Cronbach’s alpha
Sijtsma, K. (2009) · Psychometrika · doi:10.1007/s11336-008-9101-0 · Cited by 2,814
Use Omega Rather than Cronbach’s Alpha for Estimating Reliability. But…
Hayes, A. F., & Coutts, J. J. (2020) · Communication Methods and Measures · doi:10.1080/19312458.2020.1718629 · Cited by 2,675
Thanks coefficient alpha, we’ll take it from here.
McNeish, D. (2018) · Psychological Methods · doi:10.1037/met0000144 · Cited by 2,533
Benitez, J., Henseler, J., Castillo, A., & Schuberth, F. (2020) · Information & Management · doi:10.1016/j.im.2019.05.003 · Cited by 1,788
Müllensiefen, D., Gingras, B., Musil, J., & Stewart, L. (2014) · PLoS ONE · doi:10.1371/journal.pone.0089642 · Cited by 1,155
Evolutionary Personality Psychology
Buss, D. M. (1991) · Annual Review of Psychology · doi:10.1146/annurev.ps.42.020191.002331 · Cited by 930
Zinbarg, R. E., Yovel, I., Revelle, W., & McDonald, R. P. (2006) · Applied Psychological Measurement · doi:10.1177/0146621605278814 · Cited by 422
Making Reliability Reliable: A Systematic Approach to Reliability Coefficients
Cho, E. (2016) · Organizational Research Methods · doi:10.1177/1094428116656239 · Cited by 378
Birchwood, M., Smith, J., Macmillan, F., Hogg, B., Prasad, R., Harvey, C., & Bering, S. (1989) · Psychological Medicine · doi:10.1017/s0033291700024247 · Cited by 334
Yang, Y., Yuan, Y., Zhang, G., Wang, H., Chen, Y.-C., Liu, Y., Tarolli, C. G., Crepeau, D., Bukartyk, J., Junna, M. R., et al. (2022) · Nature Medicine · doi:10.1038/s41591-022-01932-x · Cited by 296
Kelley, K., & Pornprasertmanit, S. (2016) · Psychological Methods · doi:10.1037/a0040086 · Cited by 259
Wood, D., Harms, P. D., Lowman, G. H., & DeSimone, J. A. (2017) · Social Psychological and Personality Science · doi:10.1177/1948550617703168 · Cited by 243
Pandolfi, V., Magyar, C. I., & Dill, C. A. (2012) · Research in Autism Spectrum Disorders · doi:10.1016/j.rasd.2011.03.009 · Cited by 175
The German Version of the Mobile App Rating Scale (MARS-G): Development and Validation Study
Messner, E.-M., Terhorst, Y., Barke, A., Baumeister, H., Stoyanov, S., Hides, L., Kavanagh, D., Pryss, R., Sander, L., & Probst, T. (2020) · JMIR mHealth and uHealth · doi:10.2196/14479 · Cited by 156
The Disagreement Deconvolution: Bringing Machine Learning Performance Metrics In Line With Reality
Gordon, M. L., Zhou, K., Patel, K., Hashimoto, T., & Bernstein, M. S. (2021) · Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445423 · Cited by 101
Komaroff, E. (1997) · Applied Psychological Measurement · doi:10.1177/01466216970214004 · Cited by 94
Scocco, P., Castriotta, C., Toffol, E., & Preti, A. (2012) · Psychiatry Research · doi:10.1016/j.psychres.2012.06.033 · Cited by 96
PARE, G., & ELAM, J. J. (1995) · Behaviour & Information Technology · doi:10.1080/01449299508914635 · Cited by 84
Eagly, A. H., & Revelle, W. (2022) · Perspectives on Psychological Science · doi:10.1177/17456916211046006 · Cited by 60
Fife, D. A., Mendoza, J. L., & Terry, R. (2012) · Educational and Psychological Measurement · doi:10.1177/0013164411430225 · Cited by 57
Interpretive problems when correcting for attenuation
WlNNE, P. H., & BELFRY, M. J. (1982) · Journal of Educational Measurement · doi:10.1111/j.1745-3984.1982.tb00121.x · Cited by 48
Cronbach’s Alpha and Semantic Overlap Between Items: A Proposed Correction and Tests of Significance
Alkhadim, G. S. (2022) · Frontiers in Psychology · doi:10.3389/fpsyg.2022.815490 · Cited by 41
Smartphone and mobile health apps for tinnitus: Systematic identification, analysis, and assessment
Mehdi, M., Stach, M., Riha, C., Neff, P., Dode, A., Pryss, R., Schlee, W., Reichert, M., & Hauck, F. J. (2020) · JMIR mHealth and uHealth · doi:10.2196/21767 · Cited by 40
A psychometric framework for evaluating and shaping personality traits in large language models
Serapio-García, G., Safdari, M., Crepy, C., Sun, L., Fitz, S., Romero, P., Abdulhai, M., Faust, A., & Matarić, M. (2025) · Nature Machine Intelligence · doi:10.1038/s42256-025-01115-6 · Cited by 30
Boldero, J. M., Hulbert, C. A., Bloom, L., Cooper, J., Gilbert, F., Mooney, J. L., & Salinger, J. (2009) · Personality and Mental Health · doi:10.1002/pmh.93 · Cited by 24
Crossing the seven Cs of internal consistency: Assessing the reliability of formative instruments
Gruijters, S. L. K., Fleuren, B. P. I., & Peters, G. J. (2021) · doi:10.31234/osf.io/qar39 · Cited by 17
Metadata
- Authors
- Guttman, L.
- Venue
- Psychometrika
- Publisher
- Cambridge University Press (CUP)
- Published
- 1945-12
- Volume
- 10
- Issue
- 4
- Pages
- 255-282
- ISSN
- 0033-3123 (ISSN-L)
- 1860-0980
- OpenAlex
- W1992984099
- Cited by
- 1,122
- References
- 8
- FWCI
- 4.53
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.
