Understanding Internal Consistency Reliability Estimates: A Conceptual Primer on Coefficient Alpha
The DOI matches its Crossref record; 50 of the 50 references it cites were found in a registry or an index.
Abstract
Although often ignored, reliability is critical when interpreting study effects and test results. Accordingly, this article focuses on the most commonly used estimate of reliability, internal consistency coefficients, with emphasis on coefficient alpha. An interpretive framework is provided for applied researchers and others seeking a conceptual understanding of these estimates.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“We define reliability in this context as internal consistency reliability, a well-established statistical concept and the most common type of reliability employed across domains Henson (2001).”
From Can You Trust LLM Judgments? Reliability of LLM-as-a-Judge (2024) · cites this paper as Henson (2001)
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Coefficient Alpha and the Internal Structure of Tests
Cronbach, L. J. (1951) · Psychometrika · doi:10.1007/bf02310555 · Cited by 43,931
Review of Psychometric theory (2nd ed.).
SITGREAVES, R. (1979) · Contemporary Psychology: A Journal of Reviews · doi:10.1037/018882 · Cited by 11,425
Introduction to Classical and Modern Test Theory
Crocker, L. M., & Algina, J. J. (1986) · Cited by 5,090
Measurement, Design, and Analysis: An Integrated Approach.
Funk, S. G., Pedhazur, E. J., & Schmelkin, L. P. (1992) · Journal of the American Statistical Association · doi:10.2307/2290248 · Cited by 4,018
Cohen, J. (1994) · American Psychologist · doi:10.1037/0003-066x.49.12.997 · Cited by 4,003
Hunter, J., & Schmidt, F. (2004) · doi:10.4135/9781412985031 · Cited by 3,023
Educational measurement, 3rd ed.
Linn, R. L. (1989) · Cited by 2,883
Statistical methods in psychology journals: Guidelines and explanations.
Wilkinson, L., & Task Force on Statistical Inference (1999) · American Psychologist · doi:10.1037/0003-066x.54.8.594 · Cited by 2,791
Gulliksen, H. (1950) · John Wiley & Sons, Inc. eBooks · doi:10.1037/13240-000 · Cited by 2,177
Introduction to Measurement Theory
Allen, M. J. (1979) · Cited by 2,124
The Theory of the Estimation of Test Reliability
Kuder, G. F., & Richardson, M. W. (1937) · Psychometrika · doi:10.1007/bf02288391 · Cited by 2,002
The Dependability of Behavioral Measurements: Theory of Generalizability for Scores and Profiles
Merrifield, P. R., Cronbach, L. J., Gleser, G. C., Nanda, H., & Rajaratnam, N. (1974) · American Educational Research Journal · doi:10.2307/1162145 · Cited by 1,819
Things I have learned (so far).
Cohen, J. (1990) · American Psychologist · doi:10.1037/0003-066x.45.12.1304 · Cited by 1,781
Humphreys, L. G., & Lindquist, E. F. (1952) · The American Journal of Psychology · doi:10.2307/1418848 · Cited by 1,502
Measurement and evaluation in teaching
Gronlund, N. E. (1965) · Cited by 1,425
Generalizability theory: a primer
(1992) · Choice Reviews Online · doi:10.5860/choice.29-4192 · Cited by 1,298
Multiple regression as a general data-analytic system.
Cohen, J. (1968) · Psychological Bulletin · doi:10.1037/h0026714 · Cited by 1,095
Development of a general solution to the problem of validity generalization.
Schmidt, F. L., & Hunter, J. E. (1977) · Journal of Applied Psychology · doi:10.1037/0021-9010.62.5.529 · Cited by 769
Educational and Psychological Measurement and Evaluation
Hopkins, K. D., Stanley, J. C., & Hopkins, B. R. (1972) · Medical Entomology and Zoology · Cited by 565
Vacha-Haase, T. (1998) · Educational and Psychological Measurement · doi:10.1177/0013164498058001002 · Cited by 449
Advances in Social Science Methodology
Thompson, B. (1994) · Cited by 423
Psychometrics Is Datametrics: The Test Is Not Reliable
Thompson, B., & Vacha-Haase, T. (2000) · Educational and Psychological Measurement · doi:10.1177/00131640021970448 · Cited by 357
AERA Editorial Policies regarding Statistical Significance Testing: Three Suggested Reforms
Thompson, B. (1996) · Educational Researcher · doi:10.2307/1176337 · Cited by 339
A Reliability Generalization Study of the Teacher Efficacy Scale and Related Instruments
Henson, R. K., Kogan, L. R., & Vacha-Haase, T. (2001) · Educational and Psychological Measurement · doi:10.1177/00131640121971284 · Cited by 307
Self-citationResponse Format in Writing Self-Efficacy Assessment: Greater Discrimination Increases Prediction
Pajares, F., Hartley, J., & Valiante, G. (2001) · Measurement and Evaluation in Counseling and Development · doi:10.1080/07481756.2001.12069012 · Cited by 304
Canonical correlation analysis: A general parametric significance-testing system.
Knapp, T. R. (1978) · Psychological Bulletin · doi:10.1037//0033-2909.85.2.410 · Cited by 286
Psychological Testing: An Introduction
Domino, G., & Domino, M. L. (2006) · Cambridge University Press eBooks · doi:10.1017/cbo9780511813757 · Cited by 261
Reliability Methods: A Note on the Frequency of Use of Various Types
Hogan, T. P., Benjamin, A., & Brezinski, K. L. (2000) · Educational and Psychological Measurement · doi:10.1177/00131640021970691 · Cited by 258
Aiken, L. S., West, S. G., Sechrest, L., & Reno, R. R. (1990) · American Psychologist · doi:10.1037//0003-066x.45.6.721 · Cited by 249
Educational and Psychological Measurement
Boodoo, G. M., & Thompson, B. (2008) · Encyclopedia of Special Education · doi:10.1002/9780470373699.speced0734 · Cited by 242
Thompson, B. (1996) · Educational Researcher · doi:10.3102/0013189x025002026 · Cited by 211
Canonical Correlation Analysis As A Special Case Of A Structural Relations Model
Bagozzi, R. P., Fornell, C., & Larcker, D. F. (1981) · Multivariate Behavioral Research · doi:10.1207/s15327906mbr1604_2 · Cited by 209
Yin, P., & Fan, X. (2000) · Educational and Psychological Measurement · doi:10.1177/00131640021970466 · Cited by 197
Viswesvaran, C., & Ones, D. S. (2000) · Educational and Psychological Measurement · doi:10.1177/00131640021970475 · Cited by 186
A Primer on the Logic and Use of Canonical Correlation Analysis.
Thompson, B. (1991) · Measurement and Evaluation in Counseling and Development · Cited by 167
Viswesvaran, C., & Öneş, D. S. (2003) · Sage eBooks · doi:10.4135/9781412985789.n15 · Cited by 156
Modern Educational Measurement: Practical Guidelines for Educational Leaders
Popham, W. J. (1999) · Cited by 155
Reliability Generalization of the Neo Personality Scales
Caruso, J. C. (2000) · Educational and Psychological Measurement · doi:10.1177/00131640021970484 · Cited by 153
Classroom applications of educational measurement
Oosterhof, A. (1994) · Cited by 137
Reporting Practices and APA Editorial Policies Regarding Statistical Significance and Effect Size
Vacha-Haase, T., Nilsson, J. E., Reetz, D. R., Lance, T. S., & Thompson, B. (2000) · Theory & Psychology · doi:10.1177/0959354300103006 · Cited by 126
Principles of educational measurement and evaluation
Sax, G. (1974) · Medical Entomology and Zoology · Cited by 111
Practices Regarding Reporting of Reliability Coefficients: A Review of Three Journals
Vacha-haase, T., Ness, C., Nilsson, J., & Reetz, D. (1999) · The Journal of Experimental Education · doi:10.1080/00220979909598487 · Cited by 97
McCarthy, C. J., Moller, N. P., & Fouladi, R. T. (2001) · Measurement and Evaluation in Counseling and Development · doi:10.1080/07481756.2001.12069011 · Cited by 85
Henson, R. K., & Smith, A. D. (2000) · Journal of research and development in education · Cited by 70
Self-citationSawilowsky, S. S. (2000) · Educational and Psychological Measurement · doi:10.1177/00131640021970439 · Cited by 69
Mittag, K. C., & Thompson, B. (2000) · Educational Researcher · doi:10.3102/0013189x029004014 · Cited by 67
Motivational Orientations Toward Work: An Evaluation of the Work Preference Inventory (Student Form)
Loo, R. (2001) · Measurement and Evaluation in Counseling and Development · doi:10.1080/07481756.2001.12069013 · Cited by 66
Mittag, K. C., & Thompson, B. (2000) · Educational Researcher · doi:10.2307/1176454 · Cited by 50
Factors Affecting Coefficient Alpha: A Mini Monte Carlo Study.
Reinhardt, B. (1991) · Cited by 49
Reliability: Rejoinder to Thompson and Vacha-Haase
Sawilowsky, S. S. (2000) · Educational and Psychological Measurement · doi:10.1177/00131640021970457 · Cited by 21
Cited by
The Measurement of Work Engagement With a Short Questionnaire: A Cross-National Study
Schaufeli, W. B., Bakker, A. B., & Salanova, M. (2006) · Educational and Psychological Measurement · doi:10.1177/0013164405282471 · Cited by 7,403
“Thus, values of Cronbach’s alpha exceed the value of .70 that is traditionally used as a rule of thumb (Nunnally & Bernstein, 1994), and even more so, in almost all cases, alpha satisfies the more stringent value of .80 that is now considered a generally accepted standard (Henson, 2001).”
BackgroundMethodStarting at the beginning: an introduction to coefficient alpha and internal consistency
Streiner, D. L. (2003) · Journal of Personality Assessment · doi:10.1207/s15327752jpa8001_18 · Cited by 3,794
Skinner, E. A., Kindermann, T. A., & Furrer, C. J. (2009) · Educational and Psychological Measurement · doi:10.1177/0013164408323233 · Cited by 1,587
“80, indicating that some of the correlational results may be attenuated due to measurement error (Henson, 2001).”
BackgroundReliability Generalization of Scores on the Spielberger State-Trait Anxiety Inventory
Barnes, L. L. B., Harp, D., & Jung, W. S. (2002) · Educational and Psychological Measurement · doi:10.1177/0013164402062004005 · Cited by 947
“By referring to the reliability of a test or saying an instrument is reliable, what is generally implied is that once an instrument has been found to be reliable or unreliable, the status it is given is immutable; that reliability does not change (Henson, 2001; Vacha-Haase, Kogan, & Thompson, 2000).”
BackgroundResultInfluentialThe Motivation at Work Scale: Validation Evidence in Two Languages
Gagné, M., Forest, J., Gilbert, M.-H., Aubé, C., Morin, E., & Malorni, A. (2010) · Educational and Psychological Measurement · doi:10.1177/0013164409355698 · Cited by 770
Metadata
- Authors
- Henson, R. K.
- Venue
- Measurement and Evaluation in Counseling and Development
- Publisher
- Informa UK Limited
- Published
- 2001-10
- Volume
- 34
- Issue
- 3
- Pages
- 177-189
- ISSN
- 0748-1756 (ISSN-L)
- 1947-6302
- OpenAlex
- W1883573204
- Cited by
- 1,058
- References
- 50
- FWCI
- 19.93
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.