Thanks coefficient alpha, we’ll take it from here.
The DOI matches its Crossref record; 88 of the 88 references it cites were found in a registry or an index.
Abstract
Empirical studies in psychology commonly report Cronbach's alpha as a measure of internal consistency reliability despite the fact that many methodological studies have shown that Cronbach's alpha is riddled with problems stemming from unrealistic assumptions. In many circumstances, violating these assumptions yields estimates of reliability that are too small, making measures look less reliable than they actually are. Although methodological critiques of Cronbach's alpha are being cited with increasing frequency in empirical studies, in this tutorial we discuss how the trend is not necessarily improving methodology used in the literature. That is, many studies continue to use Cronbach's alpha without regard for its assumptions or merely cite methodological articles advising against its use to rationalize unfavorable Cronbach's alpha estimates. This tutorial first provides evidence that recommendations against Cronbach's alpha have not appreciably changed how empirical studies report reliability. Then, we summarize the drawbacks of Cronbach's alpha conceptually without relying on mathematical or simulation-based arguments so that these arguments are accessible to a broad audience. We continue by discussing several alternative measures that make less rigid assumptions which provide justifiably higher estimates of reliability compared to Cronbach's alpha. We conclude with empirical examples to illustrate advantages of alternative measures of reliability including omega total, Revelle's omega total, the greatest lower bound, and Coefficient H. A detailed software appendix is also provided to help researchers implement alternative methods. (PsycINFO Database Record
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“we calculated not only Cronbach ' s alpha, but also McDonald ' s omega values following recent recommendations”
From Psychometric properties of the engaged living scale (ELS) Spanish version in a large sample of Spanish pilgrims (2023) · cites this paper as McNeish, 2018
In the citing paper
“Such experiments often involve a cognitive load measurement, which is particularly challenging because this latent construct is not directly observable or physically measurable (Ayres, 2018;McNeish, 2018).”
From Development and Validation of a Theory-Based Questionnaire to Measure Different Types of Cognitive Load (2023) · cites this paper as McNeish, 2018
Citations
Cites
Hu, L., & Bentler, P. M. (1999) · Structural Equation Modeling A Multidisciplinary Journal · doi:10.1080/10705519909540118 · Cited by 108,788
Baron, R. M., & Kenny, D. A. (1986) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.51.6.1173 · Cited by 91,532
Coefficient Alpha and the Internal Structure of Tests
Cronbach, L. J. (1951) · Psychometrika · doi:10.1007/bf02310555 · Cited by 43,931
Self-efficacy: Toward a unifying theory of behavioral change
Bandura, A. (1977) · Psychological Review · doi:10.1037/0033-295x.84.2.191 · Cited by 43,925
Evaluating Goodness-of-Fit Indexes for Testing Measurement Invariance
Cheung, G. W., & Rensvold, R. B. (2002) · Structural Equation Modeling: A Multidisciplinary Journal · doi:10.1207/s15328007sem0902_5 · Cited by 16,280
Hu, L.-T., & Bentler, P. M. (1998) · Psychological Methods · doi:10.1037/1082-989x.3.4.424 · Cited by 12,298
Sensitivity of Goodness of Fit Indexes to Lack of Measurement Invariance
Chen, F. F. (2007) · Structural Equation Modeling: A Multidisciplinary Journal · doi:10.1080/10705510701301834 · Cited by 12,217
What is coefficient alpha? An examination of theory and applications
Cortina, J. M. (1993) · Journal of Applied Psychology · doi:10.1037/0021-9010.78.1.98 · Cited by 8,810
Marsh, H. W., Hau, K.-T., & Wen, Z. (2004) · Structural Equation Modeling: A Multidisciplinary Journal · doi:10.1207/s15328007sem1103_2 · Cited by 6,691
Introduction to Classical and Modern Test Theory
Crocker, L. M., & Algina, J. J. (1986) · Cited by 5,090
Measurement, Design, and Analysis: An Integrated Approach.
Funk, S. G., Pedhazur, E. J., & Schmelkin, L. P. (1992) · Journal of the American Statistical Association · doi:10.2307/2290248 · Cited by 4,018
Dunn, T. J., Baguley, T., & Brunsden, V. (2014) · British Journal of Psychology · doi:10.1111/bjop.12046 · Cited by 3,596
psych: Procedures for Personality and Psychological Research
Revelle, W. (2017) · Cited by 3,321
Flora, D. B., & Curran, P. J. (2004) · Psychological Methods · doi:10.1037/1082-989x.9.4.466 · Cited by 3,019
The Performance of RMSEA in Models With Small Degrees of Freedom
Kenny, D. A., Kaniskan, B., & McCoach, D. B. (2015) · Sociological Methods & Research · doi:10.1177/0049124114543236 · Cited by 2,841
Rhemtulla, M., Brosseau-Liard, P. É., & Savalei, V. (2012) · Psychological Methods · doi:10.1037/a0029315 · Cited by 2,816
On the use, the misuse, and the very limited usefulness of Cronbach’s alpha
Sijtsma, K. (2009) · Psychometrika · doi:10.1007/s11336-008-9101-0 · Cited by 2,814
Structural equation modelling: Adjudging model fit
Barrett, P. (2007) · Personality and Individual Differences · doi:10.1016/j.paid.2006.09.018 · Cited by 2,611
Uses and abuses of coefficient alpha
Schmitt, N. (1996) · Psychological Assessment · doi:10.1037/1040-3590.8.4.350 · Cited by 2,588
The Rediscovery of Bifactor Measurement Models
Reise, S. P. (2012) · Multivariate Behavioral Research · doi:10.1080/00273171.2012.715555 · Cited by 2,112
Estimation of composite reliability for congeneric measures
Raykov, T. (1997) · Applied Psychological Measurement · doi:10.1177/01466216970212006 · Cited by 1,775
Coefficients Alpha, Beta, Omega, and the glb: Comments on Sijtsma
Revelle, W., & Zinbarg, R. E. (2009) · Psychometrika · doi:10.1007/s11336-008-9102-z · Cited by 1,628
My Current Thoughts on Coefficient Alpha and Successor Procedures
Cronbach, L. J., & Shavelson, R. J. (2004) · Educational and Psychological Measurement · doi:10.1177/0013164404266386 · Cited by 1,606
Reliability estimation in a multilevel confirmatory factor analysis framework.
Geldhof, G. J., Preacher, K. J., & Zyphur, M. J. (2014) · Psychological Methods · doi:10.1037/a0032138 · Cited by 1,496
Zinbarg, R. E., Revelle, W., Yovel, I., & Li, W. (2005) · Psychometrika · doi:10.1007/s11336-003-0974-7 · Cited by 1,439
Gadermann, A., Guhn, M., & Zumbo, B. D. (2020) · PubMed · doi:10.7275/n560-j767 · Cited by 1,200
A Basis for Analyzing Test-Retest Reliability
Guttman, L. (1945) · Psychometrika · doi:10.1007/bf02288892 · Cited by 1,122
On the relationship between coefficient alpha and composite reliability.
Peterson, R. A., & Kim, Y. (2013) · Journal of Applied Psychology · doi:10.1037/a0030767 · Cited by 1,104
The Development of Hierarchical Factor Solutions
Schmid, J., & Leiman, J. M. (1957) · Psychometrika · doi:10.1007/bf02289209 · Cited by 1,098
Scoring and Modeling Psychological Measures in the Presence of Multidimensionality
Reise, S. P., Bonifay, W. E., & Haviland, M. G. (2013) · Journal of Personality Assessment · doi:10.1080/00223891.2012.725437 · Cited by 1,069
Ordinal Versions of Coefficients Alpha and Theta for Likert Rating Scales
Zumbo, B. D., Gadermann, A. M., & Zeisser, C. (2007) · Journal of Modern Applied Statistical Methods · doi:10.22237/jmasm/1177992180 · Cited by 1,021
Methodology Review: Assessing Unidimensionality of Tests and ltenls
Hattie, J. (1985) · Applied Psychological Measurement · doi:10.1177/014662168500900204 · Cited by 1,013
Trizano-Hermosilla, I., & Alvarado, J. M. (2016) · Frontiers in Psychology · doi:10.3389/fpsyg.2016.00769 · Cited by 942
McDonald, R. P. (1970) · British Journal of Mathematical and Statistical Psychology · doi:10.1111/j.2044-8317.1970.tb00432.x · Cited by 781
The role of the bifactor model in resolving dimensionality issues in health outcomes measures
Reise, S. P., Morizot, J., & Hays, R. D. (2007) · Quality of Life Research · doi:10.1007/s11136-007-9183-7 · Cited by 747
Graham, J. M. (2006) · Educational and Psychological Measurement · doi:10.1177/0013164406288165 · Cited by 687
A Handbook of Test Construction: Introduction to Psychometric Design
Kline, P. (1987) · Medical Entomology and Zoology · Cited by 625
Limitations of Coefficient Alpha as an Index of Test Unidimensionality1
Green, S. B., Lissitz, R. W., & Mulaik, S. A. (1977) · Educational and Psychological Measurement · doi:10.1177/001316447703700403 · Cited by 522
Van Noorden, R., Maher, B., & Nuzzo, R. (2014) · Nature · doi:10.1038/514550a · Cited by 508
Raykov, T. (1997) · Multivariate Behavioral Research · doi:10.1207/s15327906mbr3204_2 · Cited by 481
Coefficient Alpha: A Reliability Coefficient for the 21st Century?
Yang, Y., & Green, S. B. (2011) · Journal of Psychoeducational Assessment · doi:10.1177/0734282911406668 · Cited by 479
Cole, D. A., Ciesla, J. A., & Steiger, J. H. (2007) · Psychological Methods · doi:10.1037/1082-989x.12.4.381 · Cited by 448
COEFFICIENT ALPHA AND THE RELIABILITY OF COMPOSITE MEASUREMENTS
Novick, M. R., & Lewis, C. (1966) · ETS Research Bulletin Series · doi:10.1002/j.2333-8504.1966.tb00356.x · Cited by 446
Coefficient Alpha and Composite Reliability With Interrelated Nonhomogeneous Items
Raykov, T. (1998) · Applied Psychological Measurement · doi:10.1177/014662169802200407 · Cited by 438
Green, S. B., & Yang, Y. (2009) · Psychometrika · doi:10.1007/s11336-008-9099-3 · Cited by 428
Zinbarg, R. E., Yovel, I., Revelle, W., & McDonald, R. P. (2006) · Applied Psychological Measurement · doi:10.1177/0146621605278814 · Cited by 422
Alpha, Dimension-Free, and Model-Based Internal Consistency Reliability
Bentler, P. M. (2009) · Psychometrika · doi:10.1007/s11336-008-9100-1 · Cited by 405
Hierarchical Cluster Analysis And The Internal Structure Of Tests
Revelle, W. (1979) · Multivariate Behavioral Research · doi:10.1207/s15327906mbr1401_4 · Cited by 397
Miller, M. B. (1995) · Structural Equation Modeling: A Multidisciplinary Journal · doi:10.1080/10705519509540013 · Cited by 377
Behavioral scale reliability and measurement invariance evaluation using latent variable modeling
Raykov, T. (2004) · Behavior Therapy · doi:10.1016/s0005-7894(04)80041-8 · Cited by 362
The Greatest Lower Bound to the Reliability of a Test and the Hypothesis of Unidimensionality
Ten Berge, J. M. F., & Sočan, G. (2004) · Psychometrika · doi:10.1007/bf02289858 · Cited by 338
Peters, G.-J. (2014) · DSpace (Open University in the Netherlands) · doi:10.17605/osf.io/tnrxv · Cited by 334
Commentary on Coefficient Alpha: A Cautionary Tale
Green, S. B., & Yang, Y. (2009) · Psychometrika · doi:10.1007/s11336-008-9098-4 · Cited by 312
Raykov, T., & Shrout, P. E. (2002) · Structural Equation Modeling: A Multidisciplinary Journal · doi:10.1207/s15328007sem0902_3 · Cited by 283
Kelley, K., & Pornprasertmanit, S. (2016) · Psychological Methods · doi:10.1037/a0040086 · Cited by 259
Reliability Methods: A Note on the Frequency of Use of Various Types
Hogan, T. P., Benjamin, A., & Brezinski, K. L. (2000) · Educational and Psychological Measurement · doi:10.1177/00131640021970691 · Cited by 258
Methods for the Behavioral, Educational, and Social Sciences: An R package
Kelley, K. (2007) · Behavior Research Methods · doi:10.3758/bf03192993 · Cited by 255
Scale quality: alpha is an inadequate estimate and factor-analytic evidence is needed first of all
Crutzen, R., & Peters, G.-J. Y. (2017) · Health Psychology Review · doi:10.1080/17437199.2015.1124240 · Cited by 253
The nature of the data, or how to choose a correlation coefficient
Carroll, J. B. (1961) · Psychometrika · doi:10.1007/bf02289768 · Cited by 248
Zhang, Z., & Yuan, K.-H. (2016) · Educational and Psychological Measurement · doi:10.1177/0013164415594658 · Cited by 186
A Numerical Approach to the Approximate and the Exact Minimum Rank of a Covariance Matrix
ten Berge, J. M. F., & Kiers, H. A. L. (1991) · Psychometrika · doi:10.1007/bf02294464 · Cited by 179
Jackson, P. H., & Agunwamba, C. C. (1977) · Psychometrika · doi:10.1007/bf02295979 · Cited by 177
Wolff, H. G., & Preising, K. (2005) · Behavior Research Methods · doi:10.3758/bf03206397 · Cited by 163
The Reliability Paradox in Assessing Structural Relations Within Covariance Structure Models
Hancock, G. R., & Mueller, R. O. (2011) · Educational and Psychological Measurement · doi:10.1177/0013164410384856 · Cited by 163
Understanding Science Achievement Gaps by Race/Ethnicity and Gender in Kindergarten and First Grade
Curran, F. C., & Kellogg, A. T. (2016) · Educational Researcher · doi:10.3102/0013189x16656611 · Cited by 157
Uses of item response theory and the testlet concept in the measurement of psychopathology.
Steinberg, L., & Thissen, D. (1996) · Psychological Methods · doi:10.1037/1082-989x.1.1.81 · Cited by 146
Coefficient Alpha as an Estimate of Test Reliability Under Violation of Two Assumptions
Zimmerman, D. W., Zumbo, B. D., & Lalonde, C. (1993) · Educational and Psychological Measurement · doi:10.1177/0013164493053001003 · Cited by 142
Correlated Errors in True Score Models and Their Effect on Coefficient Alpha
Green, S. B., & Hershberger, S. L. (2000) · Structural Equation Modeling A Multidisciplinary Journal · doi:10.1207/s15328007sem0702_6 · Cited by 141
On the Distribution of the Maximum Likelihood Estimator of Cronbach's Alpha
Zyl, V., Neudecker, H., & Nel, D. G. (2000) · Psychometrika · doi:10.1007/bf02296146 · Cited by 140
Is Coefficient Alpha Robust to Non-Normal Data?
Sheng, Y., & Sheng, Z. (2012) · Frontiers in Psychology · doi:10.3389/fpsyg.2012.00034 · Cited by 120
Why the resistance to statistical innovations? Bridging the communication gap.
Sharpe, D. (2013) · Psychological Methods · doi:10.1037/a0034177 · Cited by 119
Mansolf, M. A., & Reise, S. P. (2016) · Multivariate Behavioral Research · doi:10.1080/00273171.2016.1215898 · Cited by 101
Coefficient Alpha and Beyond: Issues and Alternatives for Educational Research
Teo, T. P., & Fan, X. (2013) · The Asia-Pacific Education Researcher · doi:10.1007/s40299-013-0075-z · Cited by 91
Gignac, G. E., Bates, T. C., & Jang, K. L. (2007) · Personality and Individual Differences · doi:10.1016/j.paid.2007.02.024 · Cited by 91
How important is transient error in estimating reliability? Going beyond simulation studies.
Becker, G. (2000) · Psychological Methods · doi:10.1037/1082-989x.5.3.370 · Cited by 88
A coefficient alpha for test-retest data.
Green, S. B. (2003) · Psychological Methods · doi:10.1037/1082-989x.8.1.88 · Cited by 88
Estimating ω h for Structures Containing Two Group Factors: Perils and Prospects
Zinbarg, R. E., Revelle, W., & Yovel, I. (2007) · Applied Psychological Measurement · doi:10.1177/0146621606291558 · Cited by 83
Alpha-Maximized Factor Analysis (Alphamax): Its Relation to Alpha and Canonical Factor Analysis
Bentler, P. M. (1968) · Psychometrika · doi:10.1007/bf02289328 · Cited by 83
Individual Differences in Cognition: New Methods for Examining the Personality-Cognition Link
Revelle, W., Wilt, J. A., & Rosenthal, A. M. (2010) · Plenum series on human exceptionality · doi:10.1007/978-1-4419-1210-7_2 · Cited by 81
Scaling theory and the nature of measurement
Rozeboom, W. W. (1966) · Synthese · doi:10.1007/bf00485356 · Cited by 74
Zumbo, B. D., & Rupp, A. (2004) · Sage eBooks · doi:10.4135/9781412986311.n4 · Cited by 50
Terry, L. J., & Kelley, K. (2011) · British Journal of Mathematical and Statistical Psychology · doi:10.1111/j.2044-8317.2011.02030.x · Cited by 47
Shapiro, A., & ten Berge, J. M. F. (2000) · Psychometrika · doi:10.1007/bf02296154 · Cited by 44
Covariance Structure Models for Maximal Reliability of Unit-Weighted Composites
Bentler, P. M. (2007) · Elsevier eBooks · doi:10.1016/b978-044452044-9/50004-5 · Cited by 40
Kelley, K., & Cheng, Y. (2011) · Methodology · doi:10.1027/1614-2241/a000036 · Cited by 39
Beyond Free Lunch: Which Family Background Measures Matter?
Lubienski, S. T., & Crane, C. C. (2010) · Education Policy Analysis Archives · doi:10.14507/epaa.v18n11.2010 · Cited by 35
Generalizing the Reliability of Tests Comprised of Testlets
Gessaroli, M. E., & Folske, J. C. (2002) · International Journal of Testing · doi:10.1080/15305058.2002.9669496 · Cited by 16
WITHDRAWNPreprint
Crutzen, R. (2024) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/a8tkc · Cited by 10
Cited by
Use Omega Rather than Cronbach’s Alpha for Estimating Reliability. But…
Hayes, A. F., & Coutts, J. J. (2020) · Communication Methods and Measures · doi:10.1080/19312458.2020.1718629 · Cited by 2,675
An Updated Guideline for Assessing Discriminant Validity
Rönkkö, M., & Cho, E. (2022) · Organizational Research Methods · doi:10.1177/1094428120968614 · Cited by 1,309
“Recent research suggests that the congeneric reliability coefficient is a safer choice because of the less stringent assumption (Cho, 2016; Cho & Kim, 2015; McNeish, 2017).”
BackgroundA Review of Key Likert Scale Development Advances: 1995–2019
Jebb, A. T., Ng, V., & Tay, L. (2021) · Frontiers in Psychology · doi:10.3389/fpsyg.2021.637547 · Cited by 770
A perspective on using partial least squares structural equation modelling in data articles
Ringle, C. M., Sarstedt, M., Sinkovics, N., & Sinkovics, R. R. (2023) · Data in Brief · doi:10.1016/j.dib.2023.109074 · Cited by 767
Un viaje alrededor de alfa y omega para estimar la fiabilidad de consistencia interna
Viladrich, C., Angulo-Brunet, A., & Doval, E. (2017) · Anales de Psicología · doi:10.6018/analesps.33.3.268401 · Cited by 699
Metadata
- Authors
- McNeish, D.
- Affiliations
- Utrecht University (NL)
- Corresponding author
- McNeish, Daniel
- ORCID
- McNeish, Daniel
- Venue
- Psychological Methods
- Published
- 2018-09
- Volume
- 23
- Issue
- 3
- Pages
- 412-433
- ISSN
- 1082-989X (ISSN-L)
- 1939-1463
- OpenAlex
- W2617619553
- Cited by
- 2,533
- References
- 88
- Citations by year
- 2026: 439 · 2025: 397 · 2024: 389 · 2023: 326 · 2022: 309 · 2021: 247 · 2020: 195 · 2019: 147 · 2018: 57
- FWCI
- 102.22
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Psychological Methods (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Social Sciences › Decision Sciences › Management Science and Operations Research › Psychometric Methodologies and Testing
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Reliability and Agreement in Measurement
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Keywords
- Cronbach's alpha, internal consistency, reliability estimation, methodological critique, greatest lower bound
- MeSH terms
- Data Interpretation, Statistical, Humans, Psychometrics, Reproducibility of Results
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.