Meta‐Analysis of Coefficient Alpha: A Reliability Generalization Study
The DOI matches its Crossref record; 28 of the 28 references it cites were found in a registry or an index.
Abstract
Increasing precision of measurement is a goal of scientific advancement, but Nunnally's (1978) .70 benchmark for coefficient alpha (alpha) has remained the omnibus test for reliability for nearly 40 years. This likely arises due to there only being scattered empirical evidence of the degree to which the field has met or surpassed this standard. Using meta‐analytic techniques known as reliability generalization (RG), we cumulate alphas across 36 commonly used individual differences, attitudes, and behaviours from 1675 independent samples (N = 991,588). Our primary finding is that alphas almost always exceed .70 and generally fall above .80. In addition, we identified factors that moderate alpha including the specific measure used, the number of scale items, and the rater. The study provides baseline alphas that can be used for research planning and design; it also offers best practices for RG and notes the benefits of RG for understanding systematic fluctuations in reliability.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Sensitivity of Goodness of Fit Indexes to Lack of Measurement Invariance
Chen, F. F. (2007) · Structural Equation Modeling: A Multidisciplinary Journal · doi:10.1080/10705510701301834 · Cited by 12,217
What is coefficient alpha? An examination of theory and applications
Cortina, J. M. (1993) · Journal of Applied Psychology · doi:10.1037/0021-9010.78.1.98 · Cited by 8,810
Vandenberg, R. J., & Lance, C. E. (2000) · Organizational Research Methods · doi:10.1177/109442810031002 · Cited by 7,997
Meyer, J. P., Allen, N. J., & Smith, C. A. (1993) · Journal of Applied Psychology · doi:10.1037/0021-9010.78.4.538 · Cited by 6,458
Mathieu, J. E., & Zajac, D. M. (1990) · Psychological Bulletin · doi:10.1037//0033-2909.108.2.171 · Cited by 6,449
Podsakoff, P. M., MacKenzie, S. B., Moorman, R. H., & Fetter, R. (1990) · The Leadership Quarterly · doi:10.1016/1048-9843(90)90009-7 · Cited by 5,628
The development of markers for the Big-Five factor structure
Goldberg, L. R. (1992) · Psychological Assessment · doi:10.1037/1040-3590.4.1.26 · Cited by 5,530
Moorman, R. H. (1991) · Journal of Applied Psychology · doi:10.1037//0021-9010.76.6.845 · Cited by 3,422
A Meta-Analysis of Cronbach's Coefficient Alpha
Peterson, R. A. (1994) · Journal of Consumer Research · doi:10.1086/209405 · Cited by 3,028
On the use, the misuse, and the very limited usefulness of Cronbach’s alpha
Sijtsma, K. (2009) · Psychometrika · doi:10.1007/s11336-008-9101-0 · Cited by 2,814
Statistical methods in psychology journals: Guidelines and explanations.
Wilkinson, L., & Task Force on Statistical Inference (1999) · American Psychologist · doi:10.1037/0003-066x.54.8.594 · Cited by 2,791
Uses and abuses of coefficient alpha
Schmitt, N. (1996) · Psychological Assessment · doi:10.1037/1040-3590.8.4.350 · Cited by 2,588
Thanks coefficient alpha, we’ll take it from here.
McNeish, D. (2018) · Psychological Methods · doi:10.1037/met0000144 · Cited by 2,533
The Sources of Four Commonly Reported Cutoff Criteria: What Did They Really Say?
Lance, C. E., Butts, M. M., & Michels, L. C. (2006) · Organizational Research Methods · doi:10.1177/1094428105284919 · Cited by 2,053
Bias and Efficiency of Meta-Analytic Variance Estimators in the Random-Effects Model
Viechtbauer, W. (2005) · Journal of Educational and Behavioral Statistics · doi:10.3102/10769986030003261 · Cited by 1,699
A meta-analysis of the dark triad and work behavior: a social exchange perspective
O'Boyle, E. H., Forsyth, D. R., Banks, G. C., & McDaniel, M. A. (2012) · Journal of Applied Psychology · doi:10.1037/a0025679 · Cited by 1,331
The relation between emotional intelligence and job performance: A meta-analysis
O'Boyle, E. H., Humphrey, R. H., Pollack, J. M., Hawver, T. H., & Story, P. A. (2011) · Journal of Organizational Behavior · doi:10.1002/job.714 · Cited by 1,122
Self-citationChen, F. F. (2008) · Journal of Personality and Social Psychology · doi:10.1037/a0013193 · Cited by 962
Reliability Generalization of Scores on the Spielberger State-Trait Anxiety Inventory
Barnes, L. L. B., Harp, D., & Jung, W. S. (2002) · Educational and Psychological Measurement · doi:10.1177/0013164402062004005 · Cited by 947
Correlational effect size benchmarks
Bosco, F. A., Aguinis, H., Singh, K., Field, J. G., & Pierce, C. A. (2015) · Journal of Applied Psychology · doi:10.1037/a0038047 · Cited by 768
Measurement error in psychological research: Lessons from 26 research scenarios.
Schmidt, F. L., & Hunter, J. E. (1996) · Psychological Methods · doi:10.1037/1082-989x.1.2.199 · Cited by 567
Limitations of Coefficient Alpha as an Index of Test Unidimensionality1
Green, S. B., Lissitz, R. W., & Mulaik, S. A. (1977) · Educational and Psychological Measurement · doi:10.1177/001316447703700403 · Cited by 522
Hong, Y., Liao, H., Hu, J., & Jiang, K. (2013) · Journal of Applied Psychology · doi:10.1037/a0031666 · Cited by 386
Making Reliability Reliable: A Systematic Approach to Reliability Coefficients
Cho, E. (2016) · Organizational Research Methods · doi:10.1177/1094428116656239 · Cited by 378
Schmidt, F. L., Le, H., & Ilies, R. (2003) · Psychological Methods · doi:10.1037/1082-989x.8.2.206 · Cited by 362
Yin, P., & Fan, X. (2000) · Educational and Psychological Measurement · doi:10.1177/00131640021970466 · Cited by 197
Using Mixed-Effects Models In Reliability Generalization Studies
Beretvas, S. N., & Pastor, D. A. (2003) · Educational and Psychological Measurement · doi:10.1177/0013164402239318 · Cited by 76
The effect of adding items to scales: An illustrative case of LMX
Keller, T., & Dansereau, F. (2001) · Organizational Research Methods · doi:10.1177/109442810142003 · Cited by 43
Cited by
Hill, A. D., Johnson, S. G., Greco, L. M., O’Boyle, E. H., & Walter, S. L. (2021) · Journal of Management · doi:10.1177/0149206320960533 · Cited by 762
Self-citationMackey, J. D., Parker Ellen, B., McAllister, C. P., & Alexander, K. C. (2021) · Journal of Business Research · doi:10.1016/j.jbusres.2020.10.037 · Cited by 320
De Beer, L. T., van der Vaart, L., Escaffi-Schwarz, M., De Witte, H., & Schaufeli, W. B. (2024) · European Journal of Psychological Assessment · doi:10.1027/1015-5759/a000797 · Cited by 270
Hiller, N. J., Sin, H.-P., Ponnapalli, A. R., & Ozgen, S. (2019) · The Leadership Quarterly · doi:10.1016/j.leaqua.2018.11.003 · Cited by 144
Chandler, J. A., Johnson, N. E., Jordan, S. L., B, D. K., & Short, J. C. (2023) · The Leadership Quarterly · doi:10.1016/j.leaqua.2022.101660 · Cited by 105
Metadata
- Authors
- Greco, L. M., O'Boyle, E. H., Cockburn, B. S., & Yuan, Z.
- Venue
- Journal of Management Studies
- Publisher
- Wiley
- Published
- 2017-12-27
- Volume
- 55
- Issue
- 4
- Pages
- 583-618
- ISSN
- 0022-2380 (ISSN-L)
- 1467-6486
- OpenAlex
- W2769980313
- Cited by
- 87
- References
- 28
- FWCI
- 4.59
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.