The DOI matches its Crossref record; 46 of the 46 references it cites were found in a registry or an index.
Testing the Difference Between Reliability Coefficients Alpha and Omega
Open accessAbstract
Reliable measurements are key to social science research. Multiple measures of reliability of the total score have been developed, including coefficient alpha, coefficient omega, the greatest lower bound reliability, and others. Among these, the coefficient alpha has been most widely used, and it is reported in nearly every study involving the measure of a construct through multiple items in social and behavioral research. However, it is known that coefficient alpha underestimates the true reliability unless the items are tau-equivalent, and coefficient omega is deemed as a practical alternative to coefficient alpha in estimating measurement reliability of the total score. However, many researchers noticed that the difference between alpha and omega is minor in applications. Since the observed differences in alpha and omega can be due to sampling errors, the purpose of the present study, therefore, is to propose a method to evaluate the difference of coefficient alpha ([Formula: see text]) and omega ([Formula: see text]) statistically. In particular, the current article develops a procedure to estimate the SE of ([Formula: see text]) and consequently the confidence interval (CI) for ([Formula: see text]). This procedure allows us to test whether the observed difference ([Formula: see text]) is due to sample error or [Formula: see text] is significantly greater than [Formula: see text]. The developed procedure is then applied to multiple real data sets from well-known scales to empirically verify the values of ([Formula: see text]) in practice. Results showed that in most of the comparisons the differences are significantly above zero but cases also exist where the CIs contain zero. An R program for calculating [Formula: see text], [Formula: see text], and the SE of ([Formula: see text]) is also included in the present study so that the developed procedure is easily accessible to applied researchers.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Coefficient Alpha and the Internal Structure of Tests
Cronbach, L. J. (1951) · Psychometrika · doi:10.1007/bf02310555 · Cited by 43,931
A heteroskedasticity-consistent covariance matrix estimator and a direct test for heteroskedasticity
White, H. (1980) · Econometrica · doi:10.2307/1912934 · Cited by 25,861
Comparative fit indexes in structural models.
Bentler, P. M. (1990) · Psychological Bulletin · doi:10.1037/0033-2909.107.2.238 · Cited by 25,266
What is coefficient alpha? An examination of theory and applications
Cortina, J. M. (1993) · Journal of Applied Psychology · doi:10.1037/0021-9010.78.1.98 · Cited by 8,810 · cited 1×
“…of reliability of the total score have been developed, including coefficient alpha (also referred to as Cronbach’s alpha; Cronbach, 1951; see also Cortina, 1993; Raykov, 1997; Raykov& Marcoulides, 2011, 2015), coefficient omega (McDonald, 1999), the greatest lower bound reliability (Bentler,…”
BackgroundStatistical Theories of Mental Test Scores
Rozeboom, W. W., Lord, F. M., Novick, M. R., & Birnbaum, A. (1969) · American Educational Research Journal · doi:10.2307/1162101 · Cited by 8,022
(1999) · Cited by 7,995
Test Theory: A Unified Treatment
Zwick, R., & McDonald, R. P. (2000) · Journal of the American Statistical Association · doi:10.2307/2669496 · Cited by 3,603
Dunn, T. J., Baguley, T., & Brunsden, V. (2014) · British Journal of Psychology · doi:10.1111/bjop.12046 · Cited by 3,596
Handbook of Structural Equation Modeling
Howard, A. L. (2013) · Structural Equation Modeling: A Multidisciplinary Journal · doi:10.1080/10705511.2013.769397 · Cited by 3,440
On the use, the misuse, and the very limited usefulness of Cronbach’s alpha
Sijtsma, K. (2009) · Psychometrika · doi:10.1007/s11336-008-9101-0 · Cited by 2,814
Corrections to test statistics and standard errors in covariance structure analysis.
Satorra, A., & Bentler, P. M. (1994) · Cited by 2,388
Martin, R. A., Puhlik-Doris, P., Larsen, G., Gray, J., & Weir, K. (2003) · Journal of Research in Personality · doi:10.1016/s0092-6566(02)00534-2 · Cited by 2,151
Introduction to Measurement Theory
Allen, M. J. (1979) · Cited by 2,124
Jackknife, Bootstrap and Other Resampling Methods in Regression Analysis
Wu, C. F. J. (1986) · The Annals of Statistics · doi:10.1214/aos/1176350142 · Cited by 1,724
Statistical analysis of sets of congeneric tests
Jöreskog, K. G. (1971) · Psychometrika · doi:10.1007/bf02291393 · Cited by 1,481
Zinbarg, R. E., Revelle, W., Yovel, I., & Li, W. (2005) · Psychometrika · doi:10.1007/s11336-003-0974-7 · Cited by 1,439 · cited 1×
“Actually, Zinbarg et al. (2005) reported that even when the assumptions of essentially tau-equivalent model are met, omega performs at least as well as alpha.”
BackgroundLatent Variables Analysis: Applications for Developmental Research.
AA, Eye, A. V., & Clogg, C. C. (1995) · Journal of the American Statistical Association · doi:10.2307/2291370 · Cited by 1,376
Introduction to Psychometric Theory
Raykov, T., & Marcoulides, G. A. (2011) · Routledge eBooks · doi:10.4324/9780203841624 · Cited by 1,095
Matrix Analysis for Statistics.
Kafadar, K., & Schott, J. R. (1997) · Journal of the American Statistical Association · doi:10.2307/2965451 · Cited by 919
Cronbach’s Coefficient Alpha: Well Known but Poorly Understood
Cho, E., & Kim, S. (2015) · Organizational Research Methods · doi:10.1177/1094428114555994 · Cited by 764
Limitations of Coefficient Alpha as an Index of Test Unidimensionality1
Green, S. B., Lissitz, R. W., & Mulaik, S. A. (1977) · Educational and Psychological Measurement · doi:10.1177/001316447703700403 · Cited by 522
Raykov, T. (1997) · Multivariate Behavioral Research · doi:10.1207/s15327906mbr3204_2 · Cited by 481
Coefficient Alpha: A Reliability Coefficient for the 21st Century?
Yang, Y., & Green, S. B. (2011) · Journal of Psychoeducational Assessment · doi:10.1177/0734282911406668 · Cited by 479
The Relation Among Fit Indexes, Power, and Sample Size in Structural Equation Modeling
Kim, K. H. (2005) · Structural Equation Modeling: A Multidisciplinary Journal · doi:10.1207/s15328007sem1203_2 · Cited by 382
Commentary on Coefficient Alpha: A Cautionary Tale
Green, S. B., & Yang, Y. (2009) · Psychometrika · doi:10.1007/s11336-008-9098-4 · Cited by 312
Markland, D. (2007) · Personality and Individual Differences · doi:10.1016/j.paid.2006.09.023 · Cited by 256
A study in factor analysis : the stability of a bi-factor solution
Holzinger, K. J., & Swineford, F. (1939) · Medical Entomology and Zoology · Cited by 254
Ziegel, E., & Krishnaiah, P. R. (1986) · Technometrics · doi:10.2307/1268998 · Cited by 248
Handbook of Personality Theory and Research
Crockett, H. J., Borgatta, E. F., & Lambert, W. W. (1971) · Social Forces · doi:10.2307/3005768 · Cited by 248
Zhang, Z., & Yuan, K.-H. (2016) · Educational and Psychological Measurement · doi:10.1177/0013164415594658 · Cited by 186
Thompson, B. (2003) · Sage eBooks · doi:10.4135/9781412985789 · Cited by 166
Reliability Beyond Theory and Into Practice
Sijtsma, K. (2009) · Psychometrika · doi:10.1007/s11336-008-9103-y · Cited by 164
Handbook of Latent Variable and Related Models
Lee, S. (2007) · Elsevier eBooks · doi:10.1016/b978-0-444-52044-9.x5000-9 · Cited by 157
Reliability of measurement in psychology: From Spearman-Brown to maximal reliability.
Li, H., Rosenthal, R., & Rubin, D. B. (1996) · Psychological Methods · doi:10.1037/1082-989x.1.1.98 · Cited by 138
Asymptotically distribution-free (ADF) interval estimation of coefficient alpha.
Maydeu‐Olivares, A., Coffman, D. L., & Hartmann, W. M. (2007) · Psychological Methods · doi:10.1037/1082-989x.12.2.157 · Cited by 130
A Note on Structural Equation Modeling Estimates of Reliability
Yang, Y., & Green, S. B. (2010) · Structural Equation Modeling A Multidisciplinary Journal · doi:10.1080/10705510903438963 · Cited by 128
A lower-bound method for the dimension-free measurement of internal consistency
Bentler, P. M. (1972) · Social Science Research · doi:10.1016/0049-089x(72)90082-8 · Cited by 111
Bentler, P. M., & Woodward, J. A. (1980) · Psychometrika · doi:10.1007/bf02294079 · Cited by 97
Yuan, K., & Bentler, P. M. (2002) · Psychometrika · doi:10.1007/bf02294845 · Cited by 84
Standard errors in covariance structure models: Asymptotics versus bootstrap
Yuan, K., & Hayashi, K. (2006) · British Journal of Mathematical and Statistical Psychology · doi:10.1348/000711005x85896 · Cited by 76
Deng, L., Wang, L., & Zhao, Y. (2016) · Creativity Research Journal · doi:10.1080/10400419.2016.1195615 · Cited by 76
Self-citationYuan, K., Marshall, L. L., & Bentler, P. M. (2003) · Sociological Methodology · doi:10.1111/j.0081-1750.2003.00132.x · Cited by 75
Raykov, T., & Marcoulides, G. A. (2014) · Educational and Psychological Measurement · doi:10.1177/0013164414526039 · Cited by 63
Yuan, K., Guarnaccia, C. A., & Hayslip, B. (2003) · Educational and Psychological Measurement · doi:10.1177/0013164402239314 · Cited by 44
Quantile Lower Bounds to Reliability Based on Locally Optimal Splits
Hunt, T. D., & Bentler, P. M. (2013) · Psychometrika · doi:10.1007/s11336-013-9393-6 · Cited by 26
Psychometric Properties of Measures of Team Diversity With Likert Data
Deng, L., Marcoulides, G. A., & Yuan, K. (2014) · Educational and Psychological Measurement · doi:10.1177/0013164414541275 · Cited by 6
Self-citation
Cited by
Un viaje alrededor de alfa y omega para estimar la fiabilidad de consistencia interna
Viladrich, C., Angulo-Brunet, A., & Doval, E. (2017) · Anales de Psicología · doi:10.6018/analesps.33.3.268401 · Cited by 699
Schmid, M., Brianza, E., & Petko, D. (2020) · Computers & Education · doi:10.1016/j.compedu.2020.103967 · Cited by 527
Kim, H. K., Ahn, J., Atkinson, L., & Kahlor, L. A. (2020) · Science Communication · doi:10.1177/1075547020959670 · Cited by 313
“…alphas for these scales are relatively weak, they are comparable to the one used by Yang et al. (2010), who suggest that these processing scales are still under development and thus have room for improvement (also see Deng & Chan, 2017, as Yang et al., 2010, reported omega rather than alpha).”
ResultHow to Evaluate Trust in AI-Assisted Decision Making? A Survey of Empirical Methodologies
Vereschak, O., Bailly, G., & Caramiaux, B. (2021) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3476068 · Cited by 229
Schmid, R., & Petko, D. (2019) · Computers & Education · doi:10.1016/j.compedu.2019.03.006 · Cited by 144
Metadata
- Authors
- Deng, L., & Chan, W.
- Venue
- Educational and Psychological Measurement
- Publisher
- SAGE Publications
- Published
- 2016-07-20
- Volume
- 77
- Issue
- 2
- Pages
- 185-203
- ISSN
- 0013-1644 (ISSN-L)
- 1552-3888
- OpenAlex
- W2490318716
- Cited by
- 395
- References
- 46
- FWCI
- 7.66
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.