The DOI matches its Crossref record; 46 of the 46 references it cites were found in a registry or an index.
Testing the Difference Between Reliability Coefficients Alpha and Omega
Open accessAbstract
Reliable measurements are key to social science research. Multiple measures of reliability of the total score have been developed, including coefficient alpha, coefficient omega, the greatest lower bound reliability, and others. Among these, the coefficient alpha has been most widely used, and it is reported in nearly every study involving the measure of a construct through multiple items in social and behavioral research. However, it is known that coefficient alpha underestimates the true reliability unless the items are tau-equivalent, and coefficient omega is deemed as a practical alternative to coefficient alpha in estimating measurement reliability of the total score. However, many researchers noticed that the difference between alpha and omega is minor in applications. Since the observed differences in alpha and omega can be due to sampling errors, the purpose of the present study, therefore, is to propose a method to evaluate the difference of coefficient alpha ([Formula: see text]) and omega ([Formula: see text]) statistically. In particular, the current article develops a procedure to estimate the SE of ([Formula: see text]) and consequently the confidence interval (CI) for ([Formula: see text]). This procedure allows us to test whether the observed difference ([Formula: see text]) is due to sample error or [Formula: see text] is significantly greater than [Formula: see text]. The developed procedure is then applied to multiple real data sets from well-known scales to empirically verify the values of ([Formula: see text]) in practice. Results showed that in most of the comparisons the differences are significantly above zero but cases also exist where the CIs contain zero. An R program for calculating [Formula: see text], [Formula: see text], and the SE of ([Formula: see text]) is also included in the present study so that the developed procedure is easily accessible to applied researchers.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Coefficient Alpha and the Internal Structure of Tests
Cronbach, L. J. (1951) · Psychometrika · doi:10.1007/bf02310555 · Cited by 43,931
A heteroskedasticity-consistent covariance matrix estimator and a direct test for heteroskedasticity
White, H. (1980) · Econometrica · doi:10.2307/1912934 · Cited by 25,861
Comparative fit indexes in structural models.
Bentler, P. M. (1990) · Psychological Bulletin · doi:10.1037/0033-2909.107.2.238 · Cited by 25,266
What is coefficient alpha? An examination of theory and applications
Cortina, J. M. (1993) · Journal of Applied Psychology · doi:10.1037/0021-9010.78.1.98 · Cited by 8,810 · cited 1×
“…of reliability of the total score have been developed, including coefficient alpha (also referred to as Cronbach’s alpha; Cronbach, 1951; see also Cortina, 1993; Raykov, 1997; Raykov& Marcoulides, 2011, 2015), coefficient omega (McDonald, 1999), the greatest lower bound reliability (Bentler,…”
BackgroundStatistical Theories of Mental Test Scores
Rozeboom, W. W., Lord, F. M., Novick, M. R., & Birnbaum, A. (1969) · American Educational Research Journal · doi:10.2307/1162101 · Cited by 8,022
(1999) · Cited by 7,995
Test Theory: A Unified Treatment
Zwick, R., & McDonald, R. P. (2000) · Journal of the American Statistical Association · doi:10.2307/2669496 · Cited by 3,603
Dunn, T. J., Baguley, T., & Brunsden, V. (2014) · British Journal of Psychology · doi:10.1111/bjop.12046 · Cited by 3,596
Handbook of Structural Equation Modeling
Howard, A. L. (2013) · Structural Equation Modeling: A Multidisciplinary Journal · doi:10.1080/10705511.2013.769397 · Cited by 3,440
On the use, the misuse, and the very limited usefulness of Cronbach’s alpha
Sijtsma, K. (2009) · Psychometrika · doi:10.1007/s11336-008-9101-0 · Cited by 2,814
Cited by
Un viaje alrededor de alfa y omega para estimar la fiabilidad de consistencia interna
Viladrich, C., Angulo-Brunet, A., & Doval, E. (2017) · Anales de Psicología · doi:10.6018/analesps.33.3.268401 · Cited by 699
Kim, H. K., Ahn, J., Atkinson, L., & Kahlor, L. A. (2020) · Science Communication · doi:10.1177/1075547020959670 · Cited by 313
Schmid, M., Brianza, E., & Petko, D. (2020) · Computers & Education · doi:10.1016/j.compedu.2020.103967 · Cited by 312
How to Evaluate Trust in AI-Assisted Decision Making? A Survey of Empirical Methodologies
Vereschak, O., Bailly, G., & Caramiaux, B. (2021) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3476068 · Cited by 229
Schmid, R., & Petko, D. (2019) · Computers & Education · doi:10.1016/j.compedu.2019.03.006 · Cited by 144
Metadata
- Authors
- Deng, L., & Chan, W.
- Venue
- Educational and Psychological Measurement
- Publisher
- SAGE Publications
- Published
- 2016-07-20
- Volume
- 77
- Issue
- 2
- Pages
- 185-203
- ISSN
- 0013-1644 (ISSN-L)
- 1552-3888
- OpenAlex
- W2490318716
- Cited by
- 395
- References
- 46
- FWCI
- 7.66
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Testing the Difference Between Reliability Coefficients Alpha and Omega. https://app.cochat.ai/papers/10.1177/0013164416658325
- The paper
- Deng, L., & Chan, W. (2017). Testing the Difference Between Reliability Coefficients Alpha and Omega. Educational and Psychological Measurement. https://doi.org/10.1177/0013164416658325
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.