Reliability of Scales With Second-Order Structure: Evaluation of Coefficient Alpha’s Population Slippage Using Latent Variable Modeling
Open accessThe DOI matches its Crossref record; 23 of the 23 references it cites were found in a registry or an index.
Abstract
A readily applicable procedure is discussed that allows evaluation of the discrepancy between the popular coefficient alpha and the reliability coefficient of a scale with second-order factorial structure that is frequently of relevance in empirical educational and psychological research. The approach is developed within the framework of the widely used latent variable modeling methodology and permits point and interval estimation of the slippage of alpha from scale reliability in a population under investigation. The method is useful when examining the consistency of complex structure measuring instruments assessing higher order latent constructs and, under its assumptions, represents a generally recommendable alternative to coefficient alpha. The outlined procedure is illustrated using data from an authoritarianism study.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“These and other measures with second-order factors violate the assumption of unidimensionality of measures (i.e., each indicator assesses a single underlying construct; Clark & Watson, 1995), and therefore Cronbach's alpha and CR are not appropriate reliability measures because they ignore the second-order factor structure (Raykov et al., 2018).”
From Reporting reliability, convergent and discriminant validity with structural equation modeling: A review and best-practice recommendations (2024) · cites this paper as Raykov et al., 2018
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Coefficient Alpha and the Internal Structure of Tests
Cronbach, L. J. (1951) · Psychometrika · doi:10.1007/bf02310555 · Cited by 43,931 · cited 1×
“Coefficient alpha (e.g., Cronbach, 1951) is frequently used to appraise the reliability of multicomponent measuring instruments that are highly popular in these and cognate disciplines.”
BackgroundStructural Equations with Latent Variables.
Clogg, C. C., & Bollen, K. A. (1991) · Contemporary Sociology · doi:10.2307/2072165 · Cited by 17,442
Structural Equations with Latent Variables
Bollen, K. A. (1989) · Wiley series in probability and statistics · doi:10.1002/9781118619179 · Cited by 17,277 · cited 4×
“In particular, when the popular maximum likelihood (ML) method of parameter estimation is used (with observed variable normality; e.g., Bollen, 1989), Equation (8) renders the ML estimator of the population slippage of coefficient alpha from the reliability coefficient of the overall scale score X,…”
BackgroundMethodInfluential(2010) · Cited by 7,034
Casella, G., & Berger, R. (2024) · Chapman & Hall/CRC eBooks · doi:10.1201/9781003456285 · Cited by 5,711
Harman, H. H. (1960) · Cited by 5,148
Introduction to Classical and Modern Test Theory
Crocker, L. M., & Algina, J. J. (1986) · Cited by 5,090
On the use, the misuse, and the very limited usefulness of Cronbach’s alpha
Sijtsma, K. (2009) · Psychometrika · doi:10.1007/s11336-008-9101-0 · Cited by 2,814 · cited 1×
“When these conditions do not hold, however, alpha can be seriously misleading (e.g., Sijtsma, 2009), as can also be the closely related index ‘‘alpha if item deleted’’ that is currently often used by researchers involved in scale construction and development.”
BackgroundMerrifield, P. R., & Harman, H. (1969) · American Educational Research Journal · doi:10.2307/1161864 · Cited by 2,574
A First Course in Structural Equation Modeling
Raykov, T., & Marcoulides, G. A. (2012) · Routledge eBooks · doi:10.4324/9780203930687 · Cited by 1,612 · cited 2×
“(For an introduction to the Mplus syntax, see e.g., Raykov & Marcoulides, 2006.)”
BackgroundSelf-citation
Research works printed but not linked: 1
- Muthén L. K., 2017, Mplus user’s guide
Cited by
Cheung, G. W., Cooper-Thomas, H. D., Lau, R. S., & Wang, L. C. (2024) · Asia Pacific Journal of Management · doi:10.1007/s10490-023-09871-y · Cited by 2,262
“…violate the assumption of unidimensionality of measures (i.e., each indicator assesses a single underlying construct; Clark & Watson, 1995), and therefore Cronbach’s alpha and CR are not appropriate reliability measures because they ignore the second-order factor structure (Raykov et al., 2018).”
Estimating reliability: A comparison of Cronbach's α, McDonald's ωt and the greatest lower bound
Malkewitz, C. P., Schwall, P., Meesters, C., & Hardt, J. (2023) · Social Sciences & Humanities Open · doi:10.1016/j.ssaho.2022.100368 · Cited by 199
Richmond, J., Boynton, M. H., Ozawa, S., Muessig, K. E., Cykert, S., & Ribisl, K. M. (2022) · Social Science & Medicine · doi:10.1016/j.socscimed.2022.114827 · Cited by 63
Troia, G. A., Wang, H., & Lawrence, F. (2022) · Contemporary Educational Psychology · doi:10.1016/j.cedpsych.2022.102100 · Cited by 26
Raykov, T., & Marcoulides, G. A. (2023) · Measurement Interdisciplinary Research and Perspectives · doi:10.1080/15366367.2022.2031485 · Cited by 9
Self-citation
Metadata
- Authors
- Raykov, T., Goldammer, P., Marcoulides, G. A., Li, T., & Menold, N.
- Affiliations
- Michigan State University (US)
- ETH Zurich (CH)
- University of California, Santa Barbara (US)
- GESIS - Leibniz Institute for the Social Sciences (DE)
- Corresponding author
- Raykov, Tenko
- Venue
- Educational and Psychological Measurement
- Publisher
- SAGE Publications
- Published
- 2017-07-24
- Volume
- 78
- Issue
- 6
- Pages
- 1123-1135
- ISSN
- 0013-1644 (ISSN-L)
- 1552-3888
- PMC
- PMC6293413
- OpenAlex
- W2739196104
- Cited by
- 13
- References
- 23
- Citations by year
- 2025: 5 · 2024: 2 · 2023: 4 · 2022: 2
- FWCI
- 0.00
- Type
- journal article
- Language
- en
- Open access
- green
- www.ncbi.nlm.nih.gov
- Licence
- journals.sagepub.com/page/policies/text-and-data-mining-license (tdm)
- Locations
- Educational and Psychological Measurement (publishedVersion)
- Europe PMC (PubMed Central) (publishedVersion)
- PubMed Central (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Social Sciences › Decision Sciences › Management Science and Operations Research › Psychometric Methodologies and Testing
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Reliability and Agreement in Measurement
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Mental Health Research Topics
- Keywords
- Cronbach's alpha, scale reliability, latent variable models, interval estimation, higher-order constructs, authoritarianism
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Reliability of Scales With Second-Order Structure: Evaluation of Coefficient Alpha’s Population Slippage Using Latent Variable Modeling. https://app.cochat.ai/papers/10.1177/0013164417719948
- The paper
- Raykov, T., Goldammer, P., Marcoulides, G. A., Li, T., & Menold, N. (2018). Reliability of Scales With Second-Order Structure: Evaluation of Coefficient Alpha’s Population Slippage Using Latent Variable Modeling. Educational and Psychological Measurement. https://doi.org/10.1177/0013164417719948
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.