Adapting fit indices for Bayesian structural equation modeling: Comparison to maximum likelihood.
Open accessThe DOI matches its Crossref record; 20 of the 20 references it cites were found in a registry or an index.
Abstract
In a frequentist framework, the exact fit of a structural equation model (SEM) is typically evaluated with the chi-square test and at least one index of approximate fit. Current Bayesian SEM (BSEM) software provides one measure of overall fit: the posterior predictive p value (PPP χ2 ). Because of the noted limitations of PPP χ2 , common practice for evaluating Bayesian model fit instead focuses on model comparison, using information criteria or Bayes factors. Fit indices developed under maximum-likelihood estimation have not been incorporated into software for BSEM. We propose adapting 7 chi-square-based approximate fit indices for BSEM, using a Bayesian analog of the chi-square model-fit statistic. Simulation results show that the sampling distributions of the posterior means of these fit indices are similar to their frequentist counterparts across sample sizes, model types, and levels of misspecification when BSEMs are estimated with noninformative priors. The proposed fit indices therefore allow overall model-fit evaluation using familiar metrics of the original indices, with an accompanying interval to quantify their uncertainty. Illustrative examples with real data raise some important issues about the proposed fit indices' application to models specified with informative priors, when Bayesian and frequentist estimation methods might not yield similar results. (PsycINFO Database Record (c) 2020 APA, all rights reserved).
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Hu, L., & Bentler, P. M. (1999) · Structural Equation Modeling A Multidisciplinary Journal · doi:10.1080/10705519909540118 · Cited by 108,788
lavaan : An R Package for Structural Equation Modeling
Rosseel, Y. (2012) · Journal of Statistical Software · doi:10.18637/jss.v048.i02 · Cited by 27,955
Evaluating Goodness-of-Fit Indexes for Testing Measurement Invariance
Cheung, G. W., & Rensvold, R. B. (2002) · Structural Equation Modeling: A Multidisciplinary Journal · doi:10.1207/s15328007sem0902_5 · Cited by 16,280
Hu, L.-T., & Bentler, P. M. (1998) · Psychological Methods · doi:10.1037/1082-989x.3.4.424 · Cited by 12,298
Sensitivity of Goodness of Fit Indexes to Lack of Measurement Invariance
Chen, F. F. (2007) · Structural Equation Modeling: A Multidisciplinary Journal · doi:10.1080/10705510701301834 · Cited by 12,217
Stan : A Probabilistic Programming Language
Carpenter, B., Gelman, A., Hoffman, M. D., Lee, D., Goodrich, B., Betancourt, M., Brubaker, M., Guo, J., Li, P., & Riddell, A. (2017) · Journal of Statistical Software · doi:10.18637/jss.v076.i01 · Cited by 7,754
A Reliability Coefficient for Maximum Likelihood Factor Analysis
Tucker, L. R., & Lewis, C. (1973) · Psychometrika · doi:10.1007/bf02291170 · Cited by 7,330
Marsh, H. W., Hau, K.-T., & Wen, Z. (2004) · Structural Equation Modeling: A Multidisciplinary Journal · doi:10.1207/s15328007sem1103_2 · Cited by 6,691
General methods for monitoring convergence of iterative simulations
Brooks, S. P., & Gelman, A. (1998) · Journal of Computational and Graphical Statistics · doi:10.1080/10618600.1998.10474787 · Cited by 6,045
(2015) · doi:10.1007/s11222-016-9696-4 · Cited by 5,611 · cited 3×
“To calculate BSEM fit indices with p – pD in place of df, we chose pDLOO rather than pDWAIC or pDDIC because it is preferred by Vehtari et al. (2017). But because we estimated models with noninformative priors, any pD was expected to be very close to the number of parameters under MLE.”
BackgroundMethodInfluentialThe Performance of RMSEA in Models With Small Degrees of Freedom
Kenny, D. A., Kaniskan, B., & McCoach, D. B. (2015) · Sociological Methods & Research · doi:10.1177/0049124114543236 · Cited by 2,841
Power and sensitivity of alternative fit indices in tests of measurement invariance.
Meade, A. W., Johnson, E. C., & Braddy, P. W. (2008) · Journal of Applied Psychology · doi:10.1037/0021-9010.93.3.568 · Cited by 1,668
Bayesian structural equation modeling: A more flexible representation of substantive theory
Muthén, B., & Asparouhov, T. (2012) · Psychological Methods · doi:10.1037/a0026802 · Cited by 1,562
Maximum Likelihood Estimation of Latent Interaction Effects with the LMS Method
Klein, A., & Moosbrugger, H. (2000) · Psychometrika · doi:10.1007/bf02296338 · Cited by 1,429
Philosophy and the practice of Bayesian statistics
Gelman, A., & Shalizi, C. R. (2013) · British Journal of Mathematical and Statistical Psychology · doi:10.1111/j.2044-8317.2011.02037.x · Cited by 825
The fallacy of placing confidence in confidence intervals
Morey, R. D., Hoekstra, R., Rouder, J. N., Lee, M. D., & Wagenmakers, E.-J. (2016) · Psychonomic Bulletin & Review · doi:10.3758/s13423-015-0947-8 · Cited by 577
Heene, M., Hilbert, S., Draxler, C., Ziegler, M., & Bühner, M. (2011) · Psychological Methods · doi:10.1037/a0024917 · Cited by 406
blavaan : Bayesian Structural Equation Models via Parameter Expansion
Merkle, E. C., & Rosseel, Y. (2018) · Journal of Statistical Software · doi:10.18637/jss.v085.i04 · Cited by 360
What to believe: Bayesian methods for data analysis
Kruschke, J. K. (2010) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2010.05.001 · Cited by 342 · cited 1×
“Fifth, Bayesian inference has multiple advantages over frequentist inference, even in simpler applications, such as the direct inference about the parameters of interest (θ) instead of inferring about a null hypothesis (related to the unintuitive interpretation of CIs); by conditioning on the data, the accuracy of a c…”
BackgroundAsparouhov, T., Muthén, B., & Morin, A. J. S. (2015) · Journal of Management · doi:10.1177/0149206315591075 · Cited by 340
Cited by
Investigating effects of perceived technology-enhanced environment on self-regulated learning
Sui, C.-J., Yen, M.-H., & Chang, C.-Y. (2024) · Education and Information Technologies · doi:10.1007/s10639-023-12270-x · Cited by 27
“In summary, the results suggested that the proposed model demonstrates a good fit to the observed data, as evidenced by the acceptable values of various fit indices (Asparouhov & Muthén, 2021; Garnier-Villarreal & Jorgensen, 2020; Hu & Bentler, 1999).”
Metadata
- Authors
- Garnier-Villarreal, M., & Jorgensen, T. D.
- Venue
- Psychological Methods
- Published
- 2020-02
- Volume
- 25
- Issue
- 1
- Pages
- 46-70
- ISSN
- 1082-989X (ISSN-L)
- 1939-1463
- OpenAlex
- W2951914964
- Cited by
- 167
- References
- 20
- FWCI
- 12.01
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.