Bootstrapping goodness-of-fit measures in structural equation models.
Abstract
Assessing overall fit is a topic of keen interest to structural equation modelers, yet measuring goodness of fit has been hampered by several factors. First, the assumptions that underlie the chi-square tests of model fit often are violated. Second, many fit measures (e.g., Bentler and Bonett's [1980] normed fit index) have unknown statistical distributions so that hypothesis testing, confidence intervals, or comparisons of significant differences in these fit indices are not possible. Finally, modelers have little knowledge about the distribution and behavior of the fit measures for misspecified models or for nonnested models. Given this situation, bootstrapping techniques would appear to be an ideal means to tackle these problems. Indeed, Bentler's (1989) EQS 3.0 and Jöreskog and Sörbom's (forthcoming) LISREL 8 have bootstrap resampling options to bootstrap fit indices. In this article the authors (a) demonstrate that the usual bootstrapping methods will fail when applied to the original data, (b) explain why this occurs, and, (c) propose a modified bootstrap method for the chi-square test statistic for model fit. They include simulated and empirical examples to illustrate their results.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The Bollen-Stine value (p = 0.001) suggested a poor fit, but this result might have been affected by the large sample size.
“The Bollen-Stine value (p = 0.001) suggested a poor fit (p > 0.05 according to Bollen and Stine, 1992), but this result might have been affected by the large sample size.”
From Burnout and Stress Measurement in Police Officers: Literature Review and a Study With the Operational Police Stress Questionnaire (2020) · cites this paper as Bollen and Stine, 1992
Cites
Efron, B., & Tibshirani, R. (1986) · Statistical Science · doi:10.1214/ss/1177013815 · Cited by 6,033 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
<b>lavaan</b> : An <i>R</i> Package for Structural Equation Modeling
Rosseel, Y. (2012) · Journal of Statistical Software · doi:10.18637/jss.v048.i02 · Cited by 27,955 · see citing works
Using pls path modeling in new technology research: updated guidelines
Henseler, J., Hubona, G., & Ray, P. A. (2016) · Industrial Management & Data Systems · doi:10.1108/imds-09-2015-0382 · Cited by 7,173 · see citing works
An empirical comparison of the efficacy of covariance-based and variance-based SEM
Reinartz, W., Haenlein, M., & Henseler, J. (2009) · International Journal of Research in Marketing · doi:10.1016/j.ijresmar.2009.08.001 · Cited by 2,906 · see citing works
Structural Equation Modeling and Natural Systems
Grace, J. B. (2006) · doi:10.1017/cbo9780511617799 · Cited by 2,432 · see citing works
Kyriazos, T. A. (2018) · Psychology · doi:10.4236/psych.2018.98126 · Cited by 1,882 · see citing works
“Finally, bootstrapping (c.f., Bollen & Stine, 1992) is another technique that also applicable to power analysis but in contrast to the rest of the methods its usefulness in determining the target N for a research is low because the generation of bootstrapped samples requires a large existing data…”
MethodInternalized homophobia and relationship quality among lesbians, gay men, and bisexuals.
Frost, D. M., & Meyer, I. H. (2009) · Journal of Counseling Psychology · doi:10.1037/a0012844 · Cited by 781 · see citing works
“To correct for this problem, we used a bootstrapping procedure (Bollen & Stine, 1992, 1993) in AMOS ® to calculate (a) the average standardized path coefficients, their standard errors, and associated probability values on the basis of estimates from 10,000 samples dawn randomly from the 396…”
Implementing computerized technology: An organizational analysis.
Klein, K. J., Conn, A. B., & Sorra, J. S. (2001) · Journal of Applied Psychology · doi:10.1037/0021-9010.86.5.811 · Cited by 615 · see citing works
What is working memory capacity, and how can we measure it?
Wilhelm, O., Hildebrandt, A., & Oberauer, K. (2013) · Frontiers in Psychology · doi:10.3389/fpsyg.2013.00433 · Cited by 468 · see citing works
Gu, J., Strauss, C., Crane, C., Barnhofer, T., Karl, A., Cavanagh, K., & Kuyken, W. (2016) · Psychological Assessment · doi:10.1037/pas0000263 · Cited by 431 · see citing works
“Bootstrapping methods in Amos adjust both the p value associated with the chi-square test (Bollen-Stine bootstrap method; Bollen & Stine, 1992) and parameter standard errors (90% bias-corrected CIs).”
MethodFit Indices Versus Test Statistics
Yuan, K.-H. (2005) · Multivariate Behavioral Research · doi:10.1207/s15327906mbr4001_5 · Cited by 415 · see citing works
Hoi, V. N. (2020) · Computers & Education · doi:10.1016/j.compedu.2019.103761 · Cited by 250 · see citing works
Rice, S. M., Fallon, B. J., Aucote, H. M., & Möller-Leimkühler, A. M. (2013) · Journal of Affective Disorders · doi:10.1016/j.jad.2013.08.013 · Cited by 244 · see citing works
Queirós, C., Passos, F., Bártolo, A., Marques, A. J., da Silva, C. F., & Pereira, A. (2020) · Frontiers in Psychology · doi:10.3389/fpsyg.2020.00587 · Cited by 241 · see citing works
Yow, W. Q., & Li, X. (2015) · Frontiers in Psychology · doi:10.3389/fpsyg.2015.00164 · Cited by 211 · see citing works
Dimensionality of the Pittsburgh Sleep Quality Index: A systematic review
Manzar, M. D., BaHammam, A. S., Hameed, U. A., Spence, D. W., Pandi-Perumal, S. R., Moscovitch, A., & Streiner, D. L. (2018) · Health and Quality of Life Outcomes · doi:10.1186/s12955-018-0915-x · Cited by 204 · see citing works
Estimating psychological networks and their accuracy: A tutorial paper
Epskamp, S., Borsboom, D., & Fried, E. I. (2018) · Behavior Research Methods · doi:10.3758/s13428-017-0862-1 · Cited by 5,715 · see citing works
Comparison of salivary cortisol as measured by different immunoassays and tandem mass spectrometry
Miller, R., Plessow, F., Rauh, M., Gröschl, M., & Kirschbaum, C. (2013) · Psychoneuroendocrinology · doi:10.1016/j.psyneuen.2012.04.019 · Cited by 181 · see citing works
Self-stigma in substance abuse: development of a new measure
Luoma, J. B., Nobles, R. H., Drake, C. E., Hayes, S. C., O’Hair, A., Fletcher, L., & Kohlenberg, B. S. (2013) · Journal of Psychopathology and Behavioral Assessment · doi:10.1007/s10862-012-9323-4 · Cited by 150 · see citing works
A mediational model relating affect intensity, emotion inhibition, and psychological distress
Lynch, T. R., Robins, C. J., Morse, J. Q., & Krause, E. D. (2001) · Behavior Therapy · doi:10.1016/s0005-7894(01)80034-4 · Cited by 128 · see citing works
Lee, T., Lee, B.-K., & Lee-Geiller, S. (2020) · International Journal of Information Management · doi:10.1016/j.ijinfomgt.2020.102098 · Cited by 122 · see citing works
Relationships between school climate, bullying and delinquent behaviours
Aldridge, J. M., McChesney, K., & Afari, E. (2018) · Learning Environments Research · doi:10.1007/s10984-017-9249-6 · Cited by 124 · see citing works
Dyadic effects of fear of recurrence on the quality of life of cancer survivors and their caregivers
Kim, Y., Carver, C. S., Spillers, R. L., Love-Ghaffari, M., & Kaw, C.-K. (2012) · Quality of Life Research · doi:10.1007/s11136-011-9953-0 · Cited by 121 · see citing works
Jorm, A. F., Christensen, H., Medway, J., Korten, A. E., Jacomb, P. A., & Rodgers, B. (2000) · Social Psychiatry and Psychiatric Epidemiology · doi:10.1007/s001270050230 · Cited by 110 · see citing works
Kim, Y., van Ryn, M., Jensen, R. E., Griffin, J. M., Potosky, A., & Rowland, J. (2015) · Psycho-Oncology · doi:10.1002/pon.3580 · Cited by 99 · see citing works
“Thus, we implemented the Bollen-Stine bootstrap method [32] for correcting chi-square values.”
MethodHenry, A., Tourbah, A., Camus, G., Deschamps, R., Mailhan, L., Castex, C., Gout, O., & Montreuil, M. (2019) · Multiple Sclerosis and Related Disorders · doi:10.1016/j.msard.2018.09.039 · Cited by 95 · see citing works
Development of the parental psychological flexibility questionnaire
Burke, K., & Moore, S. (2015) · Child Psychiatry & Human Development · doi:10.1007/s10578-014-0495-x · Cited by 94 · see citing works
Jankowski, P. J., Hooper, L. M., Sandage, S. J., & Hannah, N. J. (2013) · Journal of Family Therapy · doi:10.1111/j.1467-6427.2011.00574.x · Cited by 96 · see citing works
Geiser, C., Eid, M., Nussbeck, F. W., Courvoisier, D. S., & Cole, D. A. (2010) · Developmental Psychology · doi:10.1037/a0017888 · Cited by 92 · see citing works
Development and Validation of the Prolonged Activation and Anticipatory Race-Related Stress Scale
Utsey, S. O., Belvet, B., Hubbard, R. R., Fischer, N. L., Opare-Henaku, A., & Gladney, L. L. (2013) · Journal of Black Psychology · doi:10.1177/0095798412461808 · Cited by 71 · see citing works
Entwicklung und Validierung eines Fragebogens zu räumlichen Strategien
Münzer, S., & Hölscher, C. (2011) · Diagnostica · doi:10.1026/0012-1924/a000040 · Cited by 64 · see citing works
Mettler, T., & Winter, R. (2016) · Journal of Information Technology · doi:10.1057/jit.2015.28 · Cited by 47 · see citing works
Zhang, R.-P., & Tsingan, L. (2014) · Journal of Happiness Studies · doi:10.1007/s10902-013-9482-3 · Cited by 37 · see citing works
Digital leadership: transitioning into the digital age
Prince, K. A. (2018) · James Cook University · doi:10.25903/5d2bdd672c0e5 · Cited by 34 · see citing works
Feingold, A. (2019) · The Quantitative Methods for Psychology · doi:10.20982/tqmp.15.2.p096 · Cited by 34 · see citing works
Moriuchi, E. (2020) · Psychology & Marketing · doi:10.1002/mar.21301 · Cited by 32 · see citing works
Adie, T., Steindl, S. R., Kirby, J. N., Kane, R. T., & Mazzucchelli, T. G. (2021) · Mindfulness · doi:10.1007/s12671-021-01637-1 · Cited by 20 · see citing works
Shi, D., Song, H., DiStefano, C., Maydeu-Olivares, A., McDaniel, H. L., & Jiang, Z. (2019) · Multivariate Behavioral Research · doi:10.1080/00273171.2018.1514484 · Cited by 19 · see citing works
Chong, Y. Y., Mak, Y. W., & Loke, A. Y. (2020) · Journal of Psychosomatic Research · doi:10.1016/j.jpsychores.2020.110208 · Cited by 12 · see citing works
Development of a Brief Version of the Social Anxiety – Acceptance and Action Questionnaire
MacKenzie, M. B., Kocovski, N. L., Blackie, R. A., Carrique, L. C., Fleming, J. E., & Antony, M. M. (2017) · Journal of Psychopathology and Behavioral Assessment · doi:10.1007/s10862-016-9585-3 · Cited by 9 · see citing works
- Authors
- Bollen, K. A., & Stine, R. A.
- Affiliations
- University of North Carolina at Chapel Hill (US)
- University of Pennsylvania (US)
- ORCID
- Bollen, Kenneth A.
- Venue
- Sociological Methods & Research
- Publisher
- SAGE Publications
- Published
- 1992-11
- Volume
- 21
- Issue
- 2
- Pages
- 205-229
- ISSN
- 0049-1241 (ISSN-L)
- 1552-8294
- OpenAlex
- W2030630447
- Cited by
- 1,831
- References
- 1
- Citations by year
- 2026: 124 · 2025: 117 · 2024: 94 · 2023: 114 · 2022: 143 · 2021: 124 · 2020: 105 · 2019: 84 · 2018: 82 · 2017: 71 · 2016: 75 · 2015: 79 · 2014: 87 · 2013: 72 · 2012: 72
- FWCI
- 5.77
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Sociological Methods & Research (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- Topics
- Social Sciences › Decision Sciences › Management Science and Operations Research › Psychometric Methodologies and Testing
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Bayesian Inference
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Distribution Estimation and Applications
- Keywords
- structural equation modeling, goodness-of-fit measures, bootstrapping, model misspecification, EQS, LISREL
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
