An Illustration of the Exploratory Structural Equation Modeling (ESEM) Framework on the Passion Scale
Open accessThe DOI matches its Crossref record; 26 of the 26 references it cites were found in a registry or an index.
Abstract
While exploratory factor analysis (EFA) provides a more realistic presentation of the data with the allowance of item cross-loadings, confirmatory factor analysis (CFA) includes many methodological advances that the former does not. To create a synergy of the two, exploratory structural equation modeling (ESEM) was proposed as an alternative solution, incorporating the advantages of EFA and CFA. The present investigation is thus an illustrative demonstration of the applicability and flexibility of ESEM. To achieve this goal, we compared CFA and ESEM models, then thoroughly tested measurement invariance and differential item functioning through multiple-indicators-multiple-causes (MIMIC) models on the Passion Scale, the only measure of the Dualistic Model of Passion which differentiates between harmonious and obsessive forms of passion. Moreover, a hybrid model was also created to overcome the drawbacks of the two methods. Analyses of the first large community sample (N = 7,466; 67.7% females; Mage = 26.01) revealed that the superiority of the ESEM model relative to CFA in terms of improved goodness-of-fit and less correlated factors, while at the same time retaining the high definition of the factors. However, this fit was only achieved with the inclusion of three correlated uniquenesses, two of which appeared in previous studies and one of which was specific to the current investigation. These findings were replicated on a second, comprehensive sample (N = 504; 51.8% females; Mage = 39.59). After combining the two samples, complete measurement invariance (factor loadings, factor correlations, item uniquenesses, item intercepts, and latent means) was achieved across gender and partial invariance across age groups and their combination. Only one item intercept was non-invariant across both multigroup and MIMIC approaches, an observation that was further corroborated by the hybrid model. While obsessive passion showed a slight decline in the hybrid model, harmonious passion did not. Overall, the ESEM framework is a viable alternative of CFA that could be used and even extended to address substantially important questions and researchers should systematically compare these two approaches to identify the most suitable one.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Hu, L., & Bentler, P. M. (1999) · Structural Equation Modeling A Multidisciplinary Journal · doi:10.1080/10705519909540118 · Cited by 108,788
Evaluating Goodness-of-Fit Indexes for Testing Measurement Invariance
Cheung, G. W., & Rensvold, R. B. (2002) · Structural Equation Modeling: A Multidisciplinary Journal · doi:10.1207/s15328007sem0902_5 · Cited by 16,280
Guidelines for the process of cross-cultural adaptation of self-report measures
Beaton, D. E., Bombardier, C., Guillemin, F., & Ferraz, M. B. (2000) · Spine · doi:10.1097/00007632-200012150-00014 · Cited by 14,542
Sensitivity of Goodness of Fit Indexes to Lack of Measurement Invariance
Chen, F. F. (2007) · Structural Equation Modeling: A Multidisciplinary Journal · doi:10.1080/10705510701301834 · Cited by 12,217
Vandenberg, R. J., & Lance, C. E. (2000) · Organizational Research Methods · doi:10.1177/109442810031002 · Cited by 7,997
Marsh, H. W., Hau, K.-T., & Wen, Z. (2004) · Structural Equation Modeling: A Multidisciplinary Journal · doi:10.1207/s15328007sem1103_2 · Cited by 6,691 · cited 2×
“We considered both adequate and excellent thresholds for these fit indices (Hu and Bentler, 1999; Marsh et al., 2004, 2005; Marsh, 2007) as strictly adhering to the more conservative “golden rules” could lead to erroneous results (Chen et al., 2008; Heene et al., 2011; Perry et al., 2015).”
BackgroundResultMeasurement Invariance, Factor Analysis and Factorial Invariance
Meredith, W. (1993) · Psychometrika · doi:10.1007/bf02294825 · Cited by 4,536 · cited 3×
“However, there are six levels that of key importance in the measurement invariance literature (Meredith, 1993; Morin et al., 2016): configural invariance, weak (metric) invariance, strong (scalar) invariance, strict (residual) invariance, latent variancecovariance invariance, and latent means…”
BackgroundOn the practice of dichotomization of quantitative variables.
MacCallum, R. C., Zhang, S., Preacher, K. J., & Rucker, D. D. (2002) · Psychological Methods · doi:10.1037/1082-989x.7.1.19 · Cited by 3,538 · cited 1×
“However, one limitation of this statistical approach is that items need to be transformed into a smaller number of categories which is particularly problematic for continuous variables such as age (MacCallum et al., 2002).”
BackgroundRhemtulla, M., Brosseau-Liard, P. É., & Savalei, V. (2012) · Psychological Methods · doi:10.1037/a0029315 · Cited by 2,816 · cited 1×
“This estimator is also preferred when there are five or more answer categories (Rhemtulla et al., 2012) such as in the present case.”
BackgroundLes passions de l'ame: on obsessive and harmonious passion
Vallerand, R. J., Blanchard, C., Mageau, G. A., Koestner, R., Ratelle, C., Léonard, M., Gagné, M., & Marsolais, J. (2003) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.85.4.756 · Cited by 2,566 · cited 11×
“An Illustrative Example: on the Dualistic Model of Passion and the Passion Scale Over the last decade, research on the field of passion has boomed with the introduction of the DMP (Vallerand et al., 2003; Vallerand, 2015) stemming from the Self-Determination Theory (Deci and Ryan, 1985; Ryan and Deci, 2017).”
BackgroundMethodInfluentialThe Rediscovery of Bifactor Measurement Models
Reise, S. P. (2012) · Multivariate Behavioral Research · doi:10.1080/00273171.2012.715555 · Cited by 2,112 · cited 1×
“Instead, whenmulticollinearity is present, a bifactor solution (Reise, 2012) should be pursued which might be able to explain the high associations between the factors.”
BackgroundA comparison of some methodologies for the factor analysis of non‐normal Likert variables
Muthén, B., & Kaplan, D. (1985) · British Journal of Mathematical and Statistical Psychology · doi:10.1111/j.2044-8317.1985.tb00832.x · Cited by 1,778 · cited 1×
“For univariate normality, considering the guidelines of Muthén and Kaplan (1985) with a ±1 threshold, neither skewness (ranging from −1.03 to +1.61), nor kurtosis (ranging −1.12 to +2.04) values suggested that the data has univariate normality.”
MethodInfluentialEvaluating Bifactor Models: Calculating and Interpreting Statistical Indices
Rodriguez, A., Reise, S. P., & Haviland, M. G. (2016) · Psychological Methods · doi:10.1037/met0000045 · Cited by 1,599
Bayesian structural equation modeling: A more flexible representation of substantive theory
Muthén, B., & Asparouhov, T. (2012) · Psychological Methods · doi:10.1037/a0026802 · Cited by 1,562 · cited 2×
“While the ESEM approach is certainly promising, the Bayesian Structural Equation Modeling (BSEM; Muthén and Asparouhov, 2012)—which is similar to ESEM in terms of freely estimating cross-loadings and giving them a small value—recently came under criticism (Stromeyer et al.”
MethodStatistical Approaches to Measurement Invariance
Millsap, R. E. (2012) · doi:10.4324/9780203821961 · Cited by 1,554
Chen, F., Curran, P. J., Bollen, K. A., Kirby, J., & Paxton, P. (2008) · Sociological Methods & Research · doi:10.1177/0049124108314720 · Cited by 1,538
A new look at the big five factor structure through exploratory structural equation modeling
Marsh, H. W., Lüdtke, O., Muthén, B., Asparouhov, T., Morin, A. J. S., Trautwein, U., & Nagengast, B. (2010) · Psychological Assessment · doi:10.1037/a0019227 · Cited by 899 · cited 2×
“Moreover, the goodness-of-fit of the models and the discriminant validity of the factors could also be undermined by these overly restrictive specifications (Marsh et al., 2010, 2014).”
BackgroundYeager, D. S., Romero, C., Paunesku, D., Hulleman, C. S., Schneider, B., Hinojosa, C., Lee, H. Y., O'Brien, J., Flint, K., Roberts, A., et al. (2016) · Journal of Educational Psychology · doi:10.1037/edu0000098 · Cited by 691 · cited 6×
“…in my life”) and HP10 (i.e., My activity is in harmony with other things that are part of me) was present for Schellenberg et al. (2014) and Zhao et al. (2015), both belonged 1We also tested the two factors separately, as unidimensional constructs to investigate the potential sources of…”
BackgroundResultInfluentialCurran, T., Hill, A. P., Appleton, P. R., Vallerand, R. J., & Standage, M. (2015) · Motivation and Emotion · doi:10.1007/s11031-015-9503-0 · Cited by 499
The Psychology of Passion: A Dualistic Model
Vallerand, R. J. (2015) · doi:10.1093/acprof:oso/9780199777600.001.0001 · Cited by 481
Marsh, H. W., Vallerand, R. J., Lafrenière, M.-A. K., Parker, P., Morin, A. J. S., Carbonneau, N., Jowett, S., Bureau, J. S., Fernet, C., Guay, F., et al. (2013) · Psychological Assessment · doi:10.1037/a0032573 · Cited by 420 · cited 16×
“This taxonomy is particularly relevant for the present investigation as Marsh et al. (2013) as well as Schellenberg et al. (2014) have already demonstrated the taxonomy’s usefulness in relation to passion and groups based on gender, language, and type of activity.”
BackgroundMethodResultInfluentialHeene, M., Hilbert, S., Draxler, C., Ziegler, M., & Bühner, M. (2011) · Psychological Methods · doi:10.1037/a0024917 · Cited by 406 · cited 2×
“, 2004, 2005; Marsh, 2007) as strictly adhering to the more conservative “golden rules” could lead to erroneous results (Chen et al., 2008; Heene et al., 2011; Perry et al., 2015).”
BackgroundA more general model for testing measurement invariance and differential item functioning
Bauer, D. J. (2017) · Psychological Methods · doi:10.1037/met0000077 · Cited by 363
Asparouhov, T., Muthén, B., & Morin, A. J. S. (2015) · Journal of Management · doi:10.1177/0149206315591075 · Cited by 340 · cited 3×
“However, even if cross-loadings are seldom present in our measurement model, ESEM still results in unbiased parameter estimates in terms of factor correlations (Asparouhov et al., 2015).”
BackgroundInfluentialLitalien, D., Morin, A. J. S., Gagné, M., Vallerand, R. J., Losier, G. F., & Ryan, R. M. (2017) · Contemporary Educational Psychology · doi:10.1016/j.cedpsych.2017.06.010 · Cited by 163
Cited by
Neff, K. D., Tóth-Király, I., Yarnell, L. M., Arimitsu, K., Castilho, P., Ghorbani, N., Guo, H. X., Hirsch, J. K., Hupfeld, J., Hutz, C. S., et al. (2019) · Psychological Assessment · doi:10.1037/pas0000629 · Cited by 397
The Development and Validation of the Compassion Scale
Pommier, E., Neff, K. D., & Tóth-Király, I. (2020) · Assessment · doi:10.1177/1073191119874108 · Cited by 345
Self-citationClarifying the structure and nature of left-wing authoritarianism.
Costello, T. H., Bowes, S. M., Stevens, S. T., Waldman, I. D., Tasimi, A., & Lilienfeld, S. O. (2022) · Journal of Personality and Social Psychology · doi:10.1037/pspp0000341 · Cited by 316
Bőthe, B., Potenza, M. N., Griffiths, M. D., Kraus, S. W., Klein, V., Fuss, J., & Demetrovics, Z. (2020) · Journal of Behavioral Addictions · doi:10.1556/2006.2020.00034 · Cited by 175
Self-citationTóth‐Király, I., Bőthe, B., Márki, A. N., Rigó, A., & Orosz, G. (2019) · European Journal of Social Psychology · doi:10.1002/ejsp.2588 · Cited by 84
Self-citation
Metadata
- Authors
- Tóth-Király, I., Bõthe, B., Rigó, A., & Orosz, G.
- Venue
- Frontiers in Psychology
- Publisher
- Frontiers Media SA
- Published
- 2017-11-07
- Volume
- 8
- Pages
- 1968-1968
- ISSN
- 1664-1078 (ISSN-L)
- OpenAlex
- W2767847494
- Cited by
- 137
- References
- 26
- FWCI
- 9.19
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.