The DOI matches its Crossref record; 82 of the 82 references it cites were found in a registry or an index.
Why item parcels are (almost) never appropriate: Two wrongs do not make a right—Camouflaging misspecification with item parcels in CFA models.
Abstract
The present investigation has a dual focus: to evaluate problematic practice in the use of item parcels and to suggest exploratory structural equation models (ESEMs) as a viable alternative to the traditional independent clusters confirmatory factor analysis (ICM-CFA) model (with no cross-loadings, subsidiary factors, or correlated uniquenesses). Typically, it is ill-advised to (a) use item parcels when ICM-CFA models do not fit the data, and (b) retain ICM-CFA models when items cross-load on multiple factors. However, the combined use of (a) and (b) is widespread and often provides such misleadingly good fit indexes that applied researchers might believe that misspecification problems are resolved--that 2 wrongs really do make a right. Taking a pragmatist perspective, in 4 studies we demonstrate with responses to the Rosenberg Self-Esteem Inventory (Rosenberg, 1965), Big Five personality factors, and simulated data that even small cross-loadings seriously distort relations among ICM-CFA constructs or even decisions on the number of factors; although obvious in item-level analyses, this is camouflaged by the use of parcels. ESEMs provide a viable alternative to ICM-CFAs and a test for the appropriateness of parcels. The use of parcels with an ICM-CFA model is most justifiable when the fit of both ICM-CFA and ESEM models is acceptable and equally good, and when substantively important interpretations are similar. However, if the ESEM model fits the data better than the ICM-CFA model, then the use of parcels with an ICM-CFA model typically is ill-advised--particularly in studies that are also interested in scale development, latent means, and measurement invariance.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Hu, L., & Bentler, P. M. (1999) · Structural Equation Modeling A Multidisciplinary Journal · doi:10.1080/10705519909540118 · Cited by 108,788
Society and the Adolescent Self-Image
Rosenberg, M. (1965) · doi:10.1515/9781400876136 · Cited by 30,126
Review of Psychometric theory (2nd ed.).
SITGREAVES, R. (1979) · Contemporary Psychology: A Journal of Reviews · doi:10.1037/018882 · Cited by 11,425
Statistical Theories of Mental Test Scores
Rozeboom, W. W., Lord, F. M., Novick, M. R., & Birnbaum, A. (1969) · American Educational Research Journal · doi:10.2307/1162101 · Cited by 8,022
Marsh, H. W., Hau, K.-T., & Wen, Z. (2004) · Structural Equation Modeling: A Multidisciplinary Journal · doi:10.1207/s15328007sem1103_2 · Cited by 6,691
Self-citationTo parcel or not to parcel: Exploring the question, weighing the merits
Little, T. D., Cunningham, W. A., Shahar, G., & Widaman, K. F. (2002) · Structural Equation Modeling: A Multidisciplinary Journal · doi:10.1207/s15328007sem0902_1 · Cited by 6,552
Sample size in factor analysis.
MacCallum, R. C., Widaman, K. F., Zhang, S., & Hong, S. (1999) · Psychological Methods · doi:10.1037/1082-989x.4.1.84 · Cited by 5,497
Enders, C., & Bandalos, D. (2001) · Structural Equation Modeling: A Multidisciplinary Journal · doi:10.1207/s15328007sem0803_5 · Cited by 4,978
Measurement Invariance, Factor Analysis and Factorial Invariance
Meredith, W. (1993) · Psychometrika · doi:10.1007/bf02294825 · Cited by 4,536
Goodness-of-fit indexes in confirmatory factor analysis: The effect of sample size.
Marsh, H. W., Balla, J. R., & McDonald, R. P. (1988) · Psychological Bulletin · doi:10.1037//0033-2909.103.3.391 · Cited by 3,824
Self-citationPsychological Assessment Resources
Abidin, R. R. (1995) · Medical Entomology and Zoology · Cited by 3,140
Exploratory Structural Equation Modeling
Asparouhov, T., & Muthén, B. (2009) · Structural Equation Modeling: A Multidisciplinary Journal · doi:10.1080/10705510903008204 · Cited by 2,665
The Rediscovery of Bifactor Measurement Models
Reise, S. P. (2012) · Multivariate Behavioral Research · doi:10.1080/00273171.2012.715555 · Cited by 2,112
Bayesian structural equation modeling: A more flexible representation of substantive theory
Muthén, B., & Asparouhov, T. (2012) · Psychological Methods · doi:10.1037/a0026802 · Cited by 1,562
Bandalos, D. L. (2002) · Structural Equation Modeling: A Multidisciplinary Journal · doi:10.1207/s15328007sem0901_5 · Cited by 1,377
New Developments and Techniques in Structural Equation Modeling
(2001) · Psychology Press eBooks · doi:10.4324/9781410601858 · Cited by 1,338
Is More Ever Too Much? The Number of Indicators per Factor in Confirmatory Factor Analysis
Marsh, H. W., Hau, K.-T., Balla, J. R., & Grayson, D. (1998) · Multivariate Behavioral Research · doi:10.1207/s15327906mbr3302_1 · Cited by 1,307
Self-citationA General Approach for Representing Constructs in Organizational Research
Bagozzi, R. P., & Edwards, J. R. (1998) · Organizational Research Methods · doi:10.1177/109442819800100104 · Cited by 1,217
Marsh, H. W., Wen, Z., & Hau, K.-T. (2004) · Psychological Methods · doi:10.1037/1082-989x.9.3.275 · Cited by 1,205
Self-citationExploratory Factor Analysis With Small Sample Sizes
de Winter*, J. C. F., Dodou*, D., & Wieringa, P. A. (2009) · Multivariate Behavioral Research · doi:10.1080/00273170902794206 · Cited by 1,168
A contemplated revision of the NEO Five-Factor Inventory
McCrae, R. R., & Costa, P. T. (2004) · Personality and Individual Differences · doi:10.1016/s0191-8869(03)00118-1 · Cited by 1,153
An Overview of Analytic Rotation in Exploratory Factor Analysis
Browne, M. W. (2001) · Multivariate Behavioral Research · doi:10.1207/s15327906mbr3601_05 · Cited by 1,140
Marsh, H. W., Muthén, B., Asparouhov, T., Lüdtke, O., Robitzsch, A., Morin, A. J. S., & Trautwein, U. (2009) · Structural Equation Modeling: A Multidisciplinary Journal · doi:10.1080/10705510903008220 · Cited by 1,093
Self-citationLongitudinal Research in the Study of Behavior and Development
Nesselroade, J. R., & Baltes, P. B. (1979) · MPG.PuRe (Max Planck Society) · Cited by 1,004
Affects of variable and subject sampling on factor pattern recovery.
Velicer, W. F., & Fava, J. L. (1998) · Psychological Methods · doi:10.1037/1082-989x.3.2.231 · Cited by 998
Anderson, S. (2002) · Journal of Management · doi:10.1016/s0149-2063(02)00190-3 · Cited by 987
Unidimensional Versus Domain Representative Parceling of Questionnaire Items: An Empirical Example
Kishton, J. M., & Widaman, K. F. (1994) · Educational and Psychological Measurement · doi:10.1177/0013164494054003022 · Cited by 980
The Foundations of Factor Analysis.
Sheth, J. N., & Mulaik, S. A. (1975) · Journal of the American Statistical Association · doi:10.2307/2285414 · Cited by 974
Behavioral Development and Construct Validity: The Principle of Aggregation
Rushton, J. P., Brainerd, C. J., & Pressley, M. (1983) · Psychological Bulletin · doi:10.1037/0033-2909.94.1.18 · Cited by 940
A new look at the big five factor structure through exploratory structural equation modeling
Marsh, H. W., Lüdtke, O., Muthén, B., Asparouhov, T., Morin, A. J. S., Trautwein, U., & Nagengast, B. (2010) · Psychological Assessment · doi:10.1037/a0019227 · Cited by 899
Self-citationMcCrae, R. R., Zonderman, A. B., Costa, P. T., Jr., & Bond, M. H. (1996) · Journal of Personality and Social Psychology · doi:10.1037//0022-3514.70.3.552 · Cited by 797
Ding, L., Velicer, W. F., & Harlow, L. L. (1995) · Structural Equation Modeling: A Multidisciplinary Journal · doi:10.1080/10705519509540000 · Cited by 789
Item Parceling Issues in Structural Equation Modeling
(2001) · New Developments and Techniques in Structural Equation Modeling · doi:10.4324/9781410601858-15 · Cited by 730
Item Parceling Strategies in SEM: Investigating the Subtle Effects of Unmodeled Secondary Constructs
Hall, R. J., Snell, A. F., & Foust, M. S. (1999) · Organizational Research Methods · doi:10.1177/109442819923002 · Cited by 708
Assessing Goodness of Fit: Is Parsimony Always Desirable?
Marsh, H. W., & Hau, K.-T. (1996) · The Journal of Experimental Education · doi:10.1080/00220973.1996.10806604 · Cited by 699
Self-citationMARSH, H. W., & O'NEILL, R. (1984) · Journal of Educational Measurement · doi:10.1111/j.1745-3984.1984.tb00227.x · Cited by 685
Self-citationAn Essay on Measurement and Factorial Invariance
Meredith, W., & Teresi, J. A. (2006) · Medical Care · doi:10.1097/01.mlr.0000245438.73837.89 · Cited by 664
Using parcels to convert path analysis models into latent variable models
Coffman, D. L., & MacCallum, R. C. (2005) · Multivariate Behavioral Research · doi:10.1207/s15327906mbr4002_4 · Cited by 662
How Should the Internal Structure of Personality Inventories Be Evaluated?
Hopwood, C. J., & Donnellan, M. B. (2010) · Personality and Social Psychology Review · doi:10.1177/1088868310361240 · Cited by 659
Kanpolat, Y. (2005) · Surgical Neurology · doi:10.1016/j.surneu.2005.07.019 · Cited by 470
The use of item parcels in structural equation modelling: Non-normal data and small sample sizes
Hau, K., & Marsh, H. W. (2004) · British Journal of Mathematical and Statistical Psychology · doi:10.1111/j.2044-8317.2004.tb00142.x · Cited by 467
Self-citationA general diagnostic model applied to language testing data
von Davier, M. (2008) · British Journal of Mathematical and Statistical Psychology · doi:10.1348/000711007x193957 · Cited by 454
Self-citationStructural Equation Models: Empirical Identification, Heywood Cases, and Related Problems
RINDSKOPF, D. (1984) · Sociological Methods & Research · doi:10.1177/0049124184013001004 · Cited by 443
Rogers, W. M., & Schmitt, N. (2004) · Multivariate Behavioral Research · doi:10.1207/s15327906mbr3903_1 · Cited by 390
Marsh, H. W. (2007) · Handbook of Sport Psychology · doi:10.1002/9781118270011.ch35 · Cited by 388
Self-citationA Comparative Investigation of Rotation Criteria Within Exploratory Factor Analysis
Sass, D. A., & Schmitt, T. A. (2010) · Multivariate Behavioral Research · doi:10.1080/00273170903504810 · Cited by 382
Handbook of sport psychology, 3rd ed.
Tenenbaum, G., & Eklund, R. C. (2007) · Cited by 368
Williams, L. J., & O'Boyle, E. H. (2008) · Human Resource Management Review · doi:10.1016/j.hrmr.2008.07.002 · Cited by 358
Marsh, H. W., Scalas, L. F., & Nagengast, B. (2010) · Psychological Assessment · doi:10.1037/a0019225 · Cited by 348
Self-citationMarsh, H. W. (1986) · Developmental Psychology · doi:10.1037//0012-1649.22.1.37 · Cited by 320
Self-citationCook, K. F., Kallen, M. A., & Amtmann, D. (2009) · Quality of Life Research · doi:10.1007/s11136-009-9464-4 · Cited by 308
Lüdtke, O., Marsh, H. W., Robitzsch, A., & Trautwein, U. (2011) · Psychological Methods · doi:10.1037/a0024376 · Cited by 273
Self-citationNasser-Abu Alhija, F., & Wisenbaker, J. (2006) · Structural Equation Modeling: A Multidisciplinary Journal · doi:10.1207/s15328007sem1302_3 · Cited by 266
Schmitt, T. A., & Sass, D. A. (2011) · Educational and Psychological Measurement · doi:10.1177/0013164410387348 · Cited by 257
Klein, A. G., & Muthén, B. O. (2007) · Multivariate Behavioral Research · doi:10.1080/00273170701710205 · Cited by 253
2001 Presidential Address: Working with Imperfect Models
MacCallum, R. C. (2003) · Multivariate Behavioral Research · doi:10.1207/s15327906mbr3801_5 · Cited by 241
Sass, D. A., & Smith, P. L. (2006) · Structural Equation Modeling: A Multidisciplinary Journal · doi:10.1207/s15328007sem1304_4 · Cited by 241
Model selection in covariance structures analysis and the "problem" of sample size: A clarification.
Cudeck, R., & Henly, S. J. (1991) · Psychological Bulletin · doi:10.1037//0033-2909.109.3.512 · Cited by 239
Comparing exploratory and confirmatory factor analysis: A study on the 5-factor model of personality
Borkenau, P., & Ostendorf, F. (1990) · Personality and Individual Differences · doi:10.1016/0191-8869(90)90065-y · Cited by 239
Yang, C., Nay, S., & Hoyle, R. H. (2010) · Applied Psychological Measurement · doi:10.1177/0146621609338592 · Cited by 237
Representing sources of error in the common-factor model: Implications for theory and practice.
MacCallum, R. C., & Tucker, L. R. (1991) · Psychological Bulletin · doi:10.1037//0033-2909.109.3.502 · Cited by 234
Marsh, H. W., Nagengast, B., Morin, A. J. S., Parada, R. H., Craven, R. G., & Hamilton, L. R. (2011) · Journal of Educational Psychology · doi:10.1037/a0024122 · Cited by 232
Self-citationDiscussion, Emphasizing the Connection Between Analysis of Variance and Spectrum Analysis
Tukey, J. W. (1961) · Technometrics · doi:10.1080/00401706.1961.10489940 · Cited by 214
Exploratory Structural Equation Modeling
Morin, A. J. S., Marsh, H. W., & Nagengast, B. (2013) · Structural Equation Modeling · doi:10.1108/978-1-62396-246-320251013 · Cited by 199
Self-citationMarsh, H. W., Liem, G. A. D., Martin, A. J., Morin, A. J. S., & Nagengast, B. (2011) · Journal of Psychoeducational Assessment · doi:10.1177/0734282911406657 · Cited by 198
Self-citationProblems With Item Parceling for Confirmatory Factor Analytic Tests of Measurement Invariance
Meade, A. W., & Kroustalis, C. M. (2006) · Organizational Research Methods · doi:10.1177/1094428105283384 · Cited by 187
Neeleman, D. (1973) · Springer eBooks · doi:10.1007/978-94-011-7486-2_4 · Cited by 178
Bandalos, D. L. (2008) · Structural Equation Modeling: A Multidisciplinary Journal · doi:10.1080/10705510801922340 · Cited by 173
Validation and intensification of the sixteen personality factor questionnaire
Cattell, R. B. (1956) · Journal of Clinical Psychology · doi:10.1002/1097-4679(195607)12:3<205::aid-jclp2270120302>3.0.co;2-0 · Cited by 164
Some Problems of Statistics and Everyday Life
Box, G. E. P. (1979) · Journal of the American Statistical Association · doi:10.1080/01621459.1979.10481600 · Cited by 138
Thurstone, L. L. (1930) · The Journal of General Psychology · doi:10.1080/00221309.1930.9918225 · Cited by 120
Structural equation modeling: A second course, 2nd ed.
Hancock, G. R., & Mueller, R. O. (2013) · Cited by 103
Using Predicted Latent Scores in General Latent Struc ture M odels
Croon, M. A. (2014) · Psychology Press eBooks · doi:10.4324/9781410602961-16 · Cited by 95
Structural Models and the Art of Approximation
McDonald, R. P. (2010) · Perspectives on Psychological Science · doi:10.1177/1745691610388766 · Cited by 90
Variability in Parameter Estimates and Model Fit Across Repeated Allocations of Items to Parcels
Sterba, S. K., & MacCallum, R. C. (2010) · Multivariate Behavioral Research · doi:10.1080/00273171003680302 · Cited by 89
Holden, R. R., & Fekken, G. C. (1994) · Personality and Individual Differences · doi:10.1016/0191-8869(94)90291-7 · Cited by 77
Comparison of Two Methods to Identify Major Personality Factors
Comrey, A. L. (1984) · Applied Psychological Measurement · doi:10.1177/014662168400800404 · Cited by 69
Testing Measurement Invariance in the Target Rotated Multigroup Exploratory Factor Model
Dolan, C. V., Oort, F. J., Stoel, R. D., & Wicherts, J. M. (2009) · Structural Equation Modeling A Multidisciplinary Journal · doi:10.1080/10705510902751416 · Cited by 61
Cattell, R. B. (1974) · Australian Journal of Psychology · doi:10.1080/00049537408255223 · Cited by 43
Sterba, S. K. (2011) · Structural Equation Modeling A Multidisciplinary Journal · doi:10.1080/10705511.2011.607073 · Cited by 33
Psychometric Engineering as Art
Thissen, D. (2001) · Psychometrika · doi:10.1007/bf02296190 · Cited by 21
A FACTOR ANALYSIS OF SELECTED MARKERS FOR OBJECTIVE PERSONALITY FACTORS
Howarth, E. (1972) · Multivariate Behavioral Research · doi:10.1207/s15327906mbr0704_3 · Cited by 9
Cited by
Marsh, H. W., Morin, A. J. S., Parker, P. D., & Kaur, G. (2014) · Annual Review of Clinical Psychology · doi:10.1146/annurev-clinpsy-032813-153700 · Cited by 1,801
Self-citationMorin, A. J. S., Arens, A. K., & Marsh, H. W. (2016) · Structural Equation Modeling: A Multidisciplinary Journal · doi:10.1080/10705511.2014.961800 · Cited by 836
Self-citationUn viaje alrededor de alfa y omega para estimar la fiabilidad de consistencia interna
Viladrich, C., Angulo-Brunet, A., & Doval, E. (2017) · Anales de Psicología · doi:10.6018/analesps.33.3.268401 · Cited by 699
Marsh, H. W., Pekrun, R., Parker, P. D., Murayama, K., Guo, J., Dicke, T., & Arens, A. K. (2019) · Journal of Educational Psychology · doi:10.1037/edu0000281 · Cited by 535
Self-citationLearning Engagement and Persistence in Massive Open Online Courses (MOOCS)
Jung, Y., & Lee, J. (2018) · Computers & Education · doi:10.1016/j.compedu.2018.02.013 · Cited by 514
Metadata
- Authors
- Marsh, H. W., Lüdtke, O., Nagengast, B., Morin, A. J. S., & von Davier, M.
- Venue
- Psychological Methods
- Published
- 2013-09
- Volume
- 18
- Issue
- 3
- Pages
- 257-284
- ISSN
- 1082-989X (ISSN-L)
- 1939-1463
- OpenAlex
- W2123334785
- Cited by
- 378
- References
- 82
- FWCI
- 37.63
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.