Analysing multitrait–multimethod data with structural equation models for ordinal variables applying the WLSMV estimator: What sample size is needed for valid results?
Open accessThe DOI matches its Crossref record; 4 of the 4 references it cites were found in a registry or an index.
Abstract
Convergent and discriminant validity of psychological constructs can best be examined in the framework of multitrait–multimethod (MTMM) analysis. To gain information at the level of single items, MTMM models for categorical variables have to be applied. The CTC(M−1) model is presented as an example of an MTMM model for ordinal variables. Based on an empirical application of the CTC(M−1) model, a complex simulation study was conducted to examine the sample size requirements of the robust weighted least squares mean‐ and variance‐adjusted χ 2 test of model fit (WLSMV estimator) implemented in Mplus. In particular, the simulation study analysed the χ 2 approximation, the parameter estimation bias, the standard error bias, and the reliability of the WLSMV estimator depending on the varying number of items per trait–method unit (ranging from 2 to 8) and varying sample sizes (250, 500, 750, and 1000 observations). The results showed that the WLSMV estimator provided a good – albeit slightly liberal – χ 2 approximation and stable and reliable parameter estimates for models of reasonable complexity (2–4 items) and small sample sizes (at least 250 observations). When more complex models with 5 or more items were analysed, larger sample sizes of at least 500 observations were needed. The most complex model with 9 trait–method units and 8 items (72 observed variables) requires sample sizes of at least 1000 observations.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Schermelleh-Engel, K., Moosbrugger, H., & Müller, H. (2003) · Department of Psychology - University of Koblenz-Landau · doi:10.23668/psycharchives.12784 · Cited by 8,975
The Jackknife, the Bootstrap and Other Resampling Plans
Efron, B. (1982) · Society for Industrial and Applied Mathematics eBooks · doi:10.1137/1.9781611970319 · Cited by 8,120
How to Use a Monte Carlo Study to Decide on Sample Size and Determine Power
Muthén, L. K., & Muthén, B. O. (2002) · Structural Equation Modeling: A Multidisciplinary Journal · doi:10.1207/s15328007sem0904_8 · Cited by 2,362
Coping through emotional approach: Scale construction and validation
Stanton, A. L., Kirk, S. B., Cameron, C. L., & Danoff-Burg, S. (2000) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.78.6.1150 · Cited by 663
Cited by
Rhemtulla, M., Brosseau-Liard, P. É., & Savalei, V. (2012) · Psychological Methods · doi:10.1037/a0029315 · Cited by 2,816
“…found that in most situations, both methods lead to unbiased parameter estimates (Beauducel & Herzberg, 2006; Dolan, 1994; Flora & Curran, 2004; Forero et al., 2009; Lei, 2009; B. O. Muthén et al., 1997; Nussbeck, Eid, & Lischetzke, 2006; Rigdon & Fergusson, 1991; Yang-Wallentin et al., 2010).”
BackgroundMethodInfluentialAnomalous results in G-factor models: Explanations and alternatives.
Eid, M., Geiser, C., Koch, T., & Heene, M. (2017) · Psychological Methods · doi:10.1037/met0000083 · Cited by 439
Self-citationHaller, M., Handley, E., Chassin, L., & Bountress, K. (2010) · Development and Psychopathology · doi:10.1017/s0954579410000532 · Cited by 101
I'm lonely, can't you tell? Convergent validity of self- and informant ratings of loneliness
Luhmann, M., Bohn, J., Holtmann, J., Koch, T., & Eid, M. (2016) · Journal of Research in Personality · doi:10.1016/j.jrp.2016.02.002 · Cited by 61
Self-citationTrifactor Models for Multiple-Ratings Data
Shin, H. J., Rabe-Hesketh, S., & Wilson, M. (2019) · Multivariate Behavioral Research · doi:10.1080/00273171.2018.1530091 · Cited by 52
Metadata
- Authors
- Nussbeck, F. W., Eid, M., & Lischetzke, T.
- Venue
- British Journal of Mathematical and Statistical Psychology
- Publisher
- Wiley
- Published
- 2006-05
- Volume
- 59
- Issue
- 1
- Pages
- 195-213
- ISSN
- 0007-1102 (ISSN-L)
- 2044-8317
- OpenAlex
- W2085355009
- Cited by
- 124
- References
- 4
- FWCI
- 3.36
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.