Comparing the relative fit of categorical and dimensional latent variable models using consistency tests.
The DOI matches its Crossref record; 3 of the 3 references it cites were found in a registry or an index.
Abstract
A number of recent studies have used Meehl's (1995) taxometric method to determine empirically whether one should model assessment-related constructs as categories or dimensions. The taxometric method includes multiple data-analytic procedures designed to check the consistency of results. The goal is to differentiate between strong evidence of categorical structure, strong evidence of dimensional structure, and ambiguous evidence that suggests withholding judgment. Many taxometric consistency tests have been proposed, but their use has not been operationalized and studied rigorously. What tests should be performed, how should results be combined, and what thresholds should be applied? We present an approach to consistency testing that builds on prior work demonstrating that parallel analyses of categorical and dimensional comparison data provide an accurate index of the relative fit of competing structural models. Using a large simulation study spanning a wide range of data conditions, we examine many critical elements of this approach. The results provide empirical support for what marks the first rigorous operationalization of consistency testing. We discuss and empirically illustrate guidelines for implementing this approach and suggest avenues for future research to extend the practice of consistency testing to other techniques for modeling latent variables in the realm of psychological assessment.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
McLachlan, G., & Peel, D. (2000) · Wiley Series in Probability and Statistics · doi:10.1002/0471721182 · Cited by 10,991 · cited 1×
“Techniques to differentiate categorical and dimensional data include cluster analysis (Everitt, Landau, & Leese, 2001), mixture modeling (McLachlan & Peel, 2001), latent class or latent profile analysis (McCutcheon, 1987), and Meehl’s (1995) taxometric method.”
MethodOn the practice of dichotomization of quantitative variables.
MacCallum, R. C., Zhang, S., Preacher, K. J., & Rucker, D. D. (2002) · Psychological Methods · doi:10.1037/1082-989x.7.1.19 · Cited by 3,538
A probability-based measure of effect size: Robustness to base rates and other factors.
Ruscio, J. (2008) · Psychological Methods · doi:10.1037/1082-989x.13.1.19 · Cited by 398
Self-citation
Cited by
Haslam, N., Holland, E., & Kuppens, P. (2012) · Psychological Medicine · doi:10.1017/s0033291711001966 · Cited by 611
Ruscio, J., & Roche, B. (2012) · Psychological Assessment · doi:10.1037/a0025697 · Cited by 532
Self-citationFraley, R. C., Hudson, N. W., Heffernan, M. E., & Segal, N. (2015) · Journal of Personality and Social Psychology · doi:10.1037/pspp0000027 · Cited by 392
MacDonald, K., Thomas, M. L., Sciolla, A. F., Schneider, B., Pappas, K., Bleijenberg, G., Bohus, M., Bekh, B., Carpenter, L., Carr, A., et al. (2016) · PLOS ONE · doi:10.1371/journal.pone.0146058 · Cited by 372
Dimensions over categories: a meta-analysis of taxometric research
Haslam, N., McGrath, M. J., Viechtbauer, W., & Kuppens, P. (2020) · Psychological Medicine · doi:10.1017/s003329172000183x · Cited by 279
Metadata
- Authors
- Ruscio, J., Walters, G. D., Marcus, D. K., & Kaczetow, W.
- Venue
- Psychological Assessment
- Published
- 2010-03
- Volume
- 22
- Issue
- 1
- Pages
- 5-21
- ISSN
- 1040-3590 (ISSN-L)
- 1939-134X
- OpenAlex
- W1990074298
- Cited by
- 155
- References
- 3
- FWCI
- 20.49
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.