Riskier Tests of the Validity of the Bifactor Model of Psychopathology
The DOI matches its Crossref record; 26 of the 26 references it cites were found in a registry or an index.
Abstract
We advanced several “riskier tests” of the validity of bifactor models of psychopathology, which included that the general and specific psychopathology factors should be reliable and well represented by their respective indicators and that including a general factor should improve on the correlated factor model’s external validity. We compared bifactor and correlated factors models of psychopathology using data from a community sample of youth ( N = 2,498) whose parents provided ratings on psychopathology and theoretically relevant external criteria (i.e., personality, aggression, antisociality). Bifactor models tended to yield either general or specific factors that were unstable and difficult to interpret. The general factor appeared to reflect a differentially weighted amalgam of psychopathology rather than a liability for psychopathology broadly construed. With rare exceptions, bifactor models did not explain additional variance in first-order psychopathology symptom dimensions or external criteria compared with correlated factors models. Together, our findings call into question the validity of bifactor models of psychopathology and the p factor more broadly.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Kotov, R., Krueger, R. F., Watson, D., Achenbach, T. M., Althoff, R. R., Bagby, R. M., Brown, T. A., Carpenter, W. T., Caspi, A., Clark, L. A., et al. (2017) · Journal of Abnormal Psychology · doi:10.1037/abn0000258 · Cited by 3,335 · cited 2×
“, 2019) that was previously agnostic with regard to the nature and number of highest order psychopathology dimensions (Kotov et al., 2017).”
BackgroundSelf-citationThe Rediscovery of Bifactor Measurement Models
Reise, S. P. (2012) · Multivariate Behavioral Research · doi:10.1080/00273171.2012.715555 · Cited by 2,112 · cited 2×
“Such findings are more consistent, rather, with the p factor reflecting an amalgam of differentially weighted and psychologically distinct sources of variance (Krueger et al., 2018; Reise, 2012).”
BackgroundResultThe Structure of Common Mental Disorders
Krueger, R. F. (1999) · Archives of General Psychiatry · doi:10.1001/archpsyc.56.10.921 · Cited by 1,881 · cited 3×
“Subsequent research suggests that internalizing can be parsed into distress, which includes depression, anxiety, and posttraumatic stress disorder, and fears, which includes phobias and panic disorder (Clark & Watson, 2006; Krueger, 1999).”
BackgroundEvaluating Bifactor Models: Calculating and Interpreting Statistical Indices
Rodriguez, A., Reise, S. P., & Haviland, M. G. (2016) · Psychological Methods · doi:10.1037/met0000045 · Cited by 1,599
Loehlin, J. C., & Beaujean, A. A. (2016) · doi:10.4324/9781315643199 · Cited by 1,381
Reinterpreting comorbidity: a model-based approach to understanding and classifying psychopathology
Krueger, R. F., & Markon, K. E. (2006) · Annual Review of Clinical Psychology · doi:10.1146/annurev.clinpsy.2.022305.095213 · Cited by 1,171 · cited 4×
“Cross-sectional and longitudinal efforts to disentangle externalizing and internalizing have revealed that the two are separable but substantially overlapping (meta-analytic r = .50; Krueger & Markon, 2006).”
BackgroundInfluentialTemperament and developmental psychopathology
Nigg, J. T. (2006) · Journal of Child Psychology and Psychiatry · doi:10.1111/j.1469-7610.2006.01612.x · Cited by 971
Snyder, H. R., Miyake, A., & Hankin, B. L. (2015) · Frontiers in Psychology · doi:10.3389/fpsyg.2015.00328 · Cited by 946 · cited 1×
“, 2019), integrating it into structural models of allied constructs (i.e., personality, personality disorders, executive functioning; Oltmanns et al., 2018; Snyder et al., 2015), and focusing on its clinical implications (Conway et al.”
BackgroundAll for One and One for All: Mental Disorders in One Dimension
Caspi, A., & Moffitt, T. E. (2018) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2018.17121383 · Cited by 918
The classification of children's psychiatric symptoms: A factor-analytic study.
Achenbach, T. M. (1966) · Psychological Monographs: General and Applied · doi:10.1037/h0093906 · Cited by 885
Heart rate variability as a transdiagnostic biomarker of psychopathology
Beauchaine, T. P., & Thayer, J. F. (2015) · International Journal of Psychophysiology · doi:10.1016/j.ijpsycho.2015.08.004 · Cited by 870
Is there a general factor of prevalent psychopathology during adulthood?
Lahey, B. B., Applegate, B., Hakes, J. K., Zald, D. H., Hariri, A. R., & Rathouz, P. J. (2012) · Journal of Abnormal Psychology · doi:10.1037/a0028355 · Cited by 641 · cited 5×
“As testament to its popularity, the seminal articles on the p factor and bifactor models of psychopathology (Caspi et al., 2014; Lahey et al., 2012) together have been cited more than 1,100 times.”
BackgroundInfluentialProgress in achieving quantitative classification of psychopathology
Krueger, R. F., Kotov, R., Watson, D., Forbes, M. K., Eaton, N. R., Ruggero, C. J., Simms, L. J., Widiger, T. A., Achenbach, T. M., Bach, B., et al. (2018) · World Psychiatry · doi:10.1002/wps.20566 · Cited by 490
Self-citationA Tutorial on Hierarchically Structured Constructs
Brunner, M., Nagy, G., & Wilhelm, O. (2012) · Journal of Personality · doi:10.1111/j.1467-6494.2011.00749.x · Cited by 459
Assessment of Adult Psychopathology: Meta-Analyses and Implications of Cross-Informant Correlations.
Achenbach, T. M., Krukowski, R. A., Dumenci, L., & Ivanova, M. Y. (2005) · Psychological Bulletin · doi:10.1037/0033-2909.131.3.361 · Cited by 406
Tackett, J. L., Lahey, B. B., van Hulle, C., Waldman, I., Krueger, R. F., & Rathouz, P. J. (2013) · Journal of Abnormal Psychology · doi:10.1037/a0034151 · Cited by 360
Self-citationThe structure of psychopathology in adolescence and its common personality and cognitive correlates.
Castellanos-Ryan, N., The IMAGEN Consortium, Brière, F. N., O'Leary-Barrett, M., Banaschewski, T., Bokde, A., Bromberg, U., Büchel, C., Flor, H., Frouin, V., et al. (2016) · Journal of Abnormal Psychology · doi:10.1037/abn0000193 · Cited by 299 · cited 2×
“, 2014; see also Widiger & Oltmanns, 2017b); impulsivity, sensation seeking, and hopelessness (Castellanos-Ryan et al., 2016); decreased intelligence, executive functioning, early life brain integrity (Caspi et al.”
BackgroundLaceulle, O. M., Vollebergh, W. A. M., & Ormel, J. (2015) · Clinical Psychological Science · doi:10.1177/2167702614560750 · Cited by 289 · cited 1×
“It is important to note that we tested bifactor models that allowed for correlated specific factors on the basis of practices observed in the psychopathology literature (Carragher et al., 2016; Caspi et al., 2014; Laceulle et al., 2015; Martel, Pan, et al., 2017; Olino et al., 2014), although bifactor-model theories a…”
Martel, M. M., Pan, P. M., Hoffmann, M. S., Gadelha, A., do Rosário, M. C., Mari, J. J., Manfro, G. G., Miguel, E. C., Paus, T., Bressan, R. A., et al. (2017) · Journal of Abnormal Psychology · doi:10.1037/abn0000205 · Cited by 268
Pettersson, E., Larsson, H., & Lichtenstein, P. (2016) · Molecular Psychiatry · doi:10.1038/mp.2015.116 · Cited by 215
Criterion validity of the general factor of psychopathology in a prospective study of girls
Lahey, B. B., Rathouz, P. J., Keenan, K., Stepp, S. D., Loeber, R., & Hipwell, A. E. (2015) · Journal of Child Psychology and Psychiatry · doi:10.1111/jcpp.12300 · Cited by 209
Murray, A. L., Eisner, M., & Ribeaud, D. (2016) · Journal of Abnormal Child Psychology · doi:10.1007/s10802-016-0132-1 · Cited by 192
Single Nucleotide Polymorphism Heritability of a General Psychopathology Factor in Children
Neumann, A., Pappa, I., Lahey, B. B., Verhulst, F. C., Medina-Gomez, C., Jaddoe, V. W., Bakermans-Kranenburg, M. J., Moffitt, T. E., van IJzendoorn, M. H., & Tiemeier, H. (2016) · Journal of the American Academy of Child & Adolescent Psychiatry · doi:10.1016/j.jaac.2016.09.498 · Cited by 121
Olino, T. M., Dougherty, L. R., Bufferd, S. J., Carlson, G. A., & Klein, D. N. (2014) · Journal of Abnormal Child Psychology · doi:10.1007/s10802-014-9865-x · Cited by 106
Noordhof, A., Krueger, R. F., Ormel, J., Oldehinkel, A. J., & Hartman, C. A. (2015) · Journal of Abnormal Child Psychology · doi:10.1007/s10802-014-9923-4 · Cited by 75
Markon, K. E., & Krueger, R. F. (2006) · Psychological Methods · doi:10.1037/1082-989x.11.3.228 · Cited by 53 · cited 2×
“Adequacy of model fit was determined on the basis of guidelines suggested in the literature and the comparison of TLI, RMSEA, SRMR, and BIC (see Loehlin, 2004; Markon & Krueger, 2006), although we present the χ2, CFI, and the Akaike information criterion (AIC) in the spirit of full disclosure.”
BackgroundMethod
Cited by
Lack of theory building and testing impedes progress in the factor and network literature
Fried, E. I. (2020) · Psychological Inquiry · doi:10.1080/1047840x.2020.1853461 · Cited by 317
Hierarchical models of psychopathology: empirical support, implications, and remaining issues
Lahey, B. B., Moore, T. M., Kaczkurkin, A. N., & Zald, D. H. (2021) · World Psychiatry · doi:10.1002/wps.20824 · Cited by 188
How Local and Global Metacognition Shape Mental Health
Seow, T. X. F., Rouault, M., Gillan, C. M., & Fleming, S. M. (2021) · Biological Psychiatry · doi:10.1016/j.biopsych.2021.05.013 · Cited by 159
Sibling Constructs: What Are They, Why Do They Matter, and How Should You Handle Them?
Lawson, K. M., & Robins, R. W. (2021) · Personality and Social Psychology Review · doi:10.1177/10888683211047101 · Cited by 144
Moore, T. M., Kaczkurkin, A. N., Durham, E. L., Jeong, H. J., McDowell, M. G., Dupont, R. M., Applegate, B., Tackett, J. L., Cardenas-Iniguez, C., Kardan, O., et al. (2020) · Journal of Abnormal Psychology · doi:10.1037/abn0000601 · Cited by 72
Metadata
- Authors
- Watts, A. L., Poore, H. E., & Waldman, I. D.
- Venue
- Clinical Psychological Science
- Publisher
- SAGE Publications
- Published
- 2019-07-29
- Volume
- 7
- Issue
- 6
- Pages
- 1285-1303
- ISSN
- 2167-7026 (ISSN-L)
- 2167-7034
- OpenAlex
- W2965229342
- Cited by
- 147
- References
- 26
- FWCI
- 22.38
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.