Appropriate Use of Bifactor Analysis in Psychopathology Research: Appreciating Benefits and Limitations
Open accessThe DOI matches its Crossref record; 35 of the 35 references it cites were found in a registry or an index.
Abstract
Co-occurrence of psychiatric disorders is well documented. Recent quantitative efforts have moved toward an understanding of this phenomenon, with the general psychopathology or p-factor model emerging as the most prominent characterization. Over the past decade, bifactor model analysis has become increasingly popular as a statistical approach to describe common/shared and unique elements in psychopathology. However, recent work has highlighted potential problems with common approaches to evaluating and interpreting bifactor models. Here, we argue that bifactor models, when properly applied and interpreted, can be useful for answering some important questions in psychology and psychiatry research. We review problems with evaluating bifactor models based on global model fit statistics. We then describe more valid approaches to evaluating bifactor models and highlight 3 types of research questions for which bifactor models are well suited to answer. We also discuss the utility and limits of bifactor applications in genetic and neurobiological research. We close by comparing advantages and disadvantages of bifactor models with other analytic approaches and note that no statistical model is a panacea to rectify limitations of the research design used to gather data.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Tripartite model of anxiety and depression: psychometric evidence and taxonomic implications
Clark, L. A., & Watson, D. (1991) · Journal of Abnormal Psychology · doi:10.1037/0021-843x.100.3.316 · Cited by 4,601
Network analysis: An integrative approach to the structure of psychopathology
Borsboom, D., & Cramer, A. O. J. (2013) · Annual Review of Clinical Psychology · doi:10.1146/annurev-clinpsy-050212-185608 · Cited by 4,359
A network theory of mental disorders
Borsboom, D. (2017) · World Psychiatry · doi:10.1002/wps.20375 · Cited by 3,482
Kotov, R., Krueger, R. F., Watson, D., Achenbach, T. M., Althoff, R. R., Bagby, R. M., Brown, T. A., Carpenter, W. T., Caspi, A., Clark, L. A., et al. (2017) · Journal of Abnormal Psychology · doi:10.1037/abn0000258 · Cited by 3,335
The p Factor: One General Psychopathology Factor in the Structure of Psychiatric Disorders?
Caspi, A., Houts, R. M., Belsky, D. W., Goldman-Mellor, S. J., Harrington, H., Israel, S., Meier, M. H., Ramrakha, S., Shalev, I., Poulton, R., et al. (2014) · Clinical Psychological Science · doi:10.1177/2167702613497473 · Cited by 2,449
The Rediscovery of Bifactor Measurement Models
Reise, S. P. (2012) · Multivariate Behavioral Research · doi:10.1080/00273171.2012.715555 · Cited by 2,112
The Structure of Common Mental Disorders
Krueger, R. F. (1999) · Archives of General Psychiatry · doi:10.1001/archpsyc.56.10.921 · Cited by 1,881
Evaluating Bifactor Models: Calculating and Interpreting Statistical Indices
Rodriguez, A., Reise, S. P., & Haviland, M. G. (2016) · Psychological Methods · doi:10.1037/met0000045 · Cited by 1,599
Cuthbert, B. N. (2014) · World Psychiatry · doi:10.1002/wps.20087 · Cited by 1,377
Reinterpreting comorbidity: a model-based approach to understanding and classifying psychopathology
Krueger, R. F., & Markon, K. E. (2006) · Annual Review of Clinical Psychology · doi:10.1146/annurev.clinpsy.2.022305.095213 · Cited by 1,171
The neuroscience of human intelligence differences
Deary, I. J., Penke, L., & Johnson, W. (2010) · Nature Reviews Neuroscience · doi:10.1038/nrn2793 · Cited by 1,038
A dynamical model of general intelligence: The positive manifold of intelligence by mutualism.
Van Der Maas, H. L. J., Dolan, C. V., Grasman, R. P. P. P., Wicherts, J. M., Huizenga, H. M., & Raijmakers, M. E. J. (2006) · Psychological Review · doi:10.1037/0033-295x.113.4.842 · Cited by 1,006
Grotzinger, A. D., Rhemtulla, M., de Vlaming, R., Ritchie, S. J., Mallard, T. T., Hill, W. D., Ip, H. F., Marioni, R. E., McIntosh, A. M., Deary, I. J., et al. (2019) · Nature Human Behaviour · doi:10.1038/s41562-019-0566-x · Cited by 958
A Comparison of Bifactor and Second-Order Models of Quality of Life
Chen, F. F., West, S., & Sousa, K. (2006) · Multivariate Behavioral Research · doi:10.1207/s15327906mbr4102_5 · Cited by 955
Is there a general factor of prevalent psychopathology during adulthood?
Lahey, B. B., Applegate, B., Hakes, J. K., Zald, D. H., Hariri, A. R., & Rathouz, P. J. (2012) · Journal of Abnormal Psychology · doi:10.1037/a0028355 · Cited by 641
Zinbarg, R. E., Barlow, D. H., & Brown, T. A. (1997) · Psychological Assessment · doi:10.1037/1040-3590.9.3.277 · Cited by 568
The structure of personality pathology: Both general (‘g’) and specific (‘s’) factors?
Sharp, C., Wright, A. G. C., Fowler, J. C., Frueh, B. C., Allen, J. G., Oldham, J., & Clark, L. A. (2015) · Journal of Abnormal Psychology · doi:10.1037/abn0000033 · Cited by 515
A hierarchical causal taxonomy of psychopathology across the life span.
Lahey, B. B., Krueger, R. F., Rathouz, P. J., Waldman, I. D., & Zald, D. H. (2017) · Psychological Bulletin · doi:10.1037/bul0000069 · Cited by 443
Tackett, J. L., Lahey, B. B., van Hulle, C., Waldman, I., Krueger, R. F., & Rathouz, P. J. (2013) · Journal of Abnormal Psychology · doi:10.1037/a0034151 · Cited by 360
Lahey, B. B., Van Hulle, C. A., Singh, A. L., Waldman, I. D., & Rathouz, P. J. (2011) · Archives of General Psychiatry · doi:10.1001/archgenpsychiatry.2010.192 · Cited by 341
The structure of psychopathology in adolescence and its common personality and cognitive correlates.
Castellanos-Ryan, N., The IMAGEN Consortium, Brière, F. N., O'Leary-Barrett, M., Banaschewski, T., Bokde, A., Bromberg, U., Büchel, C., Flor, H., Frouin, V., et al. (2016) · Journal of Abnormal Psychology · doi:10.1037/abn0000193 · Cited by 299
Hallquist, M. N., Wright, A. G. C., & Molenaar, P. C. M. (2021) · Multivariate Behavioral Research · doi:10.1080/00273171.2019.1640103 · Cited by 292
Laceulle, O. M., Vollebergh, W. A. M., & Ormel, J. (2015) · Clinical Psychological Science · doi:10.1177/2167702614560750 · Cited by 289
Martel, M. M., Pan, P. M., Hoffmann, M. S., Gadelha, A., do Rosário, M. C., Mari, J. J., Manfro, G. G., Miguel, E. C., Paus, T., Bressan, R. A., et al. (2017) · Journal of Abnormal Psychology · doi:10.1037/abn0000205 · Cited by 268
The structure and predictive validity of the internalizing disorders.
Eaton, N. R., Krueger, R. F., Markon, K. E., Keyes, K. M., Skodol, A. E., Wall, M., Hasin, D. S., & Grant, B. F. (2013) · Journal of Abnormal Psychology · doi:10.1037/a0029598 · Cited by 225
Shanmugan, S., Wolf, D. H., Calkins, M. E., Moore, T. M., Ruparel, K., Hopson, R. D., Vandekar, S. N., Roalf, D. R., Elliott, M. A., Jackson, C., et al. (2016) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2015.15060725 · Cited by 219
Criterion validity of the general factor of psychopathology in a prospective study of girls
Lahey, B. B., Rathouz, P. J., Keenan, K., Stepp, S. D., Loeber, R., & Hipwell, A. E. (2015) · Journal of Child Psychology and Psychiatry · doi:10.1111/jcpp.12300 · Cited by 209
Bifactor Modeling and the Estimation of Model-Based Reliability in the WAIS-IV
Gignac, G. E., & Watkins, M. W. (2013) · Multivariate Behavioral Research · doi:10.1080/00273171.2013.804398 · Cited by 200
Murray, A. L., Eisner, M., & Ribeaud, D. (2016) · Journal of Abnormal Child Psychology · doi:10.1007/s10802-016-0132-1 · Cited by 192
Credé, M., & Harms, P. D. (2015) · Journal of Organizational Behavior · doi:10.1002/job.2008 · Cited by 181
Are fit indices used to test psychopathology structure biased? A simulation study
Greene, A. L., Eaton, N. R., Li, K., Forbes, M. K., Krueger, R. F., Markon, K. E., Waldman, I. D., Cicero, D. C., Conway, C. C., Docherty, A. R., et al. (2019) · Journal of Abnormal Psychology · doi:10.1037/abn0000434 · Cited by 148
Medicine and the Mind — The Consequences of Psychiatry’s Identity Crisis
Gardner, C., & Kleinman, A. (2019) · New England Journal of Medicine · doi:10.1056/nejmp1910603 · Cited by 89
Davies, S. E., Connelly, B. S., Ones, D. S., & Birkland, A. S. (2015) · Personality and Individual Differences · doi:10.1016/j.paid.2015.01.006 · Cited by 77
Haltigan, J. D., Aitken, M., Skilling, T., Henderson, J., Hawke, L., Battaglia, M., Strauss, J., Szatmari, P., & Andrade, B. F. (2018) · Journal of the American Academy of Child & Adolescent Psychiatry · doi:10.1016/j.jaac.2018.03.010 · Cited by 73
Investigating the genetic architecture of general and specific psychopathology in adolescence
Jones, H. J., Heron, J., Hammerton, G., Stochl, J., Jones, P. B., Cannon, M., Smith, G. D., Holmans, P., Lewis, G., Linden, D. E. J., et al. (2018) · Translational Psychiatry · doi:10.1038/s41398-018-0204-9 · Cited by 59
Cited by
How Local and Global Metacognition Shape Mental Health
Seow, T. X. F., Rouault, M., Gillan, C. M., & Fleming, S. M. (2021) · Biological Psychiatry · doi:10.1016/j.biopsych.2021.05.013 · Cited by 159
Snyder, H. R., Friedman, N. P., & Hankin, B. L. (2021) · Assessment · doi:10.1177/1073191120965694 · Cited by 94
“The advantage of the latter is that it separates this common variance from variance that is specific to each subcomponent, allowing each to be examined in relation to other variables (e.g., Bornovalova et al., 2020).”
BackgroundMoore, T. M., Kaczkurkin, A. N., Durham, E. L., Jeong, H. J., McDowell, M. G., Dupont, R. M., Applegate, B., Tackett, J. L., Cardenas-Iniguez, C., Kardan, O., et al. (2020) · Journal of Abnormal Psychology · doi:10.1037/abn0000601 · Cited by 72
Karcher, N. R., Michelini, G., Kotov, R., & Barch, D. M. (2021) · Biological Psychiatry: Cognitive Neuroscience and Neuroimaging · doi:10.1016/j.bpsc.2020.09.008 · Cited by 55
Carmichael, J., Spitz, G., Gould, K. R., Johnston, L., Samiotis, A., & Ponsford, J. (2023) · Scientific Reports · doi:10.1038/s41598-023-35017-7 · Cited by 20
Metadata
- Authors
- Bornovalova, M. A., Choate, A. M., Fatimah, H., Petersen, K. J., & Wiernik, B. M.
- Venue
- Biological Psychiatry
- Publisher
- Elsevier BV
- Published
- 2020-07
- Volume
- 88
- Issue
- 1
- Pages
- 18-27
- ISSN
- 0006-3223 (ISSN-L)
- OpenAlex
- W3004230819
- Cited by
- 215
- References
- 35
- FWCI
- 29.84
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.