Refinements in the hierarchical structure of externalizing psychiatric disorders: Patterns of lifetime liability from mid-adolescence through early adulthood.
Open accessThe DOI matches its Crossref record; 81 of the 84 references it cites were found in a registry or an index.
Abstract
Research on hierarchical modeling of psychopathology has frequently identified 2 higher order latent factors, internalizing and externalizing. When based on the comorbidity of psychiatric diagnoses, the externalizing domain has usually been modeled as a single latent factor. Multivariate studies of externalizing symptom features, however, suggest multidimensionality. To address this apparent contradiction, confirmatory factor analytic methods and information-theoretic criteria were used to evaluate 4 theoretically plausible measurement models based on lifetime comorbidity patterns of 7 putative externalizing disorders. Diagnostic information was collected at 4 assessment waves from an age-based cohort of 816 persons between the ages of 14 and 33. A 2-factor model that distinguished oppositional behavior disorders (attention-deficit/hyperactivity disorder, oppositional defiant disorder) from social norm violation disorders (conduct disorder, adult antisocial behavior, alcohol use disorder, cannabis use disorder, hard drug use disorder) demonstrated consistently good fit and superior approximating abilities. Analyses of psychosocial outcomes measured at the last assessment wave supported the validity of this 2-factor model. Implications of this research for the theoretical understanding of domain-related disorders and the organization of classification systems are discussed.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“these studies were largely based on a priori assumptions about underlying latent structure; i.e., they assumed an underlying latent trait [15–18] or a combination of latent traits and latent classes [19].”
From ADHD and the externalizing spectrum: direct comparison of categorical, continuous, and hybrid models of liability in a nationally representative sample (2014) · cites this paper as [16]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“A small number of studies have formally tested the fit of ADHD in the externalizing spectrum [15–20].”
From ADHD and the externalizing spectrum: direct comparison of categorical, continuous, and hybrid models of liability in a nationally representative sample (2014) · cites this paper as [16]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Diagnostic and Statistical Manual of Mental Disorders
Williams, J. B. W., & First, M. (2013) · Encyclopedia of Social Work · doi:10.1093/acrefore/9780199975839.013.104 · Cited by 109,519
Comparative fit indexes in structural models.
Bentler, P. M. (1990) · Psychological Bulletin · doi:10.1037/0033-2909.107.2.238 · Cited by 25,266
Kessler, R. C., Berglund, P., Demler, O., Jin, R., Merikangas, K. R., & Walters, E. E. (2005) · Archives of General Psychiatry · doi:10.1001/archpsyc.62.6.593 · Cited by 20,391
Statistical Methods for Rates and Proportions
Fleiss, J. L., Levin, B., & Paik, M. C. (2003) · Wiley Series in Probability and Statistics · doi:10.1002/0471445428 · Cited by 18,646
Kessler, R. C. (1994) · Archives of General Psychiatry · doi:10.1001/archpsyc.1994.03950010008002 · Cited by 12,370
Kessler, R. C., Chiu, W. T., Demler, O., & Walters, E. E. (2005) · Archives of General Psychiatry · doi:10.1001/archpsyc.62.6.617 · Cited by 12,052
Multimodel Inference: Understanding AIC and BIC in Model Selection
Burnham, K. P., & Anderson, D. R. (2004) · Sociological Methods & Research · doi:10.1177/0049124104268644 · Cited by 11,648
Statistical Methods for Rates and Proportions.
Everitt, B. S., & Fleiss, J. L. (1981) · Biometrics · doi:10.2307/2530193 · Cited by 8,990
Bayesian model selection in social research
Raftery, A. E. (1995) · Sociological Methodology · doi:10.2307/271063 · Cited by 6,823
Curran, P. J., West, S. G., & Finch, J. F. (1996) · Psychological Methods · doi:10.1037/1082-989x.1.1.16 · Cited by 5,512
Research works printed but not linked: 1
- First MB Spitzer RL Gibbon M Williams JBW 1994 Structured Clinical Interview for Axis I DSM-IV Disorders–Non-Patient Edition New York Biometrics Research Department
Cited by
Kotov, R., Krueger, R. F., Watson, D., Achenbach, T. M., Althoff, R. R., Bagby, R. M., Brown, T. A., Carpenter, W. T., Caspi, A., Clark, L. A., et al. (2017) · Journal of Abnormal Psychology · doi:10.1037/abn0000258 · Cited by 3,335
“, & Arbisi, P. (2014). The MMPI-2-RF Personality Psychopathol-”
Development of lifetime comorbidity in the World Health Organization world mental health surveys
Kessler, R. C., Ormel, J., Petukhova, M., McLaughlin, K. A., Green, J. G., Russo, L. J., Stein, D. J., Zaslavsky, A. M., Aguilar-Gaxiola, S., Alonso, J., et al. (2011) · Archives of General Psychiatry · doi:10.1001/archgenpsychiatry.2010.180 · Cited by 508
Krueger, R. F., Hobbs, K. A., Conway, C. C., Dick, D. M., Dretsch, M. N., Eaton, N. R., Forbes, M. K., Forbush, K. T., Keyes, K. M., Latzman, R. D., et al. (2021) · World Psychiatry · doi:10.1002/wps.20844 · Cited by 262
Michelini, G., Carlisi, C. O., Eaton, N. R., Elison, J. T., Haltigan, J. D., Kotov, R., Krueger, R. F., Latzman, R. D., Li, J. J., Levin-Aspenson, H. F., et al. (2024) · World Psychiatry · doi:10.1002/wps.21225 · Cited by 118
Evidence for a Multi-Dimensional Latent Structural Model of Externalizing Disorders
the Conduct Problems Prevention Research Group, Witkiewitz, K., King, K., McMahon, R. J., Wu, J., Luk, J., Bierman, K. L., Coie, J. D., Dodge, K. A., Greenberg, M. T., et al. (2013) · Journal of Abnormal Child Psychology · doi:10.1007/s10802-012-9674-z · Cited by 110
Hanson, K. L., Cummins, K., Tapert, S. F., & Brown, S. A. (2011) · Psychology of Addictive Behaviors · doi:10.1037/a0022350 · Cited by 81
Walton, K. E., Ormel, J., & Krueger, R. F. (2011) · Research on Child and Adolescent Psychopathology · doi:10.1007/s10802-010-9478-y · Cited by 100
The effects of latent variables in the development of comorbidity among common mental disorders
Kessler, R. C., Cox, B. J., Green, J. G., Ormel, J., McLaughlin, K. A., Merikangas, K. R., Petukhova, M., Pine, D. S., Russo, L. J., Swendsen, J., et al. (2011) · Depression and Anxiety · doi:10.1002/da.20760 · Cited by 78
Farmer, R. F., Gau, J. M., Seeley, J. R., Kosty, D. B., Sher, K. J., & Lewinsohn, P. M. (2016) · Drug and Alcohol Dependence · doi:10.1016/j.drugalcdep.2016.04.021 · Cited by 88
Self-citationDawson, D. A., Goldstein, R. B., Moss, H. B., Li, T.-K., & Grant, B. F. (2010) · Drug and Alcohol Dependence · doi:10.1016/j.drugalcdep.2010.04.019 · Cited by 74
Natural course of cannabis use disorders
Farmer, R. F., Kosty, D. B., Seeley, J. R., Duncan, S. C., Lynskey, M. T., Rohde, P., Klein, D. N., & Lewinsohn, P. M. (2014) · Psychological Medicine · doi:10.1017/s003329171400107x · Cited by 85
Self-citationCarragher, N., Krueger, R. F., Eaton, N. R., Markon, K. E., Keyes, K. M., Blanco, C., Saha, T. D., & Hasin, D. S. (2014) · Social Psychiatry and Psychiatric Epidemiology · doi:10.1007/s00127-013-0770-3 · Cited by 77
“A small number of studies have formally tested the fit of ADHD in the externalizing spectrum [15–20].”
BackgroundFarmer, R. F., Seeley, J. R., Kosty, D. B., Gau, J. M., Duncan, S. C., Lynskey, M. T., & Lewinsohn, P. M. (2015) · Psychology of Addictive Behaviors · doi:10.1037/adb0000059 · Cited by 78
Self-citationThe cross-national structure of mental disorders: results from the World Mental Health Surveys
de Jonge, P., Wardenaar, K. J., Lim, C. C. W., Aguilar-Gaxiola, S., Alonso, J., Andrade, L. H., Bunting, B., Chatterji, S., Ciutan, M., Gureje, O., et al. (2018) · Psychological Medicine · doi:10.1017/s0033291717003610 · Cited by 66
“…subfactors have been found that explain additional clustering of disorders that are either characterized by ‘norm-violations’ (CD, substance-use disorders) or by ‘oppositional behavior’ [oppositional-defiant disorder (ODD), attention-deficit hyperactivity disorder (ADHD); Farmer et al. 2009].”
BackgroundExamination of the structure of psychopathology using latent class analysis
Olino, T. M., Klein, D. N., Farmer, R. F., Seeley, J. R., & Lewinsohn, P. M. (2011) · Comprehensive Psychiatry · doi:10.1016/j.comppsych.2011.05.008 · Cited by 60
Self-citationTrajectories of cannabis use disorder: risk factors, clinical characteristics and outcomes
Kosty, D. B., Seeley, J. R., Farmer, R. F., Stevens, J. J., & Lewinsohn, P. M. (2016) · Addiction · doi:10.1111/add.13557 · Cited by 52
Self-citationDimensions of Adolescent Psychopathology and Relationships to Suicide Risk Indicators
Verona, E., & Javdani, S. (2011) · Journal of Youth and Adolescence · doi:10.1007/s10964-011-9630-1 · Cited by 50
Parental transmission of risk for cannabis use disorders to offspring
Kosty, D. B., Farmer, R. F., Seeley, J. R., Gau, J. M., Duncan, S. C., & Lewinsohn, P. M. (2015) · Addiction · doi:10.1111/add.12914 · Cited by 49
Self-citationHandley, E. D., Chassin, L., Haller, M. M., Bountress, K. E., Dandreaux, D. M., & Beltran, I. (2011) · Journal of Abnormal Psychology · doi:10.1037/a0024162 · Cited by 44
Farmer, R. F., Kosty, D. B., Seeley, J. R., Olino, T. M., & Lewinsohn, P. M. (2013) · Journal of Abnormal Psychology · doi:10.1037/a0031429 · Cited by 38
Self-citationComparing factor structures of adolescent psychopathology.
Verona, E., Javdani, S., & Sprague, J. (2011) · Psychological Assessment · doi:10.1037/a0022055 · Cited by 37
Vrieze, S. I., Perlman, G., Krueger, R. F., & Iacono, W. G. (2011) · Research on Child and Adolescent Psychopathology · doi:10.1007/s10802-011-9571-x · Cited by 35
The structure of DSM-IV ADHD, ODD, and CD criteria in adolescent boys: A hierarchical approach
Bezdjian, S., Krueger, R. F., Derringer, J. L., Malone, S., McGue, M. K., & Iacono, W. G. (2011) · Psychiatry Research · doi:10.1016/j.psychres.2011.02.027 · Cited by 33
The forms and functions of impulsive actions: Implications for behavioral assessment and therapy.
Farmer, R. F., & Golden, J. A. (2009) · International Journal of Behavioral Consultation and Therapy · doi:10.1037/h0100870 · Cited by 24
Self-citationHarford, T. C., Chen, C. M., Saha, T. D., Smith, S. M. R., Ruan, W. J., & Grant, B. F. (2013) · Journal of Psychiatric Research · doi:10.1016/j.jpsychires.2013.07.016 · Cited by 22
McDowell, Y. E., Verges, A. J., & Sher, K. J. (2019) · Alcoholism Clinical and Experimental Research · doi:10.1111/acer.13952 · Cited by 22
Hierarchical organization of axis I psychiatric disorder comorbidity through age 30
Farmer, R. F., Seeley, J. R., Kosty, D. B., Olino, T. M., & Lewinsohn, P. M. (2013) · Comprehensive Psychiatry · doi:10.1016/j.comppsych.2012.12.007 · Cited by 20
Self-citationDo dopamine gene variants and prenatal smoking interactively predict youth externalizing behavior?
O’Brien, T. C., Mustanski, B. S., Skol, A. D., Cook, E. H., & Wakschlag, L. S. (2013) · Neurotoxicology and Teratology · doi:10.1016/j.ntt.2013.09.002 · Cited by 19
Harford, T. C., Yi, H., Chen, C. M., & Grant, B. F. (2015) · Alcoholism Clinical and Experimental Research · doi:10.1111/acer.12767 · Cited by 17
Walton, K. E., Krueger, R. F., Elkins, I. J., D’Accordo, C., McGue, M. K., & Iacono, W. G. (2016) · Journal of Personality · doi:10.1111/jopy.12245 · Cited by 16
Association of comorbid psychopathology with the duration of cannabis use disorders.
Farmer, R. F., Kosty, D. B., Seeley, J. R., Gau, J. M., Duncan, S. C., Walker, D. D., & Lewinsohn, P. M. (2016) · Psychology of Addictive Behaviors · doi:10.1037/adb0000151 · Cited by 13
Self-citationOlino, T. M., Klein, D. N., & Seeley, J. R. (2019) · Psychological Medicine · doi:10.1017/s0033291719002186 · Cited by 10
Self-citationMediators of interparental conflict and adolescent internalizing/externalizing behaviors
Fisher, S. D. (2012) · doi:10.17077/etd.amlwv24y · Cited by 9
Farmer, R. F., Seeley, J. R., Kosty, D. B., Gau, J. M., Duncan, S. C., Sher, K. J., & Lewinsohn, P. M. (2017) · Journal of Studies on Alcohol and Drugs · doi:10.15288/jsad.2017.78.222 · Cited by 8
Self-citationNorozpour, M., Pourshahbaz, A., Poursharifi, H., Dolatshahi, B., & Habibi, N. (2023) · BMJ Open · doi:10.1136/bmjopen-2022-065680 · Cited by 6
Domains of psychosocial disability and mental disorders
Ro, E., Watson, D., & Clark, L. A. (2018) · Journal of Clinical Psychology · doi:10.1002/jclp.22650 · Cited by 5
Poore, H. E., & Waldman, I. D. (2025) · Personality Disorders Theory Research and Treatment · doi:10.1037/per0000686 · Cited by 4
Adolescent Problem Gambling and Gaming in the Hierarchical Structure of Psychopathology
Richard, J., Temcheff, C. E., Ivoska, W., & Derevensky, J. L. (2023) · International Journal of Mental Health and Addiction · doi:10.1007/s11469-023-01032-y · Cited by 4
The latent structure of oppositional defiant disorder and conduct disorder
Miller, N. (2013) · NC Digital Online Collection of Knowledge and Scholarship (The University of North Carolina at Greensboro) · Cited by 3
Comorbidity: The Cross-national Structure of Mental Disorders
Wardenaar, K. J., Huang, Y., Wojtyniak, B., & de Jonge, P. (2017) · Cambridge University Press eBooks · doi:10.1017/9781316336168.020 · Cited by 3
Antagonism's place in psychiatric nosology
Sellbom, M. (2019) · Elsevier eBooks · doi:10.1016/b978-0-12-814627-9.00012-8 · Cited by 3
The measurement of emotion regulation: A confirmatory analysis
Ettel, D. (2009) · Scholars' Bank (University of Oregon) · Cited by 1
Transtornos externalizantes em adultos com TDAH
Vitola, E. S. (2011) · Americanae (AECID Library) · Cited by 1
Richard, J. (2023) · eScholarship@McGill (McGill) · doi:10.82308/16145 · Cited by 1
Kosty, D. B. (2015) · Scholars' Bank (University of Oregon)
Self-citationPutnam, K. T. (2011) · OhioLink ETD Center (Ohio Library and Information Network)
Bertuzzi, G. P. (2013) · Lume (Universidade Federal do Rio Grande do Sul)
The Constructs of Antisocial Behavior and Crime: A Measurement View
Blanc, M. L. (2021) · Springer eBooks · doi:10.1007/978-3-030-68429-7_1
McDowell, Y. E. (2020) · MOspace Institutional Repository (University of Missouri) · doi:10.32469/10355/88911
The Factor Structure of the Externalizing Spectrum in Adolescence and the Role of GABRA2
(2012) · Arizona State University Library Digital Repository (Arizona State University)
Liu, F., Lennox, C., & Leonard, S. (2026) · Psychological Reports · doi:10.1177/00332941261470819
Metadata
- Authors
- Farmer, R. F., Seeley, J. R., Kosty, D. B., & Lewinsohn, P. M.
- Affiliations
- Oregon Research Institute (US)
- Venue
- Journal of Abnormal Psychology
- Published
- 2009-11
- Volume
- 118
- Issue
- 4
- Pages
- 699-710
- ISSN
- 0021-843X (ISSN-L)
- 1939-1846
- PMC
- PMC2814069
- OpenAlex
- W1966284567
- Cited by
- 44
- References
- 84
- Citations by year
- 2026: 1 · 2024: 1 · 2023: 2 · 2021: 2 · 2020: 1 · 2019: 3 · 2018: 1 · 2017: 4 · 2016: 4 · 2015: 4 · 2014: 1 · 2013: 5 · 2012: 2
- FWCI
- 6.34
- Type
- journal article
- Language
- en
- Open access
- green
- www.ncbi.nlm.nih.gov
- Locations
- Journal of Abnormal Psychology (publishedVersion)
- PubMed (publishedVersion)
- PubMed Central (acceptedVersion)
- Funders
- National Institute on Drug Abuse (DA12951)
- National Institute of Mental Health (MH40501; MH50522)
- Topics
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Mental Health Research Topics
- Social Sciences › Psychology › Clinical Psychology › Child and Adolescent Psychosocial and Emotional Development
- Social Sciences › Psychology › Clinical Psychology › Personality Disorders and Psychopathology
- Keywords
- externalizing disorders, internalizing disorders, comorbidities, attention deficit hyperactivity disorder, oppositional defiant disorder, conduct disorder, alcoholism, cannabis use disorder, early adulthood, psychosocial outcomes, psychiatric classification
- MeSH terms
- Adolescent, Adult, Alcoholism, Antisocial Personality Disorder, Attention Deficit Disorder with Hyperactivity, Mental Disorders, Marijuana Abuse, Female, Humans, Internal-External Control, Male, Models, Psychological, Psychopathology, Risk Factors, Social Behavior Disorders, Social Conformity, Comorbidity, Conduct Disorder, Attention Deficit and Disruptive Behavior Disorders, Substance-Related Disorders, Young Adult
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.