The Structure of Psychopathology in Adolescence: Replication of a General Psychopathology Factor in the TRAILS Study
The DOI matches its Crossref record; 38 of the 39 references it cites were found in a registry or an index.
Abstract
This study aimed to replicate a study by Caspi and colleagues, which proposed that the structure of psychopathology is characterized by a general psychopathology factor, in addition to smaller internalizing and externalizing factors. Our study expanded the approach of the original by using continuous adolescent data and testing additional models, including both self- and parent-reported data, to bolster the robustness of the findings. Our findings indicate that the structure of psychopathology is best characterized by a model including a general factor, in addition to smaller internalizing and externalizing factors. These results emphasize the importance of this model for understanding the structure of psychopathology. Given the increasing emphasis on the importance of, and need for, replication, the overall evidence of a general factor seems rather robust.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“SCT does not fall within a bi-factor umbrella of either ADHD or a general disruptive behavior factor [97-99]”
From Advancing the study of sluggish cognitive tempo via DSM, RDoC, and hierarchical models of psychopathology (2019) · cites this paper as [98]
Citations
Cites
(1991) · Medical Entomology and Zoology · Cited by 8,071
A gradient of childhood self-control predicts health, wealth, and public safety
Moffitt, T. E., Arseneault, L., Belsky, D., Dickson, N., Hancox, R. J., Harrington, H., Houts, R., Poulton, R., Roberts, B. W., Ross, S., et al. (2011) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1010076108 · Cited by 4,885 · cited 1×
“…to specific consequences, the general factor may also have specific shared determinants such as self-control, neuroticism, and low SES, although conclusive experimental data is still lacking (Brunner, 1997; Moffitt et al., 2011; Neeleman, Bijl, & Ormel, 2004; Neeleman, Ormel, & Bijl, 2001).”
BackgroundKotov, R., Gamez, W., Schmidt, F., & Watson, D. (2010) · Psychological Bulletin · doi:10.1037/a0020327 · Cited by 2,677
The p Factor: One General Psychopathology Factor in the Structure of Psychiatric Disorders?
Caspi, A., Houts, R. M., Belsky, D. W., Goldman-Mellor, S. J., Harrington, H., Israel, S., Meier, M. H., Ramrakha, S., Shalev, I., Poulton, R., et al. (2014) · Clinical Psychological Science · doi:10.1177/2167702613497473 · Cited by 2,449 · cited 2×
“Specifically, a recent series of confirmatory factor analyses (CFAs) of longitudinal psychopathology data from the Dunedin study has challenged traditional models by providing strong support for a latent general overall severity factor, with high loadings in all individual symptom dimensions (Caspi et al., 2013).”
Hankin, B. L., Abramson, L. Y., Moffitt, T. E., Silva, P. A., McGee, R., & Angell, K. E. (1998) · Journal of Abnormal Psychology · doi:10.1037/0021-843x.107.1.128 · Cited by 2,333 · cited 1×
“Given that many mental disorders have their onset during early adolescence (Bernstein, Borchardt, & Perwien, 1996; Hankin et al., 1998), attempting to replicate Caspi’s findings in an adolescent sample may provide insight into whether the model as proposed by Caspi also reflects the structure of psychopathology in ado…”
BackgroundChorpita, B. F., Yim, L., Moffitt, C., Umemoto, L. A., & Francis, S. E. (2000) · Behaviour Research and Therapy · doi:10.1016/s0005-7967(99)00130-8 · Cited by 1,966
Kendler, K. S., Prescott, C. A., Myers, J., & Neale, M. C. (2003) · Archives of General Psychiatry · doi:10.1001/archpsyc.60.9.929 · Cited by 1,868
Latent Curve Models: A Structural Equation Perspective
Bollen, K. A., & Curran, P. J. (2005) · Wiley Series in Probability and Statistics · doi:10.1002/0471746096 · Cited by 1,729 · cited 1×
“CFI and TLI values greater than .95 indicate a good fit, as well as RMSEA scores less than .05 (Bollen & Curran, 2006).”
BackgroundComorbidity: a network perspective
Cramer, A. O. J., Waldorp, L. J., van der Maas, H. L. J., & Borsboom, D. (2010) · Behavioral and Brain Sciences · doi:10.1017/s0140525x09991567 · Cited by 1,575
The classification of child psychopathology: A review and analysis of empirical efforts.
Achenbach, T. M., & EDELBROCK, C. S. (1978) · Psychological Bulletin · doi:10.1037//0033-2909.85.6.1275 · Cited by 1,526 · cited 1×
“…with regard to both adult diagnostic data on mental disorders (Krueger, Caspi, Moffitt, & Silva, 1998; Krueger, Johnson, & Kling, 2006) and factor analytic studies of continuous measures of psychopathology in children, adolescents, and adults (Achenbach, 1966; Achenbach & Edelbrock, 1978).”
BackgroundLatent Curve Models: A Structural Equation Perspective
Horan, P. M. (2006) · Contemporary Sociology: A Journal of Reviews · doi:10.1177/009430610603500650 · Cited by 1,214
van den Akker, M., Buntinx, F., Metsemakers, J. F. M., Roos, S., & Knottnerus, J. A. (1998) · Journal of Clinical Epidemiology · doi:10.1016/s0895-4356(97)00306-5 · Cited by 1,027
Handbook of personality development
(2007) · Choice Reviews Online · doi:10.5860/choice.44-2967 · Cited by 930
The classification of children's psychiatric symptoms: A factor-analytic study.
Achenbach, T. M. (1966) · Psychological Monographs: General and Applied · doi:10.1037/h0093906 · Cited by 885 · cited 2×
“…with regard to both adult diagnostic data on mental disorders (Krueger, Caspi, Moffitt, & Silva, 1998; Krueger, Johnson, & Kling, 2006) and factor analytic studies of continuous measures of psychopathology in children, adolescents, and adults (Achenbach, 1966; Achenbach & Edelbrock, 1978).”
BackgroundKrueger, R. F., Caspi, A., Moffitt, T. E., & Silva, P. A. (1998) · Journal of Abnormal Psychology · doi:10.1037//0021-843x.107.2.216 · Cited by 661
Is there a general factor of prevalent psychopathology during adulthood?
Lahey, B. B., Applegate, B., Hakes, J. K., Zald, D. H., Hariri, A. R., & Rathouz, P. J. (2012) · Journal of Abnormal Psychology · doi:10.1037/a0028355 · Cited by 641
Full-Information Item Bi-Factor Analysis
Gibbons, R. D., & Hedeker, D. R. (1992) · Psychometrika · doi:10.1007/bf02295430 · Cited by 595 · cited 1×
“Also, the work of Gibbons and Hedeker and, more recently, Lahey and colleagues, for example, proposed a general psychopathology factor in addition to more domain-specific latent factors (Gibbons & Hedeker, 1992; Lahey et al., 2012; Lahey, Van Hulle, Singh, Waldman, & Rathouz, 2011).”
BackgroundKeller, M. C., & Miller, G. (2006) · Behavioral and Brain Sciences · doi:10.1017/s0140525x06009095 · Cited by 540 · cited 2×
“Keller and Miller’s (2006) watershed model of the pathways connecting upstream genes to downstream phenotypes provides an excellent model of how genes may act in a pleiotropic fashion and “contribute” to a general factor.”
BackgroundSocioeconomic determinants of health: Stress and the biology of inequality
Brunner, E. (1997) · BMJ · doi:10.1136/bmj.314.7092.1472 · Cited by 446
The structure of common DSM-IV and ICD-10 mental disorders in the Australian general population
SLADE, T., & WATSON, D. (2006) · Psychological Medicine · doi:10.1017/s0033291706008452 · Cited by 419 · cited 1×
“…widely accepted and demonstrated distinction between two different, though positively correlated, factors underlying psychopathology: internalizing and externalizing problems/disorders (Forbush & Watson, 2013; Kendler, Prescott, Myers, & Neale, 2003; Slade & Watson, 2006; Vollebergh et al., 2001).”
Backgroundde Winter, A. F., Oldehinkel, A. J., Veenstra, R., Brunnekreef, J. A., Verhulst, F. C., & Ormel, J. (2005) · European Journal of Epidemiology · doi:10.1007/s10654-004-4948-6 · Cited by 404
Self-citationAnxiety Disorders in Children and Adolescents: A Review of the Past 10 Years
BERNSTEIN, G. A., BORCHARDT, C. M., & PERWIEN, A. R. (1996) · Journal of the American Academy of Child & Adolescent Psychiatry · doi:10.1097/00004583-199609000-00008 · Cited by 383
Temperament profiles associated with internalizing and externalizing problems in preadolescence
OLDEHINKEL, A. J., HARTMAN, C. A., DE WINTER, A. F., VEENSTRA, R., & ORMEL, J. (2004) · Development and Psychopathology · doi:10.1017/s0954579404044591 · Cited by 379
Self-citationLahey, B. B., Van Hulle, C. A., Singh, A. L., Waldman, I. D., & Rathouz, P. J. (2011) · Archives of General Psychiatry · doi:10.1001/archgenpsychiatry.2010.192 · Cited by 341
Martel, M. M. (2013) · Psychological Bulletin · doi:10.1037/a0032247 · Cited by 326 · cited 2×
“This raises the question of how the two dimensions should be interpreted once the more general psychopathological characteristics are taken into account (Caspi et al., 2013; Martel, 2013; Oldehinkel, Hartman, de Winter, Veenstra, & Ormel, 2004).”
BackgroundThe concept of a ‘case’ in psychiatric population surveys
Wing, J. K., Mann, S. A., Leff, J. P., & Nixon, J. M. (1978) · Psychological Medicine · doi:10.1017/s0033291700014264 · Cited by 265
The Structure of The Extended Psychosis Phenotype in Early Adolescence--A Cross-sample Replication
Wigman, J. T. W., Vollebergh, W. A. M., Raaijmakers, Q. A. W., Iedema, J., van Dorsselaer, S., Ormel, J., Verhulst, F. C., & van Os, J. (2011) · Schizophrenia Bulletin · doi:10.1093/schbul/sbp154 · Cited by 200 · cited 2×
“These symptoms have usually been excluded in studies on common mental disorders due to methodological and conceptual issues (Kotov, Gamez, Schmidt, & Watson, 2010; Wigman et al., 2011).”
BackgroundMethodSelf-citationEmpirically based assessment and taxonomy of psychopathology: Cross-cultural applications. A review
Verhulst, F. C., & Achenbach, T. M. (1995) · European Child & Adolescent Psychiatry · doi:10.1007/bf01977734 · Cited by 163 · cited 1×
“The study assessed problem behaviors as rated by the parent using the Child Behavior Checklist (CBCL; T1, T2, T3), which is one of the most commonly used parent-report questionnaires in child and adolescent psychiatric research (Achenbach, 1991; Verhulst & Achenbach, 1995).”
MethodOrmel, J., Oldehinkel, A. J., Sijtsema, J. J., van Oort, F. V. A., Raven, D., Veenstra, R., Vollebergh, W., & Verhulst, F. C. (2012) · Journal of the American Academy of Child & Adolescent Psychiatry · doi:10.1016/j.jaac.2012.08.004 · Cited by 140 · cited 1×
“Our study used data from the first, second, third, and fourth wave of the TRacking Adolescents’ Individual Lives Survey (TRAILS; Ormel et al., 2012).”
MethodSelf-citationMental health in immigrant children in the Netherlands
Vollebergh, W., ten Have, M., Deković, M., Oosterwegel, A., Pels, T., Veenstra, R., de Winter, A., Ormel, H., & Verhulst, F. C. (2005) · Social Psychiatry and Psychiatric Epidemiology · doi:10.1007/s00127-005-0906-1 · Cited by 132
Self-citationThe structure of common and uncommon mental disorders
Forbush, K. T., & Watson, D. (2013) · Psychological Medicine · doi:10.1017/s0033291712001092 · Cited by 109 · cited 1×
“…widely accepted and demonstrated distinction between two different, though positively correlated, factors underlying psychopathology: internalizing and externalizing problems/disorders (Forbush & Watson, 2013; Kendler, Prescott, Myers, & Neale, 2003; Slade & Watson, 2006; Vollebergh et al., 2001).”
BackgroundNeeleman, J., Ormel, J., & Bijl, R. V. (2001) · Psychosomatic Medicine · doi:10.1097/00006842-200103000-00007 · Cited by 90
Self-citationMathyssek, C. M., Olino, T. M., Hartman, C. A., Ormel, J., Verhulst, F. C., & Van Oort, F. V. A. (2013) · International Journal of Methods in Psychiatric Research · doi:10.1002/mpr.1380 · Cited by 85 · cited 1×
“The RCADS consists of a list of items measuring anxiety, obsessive-compulsive, and depression symptoms (Chorpita, Yim, Moffitt, Umemoto, & Francis, 2000; Mathyssek et al., 2013).”
MethodSelf-citationBarnett, R. A., & Hunter, M. (2011) · Journal of Child and Family Studies · doi:10.1007/s10826-011-9471-2 · Cited by 80
NEELEMAN, J., BIJL, R., & ORMEL, J. (2004) · Psychological Medicine · doi:10.1017/s0033291703001193 · Cited by 80
Self-citationBehavior Genetics and Personality Development
Krueger, R. F., Johnson, W., & Kling, K. C. (2015) · Routledge eBooks · doi:10.4324/9781315805610.ch5 · Cited by 19
The Global Fund and pharmacovigilance systems in resourcelimited settings
Xueref, S., Daviaud, J., & Pal, S. N. (2013) · The Lancet · doi:10.1016/s0140-6736(13)60885-5 · Cited by 12
The Structure and Stability of Common Mental Disorders: The NEMESIS Study
Vollebergh, W. A. M., Iedema, J., Bijl, R. V., de Graaf, R., Smit, F., & Ormel, J. (2001) · Archives of General Psychiatry · doi:10.1001/archpsyc.58.6.597 · Cited by 6 · cited 1×
“…widely accepted and demonstrated distinction between two different, though positively correlated, factors underlying psychopathology: internalizing and externalizing problems/disorders (Forbush & Watson, 2013; Kendler, Prescott, Myers, & Neale, 2003; Slade & Watson, 2006; Vollebergh et al., 2001).”
BackgroundSelf-citation
Research works printed but not linked: 4
- 10.1037/0033-2909.85.6.1275 · DOI · Paper page
- 10.1037/0021-843X.107.2.216 · DOI · Paper page
- Muthén L. K., 2007, Mplus: Statistical analysis with latent variables: User’s guide
- Smoller J., 2013, Lancet, 381, 1360
Cited by
Kotov, R., Krueger, R. F., Watson, D., Achenbach, T. M., Althoff, R. R., Bagby, R. M., Brown, T. A., Carpenter, W. T., Caspi, A., Clark, L. A., et al. (2017) · Journal of Abnormal Psychology · doi:10.1037/abn0000258 · Cited by 3,335
“Studies of children and adolescents also have documented the internalizing and disinhibited externalizing spectra, with some evidence suggesting a separate thought disorder dimension (Achenbach, 1966; Achenbach & Rescorla, 2001, 2003; Achenbach et al., 1991; Laceulle et al., 2015; Lahey et al., 2004, 2008, 2011, 2015;…”
Self-citationAll for One and One for All: Mental Disorders in One Dimension
Caspi, A., & Moffitt, T. E. (2018) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2018.17121383 · Cited by 918
Clark, L. A., Cuthbert, B., Lewis-Fernández, R., Narrow, W. E., & Reed, G. M. (2017) · Psychological Science in the Public Interest · doi:10.1177/1529100617727266 · Cited by 688
Kotov, R., Krueger, R. F., Watson, D., Cicero, D. C., Conway, C. C., DeYoung, C. G., Eaton, N. R., Forbes, M. K., Hallquist, M. N., Latzman, R. D., et al. (2021) · Annual Review of Clinical Psychology · doi:10.1146/annurev-clinpsy-081219-093304 · Cited by 596
“Many higher-order dimensions have been replicated in children, including the p factor, inter-nalizing, externalizing, and thought disorder (e.g., Achenbach 2020, Laceulle et al. 2015, McElroy et al. 2018, Olino et al. 2014).”
BackgroundA hierarchical causal taxonomy of psychopathology across the life span.
Lahey, B. B., Krueger, R. F., Rathouz, P. J., Waldman, I. D., & Zald, D. H. (2017) · Psychological Bulletin · doi:10.1037/bul0000069 · Cited by 443
“Data from the longitudinal TRAILS study were analyzed using the same models employed by Caspi et al. (2014) to test the general factor hypothesis, but across younger ages (i.e., 11 – 19 years (Laceulle et al., 2015).”
Method
Metadata
- Authors
- Laceulle, O. M., Vollebergh, W. A. M., & Ormel, J.
- Affiliations
- University Medical Center Groningen (NL)
- Utrecht University (NL)
- Corresponding author
- Laceulle, Odilia M.
- Venue
- Clinical Psychological Science
- Publisher
- SAGE Publications
- Published
- 2015-02-23
- Volume
- 3
- Issue
- 6
- Pages
- 850-860
- ISSN
- 2167-7026 (ISSN-L)
- 2167-7034
- OpenAlex
- W2094595071
- Cited by
- 289
- References
- 39
- Citations by year
- 2026: 8 · 2025: 8 · 2024: 22 · 2023: 14 · 2022: 13 · 2021: 63 · 2020: 64 · 2019: 23 · 2018: 20 · 2017: 28 · 2016: 20 · 2015: 5
- FWCI
- 36.69
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- journals.sagepub.com/page/policies/text-and-data-mining-license (tdm)
- Locations
- Clinical Psychological Science (publishedVersion)
- Research portal (Tilburg University) (publishedVersion)
- Data Archiving and Networked Services (DANS) (submittedVersion)
- University of Groningen research database (University of Groningen / Centre for Information Technology) (submittedVersion)
- Topics
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Mental Health Research Topics
- Social Sciences › Psychology › Clinical Psychology › Child and Adolescent Psychosocial and Emotional Development
- Social Sciences › Psychology › Clinical Psychology › Personality Disorders and Psychopathology
- Keywords
- general psychopathology factor, internalizing disorders, externalizing disorders, adolescence, replication, self-reported symptoms, parent-reported symptoms, factor structure
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.