On the etiology of internalizing and externalizing problem behavior: A twin-family study
Open accessThe DOI matches its Crossref record; 67 of the 67 references it cites were found in a registry or an index.
Abstract
Internalizing and externalizing behavior problems are established risk factors for many unpleasant outcomes and psychopathology in adulthood, and understanding the interplay between genes and environment is important for deducing implications for therapeutic interventions. Among genetic studies on internalizing and externalizing problem behavior, the heritability estimates differ widely. Most research only uses twin data and other-reports, and therefore certain limitations are inevitable. Our study is the first to investigate genetic and environmental influences on problem behavior using a Nuclear Twin Family Design and self-reports, in order to address these limitations. Internalizing and externalizing problem behavior of 3,087 twin pairs (age 11-23), a sibling, and their parents were analyzed with structural equation modeling to estimate heritability separately for each of three twin birth cohorts. Genetic influences account for about one-third of the variance for both internalizing and externalizing. Shared environmental influences were only found for internalizing, and through the advantages of considering data from the whole twin family, firstly could be identified as solely twin-specific. Our findings could contribute to a better understanding of the gap between heritability based on twin studies and DNA-based heritability ('missing heritability problem'): Results indicate that heritability estimates gained via classic twin design and other-reports are slightly overestimated and therefore environmental influences, in general, are more important than previous research suggests. Simultaneously, we showed that family-specific environment either contributes to behavior problems only on an individual level, or that it has a lesser influence than originally thought.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures

Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Research has shown that parents and teachers tend to assign higher externalizing scores to children or students compared to the self-reports of the individuals themselves, whereas the reverse pattern is observed for internalizing symptoms.”
From Emotional Dysregulation and Cognitive Disengagement Syndrome: Exploring Their Relationship Through the Lens of Twin Studies (2025) · cites this paper as [21]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Evidence from the twin study literature indicates that third-party reports tend to overestimate both genetic (A) and shared environmental (C) influences, whereas selfreports are more likely to emphasize the role of non-shared environmental (E) factors [21,22].”
From Emotional Dysregulation and Cognitive Disengagement Syndrome: Exploring Their Relationship Through the Lens of Twin Studies (2025) · cites this paper as [21]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Diagnostic and Statistical Manual of Mental Disorders
American Psychiatric Association (2013) · doi:10.1176/appi.books.9780890425596 · Cited by 116,369
The Strengths and Difficulties Questionnaire: A research note
Goodman, R. (1997) · Journal of Child Psychology and Psychiatry · doi:10.1111/j.1469-7610.1997.tb01545.x · Cited by 14,908 · cited 6×
“In line with previously reported reliabilities for the SDQ [43, 49–51], in our sample, McDonald’s ω was .70 for INT and .63 for EXT (Cronbach’s α was .69 and .62) across all participants.”
MethodInfluentialBundesgesundheitsblatt - Gesundheitsforschung - Gesundheitsschutz
(2013) · Bundesgesundheitsblatt - Gesundheitsforschung - Gesundheitsschutz · doi:10.1007/103.1437-1588 · Cited by 11,796
Diagnostic and Statistical Manual of Mental Disorders(DSM)
(2008) · Encyclopedia of Counseling · doi:10.4135/9781412963978.n182 · Cited by 10,830
Achenbach, T. M., McConaughy, S. H., & Howell, C. T. (1987) · Psychological Bulletin · doi:10.1037/0033-2909.101.2.213 · Cited by 5,436 · cited 1×
“Taken together, the most commonly suggested reason for disagreement between informants is the tendency for children’s INT and EXT symptoms to be differentially observable depending on the situation [23, 25, 26, 28].”
BackgroundMethodology for Genetic Studies of Twins and Families
Neale, M. C., & Cardon, L. R. (1992) · doi:10.1007/978-94-015-8018-2 · Cited by 4,005 · cited 1×
“To test if a more parsimonious model fitted the data significantly worse, we used the chi square difference test [58].”
MethodDe Los Reyes, A., & Kazdin, A. E. (2005) · Psychological Bulletin · doi:10.1037/0033-2909.131.4.483 · Cited by 2,548
Steinberg, L., & Morris, A. S. (2001) · Annual Review of Psychology · doi:10.1146/annurev.psych.52.1.83 · Cited by 2,517
Goodman, R., Ford, T., Simmons, H., Gatward, R., & Meltzer, H. (2000) · British Journal of Psychiatry · doi:10.1192/bjp.177.6.534 · Cited by 1,818
The validity of the multi-informant approach to assessing child and adolescent mental health.
De Los Reyes, A., Augenstein, T. M., Wang, M., Thomas, S. A., Drabick, D. A. G., Burgers, D. E., & Rabinowitz, J. (2015) · Psychological Bulletin · doi:10.1037/a0038498 · Cited by 1,666 · cited 1×
“Taken together, the most commonly suggested reason for disagreement between informants is the tendency for children’s INT and EXT symptoms to be differentially observable depending on the situation [23, 25, 26, 28].”
Background
Research works printed but not linked: 3
- Plomin R. Behavioral genetics. 6th ed New York: Worth Publ; 2013.
- Corp IBM. IBM SPSS Statistics for Windows, Version 25.0 [Computer software]. Armonk, NY: IBM Corp.; 2017.
- Arbuckle JL. Amos (Version 24.0) [Computer software]. Chicago: IBM SPSS; 2016.
Cited by
Integrative analysis of genomic and exposomic influences on youth mental health
Choi, K. W., Wilson, M., Ge, T., Kandola, A., Patel, C. J., Lee, S. H., & Smoller, J. W. (2022) · Journal of Child Psychology and Psychiatry · doi:10.1111/jcpp.13664 · Cited by 47
“Broadly speaking, it is known that both genetic and environmental factors play a role in influencing mental health among youth (Kwong et al., 2019; Nikstat & Riemann, 2020).”
BackgroundSpeyer, L. G., Neaves, S., Hall, H. A., Hemani, G., Lombardo, M. V., Murray, A. L., Auyeung, B., & Luciano, M. (2021) · Journal of Child Psychology and Psychiatry · doi:10.1111/jcpp.13549 · Cited by 36
Latent Profiles of Sleep Patterns in Early Adolescence: Associations With Behavioral Health Risk
Zhang, L., Sasser, J., Doane, L. D., Peltz, J. S., & Oshri, A. (2023) · Journal of Adolescent Health · doi:10.1016/j.jadohealth.2023.08.021 · Cited by 17
The global epidemiology of personality disorder: a systematic review and meta-regression
Shadid, J., Ferrari, A. J., Bach, B., Sellbom, M., Sharp, C., Hutsebaut, J., d’Huart, D., Santomauro, D. F., & Chanen, A. M. (2025) · The Lancet Psychiatry · doi:10.1016/s2215-0366(25)00299-8 · Cited by 19
Gebru, N. M., Gonçalves, P. D., Cruz, R. A., Thompson, W. K., Allegair, N., Potter, A., Garavan, H., Dumas, J. A., Leeman, R. F., & Johnson, M. A. (2023) · Frontiers in Behavioral Neuroscience · doi:10.3389/fnbeh.2023.1213894 · Cited by 16
“Internalizing problems are characterized by anxiety and depressive symptoms, whereas externalizing problems are characterized by aggressive and impulsive symptoms (Achenbach et al., 2016; Nikstat and Riemann, 2020).”
Background
Metadata
- Authors
- Nikstat, A., & Riemann, R.
- Affiliations
- Bielefeld University (DE)
- Corresponding author
- Nikstat, Amelie
- Venue
- PLOS ONE
- Publisher
- Public Library of Science (PLoS)
- Published
- 2020-03-23
- Volume
- 15
- Issue
- 3
- Pages
- e0230626
- ISSN
- 1932-6203 (ISSN-L)
- PMC
- PMC7089526
- OpenAlex
- W3012701818
- Semantic Scholar
- c622a8e1d98ece50a12615f8e0133bd2cdf2e0aa
- Cited by
- 83
- References
- 67
- Citations by year
- 2026: 19 · 2025: 26 · 2024: 19 · 2023: 12 · 2022: 5 · 2021: 2
- FWCI
- 1.90
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- PLoS ONE (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Figshare (submittedVersion, cc-by)
- PUB – Publications at Bielefeld University (Bielefeld University) (submittedVersion, cc-by)
- Funders
- Deutsche Forschungsgemeinschaft (RI 595/8-1)
- Topics
- Social Sciences › Psychology › Clinical Psychology › Child and Adolescent Psychosocial and Emotional Development
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Genetics › Genetic Associations and Epidemiology
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Mental Health Research Topics
- Keywords
- internalizing problems, externalizing problems, heritability, gene-environment interaction, shared environment, missing heritability, adolescent behavior problems
- MeSH terms
- Problem Behavior, Adolescent, Child, Female, Humans, Male, Twins, Young Adult
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.