The DOI matches its Crossref record; 67 of the 67 references it cites were found in a registry or an index.
On the etiology of internalizing and externalizing problem behavior: A twin-family study
Open accessAbstract
Internalizing and externalizing behavior problems are established risk factors for many unpleasant outcomes and psychopathology in adulthood, and understanding the interplay between genes and environment is important for deducing implications for therapeutic interventions. Among genetic studies on internalizing and externalizing problem behavior, the heritability estimates differ widely. Most research only uses twin data and other-reports, and therefore certain limitations are inevitable. Our study is the first to investigate genetic and environmental influences on problem behavior using a Nuclear Twin Family Design and self-reports, in order to address these limitations. Internalizing and externalizing problem behavior of 3,087 twin pairs (age 11-23), a sibling, and their parents were analyzed with structural equation modeling to estimate heritability separately for each of three twin birth cohorts. Genetic influences account for about one-third of the variance for both internalizing and externalizing. Shared environmental influences were only found for internalizing, and through the advantages of considering data from the whole twin family, firstly could be identified as solely twin-specific. Our findings could contribute to a better understanding of the gap between heritability based on twin studies and DNA-based heritability ('missing heritability problem'): Results indicate that heritability estimates gained via classic twin design and other-reports are slightly overestimated and therefore environmental influences, in general, are more important than previous research suggests. Simultaneously, we showed that family-specific environment either contributes to behavior problems only on an individual level, or that it has a lesser influence than originally thought.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures

Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Research has shown that parents and teachers tend to assign higher externalizing scores to children or students compared to the self-reports of the individuals themselves, whereas the reverse pattern is observed for internalizing symptoms.”
From Emotional Dysregulation and Cognitive Disengagement Syndrome: Exploring Their Relationship Through the Lens of Twin Studies (2025) · cites this paper as [21]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Evidence from the twin study literature indicates that third-party reports tend to overestimate both genetic (A) and shared environmental (C) influences, whereas selfreports are more likely to emphasize the role of non-shared environmental (E) factors [21,22].”
From Emotional Dysregulation and Cognitive Disengagement Syndrome: Exploring Their Relationship Through the Lens of Twin Studies (2025) · cites this paper as [21]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Diagnostic and Statistical Manual of Mental Disorders
American Psychiatric Association (2013) · doi:10.1176/appi.books.9780890425596 · Cited by 116,369
The Strengths and Difficulties Questionnaire: A research note
Goodman, R. (1997) · Journal of Child Psychology and Psychiatry · doi:10.1111/j.1469-7610.1997.tb01545.x · Cited by 14,908
Bundesgesundheitsblatt - Gesundheitsforschung - Gesundheitsschutz
(2013) · Bundesgesundheitsblatt - Gesundheitsforschung - Gesundheitsschutz · doi:10.1007/103.1437-1588 · Cited by 11,796
Diagnostic and Statistical Manual of Mental Disorders(DSM)
(2008) · Encyclopedia of Counseling · doi:10.4135/9781412963978.n182 · Cited by 10,830
Achenbach, T. M., McConaughy, S. H., & Howell, C. T. (1987) · Psychological Bulletin · doi:10.1037/0033-2909.101.2.213 · Cited by 5,436
Methodology for Genetic Studies of Twins and Families
Neale, M. C., & Cardon, L. R. (1992) · doi:10.1007/978-94-015-8018-2 · Cited by 4,005 · cited 1×
“To test if a more parsimonious model fitted the data significantly worse, we used the chi square difference test [58].”
MethodDe Los Reyes, A., & Kazdin, A. E. (2005) · Psychological Bulletin · doi:10.1037/0033-2909.131.4.483 · Cited by 2,548
Steinberg, L., & Morris, A. S. (2001) · Annual Review of Psychology · doi:10.1146/annurev.psych.52.1.83 · Cited by 2,517
Goodman, R., Ford, T., Simmons, H., Gatward, R., & Meltzer, H. (2000) · British Journal of Psychiatry · doi:10.1192/bjp.177.6.534 · Cited by 1,818
The validity of the multi-informant approach to assessing child and adolescent mental health.
De Los Reyes, A., Augenstein, T. M., Wang, M., Thomas, S. A., Drabick, D. A. G., Burgers, D. E., & Rabinowitz, J. (2015) · Psychological Bulletin · doi:10.1037/a0038498 · Cited by 1,666
Research works printed but not linked: 3
- R Plomin, 2013, Behavioral genetics
- Corp IBM, 2017, IBM SPSS Statistics for Windows, Version 25.0
- JL Arbuckle, 2016, Amos (Version 24.0)
Cited by
Integrative analysis of genomic and exposomic influences on youth mental health
Choi, K. W., Wilson, M., Ge, T., Kandola, A., Patel, C. J., Lee, S. H., & Smoller, J. W. (2022) · Journal of Child Psychology and Psychiatry · doi:10.1111/jcpp.13664 · Cited by 47
“Broadly speaking, it is known that both genetic and environmental factors play a role in influencing mental health among youth (Kwong et al., 2019; Nikstat & Riemann, 2020).”
BackgroundSpeyer, L. G., Neaves, S., Hall, H. A., Hemani, G., Lombardo, M. V., Murray, A. L., Bonnie Auyeung, B., & Luciano, M. (2021) · Journal of Child Psychology and Psychiatry · doi:10.1111/jcpp.13549 · Cited by 36
Latent Profiles of Sleep Patterns in Early Adolescence: Associations With Behavioral Health Risk
Zhang, L., Sasser, J., Doane, L. D., Peltz, J. S., & Oshri, A. (2023) · Journal of Adolescent Health · doi:10.1016/j.jadohealth.2023.08.021 · Cited by 16
The global epidemiology of personality disorder: a systematic review and meta-regression
Shadid, J., Ferrari, A. J., Bach, B., Sellbom, M., Sharp, C., Hutsebaut, J., d’Huart, D., Santomauro, D. F., & Chanen, A. M. (2025) · The Lancet Psychiatry · doi:10.1016/s2215-0366(25)00299-8 · Cited by 19
Gebru, N. M., Gonçalves, P. D., Cruz, R. A., Thompson, W. K., Allegair, N., Potter, A., Garavan, H., Dumas, J. A., Leeman, R. F., & Johnson, M. A. (2023) · Frontiers in Behavioral Neuroscience · doi:10.3389/fnbeh.2023.1213894 · Cited by 14
Metadata
- Authors
- Nikstat, A., & Riemann, R.
- Affiliations
- Bielefeld University (DE)
- Corresponding author
- Nikstat, Amelie
- Venue
- PLOS ONE
- Publisher
- Public Library of Science (PLoS)
- Published
- 2020-03-23
- Volume
- 15
- Issue
- 3
- Pages
- e0230626
- ISSN
- 1932-6203 (ISSN-L)
- PMC
- PMC7089526
- OpenAlex
- W3012701818
- Semantic Scholar
- c622a8e1d98ece50a12615f8e0133bd2cdf2e0aa
- Cited by
- 83
- References
- 67
- Citations by year
- 2026: 19 · 2025: 26 · 2024: 19 · 2023: 12 · 2022: 5 · 2021: 2
- FWCI
- 1.90
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- PLoS ONE (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Figshare (submittedVersion, cc-by)
- PUB – Publications at Bielefeld University (Bielefeld University) (submittedVersion, cc-by)
- Funders
- Deutsche Forschungsgemeinschaft (RI 595/8-1)
- Topics
- Social Sciences › Psychology › Clinical Psychology › Child and Adolescent Psychosocial and Emotional Development
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Genetics › Genetic Associations and Epidemiology
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Mental Health Research Topics
- Keywords
- internalizing problems, externalizing problems, heritability, gene-environment interaction, shared environment, missing heritability, adolescent behavior problems
- MeSH terms
- Problem Behavior, Adolescent, Child, Female, Humans, Male, Twins, Young Adult
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: On the etiology of internalizing and externalizing problem behavior: A twin-family study. https://app.cochat.ai/papers/10.1371/journal.pone.0230626
- The paper
- Nikstat, A., & Riemann, R. (2020). On the etiology of internalizing and externalizing problem behavior: A twin-family study. PLOS ONE. https://doi.org/10.1371/journal.pone.0230626
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.