On the etiology of internalizing and externalizing problem behavior: A twin-family study
Open accessThe DOI matches its Crossref record; 67 of the 67 references it cites were found in a registry or an index.
Abstract
Internalizing and externalizing behavior problems are established risk factors for many unpleasant outcomes and psychopathology in adulthood, and understanding the interplay between genes and environment is important for deducing implications for therapeutic interventions. Among genetic studies on internalizing and externalizing problem behavior, the heritability estimates differ widely. Most research only uses twin data and other-reports, and therefore certain limitations are inevitable. Our study is the first to investigate genetic and environmental influences on problem behavior using a Nuclear Twin Family Design and self-reports, in order to address these limitations. Internalizing and externalizing problem behavior of 3,087 twin pairs (age 11-23), a sibling, and their parents were analyzed with structural equation modeling to estimate heritability separately for each of three twin birth cohorts. Genetic influences account for about one-third of the variance for both internalizing and externalizing. Shared environmental influences were only found for internalizing, and through the advantages of considering data from the whole twin family, firstly could be identified as solely twin-specific. Our findings could contribute to a better understanding of the gap between heritability based on twin studies and DNA-based heritability ('missing heritability problem'): Results indicate that heritability estimates gained via classic twin design and other-reports are slightly overestimated and therefore environmental influences, in general, are more important than previous research suggests. Simultaneously, we showed that family-specific environment either contributes to behavior problems only on an individual level, or that it has a lesser influence than originally thought.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures

Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Research has shown that parents and teachers tend to assign higher externalizing scores to children or students compared to the self-reports of the individuals themselves, whereas the reverse pattern is observed for internalizing symptoms.”
From Emotional Dysregulation and Cognitive Disengagement Syndrome: Exploring Their Relationship Through the Lens of Twin Studies (2025) · cites this paper as [21]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Evidence from the twin study literature indicates that third-party reports tend to overestimate both genetic (A) and shared environmental (C) influences, whereas selfreports are more likely to emphasize the role of non-shared environmental (E) factors [21,22].”
From Emotional Dysregulation and Cognitive Disengagement Syndrome: Exploring Their Relationship Through the Lens of Twin Studies (2025) · cites this paper as [21]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Diagnostic and Statistical Manual of Mental Disorders
American Psychiatric Association (2013) · doi:10.1176/appi.books.9780890425596 · Cited by 116,369
The Strengths and Difficulties Questionnaire: A research note
Goodman, R. (1997) · Journal of Child Psychology and Psychiatry · doi:10.1111/j.1469-7610.1997.tb01545.x · Cited by 14,908
Bundesgesundheitsblatt - Gesundheitsforschung - Gesundheitsschutz
(2013) · Bundesgesundheitsblatt - Gesundheitsforschung - Gesundheitsschutz · doi:10.1007/103.1437-1588 · Cited by 11,796
Diagnostic and Statistical Manual of Mental Disorders(DSM)
(2008) · Encyclopedia of Counseling · doi:10.4135/9781412963978.n182 · Cited by 10,830
Achenbach, T. M., McConaughy, S. H., & Howell, C. T. (1987) · Psychological Bulletin · doi:10.1037/0033-2909.101.2.213 · Cited by 5,436
Methodology for Genetic Studies of Twins and Families
Neale, M. C., & Cardon, L. R. (1992) · doi:10.1007/978-94-015-8018-2 · Cited by 4,005 · cited 1×
“To test if a more parsimonious model fitted the data significantly worse, we used the chi square difference test [58].”
MethodDe Los Reyes, A., & Kazdin, A. E. (2005) · Psychological Bulletin · doi:10.1037/0033-2909.131.4.483 · Cited by 2,548
Steinberg, L., & Morris, A. S. (2001) · Annual Review of Psychology · doi:10.1146/annurev.psych.52.1.83 · Cited by 2,517
Goodman, R., Ford, T., Simmons, H., Gatward, R., & Meltzer, H. (2000) · British Journal of Psychiatry · doi:10.1192/bjp.177.6.534 · Cited by 1,818
The validity of the multi-informant approach to assessing child and adolescent mental health.
De Los Reyes, A., Augenstein, T. M., Wang, M., Thomas, S. A., Drabick, D. A. G., Burgers, D. E., & Rabinowitz, J. (2015) · Psychological Bulletin · doi:10.1037/a0038498 · Cited by 1,666
Goodman, A., Lamping, D. L., & Ploubidis, G. B. (2010) · Journal of Abnormal Child Psychology · doi:10.1007/s10802-010-9434-x · Cited by 1,570 · cited 1×
“Relatedly, Goodman, Lamping, and Ploubidis [45] suggested using the broader INT and EXT scales for analyses in low-risk samples while retaining the original four subscales when screening for disorder.”
MethodGoodman, R., & Scott, S. (1999) · Journal of Abnormal Child Psychology · doi:10.1023/a:1022658222914 · Cited by 1,420
Fergusson, D. M., John Horwood, L., & Ridder, E. M. (2005) · Journal of Child Psychology and Psychiatry · doi:10.1111/j.1469-7610.2004.00387.x · Cited by 946
The classification of children's psychiatric symptoms: A factor-analytic study.
Achenbach, T. M. (1966) · Psychological Monographs: General and Applied · doi:10.1037/h0093906 · Cited by 885
Subthreshold Depression in Adolescence and Mental Health Outcomes in Adulthood
Fergusson, D. M., Horwood, L. J., Ridder, E. M., & Beautrais, A. L. (2005) · Archives of General Psychiatry · doi:10.1001/archpsyc.62.1.66 · Cited by 792
Adjustment of twin data for the effects of age and sex
McGue, M., & Bouchard, T. J. (1984) · Behavior Genetics · doi:10.1007/bf01080045 · Cited by 787
Goodman, R., Ford, T., Simmons, H., Gatward, R., & Meltzer, H. (2003) · International Review of Psychiatry · doi:10.1080/0954026021000046128 · Cited by 706
Eaves, L. J., Silberg, J. L., Meyer, J. M., Maes, H. H., Simonoff, E., Pickles, A., Rutter, M., Reynolds, C. A., Heath, A. C., Truett, K. R., et al. (1997) · Journal of Child Psychology and Psychiatry · doi:10.1111/j.1469-7610.1997.tb01614.x · Cited by 489
Burt, S. A. (2009) · Psychological Bulletin · doi:10.1037/a0015702 · Cited by 467 · cited 9×
“(4) In line with the meta-analysis of Burt [17], we expect no or only small non-additive genetic effects.”
BackgroundResultInfluentialBergen, S. E., Gardner, C. O., & Kendler, K. S. (2007) · Twin Research and Human Genetics · doi:10.1375/twin.10.3.423 · Cited by 461
Klasen, H., Woerner, W., Wolke, D., Meyer, R., Overmeyer, S., Kaschnitz, W., Rothenberger, A., & Goodman, R. (2000) · European Child & Adolescent Psychiatry · doi:10.1007/s007870070030 · Cited by 410
A zygosity questionnaire for young twins: A research note
Hill Goldsmith, H. (1991) · Behavior Genetics · doi:10.1007/bf01065819 · Cited by 404
Self-Report Method for Measuring Delinquency and Crime
Gomes, H. S. (2025) · Oxford Research Encyclopedia of Criminology and Criminal Justice · doi:10.1093/acrefore/9780190264079.013.761 · Cited by 390
A Symptom-Level Examination of Parent–Child Agreement in the Diagnosis of Anxious Youths
COMER, J. S., & KENDALL, P. C. (2004) · Journal of the American Academy of Child & Adolescent Psychiatry · doi:10.1097/01.chi.0000125092.35109.c5 · Cited by 373
Rescorla, L. A., Ginzburg, S., Achenbach, T. M., Ivanova, M. Y., Almqvist, F., Begovac, I., Bilenberg, N., Bird, H., Chahed, M., Dobrean, A., et al. (2013) · Journal of Clinical Child & Adolescent Psychology · doi:10.1080/15374416.2012.717870 · Cited by 343
Transdiagnostic factors of mental disorders.
Krueger, R. F., & Eaton, N. R. (2015) · World Psychiatry · doi:10.1002/wps.20175 · Cited by 330 · cited 1×
“In the light of these strong associations, it is no surprise that INT and EXT are assumed to reflect the underlying broader dimensions of the common, categorical diagnosis system of mental and personality disorders and to account for covariation among symptoms of different disorders [8, 9].”
BackgroundThe Strengths and Difficulties Questionnaire among Finnish school-aged children and adolescents
Koskelainen, M., Sourander, A., & Kaljonen, A. (2000) · European Child & Adolescent Psychiatry · doi:10.1007/s007870070031 · Cited by 325
Parent-adolescent agreement on emotional and behavioral problems
Sourander, A., Helstelä, L., & Helenius, H. (1999) · Social Psychiatry and Psychiatric Epidemiology · doi:10.1007/s001270050189 · Cited by 288
KiGGS Study Group, Hölling, H., Schlack, R., Petermann, F., Ravens-Sieberer, U., & Mauz, E. (2014) · Bundesgesundheitsblatt - Gesundheitsforschung - Gesundheitsschutz · doi:10.1007/s00103-014-1979-3 · Cited by 271
Seiffge-Krenke, I., & Kollmar, F. (1998) · Journal of Child Psychology and Psychiatry · doi:10.1017/s0021963098002492 · Cited by 257
The Strengths and Difficulties Questionnaire
Truman, J., Robinson, K., Evans, A. L., Smith, D., Cunningham, L., Millward, R., & Minnis, H. (2003) · European Child & Adolescent Psychiatry · doi:10.1007/s00787-003-0303-9 · Cited by 246
Aunola, K., Stattin, H., & Nurmi, J. (2000) · Journal of Youth and Adolescence · doi:10.1023/a:1005143607919 · Cited by 206
Keller, M. C., Medland, S. E., & Duncan, L. E. (2010) · Behavior Genetics · doi:10.1007/s10519-009-9320-x · Cited by 186
Rescorla, L., Ivanova, M. Y., Achenbach, T. M., Begovac, I., Chahed, M., Drugli, M. B., Emerich, D. R., Fung, D. S. S., Haider, M., Hansson, K., et al. (2012) · Journal of the American Academy of Child & Adolescent Psychiatry · doi:10.1016/j.jaac.2012.09.012 · Cited by 180
Are American Children's Problems Still Getting Worse? A 23-Year Comparison
Achenbach, T. M., Dumenci, L., & Rescorla, L. A. (2003) · Journal of Abnormal Child Psychology · doi:10.1023/a:1021700430364 · Cited by 160
Lohbeck, A., Schultheiß, J., Petermann, F., & Petermann, U. (2015) · Diagnostica · doi:10.1026/0012-1924/a000153 · Cited by 150
Observer effects and heritability of childhood attention-deficit hyperactivity disorder symptoms
Martin, N., Scourfield, J., & McGuffin, P. (2002) · British Journal of Psychiatry · doi:10.1192/bjp.180.3.260 · Cited by 136
The nature of adult twin relationships: An attachment-theoretical perspective.
Tancredy, C. M., & Fraley, R. C. (2006) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.90.1.78 · Cited by 130
Champion, L. A., Goodall, G., & Rutter, M. (1995) · Psychological Medicine · doi:10.1017/s003329170003614x · Cited by 124
Saudino, K. J., Ronald, A., & Plomin, R. J. (2005) · Research on Child and Adolescent Psychopathology · doi:10.1007/s10802-005-0939-7 · Cited by 122
Bartels, M., van den Oord, E. J. C. G., Hudziak, J. J., Rietveld, M. J. H., van Beijsterveldt, C. E. M., & Boomsma, D. I. (2004) · Developmental Psychology · doi:10.1037/0012-1649.40.5.852 · Cited by 116
Bøe, T., Hysing, M., Skogen, J. C., & Breivik, K. (2016) · PLOS ONE · doi:10.1371/journal.pone.0152202 · Cited by 110
Nature and Nurture: Genetic and Environmental Influences on Behavior
Plomin, R., & Asbury, K. (2005) · The ANNALS of the American Academy of Political and Social Science · doi:10.1177/0002716205277184 · Cited by 100
Hannigan, L. J., Walaker, N., Waszczuk, M. A., McAdams, T. A., & Eley, T. C. (2017) · Psychopathology Review · doi:10.5127/pr.038315 · Cited by 88
Becker, A., Wang, B., Kunze, B., Otto, C., Schlack, R., Hölling, H., Ravens-Sieberer, U., Klasen, F., Rogge, J., Isensee, C., et al. (2018) · Zeitschrift für Kinder- und Jugendpsychiatrie und Psychotherapie · doi:10.1024/1422-4917/a000589 · Cited by 86
Low self-awareness of ADHD in adults using a self-report screening questionnaire
Manor, I., Vurembrandt, N., Rozen, S., Gevah, D., Weizman, A., & Zalsman, G. (2012) · European Psychiatry · doi:10.1016/j.eurpsy.2010.08.013 · Cited by 78
Investigation of a bifactor model of the Strengths and Difficulties Questionnaire
Caci, H. M., Morin, A. J. S., & Tran, A. (2015) · European Child & Adolescent Psychiatry · doi:10.1007/s00787-015-0679-3 · Cited by 76
Probing the Depths of Informant Discrepancies: Contextual Influences on Divergence and Convergence
Hartley, A. G., Zakriski, A. L., & Wright, J. C. (2011) · Journal of Clinical Child & Adolescent Psychology · doi:10.1080/15374416.2011.533404 · Cited by 73
Childhood behaviour problems show the greatest gap between DNA-based and twin heritability
Cheesman, R., Selzam, S., Ronald, A., Dale, P. S., McAdams, T. A., Eley, T. C., & Plomin, R. J. (2017) · Translational Psychiatry · doi:10.1038/s41398-017-0046-x · Cited by 71
What Drives the Development of Social Inequality Over the Life Course? The German TwinLife Study
Hahn, E., Gottschling, J., Bleidorn, W., Kandler, C., Spengler, M., Kornadt, A. E., Schulz, W., Schunck, R., Baier, T., Krell, K., et al. (2016) · Twin Research and Human Genetics · doi:10.1017/thg.2016.76 · Cited by 66
Self-citationConduct Problems in Children and Adolescents: A Twin Study
Scourfield, J., Van den Bree, M., Martin, N., & McGuffin, P. (2004) · Archives of General Psychiatry · doi:10.1001/archpsyc.61.5.489 · Cited by 64
Bartels, M., Boomsma, D. I., Hudziak, J. J., Rietveld, M. J. H., van Beijsterveldt, T. C. E. M., & van den Oord, E. J. C. G. (2004) · Twin Research · doi:10.1375/136905204323016140 · Cited by 61
Kandler, C., Gottschling, J., & Spinath, F. M. (2015) · Child Development · doi:10.1111/cdev.12452 · Cited by 57
Hatoum, A. S., Rhee, S. H., Corley, R. P., Hewitt, J. K., & Friedman, N. P. (2018) · Behavior Genetics · doi:10.1007/s10519-018-9900-8 · Cited by 54
A Nuclear Twin Family Study of Self–Esteem
Bleidorn, W., Hufer, A., Kandler, C., Hopwood, C. J., & Riemann, R. (2018) · European Journal of Personality · doi:10.1002/per.2136 · Cited by 47
Self-citationTowards the social analysis of twinship
Stewart, E. A. (2000) · The British Journal of Sociology · doi:10.1080/00071310020015343 · Cited by 42
Lewis, G. J., & Plomin, R. J. (2015) · Psychological Medicine · doi:10.1017/s0033291715000173 · Cited by 38
Harden, K. P., Patterson, M. W., Briley, D. A., Engelhardt, L. E., Kretsch, N., Mann, F. D., Tackett, J. L., & Tucker‐Drob, E. M. (2015) · Journal of Child Psychology and Psychiatry · doi:10.1111/jcpp.12419 · Cited by 36
Patterson, M. W., Mann, F. D., Grotzinger, A. D., Tackett, J. L., Tucker–Drob, E. M., & Harden, K. P. (2018) · Developmental Psychology · doi:10.1037/dev0000578 · Cited by 34
Lewis, G. J., Haworth, C. M. A., & Plomin, R. J. (2013) · Journal of Child Psychology and Psychiatry · doi:10.1111/jcpp.12156 · Cited by 31
Thorpe, K. J. (2003) · Twin Research · doi:10.1375/136905203322686545 · Cited by 30
Lenau, F., Hahn, E., Peters, A., Gottschling, J., Thiel, W., & Spinath, F. M. (2017) · Publikationen an der Universität Bielefeld (Universität Bielefeld) · Cited by 28
Lamb, D. J., Middeldorp, C. M., Van Beijsterveldt, C. E. M., & Boomsma, D. I. (2012) · Journal of Child Psychology and Psychiatry · doi:10.1111/j.1469-7610.2011.02497.x · Cited by 23
Lang, V., & Kottwitz, A. (2017) · Publikationen an der Universität Bielefeld (Universität Bielefeld) · Cited by 22
Guest Editorial: Compromised or Competent: Analyzing Twin Children's Social Worlds
Thorpe, K. J., & Danby, S. J. (2006) · Twin Research and Human Genetics · doi:10.1375/183242706776402957 · Cited by 19
Compromised or Competent: Analyzing Twin Children's Social Worlds
Thorpe, K. J., & Danby, S. J. (2006) · Twin Research and Human Genetics · doi:10.1375/twin.9.1.90 · Cited by 13
Messinvarianz zwischen Eltern- und Jugendversion des Strengths and Difficulties Questionnaire (SDQ)?
Rogge, J., Speck, K., Hölling, H., Minnaert, A. E. M. G., Koglin, U., & Schlack, R. (2018) · Diagnostica · doi:10.1026/0012-1924/a000200 · Cited by 4
Research works printed but not linked: 3
- R Plomin, 2013, Behavioral genetics
- Corp IBM, 2017, IBM SPSS Statistics for Windows, Version 25.0
- JL Arbuckle, 2016, Amos (Version 24.0)
Cited by
Integrative analysis of genomic and exposomic influences on youth mental health
Choi, K. W., Wilson, M., Ge, T., Kandola, A., Patel, C. J., Lee, S. H., & Smoller, J. W. (2022) · Journal of Child Psychology and Psychiatry · doi:10.1111/jcpp.13664 · Cited by 47
“Broadly speaking, it is known that both genetic and environmental factors play a role in influencing mental health among youth (Kwong et al., 2019; Nikstat & Riemann, 2020).”
BackgroundSpeyer, L. G., Neaves, S., Hall, H. A., Hemani, G., Lombardo, M. V., Murray, A. L., Auyeung, B., & Luciano, M. (2021) · Journal of Child Psychology and Psychiatry · doi:10.1111/jcpp.13549 · Cited by 36
Latent Profiles of Sleep Patterns in Early Adolescence: Associations With Behavioral Health Risk
Zhang, L., Sasser, J., Doane, L. D., Peltz, J. S., & Oshri, A. (2023) · Journal of Adolescent Health · doi:10.1016/j.jadohealth.2023.08.021 · Cited by 17
The global epidemiology of personality disorder: a systematic review and meta-regression
Shadid, J., Ferrari, A. J., Bach, B., Sellbom, M., Sharp, C., Hutsebaut, J., d’Huart, D., Santomauro, D. F., & Chanen, A. M. (2025) · The Lancet Psychiatry · doi:10.1016/s2215-0366(25)00299-8 · Cited by 19
Gebru, N. M., Gonçalves, P. D., Cruz, R. A., Thompson, W. K., Allegair, N., Potter, A., Garavan, H., Dumas, J. A., Leeman, R. F., & Johnson, M. A. (2023) · Frontiers in Behavioral Neuroscience · doi:10.3389/fnbeh.2023.1213894 · Cited by 16
Metadata
- Authors
- Nikstat, A., & Riemann, R.
- Affiliations
- Bielefeld University (DE)
- Corresponding author
- Nikstat, Amelie
- Venue
- PLOS ONE
- Publisher
- Public Library of Science (PLoS)
- Published
- 2020-03-23
- Volume
- 15
- Issue
- 3
- Pages
- e0230626
- ISSN
- 1932-6203 (ISSN-L)
- PMC
- PMC7089526
- OpenAlex
- W3012701818
- Semantic Scholar
- c622a8e1d98ece50a12615f8e0133bd2cdf2e0aa
- Cited by
- 83
- References
- 67
- Citations by year
- 2026: 19 · 2025: 26 · 2024: 19 · 2023: 12 · 2022: 5 · 2021: 2
- FWCI
- 1.90
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- PLoS ONE (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Figshare (submittedVersion, cc-by)
- PUB – Publications at Bielefeld University (Bielefeld University) (submittedVersion, cc-by)
- Funders
- Deutsche Forschungsgemeinschaft (RI 595/8-1)
- Topics
- Social Sciences › Psychology › Clinical Psychology › Child and Adolescent Psychosocial and Emotional Development
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Genetics › Genetic Associations and Epidemiology
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Mental Health Research Topics
- Keywords
- internalizing problems, externalizing problems, heritability, gene-environment interaction, shared environment, missing heritability, adolescent behavior problems
- MeSH terms
- Problem Behavior, Adolescent, Child, Female, Humans, Male, Twins, Young Adult
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.