Cited by 229Child Abuse and TraumaChild Welfare and AdoptionChild and Adolescent Psychosocial and Emotional Development

Population vs Individual Prediction of Poor Health From Results of Adverse Childhood Experiences Screening

Open access
Baldwin, Jessie R., Caspi, Avshalom, Meehan, Alan J., Ambler, Antony, Arseneault, Louise, Fisher, Helen L., Harrington, HonaLee, Matthews, Timothy +5 more·2021·JAMA Pediatrics

Abstract

Importance: Adverse childhood experiences (ACEs) are well-established risk factors for health problems in a population. However, it is not known whether screening for ACEs can accurately identify individuals who develop later health problems. Objective: To test the predictive accuracy of ACE screening for later health problems. Design, Setting, and Participants: This study comprised 2 birth cohorts: the Environmental Risk (E-Risk) Longitudinal Twin Study observed 2232 participants born during the period from 1994 to 1995 until they were aged 18 years (2012-2014); the Dunedin Multidisciplinary Health and Development Study observed 1037 participants born during the period from 1972 to 1973 until they were aged 45 years (2017-2019). Statistical analysis was performed from May 28, 2018, to July 29, 2020. Exposures: ACEs were measured prospectively in childhood through repeated interviews and observations in both cohorts. ACEs were also measured retrospectively in the Dunedin cohort through interviews at 38 years. Main Outcomes and Measures: Health outcomes were assessed at 18 years in E-Risk and at 45 years in the Dunedin cohort. Mental health problems were assessed through clinical interviews using the Diagnostic Interview Schedule. Physical health problems were assessed through interviews, anthropometric measurements, and blood collection. Results: Of 2232 E-Risk participants, 2009 (1051 girls [52%]) were included in the analysis. Of 1037 Dunedin cohort participants, 918 (460 boys [50%]) were included in the analysis. In E-Risk, children with higher ACE scores had greater risk of later health problems (any mental health problem: relative risk, 1.14 [95% CI, 1.10-1.18] per each additional ACE; any physical health problem: relative risk, 1.09 [95% CI, 1.07-1.12] per each additional ACE). ACE scores were associated with health problems independent of other information typically available to clinicians (ie, sex, socioeconomic disadvantage, and history of health problems). However, ACE scores had poor accuracy in predicting an individual's risk of later health problems (any mental health problem: area under the receiver operating characteristic curve, 0.58 [95% CI, 0.56-0.61]; any physical health problem: area under the receiver operating characteristic curve, 0.60 [95% CI, 0.58-0.63]; chance prediction: area under the receiver operating characteristic curve, 0.50). Findings were consistent in the Dunedin cohort using both prospective and retrospective ACE measures. Conclusions and Relevance: This study suggests that, although ACE scores can forecast mean group differences in health, they have poor accuracy in predicting an individual's risk of later health problems. Therefore, targeting interventions based on ACE screening is likely to be ineffective in preventing poor health outcomes.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1001/jamapediatrics.2020.5602

Cites

4 of 4 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

Research works printed but not linked: 27

  1. [2]Reuben A, Moffitt TE, Caspi A,. Lest we forget: comparing retrospective and prospective assessments of adverse childhood experiences in the prediction of adult health. J Child Psychol Psychiatry. 2016; 57(10): 1103- 1112. doi: 10.1111/jcpp.12621 27647050 PMC5234278 · DOI · Paper page
  2. [5]Garner AS, Shonkoff JP, Siegel BS,; Committee on Psychosocial Aspects of Child and Family Health; Committee on Early Childhood, Adoption, and Dependent Care; Section on Developmental and Behavioral Pediatrics. Early childhood adversity, toxic stress, and the role of the pediatrician: translating developmental science into lifelong health. Pediatrics. 2012; 129(1): e224- e231. doi: 10.1542/peds.2011-2662 22201148 · DOI
  3. [6]Jones CM, Merrick MT, Houry DE. Identifying and preventing adverse childhood experiences: implications for clinical practice. JAMA. 2020; 323(1): 25- 26. doi: 10.1001/jama.2019.18499 31689343 PMC9173206 · DOI
  4. [14]Purewal SK, Bucci M, Gutiérrez Wang L,. Screening for adverse childhood experiences (ACEs) in an integrated pediatric care model. Zero to Three. 2016; 36(3): 10- 17. Accessed December 17, 2020. https://dk-media.s3.amazonaws.com/media/1lq96/downloads/299688/2016-01-ztt-journal-s.pdf#page=12%20?
  5. [15]Underwood E. Screen for childhood trauma triggers debate. Science. 2020; 367(6477): 498. doi: 10.1126/science.367.6477.498 32001637 · DOI
  6. [16]Finkelhor D. Screening for adverse childhood experiences (ACEs): cautions and suggestions. Child Abuse Negl. 2018; 85: 174- 179. doi: 10.1016/j.chiabu.2017.07.016 28784309 · DOI
  7. [17]Racine N, Killam T, Madigan S. Trauma-informed care as a universal precaution: beyond the Adverse Childhood Experiences questionnaire. JAMA Pediatr. 2019; 174(1): 1- 2. doi: 10.1001/jamapediatrics.2019.3866 31682717 · DOI
  8. [18]Anda RF, Porter LE, Brown DW. Inside the Adverse Childhood Experience score: strengths, limitations, and misapplications. Am J Prev Med. 2020; 59(2): 293- 295. doi: 10.1016/j.amepre.2020.01.009 32222260 · DOI · Paper page
  9. [19]Lacey RE, Minnis H. Practitioner review: twenty years of research with Adverse Childhood Experience scores—advantages, disadvantages and applications to practice. J Child Psychol Psychiatry. 2020; 61(2): 116- 130 2019. doi: 10.1111/jcpp.13135 31609471 · DOI
  10. [20]Kelly-Irving M, Lepage B, Dedieu D,. Childhood adversity as a risk for cancer: findings from the 1958 British birth cohort study. BMC Public Health. 2013; 13(1): 767. doi: 10.1186/1471-2458-13-767 23957659 PMC3765119 · DOI
  11. [21]Chen M, Lacey RE. Adverse childhood experiences and adult inflammation: findings from the 1958 British birth cohort. Brain Behav Immun. 2018; 69: 582- 590. doi: 10.1016/j.bbi.2018.02.007 29458198 · DOI
  12. [22]Iob E, Lacey R, Steptoe A. The long-term association of adverse childhood experiences with C-reactive protein and hair cortisol: cumulative risk versus dimensions of adversity. Brain Behav Immun. 2020; 87: 318- 328. doi: 10.1016/j.bbi.2019.12.019 31887414 · DOI
  13. [23]Monroe SM. Modern approaches to conceptualizing and measuring human life stress. Annu Rev Clin Psychol. 2008; 4: 33- 52. doi: 10.1146/annurev.clinpsy.4.022007.141207 17716038 · DOI
  14. [24]Widom CS, Raphael KG, DuMont KA. The case for prospective longitudinal studies in child maltreatment research: commentary on Dube, Williamson, Thompson, Felitti, and Anda (2004). Child Abuse Negl. 2004; 28(7): 715- 722. doi: 10.1016/j.chiabu.2004.03.009 15261466 · DOI
  15. [25]Danese A. Annual research review: rethinking childhood trauma—new research directions for measurement, study design and analytical strategies. J Child Psychol Psychiatry. 2020; 61(3): 236- 250. doi: 10.1111/jcpp.13160 31762042 · DOI
  16. [27]Newbury JB, Arseneault L, Moffitt TE,. Measuring childhood maltreatment to predict early-adult psychopathology: comparison of prospective informant-reports and retrospective self-reports. J Psychiatr Res. 2018; 96: 57- 64. doi: 10.1016/j.jpsychires.2017.09.020 28965006 PMC5725307 · DOI · Paper page
  17. [31]Moffitt TE; E-Risk Study Team. Teen-aged mothers in contemporary Britain. J Child Psychol Psychiatry. 2002; 43(6): 727- 742. doi: 10.1111/1469-7610.00082 12236608 · DOI
  18. [32]Beckley AL, Caspi A, Arseneault L,. The developmental nature of the victim-offender overlap. J Dev Life Course Criminol. 2018; 4(1): 24- 49. doi: 10.1007/s40865-017-0068-3 29581934 PMC5865449 · DOI
  19. [33]Poulton R, Moffitt TE, Silva PA. The Dunedin Multidisciplinary Health and Development Study: overview of the first 40 years, with an eye to the future. Soc Psychiatry Psychiatr Epidemiol. 2015; 50(5): 679- 693. doi: 10.1007/s00127-015-1048-8 25835958 PMC4412685 · DOI
  20. [35]Milne BJ, Caspi A, Harrington H, Poulton R, Rutter M, Moffitt TE. Predictive value of family history on severity of illness: the case for depression, anxiety, alcohol dependence, and drug dependence. Arch Gen Psychiatry. 2009; 66(7): 738- 747. doi: 10.1001/archgenpsychiatry.2009.55 19581565 PMC3752832 · DOI · Paper page
  21. [36]Carter RE, Lipsitz SR, Tilley BC. Quasi-likelihood estimation for relative risk regression models. Biostatistics. 2005; 6(1): 39- 44. doi: 10.1093/biostatistics/kxh016 15618526 · DOI
  22. [37]Safari S, Baratloo A, Elfil M, Negida A. Evidence based emergency medicine, part 5: receiver operating curve and area under the curve. Emerg (Tehran). 2016; 4(2): 111- 113. 27274525 PMC4893763
  23. [38]Smith GC, Seaman SR, Wood AM, Royston P, White IR. Correcting for optimistic prediction in small data sets. Am J Epidemiol. 2014; 180(3): 318- 324. doi: 10.1093/aje/kwu140 24966219 PMC4108045 · DOI
  24. [39]Houtepen LC, Heron J, Suderman MJ, Tilling K, Howe LD. Adverse childhood experiences in the children of the Avon Longitudinal Study of Parents and Children (ALSPAC). Wellcome Open Res. 2018; 3(106): 106. doi: 10.12688/wellcomeopenres.14716.1 30569020 PMC6281007 · DOI
  25. [40]Davidson KW, McGinn T. Screening for social determinants of health: the known and unknown. JAMA. 2019; 322(11): 1037- 1038. doi: 10.1001/jama.2019.10915 31465095 · DOI · Paper page
  26. [41]Skar AS, Ormhaug SM, Jensen TK. Reported levels of upset in youth after routine trauma screening at mental health clinics. JAMA Netw Open. 2019; 2(5): e194003. doi: 10.1001/jamanetworkopen.2019.4003 31099873 PMC6537919 · DOI
  27. [43]Meehan AJ, Latham RM, Arseneault L, Stahl D, Fisher HL, Danese A. Developing an individualized risk calculator for psychopathology among young people victimized during childhood: a population-representative cohort study. J Affect Disord. 2020; 262: 90- 98. doi: 10.1016/j.jad.2019.10.034 31715391 PMC6916410 · DOI

Cited by

Sorted by citations

Authors
Baldwin, J. R., Caspi, A., Meehan, A. J., Ambler, A., Arseneault, L., Fisher, H. L., Harrington, H., Matthews, T., Odgers, C. L., Poulton, R., Ramrakha, S., Moffitt, T. E., & Danese, A.
Affiliations
  • King's College London (GB)
  • Duke University (US)
  • University of Otago (NZ)
  • National Health Service (GB)
Corresponding author
Danese, Andrea
Venue
JAMA Pediatrics
Published
2021-04-01
Volume
175
Issue
4
Pages
385
ISSN
  • 1072-4710 (ISSN-L)
  • 2168-6203
OpenAlex
W3126099275
Cited by
229
References
4
Citations by year
2026: 23 · 2025: 37 · 2024: 43 · 2023: 44 · 2022: 44 · 2021: 38
FWCI
28.82
Type
journal article
Language
en
Open access
Licence
cc-by
Locations
  • Archives of Pediatrics and Adolescent Medicine (publishedVersion, cc-by)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • Greenwich Academic Literature Archive (University of Greenwich) (acceptedVersion)
  • UCL Discovery (University College London) (submittedVersion)
  • Research Portal (King's College London) (submittedVersion, cc-by)
Funders
  • Wellcome Trust (215917/Z/19/Z)
  • National Institute for Health and Care Research
  • King's College London
  • Jacobs Foundation
  • Medical Research Council (MR/P005918/1)
  • Economic and Social Research Council (ES/S012567/1, ES/S004424/1)
  • National Institute on Aging (R01AG032282)
  • Eunice Kennedy Shriver National Institute of Child Health and Human Development (P2CHD065563, R01HD077482)
Topics
  • Social Sciences › Psychology › Clinical Psychology › Child Abuse and Trauma
  • Social Sciences › Safety Research › Child Welfare and Adoption
  • Social Sciences › Psychology › Clinical Psychology › Child and Adolescent Psychosocial and Emotional Development
Keywords
adverse childhood experiences, ACE screening, prediction accuracy, mental illness, physical health problems, Environmental Risk Longitudinal Twin Study, Dunedin Multidisciplinary Health and Development Study, birth cohort, socioeconomic deprivation, sex differences in health outcomes, childhood adversity
MeSH terms
Adverse Childhood Experiences, Adolescent, Adult, Mental Disorders, Child, Child, Preschool, Female, United Kingdom, Health Status, Humans, Infant, Infant, Newborn, Longitudinal Studies, Male, Mass Screening, Middle Aged, New Zealand, Preventive Health Services, Prospective Studies, Retrospective Studies, Risk Factors, ROC Curve, Risk Assessment, Young Adult

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review