Cited by 269Stress Responses and CortisolNeurotransmitter Receptor Influence on BehaviorChild and Adolescent Psychosocial and Emotional Development

Gene–environment interactions: early life stress and risk for depressive and anxiety disorders

Open access
Nugent, Nicole R., Tyrka, Audrey R., Carpenter, Linda L., Price, Lawrence H.·2011·Psychopharmacology

Abstract

Rationale Prior reviews have examined how stress, broadly defined, interacts with genetic diathesis in the pathogenesis of internalizing (i.e., depressive and anxiety) disorders. Recent findings have suggested a unique role for early life stress (ELS) in the development of internalizing disorders, contributing to the rapid proliferation of research in this area.Objective This paper critically reviews studies in humans examining gene-environment interaction (GxE) effects of ELS on the risk for depression and anxiety, primarily from a candidate gene perspective. Major methodological challenges that are unique to such studies are considered.Results The majority of published studies have focused on candidates that regulate the serotonin system, especially the serotonin transporter. More recent work has addressed interactions of ELS with candidates from the hypothalamic-pituitary-adrenal axis and neurotrophin system. Available studies vary greatly with respect to definitions of ELS, examination of gene-gene interactions, consideration of gender effects, and attention to analytic limitations.Conclusions Overall, there is support for GxE effects of ELS on the risk for depressive and anxiety outcomes. Future studies of ELS in this context will require careful attention to methodologic considerations. Such studies would benefit from more systematic assessment of positive environmental factors (e.g., social support) and greater utilization of developmentally sensitive paradigms.

Integrity signals

Registry

Crossref · 10.1007/s00213-010-2151-x

Cites

173 of 173 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Claims the paper makes

0 of 97 cited sources checked · 0 supported · 0 flagged

  • Findingcitation

    Fifteen of twenty-two samples support increased risk for internalizing symptoms in participants with low-expression short alleles and early life stress, either in all participants or in a subset.

    “Findings from 15 of the 22 samples tested support increased risk for internalizing symptoms in participants with the low-expression short alleles and ELS in all participants”
    Quote in the paperSubstantial claim
  • Findingown data

    Many studies do not report whether they tested for gene-environment correlation between early life stress and genotype.

    “many studies do not report whether they have tested for rGE between ELS and genotype”
    Quote in the paperNot a substantial claim
  • Findingreasoning

    Most gene-by-early-life-stress studies to date have involved variants regulating brain serotonin systems, especially the serotonin transporter polymorphism 5-HTTLPR.

    “the majority of G×ELS studies to date have involved gene variants that regulate brain serotonin systems (Tables 1 and 2); in particular, numerous studies have focused on 5-HTTLPR”
    Quote in the paperNot a substantial claim
  • Findingreasoning

    Another major source of inconsistency involves the type of early stress under study, with some studies focusing on direct childhood maltreatment and others including broader events or qualitatively distinct circumstances.

    “Another major source of inconsistency involves the type of early stress under study. Whereas some studies have focused on direct childhood maltreatment, such as abuse and neglect, others have included more broadly experienced events, such as parental arguing/divorce, or qualitatively distinct circumstances, such as poverty or parent education levels.”
    Quote in the paperSubstantial claim
  • Findingnone given

    Relatively few studies separately test for gene-environment effects within gender or type of early life stress.

    “However, relatively few studies separately test for GxE effects within gender or type of ELS.”
    Quote in the paperSubstantial claim
  • May combine two claims. 30
  • Classified as probably not a substantial claim. 8
  • The quote only partly states this claim. 1
  • May combine two claims.

    Findingown data

    Most studies reviewed here either used racially homogeneous groups or adjusted for population stratification, but some did not report on this issue.

    “most of the studies reviewed here have either comprised racially homogeneous groups or have adjusted their models for population stratification; however, some studies have not reported on this important issue”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingnone given

    To the authors' knowledge, there is only one report examining interactions between dopamine system genes and early life stress.

    “to our knowledge there is only 1 report examining interactions with ELS.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Findingreasoning

    These reviews included studies of life events occurring throughout the lifespan and did not formally address the potentially differential effects of early life stress relative to adult stressors.

    “However, it is important to note that these reviews included studies of life events occurring throughout the lifespan and did not formally address the potentially differential effects of ELS relative to adult stressors.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingcitation

    Evidence from studies reviewed here supports the existence of differences in the impact of type of early life stress, and these effects may be gender-specific.

    “Evidence from studies reviewed here supports the existence of differences in the impact of type of ELS, and these effects may be gender-specific (Cicchetti et al. 2007; Heim et al. 2009; Sjoberg et al. 2006).”
    Quote in the paperNot a substantial claim0 of 3 sources checked
    • cites Cicchetti et al. 2007 source

      Not checked in the free run.

    • cites Heim et al. 2009 source

      Not checked in the free run.

    • cites Sjoberg et al. 2006 source

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingnone given

    Several studies have notably failed to detect these effects.

    “Several studies have notably failed to detect these effects.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Interpretationreasoning

    Gene-environment correlation can account for apparent gene-environment interaction effects, so studies observing rGE should be interpreted cautiously.

    “Studies that did observe rGE should be interpreted with caution, as it is possible that rGE can account for apparent GxE effects.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Premisecitation

    In the first of two samples tested by Chipman et al. (2007), genotype frequencies were not in Hardy-Weinberg equilibrium, and no gene-environment interaction was detected.

    “In the first of two samples tested by Chipman et al. (2007), genotype frequencies were not in HWE, and no GxE interaction was detected.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Chipman et al. (2007) source

      Not checked in the free run.

  • May combine two claims.

    Study design and conductcitation

    Interaction effects require larger sample sizes for adequate power, and power depends on allele frequencies and exposure to early life stress.

    “Achieving sufficient statistical power presents a special challenge because interaction effects require larger numbers of subjects for adequate power (Brookes et al. 2001; Luan et al. 2001; Uher 2008), and power depends on allele frequencies in addition to exposure to ELS (Munafo et al. 2009).”
    Quote in the paperNot a substantial claim0 of 3 sources checked
    • cites Brookes et al. 2001 source

      Not checked in the free run.

    • cites Luan et al. 2001 source

      Not checked in the free run.

    • cites Uher 2008 source

      Not checked in the free run.

  • May combine two claims.

    Premisecitation

    Aguilera et al. (2009) showed a gene-environment interaction effect of the 5-HTTLPR s allele and childhood sexual abuse on depressive symptoms, but also observed rGE in which the l/l genotype was more strongly associated with childhood sexual abuse than the l/s genotype.

    “Similarly, Aguilera et al. (2009) showed a GxE effect of the 5-HTTLPR s allele and a history of childhood sexual abuse on depressive symptoms, but also observed rGE, in which the l/l genotype was more strongly associated with childhood sexual abuse than the l/s genotype.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Aguilera et al. (2009) source

      Not checked in the free run.

  • May combine two claims.

    Premisecitation

    Eley et al. (2004) found no main or interaction effects for the 5-HT2C VNTR, but observed a significant main effect for increased depression in T allele carriers of the 5-HT2A T102C polymorphism.

    “Although no main or interaction effects for the 5-HT2C VNTR were found, a significant main effect for increased depression in T allele carriers of the 5-HT2A T102C was observed.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Eley et al. (2004) source

      Not checked in the free run.

  • May combine two claims.

    Study design and conductcitation

    For early life stress, the nature and timing of exposure and the method of assessment may be critical for detecting moderation by candidate risk genes.

    “In the case of ELS, the nature and timing of the stress exposure may be a critical determinant of the sequelae, while the method of assessment (i.e., prospective, retrospective; interview, records, questionnaire) may be similarly critical in permitting detection of any moderation by candidate risk genes”
    Quote in the paperSubstantial claim0 of 3 sources checked
    • cites Hardt and Rutter 2004 source

      Not checked in the free run.

    • cites Moffitt et al. 2005 source

      Not checked in the free run.

    • cites Paivio 2001 source

      Not checked in the free run.

  • May combine two claims.

    Premisecitation

    Heim et al. found a gene-environment interaction such that men reporting early life stress with an A allele had decreased cortisol responses compared with women reporting early life stress, but responses of men and women without early life stress did not differ.

    “In addition, there was a GxE interaction such that men reporting ELS with an A allele had decreased cortisol responses compared with women reporting ELS, but responses of men and women without ELS did not differ.”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites Heim et al. (2009) source

      Not checked in the free run.

  • May combine two claims.

    Premisecitation

    The short allele of 5-HTTLPR has lower transcriptional efficiency than the long allele and is associated with decreased transporter expression and serotonin reuptake.

    “The short (s) allele of this polymorphism confers lower transcriptional efficiency than the long (l) allele, and is associated with decreased transporter expression and serotonin reuptake”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites Lesch et al. 1996 source

      Not checked in the free run.

  • May combine two claims.

    Premisecitation

    Wichers et al. (2008) identified a three-way interaction between early life stress, 5-HTTLPR, and BDNF, but also found rGE between BDNF genotype and reported childhood adversity, with increased adversity reported by Val/Met relative to Val/Val youth.

    “Wichers et al. (2008), identified a three-way interaction between ELS, 5-HTTLPR, and BDNF, which the authors acknowledged must be qualified by the fact that they also found rGE between BDNF genotype and reported childhood adversity (with increased adversity reported by youth with Val/Met relative to Val/Val).”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites Wichers et al. (2008) source

      Not checked in the free run.

  • May combine two claims.

    Premisecitation

    Seven of ten SNPs spanning CRHR1 showed significant interactions with childhood maltreatment, with rs110402 and rs7209436 remaining significant after correction for multiple tests.

    “Seven of ten single nucleotide polymorphisms (SNPs) spanning the gene showed significant interactions, with the rs110402 and rs7209436 SNPs significant even after correction for multiple tests.”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites Bradley et al. 2008 source

      Not checked in the free run.

  • May combine two claims.

    Study design and conductnone given

    Continuous measures of depression or anxiety generally assess only current symptoms and may miscategorize individuals with a history of symptoms who are currently in remission.

    “However, continuous measures of depression or anxiety disorders are also problematic in that they generally provide accurate assessments only of current symptoms, and therefore may miscategorize those individuals who have a history of such symptoms but are currently in remission.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Study design and conductcitation

    Age and gender should be considered in gene-environment interaction analyses because genetic and environmental effects on depression and anxiety symptoms differ by age and gender.

    “The effects of genetic and environmental factors on symptoms of depression and anxiety have also been shown to differ as a function of age (Tambs and Mourn 1993) and gender (Eaves et al. 1997), so these factors should be considered in GxE analyses.”
    Quote in the paperNot a substantial claim0 of 2 sources checked
    • cites Tambs and Mourn 1993 source

      Not checked in the free run.

    • cites Eaves et al. 1997 source

      Not checked in the free run.

  • May combine two claims.

    Premisecitation

    Heim et al. (2009) partially replicated Tyrka et al.'s findings in a Dex/CRH study, finding that men but not women who were carriers of the A allele had decreased cortisol responses compared with men with the G/G genotype.

    “Men, but not women, who were carriers of the A allele had decreased cortisol responses compared with men with the G/G genotype.”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites Heim et al. (2009) source

      Not checked in the free run.

  • Classified as probably not a substantial claim.

    Interpretationcitation

    Tyrka et al. suggested that prior findings of elevated depressive symptoms in individuals with this genotype and childhood maltreatment could reflect alterations in neuroendocrine stress responding.

    “suggesting that prior findings of elevated depressive symptoms in individuals with this genotype and childhood maltreatment could reflect alterations in neuroendocrine stress responding.”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites Tyrka et al. (2009) source

      Not checked in the free run.

  • May combine two claims.

    Premisecitation

    In Chipman et al.'s replication sample, findings were limited because few adolescents with persistent adversity had high depressive symptoms, although the sample did not depart from Hardy-Weinberg equilibrium.

    “Although the replication sample did not show a departure from HWE, as the authors noted, findings from the replication sample were limited by the fact that very few adolescents categorized as having persistent adversity had high levels of depressive symptoms.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Chipman et al. (2007) source

      Not checked in the free run.

  • May combine two claims.

    Premisecitation

    Polanczyk et al. concluded that the gene-environment effect was supported but specific to depression-relevant emotional memories assessed with the CTQ.

    “Polanczyk et al. concluded that the GxE effect was supported, but with the effect specific to depression-relevant emotional memories assessed with the CTQ.”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites Polanczyk et al. (2009) source

      Not checked in the free run.

  • May combine two claims.

    Interpretationreasoning

    Differences in both genetic and environmental determinants of childhood- versus adult-onset disorders could be expected, limiting the validity of studies that combine these conditions.

    “Differences in both genetic and environmental determinants of childhood- vs. adult-onset disorders could be expected, limiting the validity of studies that combine these conditions.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisecitation

    Munafo et al. (2009) meta-analysis concluded that most available studies were underpowered and that findings using logistic regression models were compatible with chance.

    “Munafo et al. (2009) conducted a meta-analysis which led them to conclude that most of the available studies were underpowered, and that findings using logistic regression models were “compatible with chance.””
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Munafo et al. (2009) source

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    Reciprocal interactions between BDNF and serotonin have been well documented.

    “Reciprocal interactions between BDNF and serotonin have also been well documented (Duman 2002; MacQueen et al. 2003).”
    Quote in the paperNot a substantial claim0 of 2 sources checked
    • cites Duman 2002 source

      Not checked in the free run.

    • cites MacQueen et al. 2003 source

      Not checked in the free run.

  • May combine two claims.

    Premisecitation

    The DAT1 × maternal rejection effect was specific to depression and did not predict anxiety symptoms.

    “This effect was specific to depression and did not predict anxiety symptoms.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Haeffel et al. 2008 source

      Not checked in the free run.

  • May combine two claims.

    Premisecitation

    Psychiatric disorders tend to co-occur and are heterogeneous, so efforts to examine dichotomous diagnoses are problematic.

    “Psychiatric disorders tend to co-occur, and are also heterogeneous, so that efforts to examine dichotomous diagnoses, a common approach in genetic research, are problematic (Eaves 2006).”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites Eaves 2006 source

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    Caspi et al. (2010) asserted a prominent role for 5-HTTLPR in neurobiological and behavioral responses to stress.

    “Caspi et al. (2010), recently reviewing the role of 5-HTTLPR in stress sensitivity from a broader perspective, asserted a prominent role for this gene in the neurobiological and behavioral responses to stress.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Caspi et al. (2010) source

      Not checked in the free run.

  • May combine two claims.

    Premisecitation

    Altered sensitivity of glucocorticoid receptors is thought to mediate HPA axis dysregulation in depression and PTSD, making genes regulating this system likely candidates for gene-environment investigations.

    “Since altered sensitivity of GRs is thought to mediate HPA axis dysregulation in depression and PTSD (Raison and Miller 2003), genes regulating components of this system are likely candidates for GxE investigations of the etiopathology of depression and anxiety (Charney 2004; Wust et al. 2004a; Wust et al. 2004b).”
    Quote in the paperSubstantial claim0 of 3 sources checked
    • cites Raison and Miller 2003 source

      Not checked in the free run.

    • cites Charney 2004 source

      Not checked in the free run.

    • cites Wust et al. 2004a

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    Dopamine has been implicated in the pathophysiology of depression.

    “Dopamine, which plays a central role in motivation and pleasure, has also been implicated in the pathophysiology of depression (Dunlop and Nemeroff 2007).”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Dunlop and Nemeroff 2007 source

      Not checked in the free run.

  • May combine two claims.

    Premisecitation

    The Met allele of BDNF Val66Met has been implicated in impaired extinction of conditioned fear response and atypical frontoamygdala activity in humans.

    “and has been implicated in impaired extinction of conditioned fear response and atypical frontoamygdala activity in humans (Soliman et al. 2010)”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Soliman et al. 2010 source

      Not checked in the free run.

  • The quote only partly states this claim.

    Premisecitation

    Binder et al. (2008) found that FKBP5 interacted with reported childhood maltreatment to predict PTSD symptoms in a sample of predominantly low-income, urban, African American adult patients.

    “FKBP5 interacted with reported childhood maltreatment to predict PTSD symptoms.”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites Binder et al. 2008 source

      Not checked in the free run.

  • May combine two claims.

    Premisecitation

    Examination of continuous measures affords greater statistical power and may decrease statistical error due to miscategorization of subthreshold individuals.

    “Examination of continuous measures affords greater statistical power and may decrease statistical error due to miscategorization of “subthreshold” individuals (Caspi et al. 2010; Plomin and Davis 2009).”
    Quote in the paperNot a substantial claim0 of 2 sources checked
    • cites Caspi et al. 2010 source

      Not checked in the free run.

    • cites Plomin and Davis 2009 source

      Not checked in the free run.

  • May combine two claims.

    Premisecitation

    Gatt et al. (2009) observed significant interactions between BDNF Val66Met and early life stress, with BDNF Met carriers exposed to high early life stress showing poorer working memory, elevated heart rate in resting and arousal conditions, and smaller hippocampus and amygdala volumes.

    “Significant interactions between BDNF Val66Met and ELS were observed, with BDNF Met carriers exposed to high ELS showing poorer working memory, elevated heart rate in resting and arousal conditions, and smaller hippocampus and amygdala volumes.”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites Gatt et al. (2009) source

      Not checked in the free run.

  • May combine two claims.

    Premisecitation

    Risch et al. (2009) meta-analysis examined gene-environment interaction between stressful life events and 5-HTTLPR on depression using 14 studies (N=14,250), with just under half focusing on early life stress, and concluded there was no support for an interaction effect.

    “a recent meta-analysis by Risch et al. (2009) examined GxE between stressful life events and 5-HTTLPR on depression using 14 studies (N=14,250). Just under half of the included studies focused on the effects of ELS. The authors concluded that there was no support for an interaction effect”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites Risch et al. (2009) source

      Not checked in the free run.

  • May combine two claims.

    Premisecitation

    Xie et al. (2009) found an interaction between childhood experiences of crime and abuse and FKBP5 genotype in predicting PTSD in African Americans, but not European Americans.

    “there was an interaction between childhood experiences of crime and abuse and FKBP5 genotype in predicting PTSD in African Americans, but not European Americans.”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites Xie et al. (2009) source

      Not checked in the free run.

  • May combine two claims.

    Interpretationreasoning

    Differences in findings may be attributable to type of early life stress, gender-related effects, additional interactive or additive environmental influences such as social support, and additional moderating genes.

    “studies reviewed here suggest that differences in findings may be attributable to: (1) type of ELS, (2) gender-related effects, (3) additional interactive or additive environmental influences, such as social support, and (4) additional moderating genes.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Interpretationcitation

    Timing of early life stress is likely critically important and may further explain inconsistencies in the literature.

    “Timing of ELS is likely also critically important, and may further explain inconsistencies in the literature.”
    Quote in the paperSubstantial claim
37 of 37
  • The authors state this as an assumption.

    Common diseases are influenced by common genetic variants.

    “Candidate gene research is predicated on the assumption that common diseases are influenced by common genetic variants”
  • The paper relies on this without support.

    Early life stress does not invariably lead to dysfunction and is not a specific risk factor for any particular disorder.

    “ELS does not invariably lead to dysfunction, nor is it a specific risk factor for any particular disorder.”
  • The authors state this as an assumption.

    An increasingly accepted gene–environment model assumes that genes may interact with environmental influences on both ends of the spectrum, with risk and resilience resulting from exposure to negative and positive environments, respectively.

    “Finally, an increasingly accepted GxE model assumes genes may interact with environmental influences on both ends of the spectrum, with risk and resilience resulting from exposure to negative and positive environments, respectively.”
  • The paper relies on this without support.

    Some types of adversity commonly co-occur, while others, such as sexual abuse, may occur in isolation.

    “A further complication is that some types of adversity commonly co-occur, while others, such as sexual abuse, may occur in isolation.”
  • The paper relies on this without support.

    Identified stressors may occur in the context of additional adversity that is not consistently identified or examined.

    “Moreover, identified stressors may occur in the context of additional adversity that is not consistently identified or examined.”
5 of 5

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Cites

Flagged first, then by citations

1 of the 174 references couldn’t be matched to a known paper.

Cited by

Sorted by citations

Authors
Nugent, N. R., Tyrka, A. R., Carpenter, L. L., & Price, L. H.
Affiliations
Brown University (US)
Corresponding author
Nugent, Nicole R.
Venue
Psychopharmacology
Published
2011-01-12
Volume
214
Issue
1
Pages
175-196
ISSN
  • 0033-3158 (ISSN-L)
  • 1432-2072
OpenAlex
W2094951488
Cited by
269
References
174
Citations by year
2026: 3 · 2025: 8 · 2024: 8 · 2023: 16 · 2022: 40 · 2021: 14 · 2020: 13 · 2019: 11 · 2018: 17 · 2017: 25 · 2016: 10 · 2015: 30 · 2014: 20 · 2013: 25 · 2012: 17
FWCI
1.99
Type
journal article
Language
en
Open access
Locations
  • Psychopharmacology (publishedVersion)
  • PubMed (publishedVersion)
  • Europe PMC (PubMed Central) (acceptedVersion)
  • PubMed Central (acceptedVersion)
Funders
  • U.S. Department of Defense
  • National Institute of Mental Health (K01MH087240, R01MH083704, R01MH068767)
Topics
  • Life Sciences › Neuroscience › Behavioral Neuroscience › Stress Responses and Cortisol
  • Life Sciences › Neuroscience › Cellular and Molecular Neuroscience › Neurotransmitter Receptor Influence on Behavior
  • Social Sciences › Psychology › Clinical Psychology › Child and Adolescent Psychosocial and Emotional Development
Keywords
gene-environment interaction, early life stress, depression, anxiety disorders, internalizing disorders, candidate genes, serotonin transporter, serotonergic system, hypothalamic-pituitary-adrenal axis, neurotrophins, gene-gene interaction, sex differences, social support
MeSH terms
Animals, Anxiety Disorders, Depressive Disorder, Female, Humans, Life Change Events, Male, Risk Factors, Sex Factors, Stress, Psychological

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Claims read by deepseek-v4.1-flash under definition version 3 (extract-v3) on 2026-10-06.

Classified by jev-1.13-20260917 (gold-guideline-v0.2) on 2026-10-06.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review