PreprintCited by 286Olfactory and Sensory Function StudiesSARS-CoV-2 and COVID-19 ResearchCOVID-19 Clinical Research Studies

SARS-CoV-2 receptor and entry genes are expressed by sustentacular cells in the human olfactory neuroepithelium

Open access
Fodoulian, Leon, Tuberosa, Joel, Rossier, Daniel, Boillat, Madlaina, Kan, Chenda, Pauli, Véronique, Egervari, Kristof, Lobrinus, Johannes A. +3 more·2020·iScience

Abstract

Various reports indicate an association between COVID-19 and anosmia, suggesting an infection of the olfactory sensory epithelium, and thus a possible direct virus access to the brain. To test this hypothesis, we generated RNA-seq libraries from human olfactory neuroepithelia, in which we found substantial expression of the genes coding for the virus receptor angiotensin-converting enzyme-2 (ACE2), and for the virus internalization enhancer TMPRSS2. We analyzed a human olfactory single-cell RNA-seq dataset and determined that sustentacular cells, which maintain the integrity of olfactory sensory neurons, express ACE2 and TMPRSS2 . We then observed that the ACE2 protein was highly expressed in a subset of sustentacular cells in human and mouse olfactory tissues. Finally, we found ACE2 transcripts in specific brain cell types, both in mice and humans. Sustentacular cells thus represent a potential entry door for SARS-CoV-2 in a neuronal sensory system that is in direct connection with the brain.

AI snapshot

Written from the paper’s full text.

TL;DR

Human olfactory neuroepithelium expresses SARS-CoV-2 entry genes, with ACE2 and TMPRSS2 enriched in sustentacular cells rather than olfactory sensory neurons. ACE2 transcripts/protein were also found in specific brain cell types, suggesting potential routes for infection and anosmia.

Key findings

  • Bulk RNA-seq of human nasal biopsies found mean ACE2 and TMPRSS2 expression in olfactory sensory neuroepithelium (4.6 and 76.1 TPM, respectively) and respiratory epithelium (7.1 and 63.7 TPM, respectively), indicating entry-gene expression in both tissues.
  • In a public single-cell RNA-seq dataset of 28,726 cells from four adult patients, sustentacular cells and respiratory ciliated cells showed the highest coexpression of ACE2 and TMPRSS2; olfactory sensory neurons showed little or no expression. ACE2-positive sustentacular cells numbered 71 versus 3,011 ACE2-negative, and ACE2-positive respiratory ciliated cells numbered 19 versus 567 ACE2-negative.
  • Immunohistochemistry confirmed ACE2 protein in a subset of sustentacular cells in mouse and human olfactory tissues; in mouse, ACE2 labeling was apical and restricted to dorsal, not ventral, olfactory epithelium. TMPRSS2 labeling was observed in many nasal epithelium constituents.
  • In mouse brain datasets, Ace2 was limited mainly to pericytes/mural cells and not neurons; in human brain datasets, ACE2 was found in non-neuronal and neuronal types including astrocytes, oligodendrocytes, Purkinje neurons, and cortical layer 5 neurons, with some coexpressing TMPRSS2.

Methods

  • Bulk RNA-seq libraries were generated from human olfactory and respiratory nasal biopsies collected via nasal endoscopic surgery from four adult patients, followed by differential expression analysis.
  • Public single-cell RNA-seq data from human olfactory/nasal tissue (Durante et al., 2020; 28,726 cells, 26 clusters) were reanalyzed for ACE2, TMPRSS2, ERMN, and GSTA2 expression and coexpression.
  • Immunohistochemistry was performed on mouse and human olfactory tissues and mouse olfactory bulb using anti-ACE2 and anti-TMPRSS2 antibodies with neuronal/sustentacular markers (TUJ1, OMP, ERMN); olfactory epithelium from two deceased SARS-CoV-2-infected individuals was also examined.

Limitations

  • Stated: the olfactory sensory epithelium from two deceased SARS-CoV-2-infected individuals was highly damaged and largely detached from the basal lamina, hindering identification of viral particles in sustentacular cells; whether the damage was caused by the virus could not be determined from the few samples analyzed.
  • Evident from the text: sample sizes are small (four adult patients for biopsies; two deceased infected individuals), and brain expression conclusions rely partly on public datasets with possible differences in sequencing depth, protocol, mRNA half-lives, or cell-type selection.
  • Evident from the text: the study does not demonstrate functional SARS-CoV-2 infection of sustentacular cells or establish causality for anosmia; the authors note that inflammation or infection of other non-neuronal cell types cannot be excluded.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.1101/2020.03.31.013268

Cites

76 of 76 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Claims the paper makes

0 of 36 cited sources checked · 0 supported · 0 flagged

  • Findingown data

    In human nasal epithelium, TMPRSS2 labeling is observed in many constituents.

    “Congruently with its pervasiveness in the single-cell transcriptomes, TMPRSS2 labeling was observed in many constituents of the nasal epithelium (Figures 4H, S4F, and S4G).”
    Quote in the paperNot a substantial claim
  • Findingown data

    In the Zeisel et al. (2018) mouse brain dataset, a very limited number of cell types express Ace2.

    “In the first collection, published by Zeisel et al. (2018), which includes non-neuronal cells, we found a very limited number of cell types that expressed Ace2 (Figure 5A).”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites Zeisel et al. (2018)

      Not checked in the free run.

  • Findingown data

    Human olfactory neuroepithelia show substantial expression of ACE2 and TMPRSS2 transcripts.

    “we generated RNA-seq libraries from human olfactory neuroepithelia, in which we found substantial expression of the genes coding for the virus receptor angiotensin-converting enzyme-2 (ACE2) and for the virus internalization enhancer TMPRSS2.”
    • Also stated in: § Expression of ACE2 and TMPRSS2 Human Sustentacular and Respiratory Ciliated Cells · hedged
      “We found a mean of 4.6 and 76.1 TPMs in the sensory neuroepithelium samples for ACE2 and TMPRSS2, respectively (Figures 1F and 1G), indicating the presence in this tissue of cells that may express both genes, or of a mix of cells that express either TMPRSS2 or ACE2.”
    Quote in the paperSubstantial claim
    • Rests on an assumption: The four adult patients from whom olfactory and respiratory biopsies were collected are representative of the general human population for ACE2/TMPRSS2 expression in these tissues.
  • Findingown data

    ACE2 protein is strongly expressed in a subset of sustentacular cells in the mouse olfactory epithelium.

    “In the olfactory cavity, a strong and defined labeling was observed in the respiratory epithelium in the nasal cavity and nasopharyngeal duct (Figures S3A–S3H), and in a subset of sustentacular cells lining the nasal cavity (Figures 3C–3G and S3B).”
    Quote in the paperSubstantial claim
  • Findingown data

    Olfactory sensory neurons show little or no expression of TMPRSS2 and ACE2.

    “Olfactory sensory neurons showed little or no expression of TMPRSS2 and ACE2, respectively (Figure 2C).”
    Quote in the paperSubstantial claim
  • May combine two claims. 15
  • Classified as probably not a substantial claim. 12
  • May combine two claims.

    Findingown data

    In the Allen Brain Map human brain dataset, ACE2 is expressed at relatively limited levels in various non-neuronal and neuronal types, in particular astrocytes, oligodendrocytes, and cortical layer 5 neurons, a portion of which coexpress TMPRSS2.

    “In the second dataset, publicly available in the Allen Brain Map cell types database, we found expression of ACE2 (although at relatively limited levels) in various non-neuronal and neuronal types, in particular astrocytes, oligodendrocytes, and neurons from the cortical layer 5 (Figures 6A–6G), a portion of which coexpressed TMPRSS2 (Figures 6C–6E).”
    Quote in the paperNot a substantial claim
    • Rests on an assumption: The human brain single-nucleus RNA-seq datasets are representative of the human brain.
  • May combine two claims.

    Findingown data

    The olfactory sensory epithelium of two deceased SARS-CoV-2-infected individuals was highly damaged and largely detached from the basal lamina.

    “The olfactory sensory epithelium of two deceased SARS-CoV-2-infected individuals was analyzed. It was found to be highly damaged and largely detached from the basal lamina (Figure S5), hindering the potential identification of viral particles in sustentacular cells.”
    • Also stated in: § Limitations of the Study · plain
      “the epithelium was found to be highly damaged and largely detached from the basal lamina”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingown data

    The mouse brain cells expressing Ace2 are related to pericytes and coexpress Rgs5.

    “These cells are related to pericytes and coexpress the mural cell marker Rgs5 (Figure 5B).”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Zeisel et al. (2018)

      Not checked in the free run.

  • May combine two claims.

    Findingown data

    In the Zeisel et al. (2018) mouse brain dataset, Tmprss2 is expressed by even fewer cell types than Ace2, with Purkinje cells showing the highest expression.

    “Tmprss2, whose transcripts were barely detected, was expressed by even fewer cell types (Figure 5A), with Purkinje cells displaying the highest expression level.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Zeisel et al. (2018)

      Not checked in the free run.

  • May combine two claims.

    Findingown data

    In mouse olfactory epithelium, sustentacular cells are positive for TMPRSS2, and several other cell types show weak expression.

    “In the mouse main olfactory epithelium, sustentacular cells were positive for TMPRSS2, and several other cell types showed weak expression (Figures 3N, S2A, S2B, S2E, and S2F).”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Findingown data

    Different types of respiratory cells and olfactory sustentacular cells express ACE2, and many of these cells coexpress TMPRSS2.

    “In contrast, different types of respiratory cells, and also olfactory sustentacular cells, expressed ACE2. Many of these cells also coexpressed TMPRSS2.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingown data

    In humans, ACE2 transcripts are found in brain non-neuronal cell types such as astrocytes and microglia, and in neurons, particularly Purkinje and cortical layer 5 neurons.

    “In humans, we found ACE2 transcripts in non-neuronal cell types such as astrocytes and microglia, and also in neurons, in particular Purkinje and cortical layer 5 neurons.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingown data

    ACE2-positive sustentacular cells in mouse olfactory epithelium are almost exclusively located in the dorsal part, with a relatively abrupt transition area.

    “These were almost exclusively located in the dorsal part of the epithelium, with a relatively abrupt transition area (Figures 3H and 3I).”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Findingown data

    All three anti-ACE2 antibodies labeled the apical portion of mouse sustentacular cells, except for slight labeling of their somata with Ab2.

    “All antibodies showed a labeling of the apical portion of sustentacular cells, except for a slight labeling of their somata with Ab2 (Figure 3D).”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Findingown data

    In human olfactory neuroepithelium, ACE2 is enriched in the apical half of sustentacular cells, unlike the very apical localization in mouse.

    “However, the very apical localization of ACE2 observed in the mouse neuroepithelium was not recapitulated in humans, but ACE2 was rather enriched in the apical half of the cells.”
    Quote in the paperNot a substantial claim
  • Classified as probably not a substantial claim.

    Premisecitation

    Entry of SARS-CoV-2 into target cells depends on the Spike protein present on the virus capsid.

    “Entry of SARS-CoV-2 into target cells depends on the Spike protein (S), which is present on the virus capsid (Letko et al., 2020; Walls et al., 2020).”
    Quote in the paperSubstantial claim0 of 2 sources checked
    • cites Letko et al., 2020

      Not checked in the free run.

    • cites Walls et al., 2020

      Not checked in the free run.

  • May combine two claims.

    Premisecitation

    In SARS-CoV-2-infected Syrian hamsters, sustentacular cells are infected and the olfactory epithelium shows massive desquamation.

    “However, a study of SARS-CoV-2-infected Syrian hamsters showed infection of sustentacular cells and a massive desquamation of the olfactory epithelium (Bryche et al., 2020).”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Bryche et al., 2020

      Not checked in the free run.

  • May combine two claims.

    Interpretationown data

    Respiratory cells are not the only cells in contact with the outside world that exhibit the molecular keys involved in SARS-CoV-2 entry in the nose; sustentacular cells share the same characteristics.

    “Respiratory cells are thus not the only cells in contact with the outside world that exhibit the molecular keys involved in SARS-CoV-2 entry in the nose. Sustentacular cells, which lie at the interface between the central nervous system and the olfactory cavity, share the same characteristics.”
    Quote in the paperSubstantial claim
  • Classified as probably not a substantial claim. May combine two claims.

    Premisecitation

    TMPRSS2 primes Spike in association with ACE2, leading to fusion between cellular and viral membranes.

    “One reported mechanism facilitating virus entry consists, in association with ACE2, in the priming of S by the cellular serine protease TMPRSS2, also attached to the cellular membrane, which eventually leads to the fusion between the cellular and the viral membranes (Hoffmann et al., 2020; Zhou et al., 2020).”
    Quote in the paperSubstantial claim0 of 2 sources checked
    • cites Hoffmann et al., 2020

      Not checked in the free run.

    • cites Zhou et al., 2020

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    A retrospective case study on 214 patients with COVID-19 reported neurological manifestations possibly correlated with the severity of the disease.

    “a retrospective case study on 214 patients with COVID-19 reported neurological manifestations possibly correlated with the severity of the disease (Mao et al., 2020)”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Mao et al., 2020

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Study design and conductown data

    Whether the histological damage was caused by the virus cannot be determined based on the few samples analyzed.

    “Whether the histological damage was caused by the virus cannot be determined based on the few samples analyzed.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Interpretationreasoning

    The potential double effect on two chemosensory systems may suggest a more central alteration, involving direct infection of the brain by SARS-CoV-2.

    “this potential double effect on two chemosensory systems that share nothing at the periphery may suggest a more central alteration, involving, for example, a direct infection of the brain by SARS-CoV-2.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Study design and conductown data

    TMPRSS2 antibodies were first evaluated on kidney tissue.

    “We tested two different antibodies, which were first evaluated on kidney tissue (Figure S2).”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Study design and conductown data

    A similar somatic staining was also observed, with the same antibody, in proximal tubule cells of the mouse kidney.

    “A similar somatic staining was also observed, with the same antibody, in proximal tubule cells of the mouse kidney (Figure S1D).”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    Respiratory cells that line the respiratory airways coexpress ACE2 and TMPRSS2.

    “Expectedly, the main targets of SARS-CoV-2, respiratory cells that line the respiratory airways, coexpress ACE2 and TMPRSS2 (Bertram et al., 2012).”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Bertram et al., 2012

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    The olfactory nerve route is used by various viruses to reach the brain.

    “the olfactory nerve route is indeed used by various viruses to reach the brain, including HSV1, poliovirus, MHV (a coronavirus), paramyxoviruses, Hendra virus, Nipah virus, influenza virus, adenoviruses, bunyaviruses, and VSV (Durrant et al., 2016).”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Durrant et al., 2016

      Not checked in the free run.

  • May combine two claims.

    Premisecitation

    Tissue specificity of orthologs is highly conserved between tetrapod species, and in particular between mouse and humans.

    “Given that ortholog tissue specificity is highly conserved between tetrapod species (Kryuchkova-Mostacci and Robinson-Rechavi, 2016), and in particular between mouse and humans (Liao and Zhang, 2006), we analyzed mouse tissues in parallel to human ones.”
    Quote in the paperSubstantial claim0 of 2 sources checked
    • cites Kryuchkova-Mostacci and Robinson-Rechavi, 2016

      Not checked in the free run.

    • cites Liao and Zhang, 2006

      Not checked in the free run.

  • May combine two claims.

    Interpretationown data

    The presence of ACE2 and TMPRSS2 transcripts in sensory neuroepithelium indicates the presence of cells that may express both genes, or a mix of cells expressing either TMPRSS2 or ACE2.

    “indicating the presence in this tissue of cells that may express both genes, or of a mix of cells that express either TMPRSS2 or ACE2.”
    Quote in the paperSubstantial claim
  • Classified as probably not a substantial claim.

    Premisenone given

    Viral attachment involves an interaction between Spike and ACE2 on the target cell surface.

    “Viral attachment involves an interaction between S and the angiotensin-converting enzyme-2 (ACE2), located on the surface of the target cell.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    ACE2 is found in the motor cortex, raphe, and nuclei involved in the regulation of cardiovascular function according to a previous report.

    “which found ACE2 in the motor cortex, raphe, and nuclei involved in the regulation of cardiovascular function (Doobay et al., 2007).”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Doobay et al., 2007

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    SARS-CoV particles have been found in the human brain.

    “SARS-CoV particles have also been found in the human brain (Ding et al., 2004; Gu et al., 2005; Xu et al., 2005).”
    Quote in the paperNot a substantial claim0 of 3 sources checked
    • cites Ding et al., 2004

      Not checked in the free run.

    • cites Gu et al., 2005

      Not checked in the free run.

    • cites Xu et al., 2005

      Not checked in the free run.

26 of 26
  • The paper relies on this without support.

    The four adult patients from whom olfactory and respiratory biopsies were collected are representative of the general human population for ACE2/TMPRSS2 expression in these tissues.

    “We collected biopsies via nasal endoscopic surgery from four adult patients and explored the potential expression of ACE2 and TMPRSS2.”
  • The paper relies on this without support.

    The single-cell RNA-seq dataset from Durante et al. (2020) accurately reflects the cell types and gene expression of the human olfactory neuroepithelium.

    “To identify putative viral targets transcribing both ACE2 and TMPRSS2 in the neuroepithelium, we took advantage of a very recently published dataset reported by Durante et al. (2020).”
  • The paper relies on this without support.

    The human brain single-nucleus RNA-seq datasets are representative of the human brain.

    “Finally, we explored two single-nucleus RNA-seq datasets to evaluate ACE2 expression in the human brain.”
  • The paper relies on this without support.

    ACE2 is the main player in the binding and entry of SARS-CoV-2 into human cells.

    “ACE2, the main player in the binding and entry of the SARS-CoV-2 into human cells”
  • The paper relies on this without support.

    TMPRSS2 is a serine protease that facilitates viral entry.

    “TMPRSS2, a serine protease known to facilitate viral entry”
  • The paper relies on this without support.

    Neuronal renewal in the main olfactory epithelium is slow (a few months).

    “given the slow rate of neuronal renewal in the main olfactory epithelium (a few months)”
  • The paper relies on this without support.

    SARS-CoV-2-triggered anosmia develops rapidly.

    “the apparent rapid development of SARS-CoV-2-triggered anosmia”
  • The paper relies on this without support.

    Sustentacular cells are in direct contact with the olfactory cavity and interact with everything that enters the nose.

    “sustentacular cells are in direct contact with the olfactory cavity and thus interact with everything that enters the nose.”
  • The paper relies on this without support.

    Sustentacular cells play a critical role in the maintenance of the olfactory neuroepithelium integrity; their loss or suffering would cause disaggregation or malfunctioning of the neuroepithelium, leading to anosmia.

    “sustentacular cells play a critical role in the maintenance of the olfactory neuroepithelium integrity: their loss or suffering would cause disaggregation or malfunctioning of the neuroepithelium, respectively, leading to anosmia.”
  • The paper relies on this without support.

    The human olfactory neuroepithelium is relatively poorly organized, particularly in aged individuals.

    “the relatively poor organization of the human olfactory neuroepithelium, in particular in aged individuals.”
10 of 10

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • ACE2 expression has been reported for many tissues/organs including the lung, brain, kidney, small intestine, colon, and heart.

    “ACE2 expression has been reported for many tissues/organs including the lung (ie, lung type II alveolar cells/AT2, bronchial epithelial cells), brain, kidney, small intestine, colon, and heart.”

    From COVID-19, Myocarditis and Pericarditis (2023) · cites this paper as [15]

    The Results section on receptor expression in the brain reports ACE2 in human brain cell types. The Results section on protein expression also describes ACE2-expressing cells in mouse colon and kidney, but not human colon or kidney. The passages do not establish expression in the lung—including the specified alveolar and bronchial cells—small intestine, or heart; the respiratory cells studied are nasal. (LLM, conf=0.87)

    Experimental — accuracy not yet measured
  • Human olfactory sustentacular cells express both ACE2 and TMPRSS2 virus receptors.

    “Studies reported that human olfactory sustentacular cells express both ACE2 and TMPRSS2 virus receptors [33].”
  • Human olfactory sensory neurons do not express ACE2 and TMPRSS2 but express CD147 that could allow SARS-CoV-2 neuroinvasion.

    “Although current literature data reports that human olfactory sensory neurons do not express these proteins, they express CD147 that could allow SARS-CoV-2 neuroinvasion (Fig. 1) [33, 34].”

Cites

Flagged first, then by citations

Cited by

Sorted by citations

Authors
Fodoulian, L., Tuberosa, J., Rossier, D., Boillat, M., Kan, C., Pauli, V., Egervari, K., Lobrinus, J. A., Landis, B. N., Carleton, A., & Rodriguez, I.
Affiliations
  • University of Geneva (CH)
  • University Hospital of Geneva (CH)
Corresponding author
Carleton, Alan
Venue
iScience
Publisher
openRxiv
Published
2020-04-02
Volume
23
Issue
12
Pages
101839-101839
ISSN
2589-0042 (ISSN-L)
OpenAlex
W3107452553
Cited by
286
References
76
Citations by year
2026: 8 · 2025: 7 · 2024: 29 · 2023: 46 · 2022: 68 · 2021: 68 · 2020: 60
FWCI
21.23
Type
journal article
Language
en
Open access
Locations
  • iScience (publishedVersion, cc-by-nc-nd)
  • bioRxiv (Cold Spring Harbor Laboratory) (acceptedVersion)
  • PubMed Central (publishedVersion, cc-by-nc-nd)
  • PubMed (publishedVersion)
  • Archive ouverte UNIGE (University of Geneva) (publishedVersion, other-oa)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
  • Archive ouverte UNIGE (University of Geneva) (submittedVersion, cc-by-nd)
Funders
  • National Science Foundation
  • Schweizerischer Nationalfonds zur Förderung der Wissenschaftlichen Forschung (172878, 189153)
  • Université de Genève (31003A_172878, 310030_189153)
  • Institute of Genetics and Genomics of Geneva
Topics
  • Life Sciences › Neuroscience › Sensory Systems › Olfactory and Sensory Function Studies
  • Health Sciences › Medicine › Infectious Diseases › SARS-CoV-2 and COVID-19 Research
  • Health Sciences › Medicine › Infectious Diseases › COVID-19 Clinical Research Studies
Keywords
SARS-CoV-2, COVID-19 pandemic, olfactory epithelium, ACE2, TMPRSS2, sustentacular cells, olfactory sensory neurons, anosmia, olfactory bulb, viral entry, single-cell RNA sequencing

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Claims read by deepseek-v4.1-flash under definition version 3 (extract-v3) on 2026-10-09.

Classified by jev-1.13-20260917 (gold-guideline-v0.2) on 2026-10-09.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review