The DOI matches its Crossref record; 54 of the 54 references it cites were found in a registry or an index.
Lexical and Acoustic Speech Features Relating to Alzheimer Disease Pathology
Open accessPublished version of a preprint
Abstract
BACKGROUND AND OBJECTIVES: We compared digital speech and language features of patients with amnestic Alzheimer disease (aAD) or logopenic variant primary progressive aphasia (lvPPA) in a biologically confirmed cohort and related these features to neuropsychiatric test scores and CSF analytes. METHODS: We included patients with aAD or lvPPA with CSF (phosphorylated tau ([p-tau]/β-amyloid [Aβ] ≥0.09, and total tau/Aβ ≥0.34) or autopsy confirmation of AD pathology and age-matched healthy controls (HC) recruited at the Frontotemporal Degeneration Center of the University of Pennsylvania for a cross-sectional study. We extracted speech and language variables with automated lexical and acoustic pipelines from participants' oral picture descriptions. We compared the groups and correlated distinct features with clinical ratings and CSF p-tau levels. RESULTS: = 0.026) were correlated with patients' CSF p-tau levels. DISCUSSION: Our measures captured language and speech differences between the 2 phenotypes that traditional language-based clinical assessments failed to identify. This work demonstrates the potential of natural speech in reflecting underlying variants with AD pathology.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Patients with amnestic or non-amnestic AD presentations produced more inflectional errors and fewer tense-inflected verbs than HC.
“We and others have observed a similar finding in previous studies, 11 , 50 , 51 in which patients with amnestic or non‐amnestic AD presentations produced more inflectional errors (e.g., “She run” instead of “She runs”) and fewer tense‐inflected verbs than HC.”
From Automatic classification of AD pathology in FTD phenotypes using natural speech (2024) · cites this paper as [11]
The Results passage embedded under §2.7 reports that the non-amnestic lvPPA group produced fewer tense-inflected verbs than healthy controls, but the amnestic AD group did not differ significantly from controls (p=0.124). The paper’s lexical-pipeline description (§2.3) counts tense-inflected verbs but does not report inflectional errors such as “She run.” (LLM, conf=0.90)
Experimental — accuracy not yet measuredAdjective counts and lexical diversity of patients with cognitive impairment decreased compared to HC.
“It has been observed that adjective counts and lexical diversity of patients with cognitive impairment decreased compared to HC. 11 , 44 , 61”
From Automatic classification of AD pathology in FTD phenotypes using natural speech (2024) · cites this paper as [11]
The reported comparisons in our copy (indexed under §2.7; page unavailable) show fewer adjectives in both the amnestic AD and lvPPA groups than in healthy controls. Lexical diversity was lower in lvPPA, but the AD group did not differ significantly from controls. The claim omits that distinction. (LLM, conf=0.90)
Experimental — accuracy not yet measuredPrevious connected speech research has largely focused on Alzheimer disease, mild cognitive impairment, and PPA, with fewer studies focused on behavioral FTD variants.
“Previous connected speech research has largely focused on Alzheimer disease (AD), mild cognitive impairment, and PPA, with fewer studies focused on behavioral FTD variants.14-16”
From Automated Speech Analysis to Differentiate Frontal and Right Anterior Temporal Lobe Atrophy in Frontotemporal Dementia (2025) · cites this paper as [14]
The Background (page not available) says that much attention has been paid to AD and that many studies have characterized the language of a PPA variant, supporting those parts of the claim. It does not say that connected-speech research has largely focused on mild cognitive impairment or that fewer studies examine behavioral FTD variants; those terms appear in reference titles, not in a comparison of research volume. (LLM, conf=0.86)
Experimental — accuracy not yet measuredThere are linguistic similarities between people with the amnestic AD presentation and those with a non-amnestic lvPPA presentation with ADNC.
“A recent study identified several linguistic similarities between people with the amnestic AD presentation and those with a non‐amnestic lvPPA presentation with AD neuropathologic change (ADNC), suggesting that speech features may be useful in identifying individuals with ADNC, regardless of their clinical presentation.”
From Automatic classification of AD pathology in FTD phenotypes using natural speech (2024) · cites this paper as [11]
Patients with various types of dementia tended to produce shorter and more frequent words than HC.
“Additionally, patients with various types of dementia tended to produce shorter and more frequent words than HC. 11 , 44 , 62 , 63”
From Automatic classification of AD pathology in FTD phenotypes using natural speech (2024) · cites this paper as [11]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
McKhann, G. M., Knopman, D. S., Chertkow, H., Hyman, B. T., Jack, C. R., Kawas, C. H., Klunk, W. E., Koroshetz, W. J., Manly, J. J., Mayeux, R., et al. (2011) · Alzheimer's & Dementia · doi:10.1016/j.jalz.2011.03.005 · Cited by 18,657
Classification of primary progressive aphasia and its variants
Gorno-Tempini, M. L., Hillis, A. E., Weintraub, S., Kertesz, A., Mendez, M., Cappa, S. F., Ogar, J. M., Rohrer, J. D., Black, S., Boeve, B. F., et al. (2011) · Neurology · doi:10.1212/wnl.0b013e31821103e6 · Cited by 5,141
Self-citationSpeaking: From Intention to Articulation
Levelt, W. J. M. (1989) · doi:10.7551/mitpress/6393.001.0001 · Cited by 4,804
Verb Movement, Universal Grammar, and the Structure of IP, 1989
Zanuttini, R., Leu, T., & Kayne, R. (2013) · doi:10.1002/9781394260140.ch15 · Cited by 3,465
Montine, T. J., Phelps, C. H., Beach, T. G., Bigio, E. H., Cairns, N. J., Dickson, D. W., Duyckaerts, C., Frosch, M. P., Masliah, E., Mirra, S. S., et al. (2012) · Acta Neuropathologica · doi:10.1007/s00401-011-0910-3 · Cited by 2,894 · cited 1×
“Thirteen patients of 15 with autopsy data had a high probability of having AD pathologic change on the basis of established ABC scoring.(25) Four patients with posterior cortical atrophy and 3 patients with nonamnestic mild cognitive impairment who did not meet the criteria for lvPPA(18) were excluded from the analysi…”
BackgroundBrysbaert, M., & New, B. (2009) · Behavior Research Methods · doi:10.3758/brm.41.4.977 · Cited by 2,821
2020 Alzheimer's disease facts and figures
(2020) · Alzheimer's & Dementia · doi:10.1002/alz.12068 · Cited by 2,353
Lezak, M. D., Howieson, D. B., Bigler, E. D., & Tranel, D. (1995) · Cited by 1,840
Concreteness ratings for 40 thousand generally known English word lemmas
Brysbaert, M., Warriner, A. B., & Kuperman, V. (2014) · Behavior Research Methods · doi:10.3758/s13428-013-0403-5 · Cited by 1,821
Cognition and anatomy in three variants of primary progressive aphasia
Gorno‐Tempini, M. L., Dronkers, N. F., Rankin, K. P., Ogar, J. M., Phengrasamy, L., Rosen, H. J., Johnson, J. K., Weiner, M. W., & Miller, B. L. (2004) · Annals of Neurology · doi:10.1002/ana.10825 · Cited by 1,657
Linguistic Features Identify Alzheimer’s Disease in Narrative Speech
Fraser, K. C., Meltzer, J. A., & Rudzicz, F. (2015) · Journal of Alzheimer's Disease · doi:10.3233/jad-150520 · Cited by 797
The logopenic/phonological variant of primary progressive aphasia
Gorno‐Tempini, M., Brambati, S. M., Ginex, V., Ogar, J., Dronkers, N. F., Marcone, A., Perani, D., Garibotto, V., Cappa, S. F., & Miller, B. L. (2008) · Neurology · doi:10.1212/01.wnl.0000320506.79811.da · Cited by 731
Boston Diagnostic Aphasia Examination
Helm‐Estabrooks, N. (2018) · Springer eBooks · doi:10.1007/978-3-319-56782-2_868-4 · Cited by 675
Identification of normal and pathological aging in prospectively studied nondemented elderly humans
Dickson, D. W., Crystal, H. A., Mattiace, L. A., Masur, D. M., Blau, A. D., Davies, P., Yen, S.-H., & Aronson, M. K. (1992) · Neurobiology of Aging · doi:10.1016/0197-4580(92)90027-u · Cited by 643
An Improved Non-monotonic Transition System for Dependency Parsing
Honnibal, M., & Johnson, M. (2015) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d15-1162 · Cited by 619
Connected speech production in three variants of primary progressive aphasia
Wilson, S. M., Henry, M. L., Besbris, M., Ogar, J. M., Dronkers, N. F., Jarrold, W., Miller, B. L., & Gorno-Tempini, M. L. (2010) · Brain · doi:10.1093/brain/awq129 · Cited by 546
Version 3 of the National Alzheimer’s Coordinating Center’s Uniform Data Set
Besser, L. M., Kukull, W. A., Knopman, D. S., Chui, H. C., Galasko, D., Weıntraub, S., Jicha, G. A., Carlsson, C. M., Burns, J. M., Quinn, J. F., et al. (2018) · Alzheimer Disease & Associated Disorders · doi:10.1097/wad.0000000000000279 · Cited by 522
Cutting the Gordian Knot: The Moving-Average Type–Token Ratio (MATTR)
Covington, M. A., & McFall, J. D. (2010) · Journal of Quantitative Linguistics · doi:10.1080/09296171003643098 · Cited by 494
Hoffman, P., Lambon Ralph, M. A., & Rogers, T. T. (2013) · Behavior Research Methods · doi:10.3758/s13428-012-0278-x · Cited by 414
CONCEPTUAL APRAXIA IN ALZHEIMER'S DISEASE
Ochipa, C., Rothi, L. J. G., & Heilman, K. M. (1992) · Brain · doi:10.1093/brain/115.4.1061 · Cited by 296
Semantic knowledge in mild cognitive impairment and mild Alzheimer's disease
Adlam, A.-L. R., Bozeat, S., Arnold, R., Watson, P., & Hodges, J. R. (2006) · Cortex · doi:10.1016/s0010-9452(08)70404-0 · Cited by 274
Bucks, R. S., Singh, S., Cuerden, J. M., & Wilcock, G. K. (2000) · Aphasiology · doi:10.1080/026870300401603 · Cited by 233
Lexical Retrieval in Healthy Aging
Nicholas, M., Obler, L., Albert, M., & Goodglass, H. (1985) · Cortex · doi:10.1016/s0010-9452(58)80007-6 · Cited by 224
The Role of Semantic Memory in Object Use
Buxbaum, L. J., Schwartz, M. F., & Carew, T. G. (1997) · Cognitive Neuropsychology · doi:10.1080/026432997381565 · Cited by 217
Comparative Study of Oral and Written Picture Description in Patients with Alzheimer's Disease
Croisile, B., Ska, B., Brabant, M.-J., Duchêne, A., Lepage, Y., Aimard, G., & Trillet, M. (1996) · Brain and Language · doi:10.1006/brln.1996.0033 · Cited by 216
Word prevalence norms for 62,000 English lemmas
Brysbaert, M., Mandera, P., McCormick, S. F., & Keuleers, E. (2019) · Behavior Research Methods · doi:10.3758/s13428-018-1077-9 · Cited by 207
Prevalence of amyloid‐β pathology in distinct variants of primary progressive aphasia
Bergeron, D., Gorno‐Tempini, M. L., Rabinovici, G. D., Santos‐Santos, M. A., Seeley, W., Miller, B. L., Pijnenburg, Y., Keulen, M. A., Groot, C., van Berckel, B. N. M., et al. (2018) · Annals of Neurology · doi:10.1002/ana.25333 · Cited by 203
Self-citationAlzheimer's pathology in primary progressive aphasia
Rohrer, J. D., Rossor, M. N., & Warren, J. D. (2010) · Neurobiology of Aging · doi:10.1016/j.neurobiolaging.2010.05.020 · Cited by 175
Differentiating primary progressive aphasias in a brief sample of connected speech
Ash, S., Evans, E., O'Shea, J., Powers, J., Boller, A., Weinberg, D., Haley, J., McMillan, C., Irwin, D. J., Rascovsky, K., et al. (2013) · Neurology · doi:10.1212/wnl.0b013e31829c5d0e · Cited by 171
Self-citationGiffard, B. (2001) · Brain · doi:10.1093/brain/124.8.1522 · Cited by 145
Clinical marker for Alzheimer disease pathology in logopenic primary progressive aphasia
Giannini, L. A. A., Irwin, D. J., McMillan, C. T., Ash, S., Rascovsky, K., Wolk, D. A., Van Deerlin, V. M., Lee, E. B., Trojanowski, J. Q., & Grossman, M. (2017) · Neurology · doi:10.1212/wnl.0000000000004034 · Cited by 144
Self-citationCognitive Decline in Preclinical Alzheimer’s Disease: Amyloid-Beta versus Tauopathy
Huber, C. M., Yee, C., May, T., Dhanala, A., & Mitchell, C. S. (2017) · Journal of Alzheimer s Disease · doi:10.3233/jad-170490 · Cited by 136
Clinically concordant variations of Alzheimer pathology in aphasic versus amnestic dementia
Gefen, T. D., Gasho, K., RADEMAKER, A. W., Lalehzari, M., Weıntraub, S., Rogalski, E. J., Wieneke, C., Bigio, E. H., Geula, C., & Mesulam, M. M. (2012) · Brain · doi:10.1093/brain/aws076 · Cited by 135
Hernández-Domínguez, L., Ratté, S., Sierra, G., & Roche-Bergua, A. (2018) · Alzheimer s & Dementia Diagnosis Assessment & Disease Monitoring · doi:10.1016/j.dadm.2018.02.004 · Cited by 124
Irwin, D. J., McMillan, C. T., Toledo, J. B., Arnold, S. E., Shaw, L. M., Wang, L.-S., Van Deerlin, V., Lee, V. M.-Y., Trojanowski, J. Q., & Grossman, M. (2012) · Archives of Neurology · doi:10.1001/archneurol.2012.26 · Cited by 116
Self-citationHamsher, K. D. S. (1977) · Archives of Neurology · doi:10.1001/archneur.1977.00500130081026 · Cited by 103
The anatomical bases of semantic retrieval deficits in early Alzheimer's disease
Venneri, A., McGeown, W. J., Hietanen, H., Guerrini, C., Ellis, A. W., & Shanks, M. F. (2007) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2007.08.026 · Cited by 93
The logopenic variant of primary progressive aphasia
Henry, M., & Gorno-Tempini, M. (2010) · Current Opinion in Neurology · doi:10.1097/wco.0b013e32833fb93e · Cited by 88
Impairments of speech fluency in Lewy body spectrum disorder
Ash, S., McMillan, C. T., Gross, R. G., Cook, P. A., Gunawardena, D., Morgan, B. E., Boller, A., Siderowf, A. D., & Grossman, M. (2011) · Brain and Language · doi:10.1016/j.bandl.2011.09.004 · Cited by 75
Self-citationValidated automatic speech biomarkers in primary progressive aphasia
Nevler, N., Ash, S., Irwin, D. J., Liberman, M., & Grossman, M. (2019) · Annals of Clinical and Translational Neurology · doi:10.1002/acn3.653 · Cited by 74
Self-citationSeverity of Alzheimer’s disease and language features in picture descriptions
Kavé, G., & Dassa, A. (2018) · Aphasiology · doi:10.1080/02687038.2017.1303441 · Cited by 72
A 2-Step Cerebrospinal Algorithm for the Selection of Frontotemporal Lobar Degeneration Subtypes
Lleó, A., Irwin, D. J., Illán-Gala, I., McMillan, C. T., Wolk, D. A., Lee, E. B., Van Deerlin, V. M., Shaw, L. M., Trojanowski, J. Q., & Grossman, M. (2018) · JAMA Neurology · doi:10.1001/jamaneurol.2018.0118 · Cited by 71
Self-citationNeuropsychological and behavioural correlates of CSF biomarkers in dementia
Engelborghs, S., Maertens, K., Vloeberghs, E., Aerts, T., Somers, N., Mariën, P., & Deyn, P. P. D. (2006) · Neurochemistry International · doi:10.1016/j.neuint.2005.11.002 · Cited by 67
Word retrieval in picture descriptions produced by individuals with Alzheimer’s disease
Kavé, G., & Goral, M. (2016) · Journal of Clinical and Experimental Neuropsychology · doi:10.1080/13803395.2016.1179266 · Cited by 67
Irwin, D. J., Lleó, A., Xie, S. X., McMillan, C. T., Wolk, D. A., Lee, E. B., Van Deerlin, V. M., Shaw, L. M., Trojanowski, J. Q., & Grossman, M. (2017) · Annals of Neurology · doi:10.1002/ana.24996 · Cited by 67
Self-citationDistinctive pathological mechanisms involved in primary progressive aphasias
Leyton, C. E., Britton, A. K., Hodges, J. R., Halliday, G. M., & Kril, J. J. (2015) · Neurobiology of Aging · doi:10.1016/j.neurobiolaging.2015.10.017 · Cited by 63
Automatic measurement of prosody in behavioral variant FTD
Nevler, N., Ash, S., Jester, C., Irwin, D. J., Liberman, M., & Grossman, M. (2017) · Neurology · doi:10.1212/wnl.0000000000004236 · Cited by 61
Self-citationEyigoz, E., Courson, M., Sedeño, L., Rogg, K., Orozco-Arroyave, J. R., Nöth, E., Skodda, S., Trujillo, N., Rodríguez, M., Rusz, J., et al. (2020) · Cortex · doi:10.1016/j.cortex.2020.08.020 · Cited by 44
Automated analysis of lexical features in frontotemporal degeneration
Cho, S., Nevler, N., Ash, S., Shellikeri, S., Irwin, D. J., Massimo, L., Rascovsky, K., Olm, C., Grossman, M., & Liberman, M. (2021) · Cortex · doi:10.1016/j.cortex.2021.01.012 · Cited by 41
Self-citationRentoumi, V., Paliouras, G., Danasi, E., Arfani, D., Fragkopoulou, K., Varlokosta, S., & Papadatos, S. (2017) · 2017 8th IEEE International Conference on Cognitive Infocommunications (CogInfoCom) · doi:10.1109/coginfocom.2017.8268212 · Cited by 39
ATN status in amnestic and non-amnestic Alzheimer’s disease and frontotemporal lobar degeneration
Cousins, K. A. Q., Irwin, D. J., Wolk, D. A., Lee, E. B., Shaw, L. M. J., Trojanowski, J. Q., Re, F. D., Gibbons, G. S., Grossman, M., & Phillips, J. S. (2020) · Brain · doi:10.1093/brain/awaa165 · Cited by 39
Self-citationImpaired phonemic discrimination in logopenic variant primary progressive aphasia
Johnson, J. C. S., Jiang, J., Bond, R. L., Benhamou, E., Requena‐Komuro, M., Russell, L. L., Greaves, C. V., Nelson, A., Sivasathiaseelan, H., Marshall, C. R., et al. (2020) · Annals of Clinical and Translational Neurology · doi:10.1002/acn3.51101 · Cited by 34
Lexical and pantomine abilities in Alzheimer's disease
Kempler, D. (1988) · Aphasiology · doi:10.1080/02687038808248900 · Cited by 19
Gross, R. A. (2017) · Neurology · doi:10.1212/wnl.0000000000004073 · Cited by 11
Flagged first, then by citations
Research works printed but not linked: 2
- Loper E, Bird S. NLTK: the Natural Language Toolkit. In: ETMTNLP ’02: Proceedings of the ACL-02 Workshop on Effective Tools and Methodologies for Teaching Natural Language Processing and Computational Linguistics. Philadelphia, PA: Association for Computational Linguistics. 2002;63-70.
- 10.1044/2015 · DOI
Cited by
Sorted by citations
Speech patterns during memory recall relates to early tau burden across adulthood
Young, C. B., Smith, V., Karjadi, C., Grogan, S., Ang, T. F. A., Insel, P. S., Henderson, V. W., Sumner, M., Poston, K. L., Au, R., et al. (2024) · Alzheimer's & Dementia · doi:10.1002/alz.13731 · Cited by 27
Fristed, E., Skirrow, C., Meszaros, M., Lenain, R., Meepegama, U., Papp, K. V., Ropacki, M., & Weston, J. (2022) · Brain Communications · doi:10.1093/braincomms/fcac231 · Cited by 29
Lukic, S., Fan, Z., García, A. M., Welch, A. E., Ratnasiri, B. M., Wilson, S. M., Henry, M. L., Vonk, J., Deleon, J., Miller, B. L., et al. (2024) · Cortex · doi:10.1016/j.cortex.2023.12.013 · Cited by 19
Zhang, Z., Wang, T., Hu, Z., Yang, L.-Z., & Li, H. (2025) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2024.3509620 · Cited by 17
Automatic classification of AD pathology in FTD phenotypes using natural speech
Cho, S., Olm, C. A., Ash, S., Shellikeri, S., Agmon, G., Cousins, K. A. Q., Irwin, D. J., Grossman, M., Liberman, M., & Nevler, N. (2024) · Alzheimer's & Dementia · doi:10.1002/alz.13748 · Cited by 13
“It has been observed that adjective counts and lexical diversity of patients with cognitive impairment decreased compared to HC. 11,44,61 Additionally, patients with various types of dementia tended to produce shorter and more frequent words than HC. 11,44,62,63 These features were also selected in…”
BackgroundResultInfluentialSelf-citationVonk, J. M. J., Morin, B. T., Pillai, J., Rosado Rolon, D., Bogley, R., Baquirin, D. P., Ezzes, Z., Tee, B. L., de Leon, J., Wauters, L., et al. (2025) · Neurology · doi:10.1212/wnl.0000000000213556 · Cited by 10
Review of Artificial Intelligence for Clinical Use in Alzheimer's Disease and Related Dementias
Breithaupt, A. G., Tang, A., Paolillo, E. W., Bibars, M., Johnson, E. C. B., Saloner, R., Possin, K. L., Windon, C. C., Hill-Jarrett, T. G., Giorgio, J., et al. (2026) · Seminars in Neurology · doi:10.1055/a-2744-9871 · Cited by 6
Metadata
- Authors
- Cho, S., Cousins, K. A. Q., Shellikeri, S., Ash, S., Irwin, D. J., Liberman, M. Y., Grossman, M., & Nevler, N.
- Affiliations
- University of Pennsylvania (US)
- Corresponding author
- Cho, Sunghye
- ORCID
- Venue
- Neurology
- Published
- 2022-07-26
- Volume
- 99
- Issue
- 4
- Pages
- e313-e322
- ISSN
- 0028-3878 (ISSN-L)
- 1526-632X
- PMC
- PMC9421771
- OpenAlex
- W4225246704
- Cited by
- 51
- References
- 54
- Citations by year
- 2026: 14 · 2025: 9 · 2024: 16 · 2023: 9 · 2022: 3
- FWCI
- 6.03
- Type
- journal article
- Language
- en
- Open access
- green
- doi.org
- Licence
- cc-by-nc-nd
- Locations
- Neurology (publishedVersion)
- medRxiv (acceptedVersion, cc-by-nc-nd)
- PubMed Central (publishedVersion)
- PubMed (publishedVersion)
- Funders
- U.S. Department of Defense
- National Institute on Aging (P01AG066597, K99AG073510, R01AG054519, P30AG072979)
- National Institute of Neurological Disorders and Stroke (R01NS109260)
- Topics
- Health Sciences › Medicine › Psychiatry and Mental health › Dementia and Cognitive Impairment Research
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neurobiology of Language and Bilingualism
- Health Sciences › Health Professions › Speech and Hearing › Voice and Speech Disorders
- Keywords
- logopenic variant primary progressive aphasia, speech features, lexical features, acoustic features, phosphorylated tau, cerebrospinal fluid biomarkers, Alzheimer disease pathology, natural speech, language assessment
- MeSH terms
- Acoustics, Aged, Alzheimer Disease, Aphasia, Cross-Sectional Studies, Female, Humans, Middle Aged, Speech, Biomarkers, Amyloid beta-Peptides
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
